2024-04-24T23:23:20.703 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-24T23:23:20.704 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672197 --name teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi --owner scheduled_teuthology@teuthology --description fs/multiclient/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-2-client conf/{client mds mgr mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/ior-shared-file} -- /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672197/orig.config.yaml 2024-04-24T23:23:20.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-24T23:23:20.852 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672197 branch: squid description: fs/multiclient/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-2-client conf/{client mds mgr mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/ior-shared-file} email: ceph-qa@ceph.com first_in_suite: false job_id: '7672197' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 - - client.1 seed: 8528 sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 sleep_before_teardown: 0 subset: 122/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi057.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFISaJcw9ZfB19SZGzbjXdSDdu3IwfUw1EHZYOIQAOl1jrCK6FB760bjmcSHN9zGzStVN58iTl3LW0WaQ4RxsAw= smithi088.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIpXt2UmyDgQSUep9K7nYumg4KspDSdfqK5kwLYzA9soikizGRPS/B9xT3kFiyP+3BjUDVjUuAVwywh3Ch1xKVM= smithi116.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPctkgTH9hRnwlxHK/IRyasr3aEygt7snpmDjvM9nvxnRyzhhK2sS/6u0GdsY2uVWLwxmHbcnW4Bh2gpTixI10Y= smithi174.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBM1T37Cqx2gkOq4ZA1I3ig4y9rcRP8Cr0UtFO4tYvmNbfHvAAbL33RMKWL6//qkwtOCLRhPAxoNdk+9IG/DlCs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - pexec: clients: - set -x - cd $TESTDIR - sudo apt purge -y mpich - sudo apt install -y mpich - wget http://download.ceph.com/qa/ior-3.3.0.tar.bz2 - tar xvfj ior-3.3.0.tar.bz2 - cd ior-3.3.0 - ./configure - make - make install DESTDIR=$TESTDIR/binary/ - cd $TESTDIR/ - sudo apt install -y tree - tree binary/ - rm ior-3.3.0.tar.bz2 - rm -r ior-3.3.0 - ln -s $TESTDIR/mnt.* $TESTDIR/gmnt - ssh_keys: null - mpi: exec: $TESTDIR/binary/usr/local/bin/ior -e -w -r -W -b 10m -a POSIX -o $TESTDIR/gmnt/ior.testfile - pexec: clients: - rm -f $TESTDIR/gmnt/ior.testfile - rm -f $TESTDIR/gmnt - rm -rf $TESTDIR/binary teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-24_21:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-24T23:23:20.852 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa; will attempt to use it 2024-04-24T23:23:20.853 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa/tasks 2024-04-24T23:23:20.853 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-24T23:23:20.855 INFO:teuthology.task.internal:Checking packages... 2024-04-24T23:23:20.881 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd2c45d977142e024a59b68a8f1dce8f0b9840551' 2024-04-24T23:23:20.881 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-24T23:23:20.882 INFO:teuthology.packaging:ref: None 2024-04-24T23:23:20.882 INFO:teuthology.packaging:tag: None 2024-04-24T23:23:20.882 INFO:teuthology.packaging:branch: squid 2024-04-24T23:23:20.882 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T23:23:20.882 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-04-24T23:23:21.110 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2445-gd2c45d97-1jammy 2024-04-24T23:23:21.112 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-24T23:23:21.118 INFO:teuthology.task.internal:no buildpackages task found 2024-04-24T23:23:21.118 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-24T23:23:21.138 INFO:teuthology.task.internal:Saving configuration 2024-04-24T23:23:21.159 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-24T23:23:21.165 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-24T23:23:21.186 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672197', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-24 23:17:16.501489', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIdbbQgJnwb+Q9VNqIC76heyi3f5wlbBGhikh5kfxFj4'} 2024-04-24T23:23:21.208 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672197', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-24 23:17:16.500075', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFS1PC/3A+Hry5s7UKpVfGhDX28xnuDdG7tCnx57e38Q'} 2024-04-24T23:23:21.231 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672197', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-24 23:17:16.498666', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDfDvgABQreV2Rn692FCmQ1KO2KxGNSHi4Pq7yzh8vBe'} 2024-04-24T23:23:21.255 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672197', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-24 23:17:16.497061', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICINhSK7Ook7+o+N869LjN7glUBdpZQd429a9xOZ2Nwa'} 2024-04-24T23:23:21.255 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-24T23:23:21.261 INFO:teuthology.task.internal:roles: ubuntu@smithi057.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2024-04-24T23:23:21.262 INFO:teuthology.task.internal:roles: ubuntu@smithi088.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-24T23:23:21.262 INFO:teuthology.task.internal:roles: ubuntu@smithi116.front.sepia.ceph.com - ['client.0'] 2024-04-24T23:23:21.262 INFO:teuthology.task.internal:roles: ubuntu@smithi174.front.sepia.ceph.com - ['client.1'] 2024-04-24T23:23:21.262 INFO:teuthology.run_tasks:Running task console_log... 2024-04-24T23:23:21.470 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f94deb82040>, signals=[15]) 2024-04-24T23:23:21.471 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-24T23:23:21.477 INFO:teuthology.task.internal:Opening connections... 2024-04-24T23:23:21.477 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi057.front.sepia.ceph.com 2024-04-24T23:23:21.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:23:21.561 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi088.front.sepia.ceph.com 2024-04-24T23:23:21.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:23:21.639 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi116.front.sepia.ceph.com 2024-04-24T23:23:21.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:23:21.718 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi174.front.sepia.ceph.com 2024-04-24T23:23:21.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:23:21.797 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-24T23:23:21.804 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2024-04-24T23:23:21.810 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2024-04-24T23:23:21.810 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2024-04-24T23:23:21.855 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-24T23:23:21.855 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Ubuntu" 2024-04-24T23:23:21.855 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="22.04" 2024-04-24T23:23:21.855 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-24T23:23:21.856 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_CODENAME=jammy 2024-04-24T23:23:21.856 INFO:teuthology.orchestra.run.smithi057.stdout:ID=ubuntu 2024-04-24T23:23:21.856 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE=debian 2024-04-24T23:23:21.856 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-24T23:23:21.856 INFO:teuthology.orchestra.run.smithi057.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-24T23:23:21.856 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-24T23:23:21.856 INFO:teuthology.orchestra.run.smithi057.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-24T23:23:21.856 INFO:teuthology.orchestra.run.smithi057.stdout:UBUNTU_CODENAME=jammy 2024-04-24T23:23:21.857 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2024-04-24T23:23:21.875 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2024-04-24T23:23:21.881 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2024-04-24T23:23:21.881 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-04-24T23:23:21.928 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-24T23:23:21.929 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Ubuntu" 2024-04-24T23:23:21.929 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="22.04" 2024-04-24T23:23:21.929 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-24T23:23:21.929 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_CODENAME=jammy 2024-04-24T23:23:21.929 INFO:teuthology.orchestra.run.smithi088.stdout:ID=ubuntu 2024-04-24T23:23:21.929 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE=debian 2024-04-24T23:23:21.929 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-24T23:23:21.929 INFO:teuthology.orchestra.run.smithi088.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-24T23:23:21.929 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-24T23:23:21.929 INFO:teuthology.orchestra.run.smithi088.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-24T23:23:21.929 INFO:teuthology.orchestra.run.smithi088.stdout:UBUNTU_CODENAME=jammy 2024-04-24T23:23:21.930 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-04-24T23:23:21.958 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2024-04-24T23:23:21.964 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2024-04-24T23:23:21.965 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2024-04-24T23:23:22.011 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-24T23:23:22.011 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="Ubuntu" 2024-04-24T23:23:22.011 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="22.04" 2024-04-24T23:23:22.011 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-24T23:23:22.011 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_CODENAME=jammy 2024-04-24T23:23:22.011 INFO:teuthology.orchestra.run.smithi116.stdout:ID=ubuntu 2024-04-24T23:23:22.012 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE=debian 2024-04-24T23:23:22.012 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-24T23:23:22.012 INFO:teuthology.orchestra.run.smithi116.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-24T23:23:22.012 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-24T23:23:22.012 INFO:teuthology.orchestra.run.smithi116.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-24T23:23:22.012 INFO:teuthology.orchestra.run.smithi116.stdout:UBUNTU_CODENAME=jammy 2024-04-24T23:23:22.012 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2024-04-24T23:23:22.033 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2024-04-24T23:23:22.039 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2024-04-24T23:23:22.039 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2024-04-24T23:23:22.087 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-24T23:23:22.087 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Ubuntu" 2024-04-24T23:23:22.087 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="22.04" 2024-04-24T23:23:22.087 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-24T23:23:22.087 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_CODENAME=jammy 2024-04-24T23:23:22.087 INFO:teuthology.orchestra.run.smithi174.stdout:ID=ubuntu 2024-04-24T23:23:22.087 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE=debian 2024-04-24T23:23:22.087 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-24T23:23:22.087 INFO:teuthology.orchestra.run.smithi174.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-24T23:23:22.087 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-24T23:23:22.087 INFO:teuthology.orchestra.run.smithi174.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-24T23:23:22.088 INFO:teuthology.orchestra.run.smithi174.stdout:UBUNTU_CODENAME=jammy 2024-04-24T23:23:22.088 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2024-04-24T23:23:22.116 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-24T23:23:22.127 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-24T23:23:22.276 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-24T23:23:22.276 DEBUG:teuthology.orchestra.run.smithi057:> test '!' -e /home/ubuntu/cephtest 2024-04-24T23:23:22.279 DEBUG:teuthology.orchestra.run.smithi088:> test '!' -e /home/ubuntu/cephtest 2024-04-24T23:23:22.281 DEBUG:teuthology.orchestra.run.smithi116:> test '!' -e /home/ubuntu/cephtest 2024-04-24T23:23:22.284 DEBUG:teuthology.orchestra.run.smithi174:> test '!' -e /home/ubuntu/cephtest 2024-04-24T23:23:22.289 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-24T23:23:22.311 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-24T23:23:22.311 DEBUG:teuthology.orchestra.run.smithi057:> test -z $(ls -A /var/lib/ceph) 2024-04-24T23:23:22.328 DEBUG:teuthology.orchestra.run.smithi088:> test -z $(ls -A /var/lib/ceph) 2024-04-24T23:23:22.330 DEBUG:teuthology.orchestra.run.smithi116:> test -z $(ls -A /var/lib/ceph) 2024-04-24T23:23:22.333 DEBUG:teuthology.orchestra.run.smithi174:> test -z $(ls -A /var/lib/ceph) 2024-04-24T23:23:22.357 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-24T23:23:22.460 INFO:teuthology.run_tasks:Running task kernel... 2024-04-24T23:23:22.474 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-24T23:23:22.474 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'client.0': {'kdb': 1, 'sha1': 'distro'}, 'client.1': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-24T23:23:22.475 DEBUG:teuthology.orchestra.run.smithi057:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-24T23:23:22.475 DEBUG:teuthology.orchestra.run.smithi088:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-24T23:23:22.476 DEBUG:teuthology.orchestra.run.smithi116:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-24T23:23:22.476 DEBUG:teuthology.orchestra.run.smithi174:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-24T23:23:22.481 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:23:22.481 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:23:22.482 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2024-04-24T23:23:22.482 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2024-04-24T23:23:22.483 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:23:22.483 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:23:22.484 DEBUG:teuthology.orchestra.run.smithi174:> uname -r 2024-04-24T23:23:22.484 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2024-04-24T23:23:22.527 INFO:teuthology.orchestra.run.smithi116.stdout:5.15.0-56-generic 2024-04-24T23:23:22.527 INFO:teuthology.task.kernel:Running kernel on smithi116: 5.15.0-56-generic 2024-04-24T23:23:22.528 DEBUG:teuthology.orchestra.run.smithi116:> sudo apt-get clean 2024-04-24T23:23:22.529 INFO:teuthology.orchestra.run.smithi088.stdout:5.15.0-56-generic 2024-04-24T23:23:22.529 INFO:teuthology.task.kernel:Running kernel on smithi088: 5.15.0-56-generic 2024-04-24T23:23:22.529 DEBUG:teuthology.orchestra.run.smithi088:> sudo apt-get clean 2024-04-24T23:23:22.531 INFO:teuthology.orchestra.run.smithi057.stdout:5.15.0-56-generic 2024-04-24T23:23:22.531 INFO:teuthology.task.kernel:Running kernel on smithi057: 5.15.0-56-generic 2024-04-24T23:23:22.531 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-get clean 2024-04-24T23:23:22.534 INFO:teuthology.orchestra.run.smithi174.stdout:5.15.0-56-generic 2024-04-24T23:23:22.535 INFO:teuthology.task.kernel:Running kernel on smithi174: 5.15.0-56-generic 2024-04-24T23:23:22.535 DEBUG:teuthology.orchestra.run.smithi174:> sudo apt-get clean 2024-04-24T23:23:22.664 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-get update 2024-04-24T23:23:22.668 DEBUG:teuthology.orchestra.run.smithi174:> sudo apt-get update 2024-04-24T23:23:22.671 DEBUG:teuthology.orchestra.run.smithi116:> sudo apt-get update 2024-04-24T23:23:22.672 DEBUG:teuthology.orchestra.run.smithi088:> sudo apt-get update 2024-04-24T23:23:22.836 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-24T23:23:22.854 INFO:teuthology.orchestra.run.smithi088.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-24T23:23:22.862 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-24T23:23:22.862 INFO:teuthology.orchestra.run.smithi174.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-24T23:23:22.863 INFO:teuthology.orchestra.run.smithi174.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-24T23:23:22.925 INFO:teuthology.orchestra.run.smithi174.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-24T23:23:22.926 INFO:teuthology.orchestra.run.smithi088.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-24T23:23:22.934 INFO:teuthology.orchestra.run.smithi088.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-24T23:23:22.953 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-24T23:23:22.958 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-24T23:23:22.958 INFO:teuthology.orchestra.run.smithi057.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-24T23:23:22.961 INFO:teuthology.orchestra.run.smithi116.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-24T23:23:23.016 INFO:teuthology.orchestra.run.smithi057.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-24T23:23:23.020 INFO:teuthology.orchestra.run.smithi116.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-24T23:23:23.071 INFO:teuthology.orchestra.run.smithi088.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-24T23:23:23.089 INFO:teuthology.orchestra.run.smithi174.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-24T23:23:23.152 INFO:teuthology.orchestra.run.smithi088.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-24T23:23:23.159 INFO:teuthology.orchestra.run.smithi174.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-24T23:23:23.180 INFO:teuthology.orchestra.run.smithi174.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-24T23:23:23.191 INFO:teuthology.orchestra.run.smithi088.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-24T23:23:23.196 INFO:teuthology.orchestra.run.smithi088.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-24T23:23:23.196 INFO:teuthology.orchestra.run.smithi088.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-24T23:23:23.197 INFO:teuthology.orchestra.run.smithi088.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-24T23:23:23.219 INFO:teuthology.orchestra.run.smithi088.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-24T23:23:23.223 INFO:teuthology.orchestra.run.smithi088.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-24T23:23:23.223 INFO:teuthology.orchestra.run.smithi088.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-24T23:23:23.230 INFO:teuthology.orchestra.run.smithi088.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-24T23:23:23.237 INFO:teuthology.orchestra.run.smithi174.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-24T23:23:23.244 INFO:teuthology.orchestra.run.smithi174.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-24T23:23:23.244 INFO:teuthology.orchestra.run.smithi174.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-24T23:23:23.248 INFO:teuthology.orchestra.run.smithi174.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-24T23:23:23.261 INFO:teuthology.orchestra.run.smithi088.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-24T23:23:23.263 INFO:teuthology.orchestra.run.smithi088.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-24T23:23:23.263 INFO:teuthology.orchestra.run.smithi088.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-24T23:23:23.263 INFO:teuthology.orchestra.run.smithi088.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-24T23:23:23.264 INFO:teuthology.orchestra.run.smithi088.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-24T23:23:23.268 INFO:teuthology.orchestra.run.smithi174.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-24T23:23:23.269 INFO:teuthology.orchestra.run.smithi174.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-24T23:23:23.272 INFO:teuthology.orchestra.run.smithi174.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-24T23:23:23.272 INFO:teuthology.orchestra.run.smithi174.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-24T23:23:23.278 INFO:teuthology.orchestra.run.smithi088.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-24T23:23:23.278 INFO:teuthology.orchestra.run.smithi088.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [82.9 kB] 2024-04-24T23:23:23.279 INFO:teuthology.orchestra.run.smithi088.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [90.8 kB] 2024-04-24T23:23:23.280 INFO:teuthology.orchestra.run.smithi088.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-24T23:23:23.280 INFO:teuthology.orchestra.run.smithi088.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-24T23:23:23.284 INFO:teuthology.orchestra.run.smithi174.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-24T23:23:23.300 INFO:teuthology.orchestra.run.smithi088.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [29.8 kB] 2024-04-24T23:23:23.301 INFO:teuthology.orchestra.run.smithi088.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [18.5 kB] 2024-04-24T23:23:23.301 INFO:teuthology.orchestra.run.smithi088.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-24T23:23:23.301 INFO:teuthology.orchestra.run.smithi088.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-24T23:23:23.309 INFO:teuthology.orchestra.run.smithi174.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-24T23:23:23.309 INFO:teuthology.orchestra.run.smithi174.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-24T23:23:23.311 INFO:teuthology.orchestra.run.smithi174.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-24T23:23:23.311 INFO:teuthology.orchestra.run.smithi174.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-24T23:23:23.312 INFO:teuthology.orchestra.run.smithi174.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-24T23:23:23.312 INFO:teuthology.orchestra.run.smithi174.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-24T23:23:23.312 INFO:teuthology.orchestra.run.smithi174.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-24T23:23:23.315 INFO:teuthology.orchestra.run.smithi174.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-24T23:23:23.315 INFO:teuthology.orchestra.run.smithi174.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-24T23:23:23.335 INFO:teuthology.orchestra.run.smithi174.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-24T23:23:23.335 INFO:teuthology.orchestra.run.smithi174.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-24T23:23:23.339 INFO:teuthology.orchestra.run.smithi174.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-24T23:23:23.339 INFO:teuthology.orchestra.run.smithi174.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-24T23:23:23.348 INFO:teuthology.orchestra.run.smithi174.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-24T23:23:23.354 INFO:teuthology.orchestra.run.smithi174.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-24T23:23:23.356 INFO:teuthology.orchestra.run.smithi174.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-24T23:23:23.357 INFO:teuthology.orchestra.run.smithi174.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-24T23:23:23.357 INFO:teuthology.orchestra.run.smithi174.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-24T23:23:23.363 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-24T23:23:23.371 INFO:teuthology.orchestra.run.smithi088.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-24T23:23:23.373 INFO:teuthology.orchestra.run.smithi116.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-24T23:23:23.374 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-24T23:23:23.376 INFO:teuthology.orchestra.run.smithi174.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-24T23:23:23.377 INFO:teuthology.orchestra.run.smithi174.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-24T23:23:23.378 INFO:teuthology.orchestra.run.smithi174.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [82.9 kB] 2024-04-24T23:23:23.378 INFO:teuthology.orchestra.run.smithi174.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [90.8 kB] 2024-04-24T23:23:23.379 INFO:teuthology.orchestra.run.smithi174.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-24T23:23:23.384 INFO:teuthology.orchestra.run.smithi116.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-24T23:23:23.397 INFO:teuthology.orchestra.run.smithi174.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-24T23:23:23.397 INFO:teuthology.orchestra.run.smithi174.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [29.8 kB] 2024-04-24T23:23:23.398 INFO:teuthology.orchestra.run.smithi174.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [18.5 kB] 2024-04-24T23:23:23.398 INFO:teuthology.orchestra.run.smithi174.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-24T23:23:23.398 INFO:teuthology.orchestra.run.smithi174.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-24T23:23:23.514 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-24T23:23:23.581 INFO:teuthology.orchestra.run.smithi116.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-24T23:23:23.723 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-24T23:23:23.804 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-24T23:23:23.813 INFO:teuthology.orchestra.run.smithi116.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-24T23:23:23.822 INFO:teuthology.orchestra.run.smithi057.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-24T23:23:23.831 INFO:teuthology.orchestra.run.smithi057.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-24T23:23:23.832 INFO:teuthology.orchestra.run.smithi057.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-24T23:23:23.834 INFO:teuthology.orchestra.run.smithi116.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-24T23:23:23.849 INFO:teuthology.orchestra.run.smithi116.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-24T23:23:23.850 INFO:teuthology.orchestra.run.smithi116.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-24T23:23:23.877 INFO:teuthology.orchestra.run.smithi057.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-24T23:23:23.892 INFO:teuthology.orchestra.run.smithi057.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-24T23:23:23.893 INFO:teuthology.orchestra.run.smithi057.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-24T23:23:23.925 INFO:teuthology.orchestra.run.smithi057.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-24T23:23:23.926 INFO:teuthology.orchestra.run.smithi057.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-24T23:23:23.937 INFO:teuthology.orchestra.run.smithi116.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-24T23:23:23.937 INFO:teuthology.orchestra.run.smithi057.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-24T23:23:23.937 INFO:teuthology.orchestra.run.smithi057.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-24T23:23:23.938 INFO:teuthology.orchestra.run.smithi116.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-24T23:23:23.951 INFO:teuthology.orchestra.run.smithi116.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-24T23:23:23.951 INFO:teuthology.orchestra.run.smithi116.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-24T23:23:23.984 INFO:teuthology.orchestra.run.smithi116.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-24T23:23:24.116 INFO:teuthology.orchestra.run.smithi057.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-24T23:23:24.117 INFO:teuthology.orchestra.run.smithi057.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-24T23:23:24.117 INFO:teuthology.orchestra.run.smithi057.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-24T23:23:24.124 INFO:teuthology.orchestra.run.smithi057.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-24T23:23:24.163 INFO:teuthology.orchestra.run.smithi116.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-24T23:23:24.263 INFO:teuthology.orchestra.run.smithi088.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-24T23:23:24.288 INFO:teuthology.orchestra.run.smithi057.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-24T23:23:24.294 INFO:teuthology.orchestra.run.smithi057.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-24T23:23:24.605 INFO:teuthology.orchestra.run.smithi116.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-24T23:23:24.615 INFO:teuthology.orchestra.run.smithi116.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-24T23:23:24.618 INFO:teuthology.orchestra.run.smithi116.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-24T23:23:24.644 INFO:teuthology.orchestra.run.smithi116.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-24T23:23:24.657 INFO:teuthology.orchestra.run.smithi116.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-24T23:23:24.693 INFO:teuthology.orchestra.run.smithi057.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-24T23:23:24.699 INFO:teuthology.orchestra.run.smithi057.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-24T23:23:24.713 INFO:teuthology.orchestra.run.smithi057.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-24T23:23:24.714 INFO:teuthology.orchestra.run.smithi057.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-24T23:23:24.716 INFO:teuthology.orchestra.run.smithi057.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-24T23:23:24.917 INFO:teuthology.orchestra.run.smithi057.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-24T23:23:25.995 INFO:teuthology.orchestra.run.smithi057.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-24T23:23:26.043 INFO:teuthology.orchestra.run.smithi116.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-24T23:23:26.086 INFO:teuthology.orchestra.run.smithi088.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-24T23:23:26.332 INFO:teuthology.orchestra.run.smithi088.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-24T23:23:26.346 INFO:teuthology.orchestra.run.smithi057.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-24T23:23:26.348 INFO:teuthology.orchestra.run.smithi057.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-24T23:23:26.353 INFO:teuthology.orchestra.run.smithi057.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-24T23:23:26.366 INFO:teuthology.orchestra.run.smithi088.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-24T23:23:26.416 INFO:teuthology.orchestra.run.smithi057.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-24T23:23:26.441 INFO:teuthology.orchestra.run.smithi057.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-24T23:23:26.452 INFO:teuthology.orchestra.run.smithi057.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [90.8 kB] 2024-04-24T23:23:26.549 INFO:teuthology.orchestra.run.smithi057.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [82.9 kB] 2024-04-24T23:23:26.596 INFO:teuthology.orchestra.run.smithi057.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-24T23:23:26.767 INFO:teuthology.orchestra.run.smithi057.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-24T23:23:26.849 INFO:teuthology.orchestra.run.smithi057.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [29.8 kB] 2024-04-24T23:23:26.957 INFO:teuthology.orchestra.run.smithi057.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [18.5 kB] 2024-04-24T23:23:27.015 INFO:teuthology.orchestra.run.smithi057.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-24T23:23:27.045 INFO:teuthology.orchestra.run.smithi057.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-24T23:23:27.223 INFO:teuthology.orchestra.run.smithi088.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-24T23:23:27.230 INFO:teuthology.orchestra.run.smithi088.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-24T23:23:27.264 INFO:teuthology.orchestra.run.smithi116.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-24T23:23:27.407 INFO:teuthology.orchestra.run.smithi088.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-24T23:23:27.407 INFO:teuthology.orchestra.run.smithi088.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-24T23:23:27.738 INFO:teuthology.orchestra.run.smithi116.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-24T23:23:27.811 INFO:teuthology.orchestra.run.smithi116.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-24T23:23:27.888 INFO:teuthology.orchestra.run.smithi116.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-24T23:23:28.156 INFO:teuthology.orchestra.run.smithi088.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-24T23:23:28.782 INFO:teuthology.orchestra.run.smithi174.stdout:Fetched 13.3 MB in 2s (7,139 kB/s) 2024-04-24T23:23:29.006 INFO:teuthology.orchestra.run.smithi088.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-24T23:23:29.407 INFO:teuthology.orchestra.run.smithi088.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-24T23:23:29.413 INFO:teuthology.orchestra.run.smithi088.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-24T23:23:29.437 INFO:teuthology.orchestra.run.smithi088.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-24T23:23:29.438 INFO:teuthology.orchestra.run.smithi088.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-24T23:23:29.440 INFO:teuthology.orchestra.run.smithi088.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-24T23:23:30.166 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2024-04-24T23:23:30.184 DEBUG:teuthology.orchestra.run.smithi174:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-24T23:23:30.245 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2024-04-24T23:23:30.391 INFO:teuthology.orchestra.run.smithi116.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-24T23:23:30.445 INFO:teuthology.orchestra.run.smithi174.stdout:Building dependency tree... 2024-04-24T23:23:30.445 INFO:teuthology.orchestra.run.smithi174.stdout:Reading state information... 2024-04-24T23:23:30.622 INFO:teuthology.orchestra.run.smithi174.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T23:23:30.623 INFO:teuthology.orchestra.run.smithi174.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T23:23:30.623 INFO:teuthology.orchestra.run.smithi174.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T23:23:30.623 INFO:teuthology.orchestra.run.smithi174.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T23:23:30.624 INFO:teuthology.orchestra.run.smithi174.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-24T23:23:30.624 INFO:teuthology.orchestra.run.smithi174.stdout: python2.7-minimal 2024-04-24T23:23:30.624 INFO:teuthology.orchestra.run.smithi174.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T23:23:30.624 INFO:teuthology.orchestra.run.smithi174.stdout:The following additional packages will be installed: 2024-04-24T23:23:30.625 INFO:teuthology.orchestra.run.smithi174.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-24T23:23:30.625 INFO:teuthology.orchestra.run.smithi174.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-24T23:23:30.625 INFO:teuthology.orchestra.run.smithi174.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-24T23:23:30.626 INFO:teuthology.orchestra.run.smithi174.stdout:Suggested packages: 2024-04-24T23:23:30.626 INFO:teuthology.orchestra.run.smithi174.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-24T23:23:30.626 INFO:teuthology.orchestra.run.smithi174.stdout:Recommended packages: 2024-04-24T23:23:30.627 INFO:teuthology.orchestra.run.smithi174.stdout: thermald 2024-04-24T23:23:30.683 INFO:teuthology.orchestra.run.smithi174.stdout:The following NEW packages will be installed: 2024-04-24T23:23:30.683 INFO:teuthology.orchestra.run.smithi174.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-24T23:23:30.684 INFO:teuthology.orchestra.run.smithi174.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-24T23:23:30.684 INFO:teuthology.orchestra.run.smithi174.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-24T23:23:30.685 INFO:teuthology.orchestra.run.smithi174.stdout:The following packages will be upgraded: 2024-04-24T23:23:30.685 INFO:teuthology.orchestra.run.smithi174.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-24T23:23:30.743 INFO:teuthology.orchestra.run.smithi174.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-24T23:23:30.743 INFO:teuthology.orchestra.run.smithi174.stdout:Need to get 113 MB of archives. 2024-04-24T23:23:30.743 INFO:teuthology.orchestra.run.smithi174.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-24T23:23:30.743 INFO:teuthology.orchestra.run.smithi174.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-24T23:23:31.067 INFO:teuthology.orchestra.run.smithi116.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-24T23:23:31.197 INFO:teuthology.orchestra.run.smithi174.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-24T23:23:31.231 INFO:teuthology.orchestra.run.smithi116.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-24T23:23:31.300 INFO:teuthology.orchestra.run.smithi174.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-24T23:23:31.656 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 13.3 MB in 4s (3,084 kB/s) 2024-04-24T23:23:31.862 INFO:teuthology.orchestra.run.smithi116.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-24T23:23:31.900 INFO:teuthology.orchestra.run.smithi116.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-24T23:23:31.913 INFO:teuthology.orchestra.run.smithi116.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-24T23:23:31.913 INFO:teuthology.orchestra.run.smithi116.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-24T23:23:31.914 INFO:teuthology.orchestra.run.smithi116.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-24T23:23:31.916 INFO:teuthology.orchestra.run.smithi116.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-24T23:23:31.917 INFO:teuthology.orchestra.run.smithi116.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-24T23:23:31.917 INFO:teuthology.orchestra.run.smithi116.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [90.8 kB] 2024-04-24T23:23:31.945 INFO:teuthology.orchestra.run.smithi116.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [82.9 kB] 2024-04-24T23:23:31.950 INFO:teuthology.orchestra.run.smithi116.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-24T23:23:32.114 INFO:teuthology.orchestra.run.smithi116.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-24T23:23:32.186 INFO:teuthology.orchestra.run.smithi174.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-24T23:23:32.187 INFO:teuthology.orchestra.run.smithi174.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-24T23:23:32.187 INFO:teuthology.orchestra.run.smithi174.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-24T23:23:32.196 INFO:teuthology.orchestra.run.smithi116.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [29.8 kB] 2024-04-24T23:23:32.310 INFO:teuthology.orchestra.run.smithi116.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [18.5 kB] 2024-04-24T23:23:32.331 INFO:teuthology.orchestra.run.smithi174.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-24T23:23:32.359 INFO:teuthology.orchestra.run.smithi174.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-24T23:23:32.368 INFO:teuthology.orchestra.run.smithi116.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-24T23:23:32.402 INFO:teuthology.orchestra.run.smithi116.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-24T23:23:32.752 INFO:teuthology.orchestra.run.smithi174.stdout:Fetched 113 MB in 2s (68.0 MB/s) 2024-04-24T23:23:32.948 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-24T23:23:33.097 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2024-04-24T23:23:33.115 DEBUG:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-24T23:23:33.213 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2024-04-24T23:23:33.401 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2024-04-24T23:23:33.401 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2024-04-24T23:23:33.560 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T23:23:33.560 INFO:teuthology.orchestra.run.smithi057.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T23:23:33.560 INFO:teuthology.orchestra.run.smithi057.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T23:23:33.561 INFO:teuthology.orchestra.run.smithi057.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T23:23:33.561 INFO:teuthology.orchestra.run.smithi057.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-24T23:23:33.561 INFO:teuthology.orchestra.run.smithi057.stdout: python2.7-minimal 2024-04-24T23:23:33.561 INFO:teuthology.orchestra.run.smithi057.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T23:23:33.562 INFO:teuthology.orchestra.run.smithi057.stdout:The following additional packages will be installed: 2024-04-24T23:23:33.562 INFO:teuthology.orchestra.run.smithi057.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-24T23:23:33.562 INFO:teuthology.orchestra.run.smithi057.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-24T23:23:33.562 INFO:teuthology.orchestra.run.smithi057.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-24T23:23:33.564 INFO:teuthology.orchestra.run.smithi057.stdout:Suggested packages: 2024-04-24T23:23:33.564 INFO:teuthology.orchestra.run.smithi057.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-24T23:23:33.564 INFO:teuthology.orchestra.run.smithi057.stdout:Recommended packages: 2024-04-24T23:23:33.564 INFO:teuthology.orchestra.run.smithi057.stdout: thermald 2024-04-24T23:23:33.579 INFO:teuthology.orchestra.run.smithi088.stdout:Fetched 13.3 MB in 7s (1,983 kB/s) 2024-04-24T23:23:33.621 INFO:teuthology.orchestra.run.smithi057.stdout:The following NEW packages will be installed: 2024-04-24T23:23:33.621 INFO:teuthology.orchestra.run.smithi057.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-24T23:23:33.621 INFO:teuthology.orchestra.run.smithi057.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-24T23:23:33.621 INFO:teuthology.orchestra.run.smithi057.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-24T23:23:33.622 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages will be upgraded: 2024-04-24T23:23:33.623 INFO:teuthology.orchestra.run.smithi057.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-24T23:23:33.802 INFO:teuthology.orchestra.run.smithi057.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-24T23:23:33.803 INFO:teuthology.orchestra.run.smithi057.stdout:Need to get 113 MB of archives. 2024-04-24T23:23:33.803 INFO:teuthology.orchestra.run.smithi057.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-24T23:23:33.803 INFO:teuthology.orchestra.run.smithi057.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-24T23:23:34.826 INFO:teuthology.orchestra.run.smithi174.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-24T23:23:34.830 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T23:23:34.910 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:23:34.945 INFO:teuthology.orchestra.run.smithi088.stdout:Reading package lists... 2024-04-24T23:23:34.962 DEBUG:teuthology.orchestra.run.smithi088:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-24T23:23:35.023 INFO:teuthology.orchestra.run.smithi088.stdout:Reading package lists... 2024-04-24T23:23:35.204 INFO:teuthology.orchestra.run.smithi057.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-24T23:23:35.223 INFO:teuthology.orchestra.run.smithi088.stdout:Building dependency tree... 2024-04-24T23:23:35.223 INFO:teuthology.orchestra.run.smithi088.stdout:Reading state information... 2024-04-24T23:23:35.398 INFO:teuthology.orchestra.run.smithi088.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T23:23:35.398 INFO:teuthology.orchestra.run.smithi088.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T23:23:35.398 INFO:teuthology.orchestra.run.smithi088.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T23:23:35.399 INFO:teuthology.orchestra.run.smithi088.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T23:23:35.399 INFO:teuthology.orchestra.run.smithi088.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-24T23:23:35.399 INFO:teuthology.orchestra.run.smithi088.stdout: python2.7-minimal 2024-04-24T23:23:35.399 INFO:teuthology.orchestra.run.smithi088.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T23:23:35.400 INFO:teuthology.orchestra.run.smithi088.stdout:The following additional packages will be installed: 2024-04-24T23:23:35.400 INFO:teuthology.orchestra.run.smithi088.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-24T23:23:35.400 INFO:teuthology.orchestra.run.smithi088.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-24T23:23:35.400 INFO:teuthology.orchestra.run.smithi088.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-24T23:23:35.401 INFO:teuthology.orchestra.run.smithi088.stdout:Suggested packages: 2024-04-24T23:23:35.402 INFO:teuthology.orchestra.run.smithi088.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-24T23:23:35.402 INFO:teuthology.orchestra.run.smithi088.stdout:Recommended packages: 2024-04-24T23:23:35.402 INFO:teuthology.orchestra.run.smithi088.stdout: thermald 2024-04-24T23:23:35.450 INFO:teuthology.orchestra.run.smithi088.stdout:The following NEW packages will be installed: 2024-04-24T23:23:35.450 INFO:teuthology.orchestra.run.smithi088.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-24T23:23:35.450 INFO:teuthology.orchestra.run.smithi088.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-24T23:23:35.451 INFO:teuthology.orchestra.run.smithi088.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-24T23:23:35.452 INFO:teuthology.orchestra.run.smithi088.stdout:The following packages will be upgraded: 2024-04-24T23:23:35.453 INFO:teuthology.orchestra.run.smithi088.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-24T23:23:35.573 INFO:teuthology.orchestra.run.smithi057.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-24T23:23:35.632 INFO:teuthology.orchestra.run.smithi088.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-24T23:23:35.632 INFO:teuthology.orchestra.run.smithi088.stdout:Need to get 113 MB of archives. 2024-04-24T23:23:35.632 INFO:teuthology.orchestra.run.smithi088.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-24T23:23:35.632 INFO:teuthology.orchestra.run.smithi088.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-24T23:23:36.703 INFO:teuthology.orchestra.run.smithi116.stdout:Fetched 13.3 MB in 10s (1,377 kB/s) 2024-04-24T23:23:37.452 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-24T23:23:37.473 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T23:23:37.560 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:23:37.840 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-24T23:23:37.840 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-24T23:23:37.840 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-24T23:23:38.021 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-24T23:23:38.042 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T23:23:38.080 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:23:38.099 INFO:teuthology.orchestra.run.smithi116.stdout:Reading package lists... 2024-04-24T23:23:38.117 DEBUG:teuthology.orchestra.run.smithi116:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-24T23:23:38.176 INFO:teuthology.orchestra.run.smithi116.stdout:Reading package lists... 2024-04-24T23:23:38.330 INFO:teuthology.orchestra.run.smithi088.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-24T23:23:38.376 INFO:teuthology.orchestra.run.smithi116.stdout:Building dependency tree... 2024-04-24T23:23:38.376 INFO:teuthology.orchestra.run.smithi116.stdout:Reading state information... 2024-04-24T23:23:38.510 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-24T23:23:38.544 INFO:teuthology.orchestra.run.smithi116.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T23:23:38.544 INFO:teuthology.orchestra.run.smithi116.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T23:23:38.544 INFO:teuthology.orchestra.run.smithi116.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T23:23:38.544 INFO:teuthology.orchestra.run.smithi116.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T23:23:38.545 INFO:teuthology.orchestra.run.smithi116.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-24T23:23:38.545 INFO:teuthology.orchestra.run.smithi116.stdout: python2.7-minimal 2024-04-24T23:23:38.545 INFO:teuthology.orchestra.run.smithi116.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T23:23:38.546 INFO:teuthology.orchestra.run.smithi116.stdout:The following additional packages will be installed: 2024-04-24T23:23:38.546 INFO:teuthology.orchestra.run.smithi116.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-24T23:23:38.546 INFO:teuthology.orchestra.run.smithi116.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-24T23:23:38.546 INFO:teuthology.orchestra.run.smithi116.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-24T23:23:38.547 INFO:teuthology.orchestra.run.smithi116.stdout:Suggested packages: 2024-04-24T23:23:38.547 INFO:teuthology.orchestra.run.smithi116.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-24T23:23:38.548 INFO:teuthology.orchestra.run.smithi116.stdout:Recommended packages: 2024-04-24T23:23:38.548 INFO:teuthology.orchestra.run.smithi116.stdout: thermald 2024-04-24T23:23:38.604 INFO:teuthology.orchestra.run.smithi116.stdout:The following NEW packages will be installed: 2024-04-24T23:23:38.604 INFO:teuthology.orchestra.run.smithi116.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-24T23:23:38.604 INFO:teuthology.orchestra.run.smithi116.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-24T23:23:38.604 INFO:teuthology.orchestra.run.smithi116.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-24T23:23:38.606 INFO:teuthology.orchestra.run.smithi116.stdout:The following packages will be upgraded: 2024-04-24T23:23:38.606 INFO:teuthology.orchestra.run.smithi116.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-24T23:23:38.632 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-24T23:23:38.663 INFO:teuthology.orchestra.run.smithi116.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-24T23:23:38.663 INFO:teuthology.orchestra.run.smithi116.stdout:Need to get 113 MB of archives. 2024-04-24T23:23:38.664 INFO:teuthology.orchestra.run.smithi116.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-24T23:23:38.664 INFO:teuthology.orchestra.run.smithi116.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-24T23:23:39.044 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 113 MB in 5s (22.6 MB/s) 2024-04-24T23:23:39.048 INFO:teuthology.orchestra.run.smithi088.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-24T23:23:39.124 INFO:teuthology.orchestra.run.smithi116.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-24T23:23:39.222 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-24T23:23:39.226 INFO:teuthology.orchestra.run.smithi116.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-24T23:23:40.114 INFO:teuthology.orchestra.run.smithi116.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-24T23:23:40.114 INFO:teuthology.orchestra.run.smithi116.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-24T23:23:40.114 INFO:teuthology.orchestra.run.smithi116.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-24T23:23:40.244 INFO:teuthology.orchestra.run.smithi116.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-24T23:23:40.273 INFO:teuthology.orchestra.run.smithi116.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-24T23:23:40.663 INFO:teuthology.orchestra.run.smithi116.stdout:Fetched 113 MB in 2s (68.2 MB/s) 2024-04-24T23:23:40.863 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-24T23:23:41.186 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-24T23:23:41.191 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T23:23:41.276 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:23:42.881 INFO:teuthology.orchestra.run.smithi116.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-24T23:23:42.885 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T23:23:42.985 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:23:43.585 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-24T23:23:43.598 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T23:23:43.680 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:23:44.113 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-24T23:23:44.134 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T23:23:44.163 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:23:44.335 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-24T23:23:44.460 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-24T23:23:44.793 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-24T23:23:44.930 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-24T23:23:45.110 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-24T23:23:45.131 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T23:23:45.208 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-24T23:23:45.215 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:23:45.222 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-24T23:23:45.257 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-24T23:23:45.689 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-24T23:23:45.709 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T23:23:45.747 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:23:47.168 INFO:teuthology.orchestra.run.smithi088.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-24T23:23:47.168 INFO:teuthology.orchestra.run.smithi088.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-24T23:23:47.169 INFO:teuthology.orchestra.run.smithi088.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-24T23:23:50.300 INFO:teuthology.orchestra.run.smithi088.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-24T23:23:50.538 INFO:teuthology.orchestra.run.smithi088.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-24T23:23:50.861 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-24T23:23:50.870 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-24T23:23:50.899 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T23:23:50.944 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:23:50.945 INFO:teuthology.orchestra.run.smithi088.stdout:Fetched 113 MB in 15s (7,514 kB/s) 2024-04-24T23:23:50.995 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-24T23:23:51.104 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-24T23:23:51.311 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-24T23:23:51.415 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-24T23:23:51.734 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-24T23:23:51.758 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-24T23:23:51.801 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-24T23:23:52.955 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-24T23:23:53.080 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-24T23:23:53.108 INFO:teuthology.orchestra.run.smithi088.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-24T23:23:53.112 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T23:23:53.212 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:23:53.412 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-24T23:23:53.533 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-24T23:23:53.819 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-24T23:23:53.841 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-24T23:23:53.877 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-24T23:23:54.044 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-24T23:23:54.253 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-24T23:23:54.585 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-24T23:23:54.690 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:23:54.808 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-24T23:23:54.953 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:23:55.388 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-24T23:23:55.409 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T23:23:55.501 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:23:55.974 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-24T23:23:55.994 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T23:23:56.032 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:23:56.285 INFO:teuthology.orchestra.run.smithi174.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-24T23:23:56.285 INFO:teuthology.orchestra.run.smithi174.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-24T23:23:56.285 INFO:teuthology.orchestra.run.smithi174.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-24T23:23:56.285 INFO:teuthology.orchestra.run.smithi174.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-24T23:23:56.437 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:23:57.392 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-24T23:23:57.430 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T23:23:57.466 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:23:57.856 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:23:59.407 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-24T23:23:59.557 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-24T23:23:59.684 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:23:59.750 INFO:teuthology.orchestra.run.smithi174.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-24T23:23:59.750 INFO:teuthology.orchestra.run.smithi174.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-24T23:24:00.580 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-24T23:24:00.617 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T23:24:00.680 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:24:01.387 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-24T23:24:01.509 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-24T23:24:01.851 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-24T23:24:01.972 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:24:02.098 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-24T23:24:02.218 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:24:03.350 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-24T23:24:03.473 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-24T23:24:03.580 INFO:teuthology.orchestra.run.smithi057.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-24T23:24:03.580 INFO:teuthology.orchestra.run.smithi057.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-24T23:24:03.581 INFO:teuthology.orchestra.run.smithi057.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-24T23:24:03.581 INFO:teuthology.orchestra.run.smithi057.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-24T23:24:03.631 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-24T23:24:03.736 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:24:03.810 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-24T23:24:03.831 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-24T23:24:03.945 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:24:04.045 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-24T23:24:04.149 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:24:04.207 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-24T23:24:04.331 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-24T23:24:04.656 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-24T23:24:04.678 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-24T23:24:04.722 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-24T23:24:05.279 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:24:05.450 INFO:teuthology.orchestra.run.smithi116.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-24T23:24:05.450 INFO:teuthology.orchestra.run.smithi116.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-24T23:24:05.450 INFO:teuthology.orchestra.run.smithi116.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-24T23:24:05.450 INFO:teuthology.orchestra.run.smithi116.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-24T23:24:05.642 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:24:06.706 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-24T23:24:06.831 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-24T23:24:06.949 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:24:07.008 INFO:teuthology.orchestra.run.smithi057.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-24T23:24:07.008 INFO:teuthology.orchestra.run.smithi057.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-24T23:24:07.044 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:24:08.403 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-24T23:24:08.529 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-24T23:24:08.672 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:24:08.741 INFO:teuthology.orchestra.run.smithi116.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-24T23:24:08.742 INFO:teuthology.orchestra.run.smithi116.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-24T23:24:11.478 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-24T23:24:11.515 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T23:24:11.553 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:24:14.052 INFO:teuthology.orchestra.run.smithi174.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-24T23:24:14.053 INFO:teuthology.orchestra.run.smithi174.stdout:Sourcing file `/etc/default/grub' 2024-04-24T23:24:14.064 INFO:teuthology.orchestra.run.smithi174.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-24T23:24:14.079 INFO:teuthology.orchestra.run.smithi174.stdout:Generating grub configuration file ... 2024-04-24T23:24:14.249 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-24T23:24:14.313 INFO:teuthology.orchestra.run.smithi174.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-24T23:24:14.331 INFO:teuthology.orchestra.run.smithi174.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-24T23:24:14.388 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-24T23:24:14.655 INFO:teuthology.orchestra.run.smithi174.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-24T23:24:14.661 INFO:teuthology.orchestra.run.smithi174.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-24T23:24:14.729 INFO:teuthology.orchestra.run.smithi174.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-24T23:24:14.730 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-24T23:24:14.735 INFO:teuthology.orchestra.run.smithi174.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-24T23:24:14.868 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:24:14.890 INFO:teuthology.orchestra.run.smithi174.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-24T23:24:14.890 INFO:teuthology.orchestra.run.smithi174.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-24T23:24:14.890 INFO:teuthology.orchestra.run.smithi174.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-24T23:24:14.932 INFO:teuthology.orchestra.run.smithi174.stdout:done 2024-04-24T23:24:14.994 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-24T23:24:15.139 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:24:15.412 DEBUG:teuthology.orchestra.run.smithi174:> dpkg -s linux-image-generic 2024-04-24T23:24:15.434 INFO:teuthology.orchestra.run.smithi174.stdout:Package: linux-image-generic 2024-04-24T23:24:15.434 INFO:teuthology.orchestra.run.smithi174.stdout:Status: install ok installed 2024-04-24T23:24:15.434 INFO:teuthology.orchestra.run.smithi174.stdout:Priority: optional 2024-04-24T23:24:15.434 INFO:teuthology.orchestra.run.smithi174.stdout:Section: kernel 2024-04-24T23:24:15.434 INFO:teuthology.orchestra.run.smithi174.stdout:Installed-Size: 21 2024-04-24T23:24:15.434 INFO:teuthology.orchestra.run.smithi174.stdout:Maintainer: Ubuntu Kernel Team 2024-04-24T23:24:15.434 INFO:teuthology.orchestra.run.smithi174.stdout:Architecture: amd64 2024-04-24T23:24:15.434 INFO:teuthology.orchestra.run.smithi174.stdout:Source: linux-meta 2024-04-24T23:24:15.434 INFO:teuthology.orchestra.run.smithi174.stdout:Version: 5.15.0.105.102 2024-04-24T23:24:15.434 INFO:teuthology.orchestra.run.smithi174.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-24T23:24:15.434 INFO:teuthology.orchestra.run.smithi174.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-24T23:24:15.434 INFO:teuthology.orchestra.run.smithi174.stdout:Recommends: thermald 2024-04-24T23:24:15.434 INFO:teuthology.orchestra.run.smithi174.stdout:Description: Generic Linux kernel image 2024-04-24T23:24:15.435 INFO:teuthology.orchestra.run.smithi174.stdout: This package will always depend on the latest generic kernel image 2024-04-24T23:24:15.435 INFO:teuthology.orchestra.run.smithi174.stdout: available. 2024-04-24T23:24:15.435 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-24T23:24:15.435 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-24T23:24:15.435 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-24T23:24:15.435 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-04-24T23:24:15.435 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi174.front.sepia.ceph.com, path=None, version=distro) 2024-04-24T23:24:15.435 DEBUG:teuthology.orchestra.run.smithi174:> sudo apt-get clean 2024-04-24T23:24:15.662 DEBUG:teuthology.orchestra.run.smithi174:> sudo apt-get update 2024-04-24T23:24:15.780 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-24T23:24:15.895 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-24T23:24:15.975 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-24T23:24:16.076 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-24T23:24:16.493 INFO:teuthology.orchestra.run.smithi088.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-24T23:24:16.493 INFO:teuthology.orchestra.run.smithi088.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-24T23:24:16.493 INFO:teuthology.orchestra.run.smithi088.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-24T23:24:16.493 INFO:teuthology.orchestra.run.smithi088.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-24T23:24:16.674 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:24:17.200 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2024-04-24T23:24:17.218 DEBUG:teuthology.orchestra.run.smithi174:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-24T23:24:17.268 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2024-04-24T23:24:17.445 INFO:teuthology.orchestra.run.smithi174.stdout:Building dependency tree... 2024-04-24T23:24:17.445 INFO:teuthology.orchestra.run.smithi174.stdout:Reading state information... 2024-04-24T23:24:17.604 INFO:teuthology.orchestra.run.smithi174.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-24T23:24:17.604 INFO:teuthology.orchestra.run.smithi174.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T23:24:17.605 INFO:teuthology.orchestra.run.smithi174.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T23:24:17.605 INFO:teuthology.orchestra.run.smithi174.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T23:24:17.605 INFO:teuthology.orchestra.run.smithi174.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T23:24:17.605 INFO:teuthology.orchestra.run.smithi174.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-24T23:24:17.605 INFO:teuthology.orchestra.run.smithi174.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-24T23:24:17.605 INFO:teuthology.orchestra.run.smithi174.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T23:24:17.644 INFO:teuthology.orchestra.run.smithi174.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-24T23:24:17.646 DEBUG:teuthology.orchestra.run.smithi174:> dpkg -s linux-image-generic 2024-04-24T23:24:17.708 INFO:teuthology.orchestra.run.smithi174.stdout:Package: linux-image-generic 2024-04-24T23:24:17.709 INFO:teuthology.orchestra.run.smithi174.stdout:Status: install ok installed 2024-04-24T23:24:17.709 INFO:teuthology.orchestra.run.smithi174.stdout:Priority: optional 2024-04-24T23:24:17.709 INFO:teuthology.orchestra.run.smithi174.stdout:Section: kernel 2024-04-24T23:24:17.709 INFO:teuthology.orchestra.run.smithi174.stdout:Installed-Size: 21 2024-04-24T23:24:17.709 INFO:teuthology.orchestra.run.smithi174.stdout:Maintainer: Ubuntu Kernel Team 2024-04-24T23:24:17.709 INFO:teuthology.orchestra.run.smithi174.stdout:Architecture: amd64 2024-04-24T23:24:17.709 INFO:teuthology.orchestra.run.smithi174.stdout:Source: linux-meta 2024-04-24T23:24:17.709 INFO:teuthology.orchestra.run.smithi174.stdout:Version: 5.15.0.105.102 2024-04-24T23:24:17.709 INFO:teuthology.orchestra.run.smithi174.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-24T23:24:17.709 INFO:teuthology.orchestra.run.smithi174.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-24T23:24:17.709 INFO:teuthology.orchestra.run.smithi174.stdout:Recommends: thermald 2024-04-24T23:24:17.709 INFO:teuthology.orchestra.run.smithi174.stdout:Description: Generic Linux kernel image 2024-04-24T23:24:17.709 INFO:teuthology.orchestra.run.smithi174.stdout: This package will always depend on the latest generic kernel image 2024-04-24T23:24:17.709 INFO:teuthology.orchestra.run.smithi174.stdout: available. 2024-04-24T23:24:17.710 DEBUG:teuthology.orchestra.run.smithi174:> mktemp 2024-04-24T23:24:17.754 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.StvhsHzTOY 2024-04-24T23:24:17.755 DEBUG:teuthology.orchestra.run.smithi174:> sudo cp /boot/grub/grub.cfg /tmp/tmp.StvhsHzTOY 2024-04-24T23:24:17.810 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.StvhsHzTOY 2024-04-24T23:24:17.938 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.StvhsHzTOY is 10KB 2024-04-24T23:24:17.950 DEBUG:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.StvhsHzTOY 2024-04-24T23:24:17.956 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-24T23:24:18.009 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-24T23:24:18.009 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-24T23:24:18.010 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-24T23:24:18.076 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-24T23:24:18.076 DEBUG:teuthology.orchestra.run.smithi174:> sudo update-grub 2024-04-24T23:24:18.118 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:24:19.268 INFO:teuthology.orchestra.run.smithi174.stderr:Sourcing file `/etc/default/grub' 2024-04-24T23:24:19.269 INFO:teuthology.orchestra.run.smithi174.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-24T23:24:19.272 INFO:teuthology.orchestra.run.smithi174.stderr:Generating grub configuration file ... 2024-04-24T23:24:19.435 INFO:teuthology.orchestra.run.smithi174.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-24T23:24:19.441 INFO:teuthology.orchestra.run.smithi174.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-24T23:24:19.510 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-24T23:24:19.669 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-24T23:24:19.689 INFO:teuthology.orchestra.run.smithi174.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-24T23:24:19.694 INFO:teuthology.orchestra.run.smithi174.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-24T23:24:19.736 INFO:teuthology.orchestra.run.smithi174.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-24T23:24:19.742 INFO:teuthology.orchestra.run.smithi174.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-24T23:24:19.795 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T23:24:19.851 INFO:teuthology.orchestra.run.smithi174.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-24T23:24:19.851 INFO:teuthology.orchestra.run.smithi174.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-24T23:24:19.851 INFO:teuthology.orchestra.run.smithi174.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-24T23:24:19.856 INFO:teuthology.orchestra.run.smithi088.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-24T23:24:19.856 INFO:teuthology.orchestra.run.smithi088.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-24T23:24:19.876 INFO:teuthology.orchestra.run.smithi174.stderr:done 2024-04-24T23:24:19.885 DEBUG:teuthology.orchestra.run.smithi174:> sudo shutdown -r now 2024-04-24T23:24:21.411 INFO:teuthology.orchestra.run.smithi057.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-24T23:24:21.411 INFO:teuthology.orchestra.run.smithi057.stdout:Sourcing file `/etc/default/grub' 2024-04-24T23:24:21.432 INFO:teuthology.orchestra.run.smithi057.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-24T23:24:21.456 INFO:teuthology.orchestra.run.smithi057.stdout:Generating grub configuration file ... 2024-04-24T23:24:21.713 INFO:teuthology.orchestra.run.smithi057.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-24T23:24:21.731 INFO:teuthology.orchestra.run.smithi057.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-24T23:24:22.006 INFO:teuthology.orchestra.run.smithi057.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-24T23:24:22.011 INFO:teuthology.orchestra.run.smithi057.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-24T23:24:22.077 INFO:teuthology.orchestra.run.smithi057.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-24T23:24:22.081 INFO:teuthology.orchestra.run.smithi057.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-24T23:24:22.270 INFO:teuthology.orchestra.run.smithi057.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-24T23:24:22.270 INFO:teuthology.orchestra.run.smithi057.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-24T23:24:22.270 INFO:teuthology.orchestra.run.smithi057.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-24T23:24:22.298 INFO:teuthology.orchestra.run.smithi057.stdout:done 2024-04-24T23:24:22.725 INFO:teuthology.orchestra.run.smithi116.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-24T23:24:22.726 INFO:teuthology.orchestra.run.smithi116.stdout:Sourcing file `/etc/default/grub' 2024-04-24T23:24:22.741 INFO:teuthology.orchestra.run.smithi116.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-24T23:24:22.753 INFO:teuthology.orchestra.run.smithi116.stdout:Generating grub configuration file ... 2024-04-24T23:24:22.776 DEBUG:teuthology.orchestra.run.smithi057:> dpkg -s linux-image-generic 2024-04-24T23:24:22.800 INFO:teuthology.orchestra.run.smithi057.stdout:Package: linux-image-generic 2024-04-24T23:24:22.800 INFO:teuthology.orchestra.run.smithi057.stdout:Status: install ok installed 2024-04-24T23:24:22.800 INFO:teuthology.orchestra.run.smithi057.stdout:Priority: optional 2024-04-24T23:24:22.800 INFO:teuthology.orchestra.run.smithi057.stdout:Section: kernel 2024-04-24T23:24:22.800 INFO:teuthology.orchestra.run.smithi057.stdout:Installed-Size: 21 2024-04-24T23:24:22.800 INFO:teuthology.orchestra.run.smithi057.stdout:Maintainer: Ubuntu Kernel Team 2024-04-24T23:24:22.800 INFO:teuthology.orchestra.run.smithi057.stdout:Architecture: amd64 2024-04-24T23:24:22.801 INFO:teuthology.orchestra.run.smithi057.stdout:Source: linux-meta 2024-04-24T23:24:22.801 INFO:teuthology.orchestra.run.smithi057.stdout:Version: 5.15.0.105.102 2024-04-24T23:24:22.801 INFO:teuthology.orchestra.run.smithi057.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-24T23:24:22.801 INFO:teuthology.orchestra.run.smithi057.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-24T23:24:22.801 INFO:teuthology.orchestra.run.smithi057.stdout:Recommends: thermald 2024-04-24T23:24:22.801 INFO:teuthology.orchestra.run.smithi057.stdout:Description: Generic Linux kernel image 2024-04-24T23:24:22.801 INFO:teuthology.orchestra.run.smithi057.stdout: This package will always depend on the latest generic kernel image 2024-04-24T23:24:22.801 INFO:teuthology.orchestra.run.smithi057.stdout: available. 2024-04-24T23:24:22.801 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-24T23:24:22.801 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-24T23:24:22.801 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-24T23:24:22.802 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-24T23:24:22.802 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi057.front.sepia.ceph.com, path=None, version=distro) 2024-04-24T23:24:22.802 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-get clean 2024-04-24T23:24:22.958 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-get update 2024-04-24T23:24:23.029 INFO:teuthology.orchestra.run.smithi116.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-24T23:24:23.045 INFO:teuthology.orchestra.run.smithi116.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-24T23:24:23.121 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-24T23:24:23.121 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-24T23:24:23.121 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-24T23:24:23.131 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-24T23:24:23.329 INFO:teuthology.orchestra.run.smithi116.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-24T23:24:23.334 INFO:teuthology.orchestra.run.smithi116.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-24T23:24:23.400 INFO:teuthology.orchestra.run.smithi116.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-24T23:24:23.405 INFO:teuthology.orchestra.run.smithi116.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-24T23:24:23.568 INFO:teuthology.orchestra.run.smithi116.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-24T23:24:23.568 INFO:teuthology.orchestra.run.smithi116.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-24T23:24:23.568 INFO:teuthology.orchestra.run.smithi116.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-24T23:24:23.614 INFO:teuthology.orchestra.run.smithi116.stdout:done 2024-04-24T23:24:24.113 DEBUG:teuthology.orchestra.run.smithi116:> dpkg -s linux-image-generic 2024-04-24T23:24:24.134 INFO:teuthology.orchestra.run.smithi116.stdout:Package: linux-image-generic 2024-04-24T23:24:24.135 INFO:teuthology.orchestra.run.smithi116.stdout:Status: install ok installed 2024-04-24T23:24:24.135 INFO:teuthology.orchestra.run.smithi116.stdout:Priority: optional 2024-04-24T23:24:24.135 INFO:teuthology.orchestra.run.smithi116.stdout:Section: kernel 2024-04-24T23:24:24.135 INFO:teuthology.orchestra.run.smithi116.stdout:Installed-Size: 21 2024-04-24T23:24:24.135 INFO:teuthology.orchestra.run.smithi116.stdout:Maintainer: Ubuntu Kernel Team 2024-04-24T23:24:24.135 INFO:teuthology.orchestra.run.smithi116.stdout:Architecture: amd64 2024-04-24T23:24:24.135 INFO:teuthology.orchestra.run.smithi116.stdout:Source: linux-meta 2024-04-24T23:24:24.135 INFO:teuthology.orchestra.run.smithi116.stdout:Version: 5.15.0.105.102 2024-04-24T23:24:24.136 INFO:teuthology.orchestra.run.smithi116.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-24T23:24:24.136 INFO:teuthology.orchestra.run.smithi116.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-24T23:24:24.136 INFO:teuthology.orchestra.run.smithi116.stdout:Recommends: thermald 2024-04-24T23:24:24.136 INFO:teuthology.orchestra.run.smithi116.stdout:Description: Generic Linux kernel image 2024-04-24T23:24:24.136 INFO:teuthology.orchestra.run.smithi116.stdout: This package will always depend on the latest generic kernel image 2024-04-24T23:24:24.136 INFO:teuthology.orchestra.run.smithi116.stdout: available. 2024-04-24T23:24:24.136 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-24T23:24:24.136 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-24T23:24:24.136 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-24T23:24:24.136 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-04-24T23:24:24.136 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi116.front.sepia.ceph.com, path=None, version=distro) 2024-04-24T23:24:24.137 DEBUG:teuthology.orchestra.run.smithi116:> sudo apt-get clean 2024-04-24T23:24:24.328 DEBUG:teuthology.orchestra.run.smithi116:> sudo apt-get update 2024-04-24T23:24:24.463 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-24T23:24:24.463 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-24T23:24:24.474 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-24T23:24:24.494 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-24T23:24:24.527 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2024-04-24T23:24:24.545 DEBUG:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-24T23:24:24.598 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2024-04-24T23:24:24.781 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2024-04-24T23:24:24.781 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2024-04-24T23:24:24.943 INFO:teuthology.orchestra.run.smithi057.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-24T23:24:24.943 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T23:24:24.943 INFO:teuthology.orchestra.run.smithi057.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T23:24:24.943 INFO:teuthology.orchestra.run.smithi057.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T23:24:24.943 INFO:teuthology.orchestra.run.smithi057.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T23:24:24.943 INFO:teuthology.orchestra.run.smithi057.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-24T23:24:24.943 INFO:teuthology.orchestra.run.smithi057.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-24T23:24:24.944 INFO:teuthology.orchestra.run.smithi057.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T23:24:24.983 INFO:teuthology.orchestra.run.smithi057.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-24T23:24:24.985 DEBUG:teuthology.orchestra.run.smithi057:> dpkg -s linux-image-generic 2024-04-24T23:24:25.041 INFO:teuthology.orchestra.run.smithi057.stdout:Package: linux-image-generic 2024-04-24T23:24:25.041 INFO:teuthology.orchestra.run.smithi057.stdout:Status: install ok installed 2024-04-24T23:24:25.041 INFO:teuthology.orchestra.run.smithi057.stdout:Priority: optional 2024-04-24T23:24:25.041 INFO:teuthology.orchestra.run.smithi057.stdout:Section: kernel 2024-04-24T23:24:25.041 INFO:teuthology.orchestra.run.smithi057.stdout:Installed-Size: 21 2024-04-24T23:24:25.042 INFO:teuthology.orchestra.run.smithi057.stdout:Maintainer: Ubuntu Kernel Team 2024-04-24T23:24:25.042 INFO:teuthology.orchestra.run.smithi057.stdout:Architecture: amd64 2024-04-24T23:24:25.042 INFO:teuthology.orchestra.run.smithi057.stdout:Source: linux-meta 2024-04-24T23:24:25.042 INFO:teuthology.orchestra.run.smithi057.stdout:Version: 5.15.0.105.102 2024-04-24T23:24:25.042 INFO:teuthology.orchestra.run.smithi057.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-24T23:24:25.042 INFO:teuthology.orchestra.run.smithi057.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-24T23:24:25.042 INFO:teuthology.orchestra.run.smithi057.stdout:Recommends: thermald 2024-04-24T23:24:25.042 INFO:teuthology.orchestra.run.smithi057.stdout:Description: Generic Linux kernel image 2024-04-24T23:24:25.042 INFO:teuthology.orchestra.run.smithi057.stdout: This package will always depend on the latest generic kernel image 2024-04-24T23:24:25.042 INFO:teuthology.orchestra.run.smithi057.stdout: available. 2024-04-24T23:24:25.042 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2024-04-24T23:24:25.086 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.MfqBOtQ8ib 2024-04-24T23:24:25.086 DEBUG:teuthology.orchestra.run.smithi057:> sudo cp /boot/grub/grub.cfg /tmp/tmp.MfqBOtQ8ib 2024-04-24T23:24:25.142 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.MfqBOtQ8ib 2024-04-24T23:24:25.273 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.MfqBOtQ8ib is 10KB 2024-04-24T23:24:25.627 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.MfqBOtQ8ib 2024-04-24T23:24:25.632 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-24T23:24:25.687 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T23:24:25.687 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-24T23:24:25.687 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-24T23:24:25.793 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-24T23:24:25.793 DEBUG:teuthology.orchestra.run.smithi057:> sudo update-grub 2024-04-24T23:24:25.872 INFO:teuthology.orchestra.run.smithi116.stdout:Reading package lists... 2024-04-24T23:24:25.889 DEBUG:teuthology.orchestra.run.smithi116:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-24T23:24:25.940 INFO:teuthology.orchestra.run.smithi116.stdout:Reading package lists... 2024-04-24T23:24:26.116 INFO:teuthology.orchestra.run.smithi116.stdout:Building dependency tree... 2024-04-24T23:24:26.117 INFO:teuthology.orchestra.run.smithi116.stdout:Reading state information... 2024-04-24T23:24:26.273 INFO:teuthology.orchestra.run.smithi116.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-24T23:24:26.273 INFO:teuthology.orchestra.run.smithi116.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T23:24:26.274 INFO:teuthology.orchestra.run.smithi116.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T23:24:26.274 INFO:teuthology.orchestra.run.smithi116.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T23:24:26.274 INFO:teuthology.orchestra.run.smithi116.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T23:24:26.274 INFO:teuthology.orchestra.run.smithi116.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-24T23:24:26.274 INFO:teuthology.orchestra.run.smithi116.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-24T23:24:26.274 INFO:teuthology.orchestra.run.smithi116.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T23:24:26.312 INFO:teuthology.orchestra.run.smithi116.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-24T23:24:26.314 DEBUG:teuthology.orchestra.run.smithi116:> dpkg -s linux-image-generic 2024-04-24T23:24:26.373 INFO:teuthology.orchestra.run.smithi116.stdout:Package: linux-image-generic 2024-04-24T23:24:26.373 INFO:teuthology.orchestra.run.smithi116.stdout:Status: install ok installed 2024-04-24T23:24:26.373 INFO:teuthology.orchestra.run.smithi116.stdout:Priority: optional 2024-04-24T23:24:26.373 INFO:teuthology.orchestra.run.smithi116.stdout:Section: kernel 2024-04-24T23:24:26.373 INFO:teuthology.orchestra.run.smithi116.stdout:Installed-Size: 21 2024-04-24T23:24:26.373 INFO:teuthology.orchestra.run.smithi116.stdout:Maintainer: Ubuntu Kernel Team 2024-04-24T23:24:26.373 INFO:teuthology.orchestra.run.smithi116.stdout:Architecture: amd64 2024-04-24T23:24:26.374 INFO:teuthology.orchestra.run.smithi116.stdout:Source: linux-meta 2024-04-24T23:24:26.374 INFO:teuthology.orchestra.run.smithi116.stdout:Version: 5.15.0.105.102 2024-04-24T23:24:26.374 INFO:teuthology.orchestra.run.smithi116.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-24T23:24:26.374 INFO:teuthology.orchestra.run.smithi116.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-24T23:24:26.374 INFO:teuthology.orchestra.run.smithi116.stdout:Recommends: thermald 2024-04-24T23:24:26.374 INFO:teuthology.orchestra.run.smithi116.stdout:Description: Generic Linux kernel image 2024-04-24T23:24:26.374 INFO:teuthology.orchestra.run.smithi116.stdout: This package will always depend on the latest generic kernel image 2024-04-24T23:24:26.374 INFO:teuthology.orchestra.run.smithi116.stdout: available. 2024-04-24T23:24:26.375 DEBUG:teuthology.orchestra.run.smithi116:> mktemp 2024-04-24T23:24:26.418 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.jWHnHqNcqi 2024-04-24T23:24:26.418 DEBUG:teuthology.orchestra.run.smithi116:> sudo cp /boot/grub/grub.cfg /tmp/tmp.jWHnHqNcqi 2024-04-24T23:24:26.477 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.jWHnHqNcqi 2024-04-24T23:24:26.595 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.jWHnHqNcqi is 10KB 2024-04-24T23:24:26.609 DEBUG:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.jWHnHqNcqi 2024-04-24T23:24:26.614 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-24T23:24:26.669 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-24T23:24:26.669 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-24T23:24:26.669 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-24T23:24:26.741 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-24T23:24:26.741 DEBUG:teuthology.orchestra.run.smithi116:> sudo update-grub 2024-04-24T23:24:26.958 INFO:teuthology.orchestra.run.smithi057.stderr:Sourcing file `/etc/default/grub' 2024-04-24T23:24:26.962 INFO:teuthology.orchestra.run.smithi057.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-24T23:24:26.962 INFO:teuthology.orchestra.run.smithi057.stderr:Generating grub configuration file ... 2024-04-24T23:24:27.127 INFO:teuthology.orchestra.run.smithi057.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-24T23:24:27.134 INFO:teuthology.orchestra.run.smithi057.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-24T23:24:27.355 INFO:teuthology.orchestra.run.smithi057.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-24T23:24:27.361 INFO:teuthology.orchestra.run.smithi057.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-24T23:24:27.405 INFO:teuthology.orchestra.run.smithi057.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-24T23:24:27.411 INFO:teuthology.orchestra.run.smithi057.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-24T23:24:27.536 INFO:teuthology.orchestra.run.smithi057.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-24T23:24:27.536 INFO:teuthology.orchestra.run.smithi057.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-24T23:24:27.536 INFO:teuthology.orchestra.run.smithi057.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-24T23:24:27.552 INFO:teuthology.orchestra.run.smithi057.stderr:done 2024-04-24T23:24:27.561 DEBUG:teuthology.orchestra.run.smithi057:> sudo shutdown -r now 2024-04-24T23:24:28.019 INFO:teuthology.orchestra.run.smithi116.stderr:Sourcing file `/etc/default/grub' 2024-04-24T23:24:28.020 INFO:teuthology.orchestra.run.smithi116.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-24T23:24:28.024 INFO:teuthology.orchestra.run.smithi116.stderr:Generating grub configuration file ... 2024-04-24T23:24:28.212 INFO:teuthology.orchestra.run.smithi116.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-24T23:24:28.219 INFO:teuthology.orchestra.run.smithi116.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-24T23:24:28.457 INFO:teuthology.orchestra.run.smithi116.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-24T23:24:28.462 INFO:teuthology.orchestra.run.smithi116.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-24T23:24:28.502 INFO:teuthology.orchestra.run.smithi116.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-24T23:24:28.507 INFO:teuthology.orchestra.run.smithi116.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-24T23:24:28.635 INFO:teuthology.orchestra.run.smithi116.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-24T23:24:28.635 INFO:teuthology.orchestra.run.smithi116.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-24T23:24:28.635 INFO:teuthology.orchestra.run.smithi116.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-24T23:24:28.658 INFO:teuthology.orchestra.run.smithi116.stderr:done 2024-04-24T23:24:28.666 DEBUG:teuthology.orchestra.run.smithi116:> sudo shutdown -r now 2024-04-24T23:24:33.940 INFO:teuthology.orchestra.run.smithi088.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-24T23:24:33.940 INFO:teuthology.orchestra.run.smithi088.stdout:Sourcing file `/etc/default/grub' 2024-04-24T23:24:33.966 INFO:teuthology.orchestra.run.smithi088.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-24T23:24:34.019 INFO:teuthology.orchestra.run.smithi088.stdout:Generating grub configuration file ... 2024-04-24T23:24:34.359 INFO:teuthology.orchestra.run.smithi088.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-24T23:24:34.378 INFO:teuthology.orchestra.run.smithi088.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-24T23:24:34.767 INFO:teuthology.orchestra.run.smithi088.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-24T23:24:34.773 INFO:teuthology.orchestra.run.smithi088.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-24T23:24:34.839 INFO:teuthology.orchestra.run.smithi088.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-24T23:24:34.845 INFO:teuthology.orchestra.run.smithi088.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-24T23:24:34.995 INFO:teuthology.orchestra.run.smithi088.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-24T23:24:34.995 INFO:teuthology.orchestra.run.smithi088.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-24T23:24:34.995 INFO:teuthology.orchestra.run.smithi088.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-24T23:24:35.048 INFO:teuthology.orchestra.run.smithi088.stdout:done 2024-04-24T23:24:35.556 DEBUG:teuthology.orchestra.run.smithi088:> dpkg -s linux-image-generic 2024-04-24T23:24:35.581 INFO:teuthology.orchestra.run.smithi088.stdout:Package: linux-image-generic 2024-04-24T23:24:35.581 INFO:teuthology.orchestra.run.smithi088.stdout:Status: install ok installed 2024-04-24T23:24:35.581 INFO:teuthology.orchestra.run.smithi088.stdout:Priority: optional 2024-04-24T23:24:35.581 INFO:teuthology.orchestra.run.smithi088.stdout:Section: kernel 2024-04-24T23:24:35.582 INFO:teuthology.orchestra.run.smithi088.stdout:Installed-Size: 21 2024-04-24T23:24:35.582 INFO:teuthology.orchestra.run.smithi088.stdout:Maintainer: Ubuntu Kernel Team 2024-04-24T23:24:35.582 INFO:teuthology.orchestra.run.smithi088.stdout:Architecture: amd64 2024-04-24T23:24:35.582 INFO:teuthology.orchestra.run.smithi088.stdout:Source: linux-meta 2024-04-24T23:24:35.582 INFO:teuthology.orchestra.run.smithi088.stdout:Version: 5.15.0.105.102 2024-04-24T23:24:35.582 INFO:teuthology.orchestra.run.smithi088.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-24T23:24:35.582 INFO:teuthology.orchestra.run.smithi088.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-24T23:24:35.582 INFO:teuthology.orchestra.run.smithi088.stdout:Recommends: thermald 2024-04-24T23:24:35.582 INFO:teuthology.orchestra.run.smithi088.stdout:Description: Generic Linux kernel image 2024-04-24T23:24:35.582 INFO:teuthology.orchestra.run.smithi088.stdout: This package will always depend on the latest generic kernel image 2024-04-24T23:24:35.582 INFO:teuthology.orchestra.run.smithi088.stdout: available. 2024-04-24T23:24:35.583 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-24T23:24:35.583 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-24T23:24:35.583 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-24T23:24:35.584 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-24T23:24:35.584 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi088.front.sepia.ceph.com, path=None, version=distro) 2024-04-24T23:24:35.584 DEBUG:teuthology.orchestra.run.smithi088:> sudo apt-get clean 2024-04-24T23:24:35.747 DEBUG:teuthology.orchestra.run.smithi088:> sudo apt-get update 2024-04-24T23:24:35.882 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-24T23:24:35.882 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-24T23:24:35.895 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-24T23:24:35.918 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-24T23:24:37.276 INFO:teuthology.orchestra.run.smithi088.stdout:Reading package lists... 2024-04-24T23:24:37.294 DEBUG:teuthology.orchestra.run.smithi088:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-24T23:24:37.355 INFO:teuthology.orchestra.run.smithi088.stdout:Reading package lists... 2024-04-24T23:24:37.563 INFO:teuthology.orchestra.run.smithi088.stdout:Building dependency tree... 2024-04-24T23:24:37.564 INFO:teuthology.orchestra.run.smithi088.stdout:Reading state information... 2024-04-24T23:24:37.734 INFO:teuthology.orchestra.run.smithi088.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-24T23:24:37.735 INFO:teuthology.orchestra.run.smithi088.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T23:24:37.735 INFO:teuthology.orchestra.run.smithi088.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T23:24:37.735 INFO:teuthology.orchestra.run.smithi088.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T23:24:37.735 INFO:teuthology.orchestra.run.smithi088.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T23:24:37.735 INFO:teuthology.orchestra.run.smithi088.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-24T23:24:37.735 INFO:teuthology.orchestra.run.smithi088.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-24T23:24:37.736 INFO:teuthology.orchestra.run.smithi088.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T23:24:37.774 INFO:teuthology.orchestra.run.smithi088.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-24T23:24:37.776 DEBUG:teuthology.orchestra.run.smithi088:> dpkg -s linux-image-generic 2024-04-24T23:24:37.791 INFO:teuthology.orchestra.run.smithi088.stdout:Package: linux-image-generic 2024-04-24T23:24:37.792 INFO:teuthology.orchestra.run.smithi088.stdout:Status: install ok installed 2024-04-24T23:24:37.792 INFO:teuthology.orchestra.run.smithi088.stdout:Priority: optional 2024-04-24T23:24:37.792 INFO:teuthology.orchestra.run.smithi088.stdout:Section: kernel 2024-04-24T23:24:37.792 INFO:teuthology.orchestra.run.smithi088.stdout:Installed-Size: 21 2024-04-24T23:24:37.792 INFO:teuthology.orchestra.run.smithi088.stdout:Maintainer: Ubuntu Kernel Team 2024-04-24T23:24:37.792 INFO:teuthology.orchestra.run.smithi088.stdout:Architecture: amd64 2024-04-24T23:24:37.792 INFO:teuthology.orchestra.run.smithi088.stdout:Source: linux-meta 2024-04-24T23:24:37.792 INFO:teuthology.orchestra.run.smithi088.stdout:Version: 5.15.0.105.102 2024-04-24T23:24:37.792 INFO:teuthology.orchestra.run.smithi088.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-24T23:24:37.792 INFO:teuthology.orchestra.run.smithi088.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-24T23:24:37.793 INFO:teuthology.orchestra.run.smithi088.stdout:Recommends: thermald 2024-04-24T23:24:37.793 INFO:teuthology.orchestra.run.smithi088.stdout:Description: Generic Linux kernel image 2024-04-24T23:24:37.793 INFO:teuthology.orchestra.run.smithi088.stdout: This package will always depend on the latest generic kernel image 2024-04-24T23:24:37.793 INFO:teuthology.orchestra.run.smithi088.stdout: available. 2024-04-24T23:24:37.793 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2024-04-24T23:24:37.843 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.hirpNRSnRf 2024-04-24T23:24:37.843 DEBUG:teuthology.orchestra.run.smithi088:> sudo cp /boot/grub/grub.cfg /tmp/tmp.hirpNRSnRf 2024-04-24T23:24:37.905 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.hirpNRSnRf 2024-04-24T23:24:38.019 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.hirpNRSnRf is 10KB 2024-04-24T23:24:38.032 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.hirpNRSnRf 2024-04-24T23:24:38.037 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-24T23:24:38.091 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T23:24:38.091 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-24T23:24:38.091 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-24T23:24:38.181 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-24T23:24:38.181 DEBUG:teuthology.orchestra.run.smithi088:> sudo update-grub 2024-04-24T23:24:39.491 INFO:teuthology.orchestra.run.smithi088.stderr:Sourcing file `/etc/default/grub' 2024-04-24T23:24:39.491 INFO:teuthology.orchestra.run.smithi088.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-24T23:24:39.494 INFO:teuthology.orchestra.run.smithi088.stderr:Generating grub configuration file ... 2024-04-24T23:24:39.787 INFO:teuthology.orchestra.run.smithi088.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-24T23:24:39.794 INFO:teuthology.orchestra.run.smithi088.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-24T23:24:40.155 INFO:teuthology.orchestra.run.smithi088.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-24T23:24:40.161 INFO:teuthology.orchestra.run.smithi088.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-24T23:24:40.203 INFO:teuthology.orchestra.run.smithi088.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-24T23:24:40.209 INFO:teuthology.orchestra.run.smithi088.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-24T23:24:40.333 INFO:teuthology.orchestra.run.smithi088.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-24T23:24:40.333 INFO:teuthology.orchestra.run.smithi088.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-24T23:24:40.333 INFO:teuthology.orchestra.run.smithi088.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-24T23:24:40.353 INFO:teuthology.orchestra.run.smithi088.stderr:done 2024-04-24T23:24:40.355 DEBUG:teuthology.orchestra.run.smithi088:> sudo shutdown -r now 2024-04-24T23:24:49.894 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-04-24T23:24:49.895 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-04-24T23:24:49.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:24:57.571 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-24T23:24:57.571 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-24T23:24:57.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:24:58.670 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-24T23:24:58.671 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-04-24T23:24:58.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:25:08.257 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-04-24T23:25:10.398 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-24T23:25:10.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-24T23:25:10.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:25:15.934 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-04-24T23:25:17.214 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-04-24T23:25:17.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-04-24T23:25:17.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:25:20.318 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-04-24T23:25:24.938 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-24T23:25:24.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:25:26.217 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-04-24T23:25:26.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:25:28.002 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-04-24T23:25:28.734 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-24T23:25:29.278 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-04-24T23:25:32.322 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-04-24T23:25:32.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:25:35.390 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-04-24T23:25:37.736 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-24T23:25:37.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:25:40.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-24T23:25:40.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:25:40.802 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-24T23:25:41.280 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-04-24T23:25:41.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:25:50.399 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-04-24T23:25:50.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:25:52.805 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-24T23:25:52.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:25:55.870 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-24T23:25:59.710 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-04-24T23:26:08.926 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-04-24T23:26:10.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-24T23:26:10.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:26:14.714 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-04-24T23:26:14.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:26:15.374 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-04-24T23:26:16.090 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-04-24T23:26:16.090 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.15.0-105-generic"... 2024-04-24T23:26:16.090 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2024-04-24T23:26:16.138 INFO:teuthology.orchestra.run.smithi116.stdout:5.15.0-105-generic 2024-04-24T23:26:16.139 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-24T23:26:16.139 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-24T23:26:16.139 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-24T23:26:17.139 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2024-04-24T23:26:17.140 DEBUG:teuthology.orchestra.run.smithi116:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-24T23:26:17.200 INFO:teuthology.orchestra.run.smithi116.stdout:ttyS1 2024-04-24T23:26:17.215 DEBUG:teuthology.parallel:result is None 2024-04-24T23:26:26.928 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-04-24T23:26:26.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:26:27.323 DEBUG:teuthology.orchestra.run.smithi174:> true 2024-04-24T23:26:27.961 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-04-24T23:26:27.961 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.15.0-105-generic"... 2024-04-24T23:26:27.961 DEBUG:teuthology.orchestra.run.smithi174:> uname -r 2024-04-24T23:26:28.009 INFO:teuthology.orchestra.run.smithi174.stdout:5.15.0-105-generic 2024-04-24T23:26:28.009 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-24T23:26:28.009 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-24T23:26:28.009 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-24T23:26:29.010 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2024-04-24T23:26:29.010 DEBUG:teuthology.orchestra.run.smithi174:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-24T23:26:29.372 INFO:teuthology.orchestra.run.smithi174.stdout:ttyS1 2024-04-24T23:26:29.403 DEBUG:teuthology.parallel:result is None 2024-04-24T23:26:29.406 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-24T23:26:40.008 DEBUG:teuthology.orchestra.remote:timed out 2024-04-24T23:26:47.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-24T23:26:47.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:26:47.684 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-04-24T23:26:48.324 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-24T23:26:48.325 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-105-generic"... 2024-04-24T23:26:48.325 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2024-04-24T23:26:48.377 INFO:teuthology.orchestra.run.smithi088.stdout:5.15.0-105-generic 2024-04-24T23:26:48.378 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-24T23:26:48.378 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-24T23:26:48.378 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-24T23:26:49.379 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-24T23:26:49.415 DEBUG:teuthology.orchestra.run.smithi088:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-24T23:26:49.746 INFO:teuthology.orchestra.run.smithi088.stdout:ttyS1 2024-04-24T23:26:49.768 DEBUG:teuthology.parallel:result is None 2024-04-24T23:26:55.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-24T23:26:55.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:26:55.199 DEBUG:teuthology.orchestra.run.smithi057:> true 2024-04-24T23:26:55.774 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-24T23:26:55.774 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-105-generic"... 2024-04-24T23:26:55.774 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2024-04-24T23:26:55.823 INFO:teuthology.orchestra.run.smithi057.stdout:5.15.0-105-generic 2024-04-24T23:26:55.824 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-24T23:26:55.824 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-24T23:26:55.824 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-24T23:26:56.824 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-24T23:26:56.825 DEBUG:teuthology.orchestra.run.smithi057:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-24T23:26:56.901 INFO:teuthology.orchestra.run.smithi057.stdout:ttyS1 2024-04-24T23:26:56.929 DEBUG:teuthology.parallel:result is None 2024-04-24T23:26:56.929 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-24T23:26:56.937 INFO:teuthology.task.internal:Creating test directory... 2024-04-24T23:26:56.937 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-24T23:26:56.939 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-24T23:26:56.942 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-24T23:26:56.944 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-24T23:26:56.951 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-24T23:26:56.974 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-24T23:26:57.021 INFO:teuthology.task.internal:Creating archive directory... 2024-04-24T23:26:57.021 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-24T23:26:57.023 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-24T23:26:57.026 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-24T23:26:57.028 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-24T23:26:57.123 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-24T23:26:57.130 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-24T23:26:57.130 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-24T23:26:57.132 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-24T23:26:57.135 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-24T23:26:57.137 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-24T23:26:57.151 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T23:26:57.152 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T23:26:57.154 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T23:26:57.158 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T23:26:57.160 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T23:26:57.161 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T23:26:57.162 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T23:26:57.168 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T23:26:57.170 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-24T23:26:57.180 INFO:teuthology.task.internal:Configuring sudo... 2024-04-24T23:26:57.180 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-24T23:26:57.208 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-24T23:26:57.210 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-24T23:26:57.214 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-24T23:26:57.227 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-24T23:26:57.237 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-24T23:26:57.237 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-24T23:26:57.264 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-24T23:26:57.267 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-24T23:26:57.271 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-24T23:26:57.276 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T23:26:57.319 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T23:26:57.368 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T23:26:57.368 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-24T23:26:57.427 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T23:26:57.433 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T23:26:57.482 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T23:26:57.482 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-24T23:26:57.575 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T23:26:57.580 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T23:26:57.630 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-24T23:26:57.631 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-24T23:26:57.699 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T23:26:57.704 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T23:26:57.753 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-24T23:26:57.754 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-24T23:26:57.813 DEBUG:teuthology.orchestra.run.smithi057:> sudo service rsyslog restart 2024-04-24T23:26:57.817 DEBUG:teuthology.orchestra.run.smithi088:> sudo service rsyslog restart 2024-04-24T23:26:57.820 DEBUG:teuthology.orchestra.run.smithi116:> sudo service rsyslog restart 2024-04-24T23:26:57.823 DEBUG:teuthology.orchestra.run.smithi174:> sudo service rsyslog restart 2024-04-24T23:26:57.892 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-24T23:26:57.900 INFO:teuthology.task.internal:Starting timer... 2024-04-24T23:26:57.900 INFO:teuthology.run_tasks:Running task pcp... 2024-04-24T23:26:57.948 INFO:teuthology.run_tasks:Running task selinux... 2024-04-24T23:26:57.993 DEBUG:teuthology.task.selinux:Excluding smithi057: OS 'ubuntu' does not support SELinux 2024-04-24T23:26:57.994 DEBUG:teuthology.task.selinux:Excluding smithi088: OS 'ubuntu' does not support SELinux 2024-04-24T23:26:57.994 DEBUG:teuthology.task.selinux:Excluding smithi116: OS 'ubuntu' does not support SELinux 2024-04-24T23:26:57.994 DEBUG:teuthology.task.selinux:Excluding smithi174: OS 'ubuntu' does not support SELinux 2024-04-24T23:26:57.994 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-24T23:26:57.994 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-24T23:26:57.994 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-24T23:26:57.994 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-24T23:26:58.083 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-24T23:26:58.100 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-24T23:26:58.101 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi057.front.sepia.ceph.com,smithi088.front.sepia.ceph.com,smithi116.front.sepia.ceph.com,smithi174.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-24T23:34:06.780 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi057.front.sepia.ceph.com'), Remote(name='ubuntu@smithi088.front.sepia.ceph.com'), Remote(name='ubuntu@smithi116.front.sepia.ceph.com'), Remote(name='ubuntu@smithi174.front.sepia.ceph.com')] 2024-04-24T23:34:06.782 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-24T23:34:06.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:34:06.866 DEBUG:teuthology.orchestra.run.smithi057:> true 2024-04-24T23:34:06.942 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-24T23:34:06.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-24T23:34:06.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:34:07.020 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-04-24T23:34:07.103 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-24T23:34:07.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-04-24T23:34:07.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:34:07.183 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-04-24T23:34:07.262 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-04-24T23:34:07.262 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-04-24T23:34:07.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T23:34:07.341 DEBUG:teuthology.orchestra.run.smithi174:> true 2024-04-24T23:34:07.418 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-04-24T23:34:07.419 INFO:teuthology.run_tasks:Running task clock... 2024-04-24T23:34:07.434 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-24T23:34:07.435 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-24T23:34:07.435 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T23:34:07.437 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-24T23:34:07.437 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T23:34:07.439 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-24T23:34:07.440 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T23:34:07.442 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-24T23:34:07.442 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T23:34:07.464 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 23:34:07 ntpd[17211]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-24T23:34:07.464 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 23:34:07 ntpd[17211]: Command line: ntpd -gq 2024-04-24T23:34:07.464 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 23:34:07 ntpd[17211]: ---------------------------------------------------- 2024-04-24T23:34:07.464 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 23:34:07 ntpd[17211]: ntp-4 is maintained by Network Time Foundation, 2024-04-24T23:34:07.464 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 23:34:07 ntpd[17211]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-24T23:34:07.464 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 23:34:07 ntpd[17211]: corporation. Support and training for ntp-4 are 2024-04-24T23:34:07.464 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 23:34:07 ntpd[17211]: available at https://www.nwtime.org/support 2024-04-24T23:34:07.464 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 23:34:07 ntpd[17211]: ---------------------------------------------------- 2024-04-24T23:34:07.465 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 23:34:07 ntpd[17211]: proto: precision = 0.043 usec (-24) 2024-04-24T23:34:07.465 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 23:34:07 ntpd[17211]: basedate set to 2022-02-04 2024-04-24T23:34:07.465 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 23:34:07 ntpd[17211]: gps base set to 2022-02-06 (week 2196) 2024-04-24T23:34:07.465 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 23:34:07 ntpd[17211]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-24T23:34:07.465 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 23:34:07 ntpd[17211]: restrict ::: KOD does nothing without LIMITED. 2024-04-24T23:34:07.465 INFO:teuthology.orchestra.run.smithi088.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-24T23:34:07.465 INFO:teuthology.orchestra.run.smithi088.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-24T23:34:07.466 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 23:34:07 ntpd[17211]: Listen and drop on 0 v6wildcard [::]:123 2024-04-24T23:34:07.466 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 23:34:07 ntpd[17211]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-24T23:34:07.466 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 23:34:07 ntpd[17211]: Listen normally on 2 lo 127.0.0.1:123 2024-04-24T23:34:07.466 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 23:34:07 ntpd[17211]: Listen normally on 3 enp3s0f1 172.21.15.88:123 2024-04-24T23:34:07.466 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 23:34:07 ntpd[17211]: Listen normally on 4 lo [::1]:123 2024-04-24T23:34:07.466 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 23:34:07 ntpd[17211]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d42d%5]:123 2024-04-24T23:34:07.467 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 23:34:07 ntpd[17211]: Listening on routing socket on fd #22 for interface updates 2024-04-24T23:34:07.467 INFO:teuthology.orchestra.run.smithi057.stdout:24 Apr 23:34:07 ntpd[17090]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-24T23:34:07.468 INFO:teuthology.orchestra.run.smithi057.stdout:24 Apr 23:34:07 ntpd[17090]: Command line: ntpd -gq 2024-04-24T23:34:07.468 INFO:teuthology.orchestra.run.smithi057.stdout:24 Apr 23:34:07 ntpd[17090]: ---------------------------------------------------- 2024-04-24T23:34:07.468 INFO:teuthology.orchestra.run.smithi057.stdout:24 Apr 23:34:07 ntpd[17090]: ntp-4 is maintained by Network Time Foundation, 2024-04-24T23:34:07.468 INFO:teuthology.orchestra.run.smithi057.stdout:24 Apr 23:34:07 ntpd[17090]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-24T23:34:07.468 INFO:teuthology.orchestra.run.smithi057.stdout:24 Apr 23:34:07 ntpd[17090]: corporation. Support and training for ntp-4 are 2024-04-24T23:34:07.468 INFO:teuthology.orchestra.run.smithi057.stdout:24 Apr 23:34:07 ntpd[17090]: available at https://www.nwtime.org/support 2024-04-24T23:34:07.468 INFO:teuthology.orchestra.run.smithi057.stdout:24 Apr 23:34:07 ntpd[17090]: ---------------------------------------------------- 2024-04-24T23:34:07.468 INFO:teuthology.orchestra.run.smithi057.stdout:24 Apr 23:34:07 ntpd[17090]: proto: precision = 0.065 usec (-24) 2024-04-24T23:34:07.468 INFO:teuthology.orchestra.run.smithi057.stdout:24 Apr 23:34:07 ntpd[17090]: basedate set to 2022-02-04 2024-04-24T23:34:07.468 INFO:teuthology.orchestra.run.smithi057.stdout:24 Apr 23:34:07 ntpd[17090]: gps base set to 2022-02-06 (week 2196) 2024-04-24T23:34:07.468 INFO:teuthology.orchestra.run.smithi057.stdout:24 Apr 23:34:07 ntpd[17090]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-24T23:34:07.469 INFO:teuthology.orchestra.run.smithi057.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-24T23:34:07.469 INFO:teuthology.orchestra.run.smithi057.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-24T23:34:07.469 INFO:teuthology.orchestra.run.smithi057.stdout:24 Apr 23:34:07 ntpd[17090]: restrict ::: KOD does nothing without LIMITED. 2024-04-24T23:34:07.470 INFO:teuthology.orchestra.run.smithi057.stdout:24 Apr 23:34:07 ntpd[17090]: Listen and drop on 0 v6wildcard [::]:123 2024-04-24T23:34:07.470 INFO:teuthology.orchestra.run.smithi057.stdout:24 Apr 23:34:07 ntpd[17090]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-24T23:34:07.470 INFO:teuthology.orchestra.run.smithi057.stdout:24 Apr 23:34:07 ntpd[17090]: Listen normally on 2 lo 127.0.0.1:123 2024-04-24T23:34:07.470 INFO:teuthology.orchestra.run.smithi057.stdout:24 Apr 23:34:07 ntpd[17090]: Listen normally on 3 ens1f0 172.21.15.57:123 2024-04-24T23:34:07.470 INFO:teuthology.orchestra.run.smithi057.stdout:24 Apr 23:34:07 ntpd[17090]: Listen normally on 4 lo [::1]:123 2024-04-24T23:34:07.470 INFO:teuthology.orchestra.run.smithi057.stdout:24 Apr 23:34:07 ntpd[17090]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1562%4]:123 2024-04-24T23:34:07.470 INFO:teuthology.orchestra.run.smithi057.stdout:24 Apr 23:34:07 ntpd[17090]: Listening on routing socket on fd #22 for interface updates 2024-04-24T23:34:07.471 INFO:teuthology.orchestra.run.smithi116.stdout:24 Apr 23:34:07 ntpd[17231]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-24T23:34:07.471 INFO:teuthology.orchestra.run.smithi116.stdout:24 Apr 23:34:07 ntpd[17231]: Command line: ntpd -gq 2024-04-24T23:34:07.471 INFO:teuthology.orchestra.run.smithi116.stdout:24 Apr 23:34:07 ntpd[17231]: ---------------------------------------------------- 2024-04-24T23:34:07.471 INFO:teuthology.orchestra.run.smithi116.stdout:24 Apr 23:34:07 ntpd[17231]: ntp-4 is maintained by Network Time Foundation, 2024-04-24T23:34:07.471 INFO:teuthology.orchestra.run.smithi116.stdout:24 Apr 23:34:07 ntpd[17231]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-24T23:34:07.471 INFO:teuthology.orchestra.run.smithi116.stdout:24 Apr 23:34:07 ntpd[17231]: corporation. Support and training for ntp-4 are 2024-04-24T23:34:07.471 INFO:teuthology.orchestra.run.smithi116.stdout:24 Apr 23:34:07 ntpd[17231]: available at https://www.nwtime.org/support 2024-04-24T23:34:07.471 INFO:teuthology.orchestra.run.smithi116.stdout:24 Apr 23:34:07 ntpd[17231]: ---------------------------------------------------- 2024-04-24T23:34:07.471 INFO:teuthology.orchestra.run.smithi116.stdout:24 Apr 23:34:07 ntpd[17231]: proto: precision = 0.059 usec (-24) 2024-04-24T23:34:07.471 INFO:teuthology.orchestra.run.smithi116.stdout:24 Apr 23:34:07 ntpd[17231]: basedate set to 2022-02-04 2024-04-24T23:34:07.472 INFO:teuthology.orchestra.run.smithi116.stdout:24 Apr 23:34:07 ntpd[17231]: gps base set to 2022-02-06 (week 2196) 2024-04-24T23:34:07.472 INFO:teuthology.orchestra.run.smithi116.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-24T23:34:07.472 INFO:teuthology.orchestra.run.smithi116.stdout:24 Apr 23:34:07 ntpd[17231]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-24T23:34:07.472 INFO:teuthology.orchestra.run.smithi116.stdout:24 Apr 23:34:07 ntpd[17231]: restrict ::: KOD does nothing without LIMITED. 2024-04-24T23:34:07.473 INFO:teuthology.orchestra.run.smithi116.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-24T23:34:07.473 INFO:teuthology.orchestra.run.smithi116.stdout:24 Apr 23:34:07 ntpd[17231]: Listen and drop on 0 v6wildcard [::]:123 2024-04-24T23:34:07.473 INFO:teuthology.orchestra.run.smithi116.stdout:24 Apr 23:34:07 ntpd[17231]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-24T23:34:07.473 INFO:teuthology.orchestra.run.smithi116.stdout:24 Apr 23:34:07 ntpd[17231]: Listen normally on 2 lo 127.0.0.1:123 2024-04-24T23:34:07.474 INFO:teuthology.orchestra.run.smithi116.stdout:24 Apr 23:34:07 ntpd[17231]: Listen normally on 3 enp3s0f1 172.21.15.116:123 2024-04-24T23:34:07.474 INFO:teuthology.orchestra.run.smithi116.stdout:24 Apr 23:34:07 ntpd[17231]: Listen normally on 4 lo [::1]:123 2024-04-24T23:34:07.474 INFO:teuthology.orchestra.run.smithi116.stdout:24 Apr 23:34:07 ntpd[17231]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:3f67%5]:123 2024-04-24T23:34:07.474 INFO:teuthology.orchestra.run.smithi116.stdout:24 Apr 23:34:07 ntpd[17231]: Listening on routing socket on fd #22 for interface updates 2024-04-24T23:34:07.488 INFO:teuthology.orchestra.run.smithi174.stdout:24 Apr 23:34:07 ntpd[17199]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-24T23:34:07.488 INFO:teuthology.orchestra.run.smithi174.stdout:24 Apr 23:34:07 ntpd[17199]: Command line: ntpd -gq 2024-04-24T23:34:07.488 INFO:teuthology.orchestra.run.smithi174.stdout:24 Apr 23:34:07 ntpd[17199]: ---------------------------------------------------- 2024-04-24T23:34:07.488 INFO:teuthology.orchestra.run.smithi174.stdout:24 Apr 23:34:07 ntpd[17199]: ntp-4 is maintained by Network Time Foundation, 2024-04-24T23:34:07.488 INFO:teuthology.orchestra.run.smithi174.stdout:24 Apr 23:34:07 ntpd[17199]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-24T23:34:07.488 INFO:teuthology.orchestra.run.smithi174.stdout:24 Apr 23:34:07 ntpd[17199]: corporation. Support and training for ntp-4 are 2024-04-24T23:34:07.489 INFO:teuthology.orchestra.run.smithi174.stdout:24 Apr 23:34:07 ntpd[17199]: available at https://www.nwtime.org/support 2024-04-24T23:34:07.489 INFO:teuthology.orchestra.run.smithi174.stdout:24 Apr 23:34:07 ntpd[17199]: ---------------------------------------------------- 2024-04-24T23:34:07.489 INFO:teuthology.orchestra.run.smithi174.stdout:24 Apr 23:34:07 ntpd[17199]: proto: precision = 0.044 usec (-24) 2024-04-24T23:34:07.489 INFO:teuthology.orchestra.run.smithi174.stdout:24 Apr 23:34:07 ntpd[17199]: basedate set to 2022-02-04 2024-04-24T23:34:07.489 INFO:teuthology.orchestra.run.smithi174.stdout:24 Apr 23:34:07 ntpd[17199]: gps base set to 2022-02-06 (week 2196) 2024-04-24T23:34:07.490 INFO:teuthology.orchestra.run.smithi174.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-24T23:34:07.490 INFO:teuthology.orchestra.run.smithi174.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-24T23:34:07.491 INFO:teuthology.orchestra.run.smithi174.stdout:24 Apr 23:34:07 ntpd[17199]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-24T23:34:07.491 INFO:teuthology.orchestra.run.smithi174.stdout:24 Apr 23:34:07 ntpd[17199]: restrict ::: KOD does nothing without LIMITED. 2024-04-24T23:34:07.491 INFO:teuthology.orchestra.run.smithi174.stdout:24 Apr 23:34:07 ntpd[17199]: Listen and drop on 0 v6wildcard [::]:123 2024-04-24T23:34:07.491 INFO:teuthology.orchestra.run.smithi174.stdout:24 Apr 23:34:07 ntpd[17199]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-24T23:34:07.491 INFO:teuthology.orchestra.run.smithi174.stdout:24 Apr 23:34:07 ntpd[17199]: Listen normally on 2 lo 127.0.0.1:123 2024-04-24T23:34:07.491 INFO:teuthology.orchestra.run.smithi174.stdout:24 Apr 23:34:07 ntpd[17199]: Listen normally on 3 enp3s0f1 172.21.15.174:123 2024-04-24T23:34:07.491 INFO:teuthology.orchestra.run.smithi174.stdout:24 Apr 23:34:07 ntpd[17199]: Listen normally on 4 lo [::1]:123 2024-04-24T23:34:07.491 INFO:teuthology.orchestra.run.smithi174.stdout:24 Apr 23:34:07 ntpd[17199]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:771b%5]:123 2024-04-24T23:34:07.491 INFO:teuthology.orchestra.run.smithi174.stdout:24 Apr 23:34:07 ntpd[17199]: Listening on routing socket on fd #22 for interface updates 2024-04-24T23:34:08.463 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:08 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:08.464 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:08 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:08.464 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:08 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:08.464 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:08 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:08.464 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:08 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:08.464 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:08 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:08.467 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:08 ntpd[17090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:08.467 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:08 ntpd[17090]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:08.467 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:08 ntpd[17090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:08.467 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:08 ntpd[17090]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:08.467 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:08 ntpd[17090]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:08.467 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:08 ntpd[17090]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:08.469 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:08 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:08.469 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:08 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:08.469 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:08 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:08.469 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:08 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:08.469 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:08 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:08.469 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:08 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:08.469 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:08 ntpd[17231]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:08.469 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:08 ntpd[17231]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:08.469 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:08 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:08.469 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:08 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:08.469 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:08 ntpd[17231]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:08.469 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:08 ntpd[17231]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:08.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:08 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:08.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:08 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:08.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:08 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:08.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:08 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:08.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:08 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:08.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:08 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:09.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:09 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:09.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:09 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:09.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:09 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:09.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:09 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:09.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:09 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:09.490 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:09 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:10.464 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:10 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:10.464 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:10 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:10.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:10 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:10.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:10 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:10.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:10 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:10.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:10 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:10.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:10 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:10.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:10 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:10.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:10 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:10.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:10 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:10.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:10 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:10.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:10 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:10.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:10 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:10.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:10 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:10.466 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:10 ntpd[17090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:10.467 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:10 ntpd[17090]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:10.467 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:10 ntpd[17090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:10.467 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:10 ntpd[17090]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:10.467 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:10 ntpd[17090]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:10.467 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:10 ntpd[17090]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:10.469 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:10 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:10.469 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:10 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:10.469 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:10 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:10.469 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:10 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:10.469 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:10 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:10.469 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:10 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:10.469 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:10 ntpd[17231]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:10.469 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:10 ntpd[17231]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:10.469 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:10 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:10.469 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:10 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:10.469 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:10 ntpd[17231]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:10.470 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:10 ntpd[17231]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:10.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:10 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:10.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:10 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:10.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:10 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:10.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:10 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:10.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:10 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:10.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:10 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:10.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:10 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:10.490 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:10 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:11.466 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:11 ntpd[17090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:11.466 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:11 ntpd[17090]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:11.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:11 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:11.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:11 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:11.490 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:11 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:11.490 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:11 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:11.490 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:11 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:11.490 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:11 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:11.490 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:11 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:11.490 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:11 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:11.490 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:11 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:11.490 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:11 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:11.490 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:11 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:11.490 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:11 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:12.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:12 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:12.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:12 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:12.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:12 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:12.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:12 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:12.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:12 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:12.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:12 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:12.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:12 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:12.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:12 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:12.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:12 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:12.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:12 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:12.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:12 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:12.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:12 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:12.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:12 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:12.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:12 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:12.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:12 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:12.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:12 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:12.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:12 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:12.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:12 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:12.468 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:12 ntpd[17090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:12.468 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:12 ntpd[17090]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:12.468 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:12 ntpd[17090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:12.468 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:12 ntpd[17090]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:12.468 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:12 ntpd[17090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:12.468 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:12 ntpd[17090]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:12.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:12 ntpd[17090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:12.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:12 ntpd[17090]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:12.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:12 ntpd[17090]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:12.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:12 ntpd[17090]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:12.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:12 ntpd[17090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:12.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:12 ntpd[17090]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:12.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:12 ntpd[17090]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:12.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:12 ntpd[17090]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:12.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:12 ntpd[17090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:12.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:12 ntpd[17090]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:12.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:12 ntpd[17090]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:12.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:12 ntpd[17090]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:12.471 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:12 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:12.471 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:12 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:12.471 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:12 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:12.471 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:12 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:12.471 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:12 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:12.471 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:12 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:12.472 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:12 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:12.472 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:12 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:12.472 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:12 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:12.472 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:12 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:12.472 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:12 ntpd[17231]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:12.472 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:12 ntpd[17231]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:12.472 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:12 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:12.472 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:12 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:12.472 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:12 ntpd[17231]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:12.472 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:12 ntpd[17231]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:12.472 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:12 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:12.472 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:12 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:12.472 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:12 ntpd[17231]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:12.472 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:12 ntpd[17231]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:12.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:12 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:12.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:12 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:12.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:12 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:12.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:12 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:12.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:12 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:12.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:12 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:13.490 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:13 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:13.490 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:13 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:13.490 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:13 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:13.491 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:13 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:13.491 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:13 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:13.491 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:13 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:13.491 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:13 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:13.491 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:13 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:13.491 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:13 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:13.491 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:13 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:13.491 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:13 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:13.491 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:13 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:14.464 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:14 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:14.464 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:14 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:14.464 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:14 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:14.464 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:14 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:14.464 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:14 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:14.464 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:14 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:14.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:14 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:14.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:14 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:14.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:14 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:14.465 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:14 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:14.465 INFO:teuthology.orchestra.run.smithi088.stdout:24 Apr 23:34:14 ntpd[17211]: ntpd: time slew -0.000831 s 2024-04-24T23:34:14.465 INFO:teuthology.orchestra.run.smithi088.stdout:ntpd: time slew -0.000831s 2024-04-24T23:34:14.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:14 ntpd[17211]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-24T23:34:14.466 INFO:teuthology.orchestra.run.smithi088.stderr:24 Apr 23:34:14 ntpd[17211]: can't open /var/log/ntpstats/loopstats.20240424: Permission denied 2024-04-24T23:34:14.468 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:14 ntpd[17090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:14.468 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:14 ntpd[17090]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:14.468 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:14 ntpd[17090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:14.468 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:14 ntpd[17090]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:14.468 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:14 ntpd[17090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:14.468 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:14 ntpd[17090]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:14.468 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:14 ntpd[17090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:14.468 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:14 ntpd[17090]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:14.468 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:14 ntpd[17090]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:14.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:14 ntpd[17090]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:14.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:14 ntpd[17090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:14.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:14 ntpd[17090]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:14.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:14 ntpd[17090]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:14.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:14 ntpd[17090]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:14.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:14 ntpd[17090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:14.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:14 ntpd[17090]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:14.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:14 ntpd[17090]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:14.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:14 ntpd[17090]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:14.470 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:14 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:14.470 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:14 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:14.470 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:14 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:14.470 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:14 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:14.471 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:14 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:14.471 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:14 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:14.471 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:14 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:14.471 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:14 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:14.471 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:14 ntpd[17231]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:14.471 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:14 ntpd[17231]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:14.471 INFO:teuthology.orchestra.run.smithi116.stdout:24 Apr 23:34:14 ntpd[17231]: ntpd: time slew -0.000371 s 2024-04-24T23:34:14.471 INFO:teuthology.orchestra.run.smithi116.stdout:ntpd: time slew -0.000371s 2024-04-24T23:34:14.472 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:14 ntpd[17231]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-24T23:34:14.472 INFO:teuthology.orchestra.run.smithi116.stderr:24 Apr 23:34:14 ntpd[17231]: can't open /var/log/ntpstats/loopstats.20240424: Permission denied 2024-04-24T23:34:14.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:14 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:14.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:14 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:14.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:14 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:14.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:14 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:14.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:14 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:14.489 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:14 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:14.490 INFO:teuthology.orchestra.run.smithi174.stdout:24 Apr 23:34:14 ntpd[17199]: ntpd: time slew -0.000677 s 2024-04-24T23:34:14.490 INFO:teuthology.orchestra.run.smithi174.stdout:ntpd: time slew -0.000677s 2024-04-24T23:34:14.490 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:14 ntpd[17199]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-24T23:34:14.490 INFO:teuthology.orchestra.run.smithi174.stderr:24 Apr 23:34:14 ntpd[17199]: can't open /var/log/ntpstats/loopstats.20240424: Permission denied 2024-04-24T23:34:14.518 INFO:teuthology.orchestra.run.smithi088.stdout: remote refid st t when poll reach delay offset jitter 2024-04-24T23:34:14.519 INFO:teuthology.orchestra.run.smithi088.stdout:============================================================================== 2024-04-24T23:34:14.519 INFO:teuthology.orchestra.run.smithi088.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T23:34:14.519 INFO:teuthology.orchestra.run.smithi088.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T23:34:14.519 INFO:teuthology.orchestra.run.smithi088.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T23:34:14.519 INFO:teuthology.orchestra.run.smithi088.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T23:34:14.520 INFO:teuthology.orchestra.run.smithi116.stdout: remote refid st t when poll reach delay offset jitter 2024-04-24T23:34:14.521 INFO:teuthology.orchestra.run.smithi116.stdout:============================================================================== 2024-04-24T23:34:14.521 INFO:teuthology.orchestra.run.smithi116.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T23:34:14.521 INFO:teuthology.orchestra.run.smithi116.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T23:34:14.521 INFO:teuthology.orchestra.run.smithi116.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T23:34:14.521 INFO:teuthology.orchestra.run.smithi116.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T23:34:14.534 INFO:teuthology.orchestra.run.smithi174.stdout: remote refid st t when poll reach delay offset jitter 2024-04-24T23:34:14.534 INFO:teuthology.orchestra.run.smithi174.stdout:============================================================================== 2024-04-24T23:34:14.534 INFO:teuthology.orchestra.run.smithi174.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T23:34:14.534 INFO:teuthology.orchestra.run.smithi174.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T23:34:14.534 INFO:teuthology.orchestra.run.smithi174.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T23:34:14.535 INFO:teuthology.orchestra.run.smithi174.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T23:34:16.468 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:16 ntpd[17090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:16.468 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:16 ntpd[17090]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:16.468 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:16 ntpd[17090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:16.468 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:16 ntpd[17090]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:16.468 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:16 ntpd[17090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:16.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:16 ntpd[17090]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:16.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:16 ntpd[17090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:16.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:16 ntpd[17090]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:16.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:16 ntpd[17090]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:16.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:16 ntpd[17090]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:16.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:16 ntpd[17090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:16.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:16 ntpd[17090]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:16.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:16 ntpd[17090]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:16.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:16 ntpd[17090]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:16.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:16 ntpd[17090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T23:34:16.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:16 ntpd[17090]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T23:34:16.469 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:16 ntpd[17090]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T23:34:16.470 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:16 ntpd[17090]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T23:34:16.470 INFO:teuthology.orchestra.run.smithi057.stdout:24 Apr 23:34:16 ntpd[17090]: ntpd: time slew -0.001468 s 2024-04-24T23:34:16.470 INFO:teuthology.orchestra.run.smithi057.stdout:ntpd: time slew -0.001468s 2024-04-24T23:34:16.470 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:16 ntpd[17090]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-24T23:34:16.470 INFO:teuthology.orchestra.run.smithi057.stderr:24 Apr 23:34:16 ntpd[17090]: can't open /var/log/ntpstats/loopstats.20240424: Permission denied 2024-04-24T23:34:16.520 INFO:teuthology.orchestra.run.smithi057.stdout: remote refid st t when poll reach delay offset jitter 2024-04-24T23:34:16.520 INFO:teuthology.orchestra.run.smithi057.stdout:============================================================================== 2024-04-24T23:34:16.520 INFO:teuthology.orchestra.run.smithi057.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T23:34:16.520 INFO:teuthology.orchestra.run.smithi057.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T23:34:16.520 INFO:teuthology.orchestra.run.smithi057.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T23:34:16.520 INFO:teuthology.orchestra.run.smithi057.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T23:34:16.521 INFO:teuthology.run_tasks:Running task install... 2024-04-24T23:34:16.530 DEBUG:teuthology.task.install:project ceph 2024-04-24T23:34:16.530 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}} 2024-04-24T23:34:16.530 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'} 2024-04-24T23:34:16.530 INFO:teuthology.task.install:Using flavor: default 2024-04-24T23:34:16.536 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-24T23:34:16.536 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-24T23:34:16.537 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-key list | grep Ceph 2024-04-24T23:34:16.537 DEBUG:teuthology.orchestra.run.smithi088:> sudo apt-key list | grep Ceph 2024-04-24T23:34:16.538 DEBUG:teuthology.orchestra.run.smithi116:> sudo apt-key list | grep Ceph 2024-04-24T23:34:16.538 DEBUG:teuthology.orchestra.run.smithi174:> sudo apt-key list | grep Ceph 2024-04-24T23:34:16.602 INFO:teuthology.orchestra.run.smithi174.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-24T23:34:16.603 INFO:teuthology.orchestra.run.smithi088.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-24T23:34:16.605 INFO:teuthology.orchestra.run.smithi116.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-24T23:34:16.622 INFO:teuthology.orchestra.run.smithi057.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-24T23:34:16.630 INFO:teuthology.orchestra.run.smithi174.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-24T23:34:16.631 INFO:teuthology.orchestra.run.smithi174.stdout:uid [ unknown] Ceph.com (release key) 2024-04-24T23:34:16.632 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-24T23:34:16.632 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-24T23:34:16.632 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T23:34:16.638 INFO:teuthology.orchestra.run.smithi116.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-24T23:34:16.638 INFO:teuthology.orchestra.run.smithi116.stdout:uid [ unknown] Ceph.com (release key) 2024-04-24T23:34:16.638 INFO:teuthology.orchestra.run.smithi088.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-24T23:34:16.638 INFO:teuthology.orchestra.run.smithi088.stdout:uid [ unknown] Ceph.com (release key) 2024-04-24T23:34:16.638 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-24T23:34:16.638 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-24T23:34:16.639 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T23:34:16.640 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-24T23:34:16.640 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-24T23:34:16.640 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T23:34:16.650 INFO:teuthology.orchestra.run.smithi057.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-24T23:34:16.650 INFO:teuthology.orchestra.run.smithi057.stdout:uid [ unknown] Ceph.com (release key) 2024-04-24T23:34:16.651 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-24T23:34:16.651 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-24T23:34:16.651 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T23:34:16.785 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default/ 2024-04-24T23:34:16.785 INFO:teuthology.task.install.deb:Package version is 19.0.0-2445-gd2c45d97-1jammy 2024-04-24T23:34:16.801 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default/ 2024-04-24T23:34:16.801 INFO:teuthology.task.install.deb:Package version is 19.0.0-2445-gd2c45d97-1jammy 2024-04-24T23:34:16.847 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default/ 2024-04-24T23:34:16.847 INFO:teuthology.task.install.deb:Package version is 19.0.0-2445-gd2c45d97-1jammy 2024-04-24T23:34:16.855 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default/ 2024-04-24T23:34:16.855 INFO:teuthology.task.install.deb:Package version is 19.0.0-2445-gd2c45d97-1jammy 2024-04-24T23:34:16.894 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T23:34:16.894 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-24T23:34:16.908 DEBUG:teuthology.orchestra.run.smithi088:> sudo apt-get update 2024-04-24T23:34:16.911 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T23:34:16.911 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-24T23:34:16.926 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-get update 2024-04-24T23:34:16.953 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-24T23:34:16.953 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-24T23:34:16.962 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-24T23:34:16.963 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-24T23:34:16.967 DEBUG:teuthology.orchestra.run.smithi174:> sudo apt-get update 2024-04-24T23:34:16.976 DEBUG:teuthology.orchestra.run.smithi116:> sudo apt-get update 2024-04-24T23:34:17.083 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-24T23:34:17.095 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-24T23:34:17.098 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-24T23:34:17.110 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-24T23:34:17.116 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-24T23:34:17.129 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-24T23:34:17.142 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-24T23:34:17.147 INFO:teuthology.orchestra.run.smithi057.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy InRelease 2024-04-24T23:34:17.155 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-24T23:34:17.155 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-24T23:34:17.157 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-24T23:34:17.163 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-24T23:34:17.168 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-24T23:34:17.176 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-24T23:34:17.190 INFO:teuthology.orchestra.run.smithi088.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy InRelease 2024-04-24T23:34:17.191 INFO:teuthology.orchestra.run.smithi057.stdout:Ign:6 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-24T23:34:17.199 INFO:teuthology.orchestra.run.smithi116.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy InRelease 2024-04-24T23:34:17.211 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-04-24T23:34:17.219 INFO:teuthology.orchestra.run.smithi116.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-24T23:34:17.226 INFO:teuthology.orchestra.run.smithi088.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-24T23:34:17.238 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2024-04-24T23:34:17.241 INFO:teuthology.orchestra.run.smithi116.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-24T23:34:17.251 INFO:teuthology.orchestra.run.smithi174.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy InRelease 2024-04-24T23:34:17.262 INFO:teuthology.orchestra.run.smithi116.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2024-04-24T23:34:17.263 INFO:teuthology.orchestra.run.smithi088.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-24T23:34:17.268 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-24T23:34:17.279 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:9 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-24T23:34:17.286 INFO:teuthology.orchestra.run.smithi174.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-24T23:34:17.289 INFO:teuthology.orchestra.run.smithi116.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-04-24T23:34:17.299 INFO:teuthology.orchestra.run.smithi088.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-04-24T23:34:17.323 INFO:teuthology.orchestra.run.smithi174.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-24T23:34:17.343 INFO:teuthology.orchestra.run.smithi088.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2024-04-24T23:34:17.348 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-24T23:34:17.359 INFO:teuthology.orchestra.run.smithi174.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2024-04-24T23:34:17.405 INFO:teuthology.orchestra.run.smithi174.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-04-24T23:34:17.428 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-24T23:34:17.446 INFO:teuthology.orchestra.run.smithi088.stdout:Fetched 28.9 kB in 0s (80.8 kB/s) 2024-04-24T23:34:17.474 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 28.9 kB in 0s (79.8 kB/s) 2024-04-24T23:34:17.491 INFO:teuthology.orchestra.run.smithi174.stdout:Fetched 28.9 kB in 0s (83.9 kB/s) 2024-04-24T23:34:17.570 INFO:teuthology.orchestra.run.smithi116.stdout:Fetched 28.9 kB in 0s (69.6 kB/s) 2024-04-24T23:34:18.434 INFO:teuthology.orchestra.run.smithi088.stdout:Reading package lists... 2024-04-24T23:34:18.450 DEBUG:teuthology.orchestra.run.smithi088:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2445-gd2c45d97-1jammy cephadm=19.0.0-2445-gd2c45d97-1jammy ceph-mds=19.0.0-2445-gd2c45d97-1jammy ceph-mgr=19.0.0-2445-gd2c45d97-1jammy ceph-common=19.0.0-2445-gd2c45d97-1jammy ceph-fuse=19.0.0-2445-gd2c45d97-1jammy ceph-test=19.0.0-2445-gd2c45d97-1jammy ceph-volume=19.0.0-2445-gd2c45d97-1jammy radosgw=19.0.0-2445-gd2c45d97-1jammy python3-rados=19.0.0-2445-gd2c45d97-1jammy python3-rgw=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy python3-rbd=19.0.0-2445-gd2c45d97-1jammy libcephfs2=19.0.0-2445-gd2c45d97-1jammy libcephfs-dev=19.0.0-2445-gd2c45d97-1jammy librados2=19.0.0-2445-gd2c45d97-1jammy librbd1=19.0.0-2445-gd2c45d97-1jammy rbd-fuse=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy cephfs-shell=19.0.0-2445-gd2c45d97-1jammy cephfs-top=19.0.0-2445-gd2c45d97-1jammy cephfs-mirror=19.0.0-2445-gd2c45d97-1jammy 2024-04-24T23:34:18.456 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2024-04-24T23:34:18.464 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2024-04-24T23:34:18.471 DEBUG:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2445-gd2c45d97-1jammy cephadm=19.0.0-2445-gd2c45d97-1jammy ceph-mds=19.0.0-2445-gd2c45d97-1jammy ceph-mgr=19.0.0-2445-gd2c45d97-1jammy ceph-common=19.0.0-2445-gd2c45d97-1jammy ceph-fuse=19.0.0-2445-gd2c45d97-1jammy ceph-test=19.0.0-2445-gd2c45d97-1jammy ceph-volume=19.0.0-2445-gd2c45d97-1jammy radosgw=19.0.0-2445-gd2c45d97-1jammy python3-rados=19.0.0-2445-gd2c45d97-1jammy python3-rgw=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy python3-rbd=19.0.0-2445-gd2c45d97-1jammy libcephfs2=19.0.0-2445-gd2c45d97-1jammy libcephfs-dev=19.0.0-2445-gd2c45d97-1jammy librados2=19.0.0-2445-gd2c45d97-1jammy librbd1=19.0.0-2445-gd2c45d97-1jammy rbd-fuse=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy cephfs-shell=19.0.0-2445-gd2c45d97-1jammy cephfs-top=19.0.0-2445-gd2c45d97-1jammy cephfs-mirror=19.0.0-2445-gd2c45d97-1jammy 2024-04-24T23:34:18.480 DEBUG:teuthology.orchestra.run.smithi174:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2445-gd2c45d97-1jammy cephadm=19.0.0-2445-gd2c45d97-1jammy ceph-mds=19.0.0-2445-gd2c45d97-1jammy ceph-mgr=19.0.0-2445-gd2c45d97-1jammy ceph-common=19.0.0-2445-gd2c45d97-1jammy ceph-fuse=19.0.0-2445-gd2c45d97-1jammy ceph-test=19.0.0-2445-gd2c45d97-1jammy ceph-volume=19.0.0-2445-gd2c45d97-1jammy radosgw=19.0.0-2445-gd2c45d97-1jammy python3-rados=19.0.0-2445-gd2c45d97-1jammy python3-rgw=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy python3-rbd=19.0.0-2445-gd2c45d97-1jammy libcephfs2=19.0.0-2445-gd2c45d97-1jammy libcephfs-dev=19.0.0-2445-gd2c45d97-1jammy librados2=19.0.0-2445-gd2c45d97-1jammy librbd1=19.0.0-2445-gd2c45d97-1jammy rbd-fuse=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy cephfs-shell=19.0.0-2445-gd2c45d97-1jammy cephfs-top=19.0.0-2445-gd2c45d97-1jammy cephfs-mirror=19.0.0-2445-gd2c45d97-1jammy 2024-04-24T23:34:18.502 INFO:teuthology.orchestra.run.smithi088.stdout:Reading package lists... 2024-04-24T23:34:18.531 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2024-04-24T23:34:18.539 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2024-04-24T23:34:18.581 INFO:teuthology.orchestra.run.smithi116.stdout:Reading package lists... 2024-04-24T23:34:18.596 DEBUG:teuthology.orchestra.run.smithi116:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2445-gd2c45d97-1jammy cephadm=19.0.0-2445-gd2c45d97-1jammy ceph-mds=19.0.0-2445-gd2c45d97-1jammy ceph-mgr=19.0.0-2445-gd2c45d97-1jammy ceph-common=19.0.0-2445-gd2c45d97-1jammy ceph-fuse=19.0.0-2445-gd2c45d97-1jammy ceph-test=19.0.0-2445-gd2c45d97-1jammy ceph-volume=19.0.0-2445-gd2c45d97-1jammy radosgw=19.0.0-2445-gd2c45d97-1jammy python3-rados=19.0.0-2445-gd2c45d97-1jammy python3-rgw=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy python3-rbd=19.0.0-2445-gd2c45d97-1jammy libcephfs2=19.0.0-2445-gd2c45d97-1jammy libcephfs-dev=19.0.0-2445-gd2c45d97-1jammy librados2=19.0.0-2445-gd2c45d97-1jammy librbd1=19.0.0-2445-gd2c45d97-1jammy rbd-fuse=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy cephfs-shell=19.0.0-2445-gd2c45d97-1jammy cephfs-top=19.0.0-2445-gd2c45d97-1jammy cephfs-mirror=19.0.0-2445-gd2c45d97-1jammy 2024-04-24T23:34:18.649 INFO:teuthology.orchestra.run.smithi116.stdout:Reading package lists... 2024-04-24T23:34:18.677 INFO:teuthology.orchestra.run.smithi088.stdout:Building dependency tree... 2024-04-24T23:34:18.678 INFO:teuthology.orchestra.run.smithi088.stdout:Reading state information... 2024-04-24T23:34:18.734 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2024-04-24T23:34:18.735 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2024-04-24T23:34:18.751 INFO:teuthology.orchestra.run.smithi174.stdout:Building dependency tree... 2024-04-24T23:34:18.752 INFO:teuthology.orchestra.run.smithi174.stdout:Reading state information... 2024-04-24T23:34:18.825 INFO:teuthology.orchestra.run.smithi116.stdout:Building dependency tree... 2024-04-24T23:34:18.826 INFO:teuthology.orchestra.run.smithi116.stdout:Reading state information... 2024-04-24T23:34:18.848 INFO:teuthology.orchestra.run.smithi088.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T23:34:18.848 INFO:teuthology.orchestra.run.smithi088.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T23:34:18.848 INFO:teuthology.orchestra.run.smithi088.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T23:34:18.848 INFO:teuthology.orchestra.run.smithi088.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T23:34:18.849 INFO:teuthology.orchestra.run.smithi088.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-24T23:34:18.849 INFO:teuthology.orchestra.run.smithi088.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-24T23:34:18.849 INFO:teuthology.orchestra.run.smithi088.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T23:34:18.851 INFO:teuthology.orchestra.run.smithi088.stdout:The following additional packages will be installed: 2024-04-24T23:34:18.851 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-24T23:34:18.851 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-24T23:34:18.851 INFO:teuthology.orchestra.run.smithi088.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-24T23:34:18.851 INFO:teuthology.orchestra.run.smithi088.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-24T23:34:18.851 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-24T23:34:18.851 INFO:teuthology.orchestra.run.smithi088.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-24T23:34:18.851 INFO:teuthology.orchestra.run.smithi088.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-24T23:34:18.851 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-24T23:34:18.851 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-24T23:34:18.852 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-24T23:34:18.852 INFO:teuthology.orchestra.run.smithi088.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-24T23:34:18.852 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-24T23:34:18.852 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-24T23:34:18.852 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-24T23:34:18.852 INFO:teuthology.orchestra.run.smithi088.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-24T23:34:18.852 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-24T23:34:18.852 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-24T23:34:18.852 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-24T23:34:18.852 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-24T23:34:18.852 INFO:teuthology.orchestra.run.smithi088.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-24T23:34:18.852 INFO:teuthology.orchestra.run.smithi088.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-24T23:34:18.852 INFO:teuthology.orchestra.run.smithi088.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-24T23:34:18.852 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-24T23:34:18.853 INFO:teuthology.orchestra.run.smithi088.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-24T23:34:18.853 INFO:teuthology.orchestra.run.smithi088.stdout:Suggested packages: 2024-04-24T23:34:18.853 INFO:teuthology.orchestra.run.smithi088.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-24T23:34:18.853 INFO:teuthology.orchestra.run.smithi088.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-24T23:34:18.853 INFO:teuthology.orchestra.run.smithi088.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-24T23:34:18.853 INFO:teuthology.orchestra.run.smithi088.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-24T23:34:18.853 INFO:teuthology.orchestra.run.smithi088.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-24T23:34:18.853 INFO:teuthology.orchestra.run.smithi088.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-24T23:34:18.854 INFO:teuthology.orchestra.run.smithi088.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-24T23:34:18.854 INFO:teuthology.orchestra.run.smithi088.stdout:Recommended packages: 2024-04-24T23:34:18.854 INFO:teuthology.orchestra.run.smithi088.stdout: btrfs-tools 2024-04-24T23:34:18.937 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T23:34:18.938 INFO:teuthology.orchestra.run.smithi057.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T23:34:18.938 INFO:teuthology.orchestra.run.smithi057.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T23:34:18.938 INFO:teuthology.orchestra.run.smithi057.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T23:34:18.939 INFO:teuthology.orchestra.run.smithi057.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-24T23:34:18.939 INFO:teuthology.orchestra.run.smithi057.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-24T23:34:18.939 INFO:teuthology.orchestra.run.smithi057.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T23:34:18.939 INFO:teuthology.orchestra.run.smithi057.stdout:The following additional packages will be installed: 2024-04-24T23:34:18.939 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-24T23:34:18.939 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-24T23:34:18.941 INFO:teuthology.orchestra.run.smithi057.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-24T23:34:18.941 INFO:teuthology.orchestra.run.smithi057.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-24T23:34:18.941 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-24T23:34:18.941 INFO:teuthology.orchestra.run.smithi057.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-24T23:34:18.941 INFO:teuthology.orchestra.run.smithi057.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-24T23:34:18.941 INFO:teuthology.orchestra.run.smithi057.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-24T23:34:18.941 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-24T23:34:18.941 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-24T23:34:18.941 INFO:teuthology.orchestra.run.smithi057.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-24T23:34:18.941 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-24T23:34:18.942 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-24T23:34:18.942 INFO:teuthology.orchestra.run.smithi057.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-24T23:34:18.942 INFO:teuthology.orchestra.run.smithi057.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-24T23:34:18.942 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-24T23:34:18.942 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-24T23:34:18.942 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-24T23:34:18.942 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-24T23:34:18.942 INFO:teuthology.orchestra.run.smithi057.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-24T23:34:18.942 INFO:teuthology.orchestra.run.smithi057.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-24T23:34:18.942 INFO:teuthology.orchestra.run.smithi057.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-24T23:34:18.942 INFO:teuthology.orchestra.run.smithi057.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-24T23:34:18.942 INFO:teuthology.orchestra.run.smithi057.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-24T23:34:18.943 INFO:teuthology.orchestra.run.smithi057.stdout:Suggested packages: 2024-04-24T23:34:18.943 INFO:teuthology.orchestra.run.smithi057.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-24T23:34:18.943 INFO:teuthology.orchestra.run.smithi057.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-24T23:34:18.943 INFO:teuthology.orchestra.run.smithi057.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-24T23:34:18.943 INFO:teuthology.orchestra.run.smithi057.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-24T23:34:18.943 INFO:teuthology.orchestra.run.smithi057.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-24T23:34:18.943 INFO:teuthology.orchestra.run.smithi057.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-24T23:34:18.943 INFO:teuthology.orchestra.run.smithi057.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-24T23:34:18.943 INFO:teuthology.orchestra.run.smithi057.stdout:Recommended packages: 2024-04-24T23:34:18.944 INFO:teuthology.orchestra.run.smithi057.stdout: btrfs-tools 2024-04-24T23:34:18.950 INFO:teuthology.orchestra.run.smithi174.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T23:34:18.950 INFO:teuthology.orchestra.run.smithi174.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T23:34:18.950 INFO:teuthology.orchestra.run.smithi174.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T23:34:18.950 INFO:teuthology.orchestra.run.smithi174.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T23:34:18.951 INFO:teuthology.orchestra.run.smithi174.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-24T23:34:18.951 INFO:teuthology.orchestra.run.smithi174.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-24T23:34:18.951 INFO:teuthology.orchestra.run.smithi174.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T23:34:18.952 INFO:teuthology.orchestra.run.smithi174.stdout:The following additional packages will be installed: 2024-04-24T23:34:18.952 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-24T23:34:18.952 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-24T23:34:18.952 INFO:teuthology.orchestra.run.smithi174.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-24T23:34:18.952 INFO:teuthology.orchestra.run.smithi174.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-24T23:34:18.953 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-24T23:34:18.954 INFO:teuthology.orchestra.run.smithi174.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-24T23:34:18.954 INFO:teuthology.orchestra.run.smithi174.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-24T23:34:18.954 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-24T23:34:18.954 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-24T23:34:18.954 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-24T23:34:18.954 INFO:teuthology.orchestra.run.smithi174.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-24T23:34:18.954 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-24T23:34:18.954 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-24T23:34:18.954 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-24T23:34:18.954 INFO:teuthology.orchestra.run.smithi174.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-24T23:34:18.954 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-24T23:34:18.954 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-24T23:34:18.955 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-24T23:34:18.955 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-24T23:34:18.955 INFO:teuthology.orchestra.run.smithi174.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-24T23:34:18.955 INFO:teuthology.orchestra.run.smithi174.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-24T23:34:18.955 INFO:teuthology.orchestra.run.smithi174.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-24T23:34:18.955 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-24T23:34:18.955 INFO:teuthology.orchestra.run.smithi174.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-24T23:34:18.955 INFO:teuthology.orchestra.run.smithi174.stdout:Suggested packages: 2024-04-24T23:34:18.956 INFO:teuthology.orchestra.run.smithi174.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-24T23:34:18.956 INFO:teuthology.orchestra.run.smithi174.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-24T23:34:18.956 INFO:teuthology.orchestra.run.smithi174.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-24T23:34:18.956 INFO:teuthology.orchestra.run.smithi174.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-24T23:34:18.956 INFO:teuthology.orchestra.run.smithi174.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-24T23:34:18.956 INFO:teuthology.orchestra.run.smithi174.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-24T23:34:18.956 INFO:teuthology.orchestra.run.smithi174.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-24T23:34:18.956 INFO:teuthology.orchestra.run.smithi174.stdout:Recommended packages: 2024-04-24T23:34:18.956 INFO:teuthology.orchestra.run.smithi174.stdout: btrfs-tools 2024-04-24T23:34:18.958 INFO:teuthology.orchestra.run.smithi088.stdout:The following NEW packages will be installed: 2024-04-24T23:34:18.958 INFO:teuthology.orchestra.run.smithi088.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-24T23:34:18.958 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-24T23:34:18.958 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-24T23:34:18.958 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-24T23:34:18.960 INFO:teuthology.orchestra.run.smithi088.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-24T23:34:18.960 INFO:teuthology.orchestra.run.smithi088.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-24T23:34:18.960 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-24T23:34:18.960 INFO:teuthology.orchestra.run.smithi088.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-24T23:34:18.960 INFO:teuthology.orchestra.run.smithi088.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-24T23:34:18.960 INFO:teuthology.orchestra.run.smithi088.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-24T23:34:18.960 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-24T23:34:18.960 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-24T23:34:18.960 INFO:teuthology.orchestra.run.smithi088.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-24T23:34:18.960 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-24T23:34:18.960 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-24T23:34:18.960 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-24T23:34:18.961 INFO:teuthology.orchestra.run.smithi088.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-24T23:34:18.961 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-24T23:34:18.961 INFO:teuthology.orchestra.run.smithi088.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-24T23:34:18.961 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-24T23:34:18.961 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-24T23:34:18.961 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-24T23:34:18.961 INFO:teuthology.orchestra.run.smithi088.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-24T23:34:18.961 INFO:teuthology.orchestra.run.smithi088.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-24T23:34:18.961 INFO:teuthology.orchestra.run.smithi088.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-24T23:34:18.961 INFO:teuthology.orchestra.run.smithi088.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-24T23:34:18.961 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-24T23:34:18.961 INFO:teuthology.orchestra.run.smithi088.stdout: socat unzip xmlstarlet zip 2024-04-24T23:34:18.998 INFO:teuthology.orchestra.run.smithi116.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T23:34:18.998 INFO:teuthology.orchestra.run.smithi116.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T23:34:18.998 INFO:teuthology.orchestra.run.smithi116.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T23:34:18.998 INFO:teuthology.orchestra.run.smithi116.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T23:34:18.999 INFO:teuthology.orchestra.run.smithi116.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-24T23:34:18.999 INFO:teuthology.orchestra.run.smithi116.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-24T23:34:18.999 INFO:teuthology.orchestra.run.smithi116.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T23:34:19.001 INFO:teuthology.orchestra.run.smithi116.stdout:The following additional packages will be installed: 2024-04-24T23:34:19.001 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-24T23:34:19.001 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-24T23:34:19.001 INFO:teuthology.orchestra.run.smithi116.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-24T23:34:19.001 INFO:teuthology.orchestra.run.smithi116.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-24T23:34:19.001 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-24T23:34:19.001 INFO:teuthology.orchestra.run.smithi116.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-24T23:34:19.001 INFO:teuthology.orchestra.run.smithi116.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-24T23:34:19.001 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-24T23:34:19.001 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-24T23:34:19.001 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-24T23:34:19.002 INFO:teuthology.orchestra.run.smithi116.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-24T23:34:19.002 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-24T23:34:19.002 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-24T23:34:19.002 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-24T23:34:19.002 INFO:teuthology.orchestra.run.smithi116.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-24T23:34:19.002 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-24T23:34:19.002 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-24T23:34:19.002 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-24T23:34:19.002 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-24T23:34:19.002 INFO:teuthology.orchestra.run.smithi116.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-24T23:34:19.002 INFO:teuthology.orchestra.run.smithi116.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-24T23:34:19.002 INFO:teuthology.orchestra.run.smithi116.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-24T23:34:19.002 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-24T23:34:19.003 INFO:teuthology.orchestra.run.smithi116.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-24T23:34:19.003 INFO:teuthology.orchestra.run.smithi116.stdout:Suggested packages: 2024-04-24T23:34:19.003 INFO:teuthology.orchestra.run.smithi116.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-24T23:34:19.003 INFO:teuthology.orchestra.run.smithi116.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-24T23:34:19.003 INFO:teuthology.orchestra.run.smithi116.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-24T23:34:19.003 INFO:teuthology.orchestra.run.smithi116.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-24T23:34:19.003 INFO:teuthology.orchestra.run.smithi116.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-24T23:34:19.003 INFO:teuthology.orchestra.run.smithi116.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-24T23:34:19.003 INFO:teuthology.orchestra.run.smithi116.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-24T23:34:19.004 INFO:teuthology.orchestra.run.smithi116.stdout:Recommended packages: 2024-04-24T23:34:19.004 INFO:teuthology.orchestra.run.smithi116.stdout: btrfs-tools 2024-04-24T23:34:19.025 INFO:teuthology.orchestra.run.smithi088.stdout:0 upgraded, 124 newly installed, 0 to remove and 302 not upgraded. 2024-04-24T23:34:19.025 INFO:teuthology.orchestra.run.smithi088.stdout:Need to get 180 MB of archives. 2024-04-24T23:34:19.026 INFO:teuthology.orchestra.run.smithi088.stdout:After this operation, 823 MB of additional disk space will be used. 2024-04-24T23:34:19.026 INFO:teuthology.orchestra.run.smithi088.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-24T23:34:19.047 INFO:teuthology.orchestra.run.smithi088.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-24T23:34:19.054 INFO:teuthology.orchestra.run.smithi057.stdout:The following NEW packages will be installed: 2024-04-24T23:34:19.054 INFO:teuthology.orchestra.run.smithi057.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-24T23:34:19.054 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-24T23:34:19.054 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-24T23:34:19.054 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-24T23:34:19.055 INFO:teuthology.orchestra.run.smithi057.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-24T23:34:19.056 INFO:teuthology.orchestra.run.smithi057.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-24T23:34:19.056 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-24T23:34:19.056 INFO:teuthology.orchestra.run.smithi057.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-24T23:34:19.056 INFO:teuthology.orchestra.run.smithi057.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-24T23:34:19.056 INFO:teuthology.orchestra.run.smithi057.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-24T23:34:19.056 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-24T23:34:19.056 INFO:teuthology.orchestra.run.smithi057.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-24T23:34:19.056 INFO:teuthology.orchestra.run.smithi057.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-24T23:34:19.056 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-24T23:34:19.056 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-24T23:34:19.056 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-24T23:34:19.056 INFO:teuthology.orchestra.run.smithi057.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-24T23:34:19.057 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-24T23:34:19.057 INFO:teuthology.orchestra.run.smithi057.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-24T23:34:19.057 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-24T23:34:19.057 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-24T23:34:19.057 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-24T23:34:19.057 INFO:teuthology.orchestra.run.smithi057.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-24T23:34:19.057 INFO:teuthology.orchestra.run.smithi057.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-24T23:34:19.057 INFO:teuthology.orchestra.run.smithi057.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-24T23:34:19.057 INFO:teuthology.orchestra.run.smithi057.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-24T23:34:19.057 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-24T23:34:19.057 INFO:teuthology.orchestra.run.smithi057.stdout: socat unzip xmlstarlet zip 2024-04-24T23:34:19.060 INFO:teuthology.orchestra.run.smithi174.stdout:The following NEW packages will be installed: 2024-04-24T23:34:19.060 INFO:teuthology.orchestra.run.smithi174.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-24T23:34:19.060 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-24T23:34:19.060 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-24T23:34:19.060 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-24T23:34:19.060 INFO:teuthology.orchestra.run.smithi174.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-24T23:34:19.060 INFO:teuthology.orchestra.run.smithi174.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-24T23:34:19.060 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-24T23:34:19.060 INFO:teuthology.orchestra.run.smithi174.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-24T23:34:19.061 INFO:teuthology.orchestra.run.smithi174.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-24T23:34:19.062 INFO:teuthology.orchestra.run.smithi174.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-24T23:34:19.062 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-24T23:34:19.062 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-24T23:34:19.062 INFO:teuthology.orchestra.run.smithi174.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-24T23:34:19.062 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-24T23:34:19.062 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-24T23:34:19.062 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-24T23:34:19.062 INFO:teuthology.orchestra.run.smithi174.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-24T23:34:19.062 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-24T23:34:19.062 INFO:teuthology.orchestra.run.smithi174.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-24T23:34:19.062 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-24T23:34:19.062 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-24T23:34:19.063 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-24T23:34:19.063 INFO:teuthology.orchestra.run.smithi174.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-24T23:34:19.063 INFO:teuthology.orchestra.run.smithi174.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-24T23:34:19.063 INFO:teuthology.orchestra.run.smithi174.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-24T23:34:19.063 INFO:teuthology.orchestra.run.smithi174.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-24T23:34:19.063 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-24T23:34:19.063 INFO:teuthology.orchestra.run.smithi174.stdout: socat unzip xmlstarlet zip 2024-04-24T23:34:19.066 INFO:teuthology.orchestra.run.smithi088.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-24T23:34:19.107 INFO:teuthology.orchestra.run.smithi116.stdout:The following NEW packages will be installed: 2024-04-24T23:34:19.108 INFO:teuthology.orchestra.run.smithi116.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-24T23:34:19.108 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-24T23:34:19.108 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-24T23:34:19.108 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-24T23:34:19.109 INFO:teuthology.orchestra.run.smithi116.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-24T23:34:19.109 INFO:teuthology.orchestra.run.smithi116.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-24T23:34:19.109 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-24T23:34:19.110 INFO:teuthology.orchestra.run.smithi116.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-24T23:34:19.110 INFO:teuthology.orchestra.run.smithi116.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-24T23:34:19.110 INFO:teuthology.orchestra.run.smithi116.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-24T23:34:19.110 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-24T23:34:19.110 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-24T23:34:19.110 INFO:teuthology.orchestra.run.smithi116.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-24T23:34:19.110 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-24T23:34:19.110 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-24T23:34:19.110 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-24T23:34:19.110 INFO:teuthology.orchestra.run.smithi116.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-24T23:34:19.110 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-24T23:34:19.110 INFO:teuthology.orchestra.run.smithi116.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-24T23:34:19.110 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-24T23:34:19.111 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-24T23:34:19.111 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-24T23:34:19.111 INFO:teuthology.orchestra.run.smithi116.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-24T23:34:19.111 INFO:teuthology.orchestra.run.smithi116.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-24T23:34:19.111 INFO:teuthology.orchestra.run.smithi116.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-24T23:34:19.111 INFO:teuthology.orchestra.run.smithi116.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-24T23:34:19.111 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-24T23:34:19.111 INFO:teuthology.orchestra.run.smithi116.stdout: socat unzip xmlstarlet zip 2024-04-24T23:34:19.131 INFO:teuthology.orchestra.run.smithi088.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-24T23:34:19.133 INFO:teuthology.orchestra.run.smithi174.stdout:0 upgraded, 124 newly installed, 0 to remove and 302 not upgraded. 2024-04-24T23:34:19.133 INFO:teuthology.orchestra.run.smithi174.stdout:Need to get 180 MB of archives. 2024-04-24T23:34:19.134 INFO:teuthology.orchestra.run.smithi174.stdout:After this operation, 823 MB of additional disk space will be used. 2024-04-24T23:34:19.134 INFO:teuthology.orchestra.run.smithi174.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-24T23:34:19.154 INFO:teuthology.orchestra.run.smithi174.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-24T23:34:19.165 INFO:teuthology.orchestra.run.smithi088.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-24T23:34:19.169 INFO:teuthology.orchestra.run.smithi174.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-24T23:34:19.174 INFO:teuthology.orchestra.run.smithi088.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-24T23:34:19.179 INFO:teuthology.orchestra.run.smithi116.stdout:0 upgraded, 124 newly installed, 0 to remove and 302 not upgraded. 2024-04-24T23:34:19.179 INFO:teuthology.orchestra.run.smithi116.stdout:Need to get 180 MB of archives. 2024-04-24T23:34:19.179 INFO:teuthology.orchestra.run.smithi116.stdout:After this operation, 823 MB of additional disk space will be used. 2024-04-24T23:34:19.179 INFO:teuthology.orchestra.run.smithi116.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-24T23:34:19.196 INFO:teuthology.orchestra.run.smithi088.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-24T23:34:19.215 INFO:teuthology.orchestra.run.smithi116.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-24T23:34:19.216 INFO:teuthology.orchestra.run.smithi057.stdout:0 upgraded, 124 newly installed, 0 to remove and 302 not upgraded. 2024-04-24T23:34:19.216 INFO:teuthology.orchestra.run.smithi057.stdout:Need to get 180 MB of archives. 2024-04-24T23:34:19.216 INFO:teuthology.orchestra.run.smithi057.stdout:After this operation, 823 MB of additional disk space will be used. 2024-04-24T23:34:19.217 INFO:teuthology.orchestra.run.smithi057.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2445-gd2c45d97-1jammy [3,540 kB] 2024-04-24T23:34:19.228 INFO:teuthology.orchestra.run.smithi116.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-24T23:34:19.238 INFO:teuthology.orchestra.run.smithi174.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-24T23:34:19.240 INFO:teuthology.orchestra.run.smithi088.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2445-gd2c45d97-1jammy [3,540 kB] 2024-04-24T23:34:19.245 INFO:teuthology.orchestra.run.smithi057.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-24T23:34:19.264 INFO:teuthology.orchestra.run.smithi174.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-24T23:34:19.268 INFO:teuthology.orchestra.run.smithi174.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-24T23:34:19.275 INFO:teuthology.orchestra.run.smithi088.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-24T23:34:19.279 INFO:teuthology.orchestra.run.smithi088.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-24T23:34:19.286 INFO:teuthology.orchestra.run.smithi174.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-24T23:34:19.288 INFO:teuthology.orchestra.run.smithi088.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-24T23:34:19.290 INFO:teuthology.orchestra.run.smithi116.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-24T23:34:19.291 INFO:teuthology.orchestra.run.smithi088.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-24T23:34:19.292 INFO:teuthology.orchestra.run.smithi088.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-24T23:34:19.300 INFO:teuthology.orchestra.run.smithi088.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-24T23:34:19.302 INFO:teuthology.orchestra.run.smithi088.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-24T23:34:19.304 INFO:teuthology.orchestra.run.smithi088.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-24T23:34:19.305 INFO:teuthology.orchestra.run.smithi088.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-24T23:34:19.305 INFO:teuthology.orchestra.run.smithi088.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-24T23:34:19.316 INFO:teuthology.orchestra.run.smithi174.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2445-gd2c45d97-1jammy [3,540 kB] 2024-04-24T23:34:19.318 INFO:teuthology.orchestra.run.smithi088.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-24T23:34:19.320 INFO:teuthology.orchestra.run.smithi088.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-24T23:34:19.321 INFO:teuthology.orchestra.run.smithi116.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-24T23:34:19.322 INFO:teuthology.orchestra.run.smithi088.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-24T23:34:19.322 INFO:teuthology.orchestra.run.smithi088.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-24T23:34:19.324 INFO:teuthology.orchestra.run.smithi116.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-24T23:34:19.328 INFO:teuthology.orchestra.run.smithi057.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-24T23:34:19.338 INFO:teuthology.orchestra.run.smithi088.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-24T23:34:19.338 INFO:teuthology.orchestra.run.smithi116.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-24T23:34:19.340 INFO:teuthology.orchestra.run.smithi088.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-24T23:34:19.340 INFO:teuthology.orchestra.run.smithi088.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-24T23:34:19.340 INFO:teuthology.orchestra.run.smithi088.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-24T23:34:19.340 INFO:teuthology.orchestra.run.smithi088.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-24T23:34:19.341 INFO:teuthology.orchestra.run.smithi088.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-24T23:34:19.345 INFO:teuthology.orchestra.run.smithi174.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-24T23:34:19.350 INFO:teuthology.orchestra.run.smithi174.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-24T23:34:19.356 INFO:teuthology.orchestra.run.smithi116.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2445-gd2c45d97-1jammy [3,540 kB] 2024-04-24T23:34:19.362 INFO:teuthology.orchestra.run.smithi174.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-24T23:34:19.366 INFO:teuthology.orchestra.run.smithi174.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-24T23:34:19.367 INFO:teuthology.orchestra.run.smithi088.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-24T23:34:19.367 INFO:teuthology.orchestra.run.smithi088.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-24T23:34:19.368 INFO:teuthology.orchestra.run.smithi174.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-24T23:34:19.370 INFO:teuthology.orchestra.run.smithi088.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-24T23:34:19.370 INFO:teuthology.orchestra.run.smithi088.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-24T23:34:19.374 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-24T23:34:19.375 INFO:teuthology.orchestra.run.smithi174.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-24T23:34:19.378 INFO:teuthology.orchestra.run.smithi174.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-24T23:34:19.380 INFO:teuthology.orchestra.run.smithi174.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-24T23:34:19.381 INFO:teuthology.orchestra.run.smithi174.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-24T23:34:19.381 INFO:teuthology.orchestra.run.smithi174.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-24T23:34:19.386 INFO:teuthology.orchestra.run.smithi088.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-24T23:34:19.387 INFO:teuthology.orchestra.run.smithi088.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-24T23:34:19.388 INFO:teuthology.orchestra.run.smithi088.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-24T23:34:19.388 INFO:teuthology.orchestra.run.smithi088.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-24T23:34:19.389 INFO:teuthology.orchestra.run.smithi088.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-24T23:34:19.390 INFO:teuthology.orchestra.run.smithi088.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-24T23:34:19.396 INFO:teuthology.orchestra.run.smithi174.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-24T23:34:19.398 INFO:teuthology.orchestra.run.smithi174.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-24T23:34:19.400 INFO:teuthology.orchestra.run.smithi174.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-24T23:34:19.400 INFO:teuthology.orchestra.run.smithi174.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-24T23:34:19.402 INFO:teuthology.orchestra.run.smithi116.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-24T23:34:19.407 INFO:teuthology.orchestra.run.smithi116.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-24T23:34:19.410 INFO:teuthology.orchestra.run.smithi088.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-24T23:34:19.411 INFO:teuthology.orchestra.run.smithi088.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-24T23:34:19.416 INFO:teuthology.orchestra.run.smithi088.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-24T23:34:19.417 INFO:teuthology.orchestra.run.smithi088.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-24T23:34:19.419 INFO:teuthology.orchestra.run.smithi116.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-24T23:34:19.423 INFO:teuthology.orchestra.run.smithi116.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-24T23:34:19.424 INFO:teuthology.orchestra.run.smithi116.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-24T23:34:19.426 INFO:teuthology.orchestra.run.smithi174.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-24T23:34:19.428 INFO:teuthology.orchestra.run.smithi174.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-24T23:34:19.428 INFO:teuthology.orchestra.run.smithi174.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-24T23:34:19.428 INFO:teuthology.orchestra.run.smithi174.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-24T23:34:19.429 INFO:teuthology.orchestra.run.smithi174.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-24T23:34:19.429 INFO:teuthology.orchestra.run.smithi174.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-24T23:34:19.432 INFO:teuthology.orchestra.run.smithi116.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-24T23:34:19.434 INFO:teuthology.orchestra.run.smithi116.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-24T23:34:19.435 INFO:teuthology.orchestra.run.smithi088.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-24T23:34:19.436 INFO:teuthology.orchestra.run.smithi088.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-24T23:34:19.437 INFO:teuthology.orchestra.run.smithi116.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-24T23:34:19.437 INFO:teuthology.orchestra.run.smithi088.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-24T23:34:19.438 INFO:teuthology.orchestra.run.smithi116.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-24T23:34:19.438 INFO:teuthology.orchestra.run.smithi116.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-24T23:34:19.439 INFO:teuthology.orchestra.run.smithi088.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-24T23:34:19.440 INFO:teuthology.orchestra.run.smithi088.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-24T23:34:19.441 INFO:teuthology.orchestra.run.smithi088.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-24T23:34:19.446 INFO:teuthology.orchestra.run.smithi174.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-24T23:34:19.446 INFO:teuthology.orchestra.run.smithi174.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-24T23:34:19.449 INFO:teuthology.orchestra.run.smithi174.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-24T23:34:19.449 INFO:teuthology.orchestra.run.smithi174.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-24T23:34:19.453 INFO:teuthology.orchestra.run.smithi116.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-24T23:34:19.456 INFO:teuthology.orchestra.run.smithi116.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-24T23:34:19.456 INFO:teuthology.orchestra.run.smithi088.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-24T23:34:19.458 INFO:teuthology.orchestra.run.smithi116.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-24T23:34:19.458 INFO:teuthology.orchestra.run.smithi116.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-24T23:34:19.461 INFO:teuthology.orchestra.run.smithi088.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-24T23:34:19.462 INFO:teuthology.orchestra.run.smithi088.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-24T23:34:19.464 INFO:teuthology.orchestra.run.smithi088.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-24T23:34:19.466 INFO:teuthology.orchestra.run.smithi174.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-24T23:34:19.466 INFO:teuthology.orchestra.run.smithi174.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-24T23:34:19.467 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2445-gd2c45d97-1jammy [3,218 kB] 2024-04-24T23:34:19.467 INFO:teuthology.orchestra.run.smithi174.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-24T23:34:19.468 INFO:teuthology.orchestra.run.smithi174.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-24T23:34:19.468 INFO:teuthology.orchestra.run.smithi174.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-24T23:34:19.469 INFO:teuthology.orchestra.run.smithi174.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-24T23:34:19.474 INFO:teuthology.orchestra.run.smithi116.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-24T23:34:19.476 INFO:teuthology.orchestra.run.smithi088.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-24T23:34:19.476 INFO:teuthology.orchestra.run.smithi116.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-24T23:34:19.476 INFO:teuthology.orchestra.run.smithi116.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-24T23:34:19.476 INFO:teuthology.orchestra.run.smithi116.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-24T23:34:19.477 INFO:teuthology.orchestra.run.smithi116.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-24T23:34:19.477 INFO:teuthology.orchestra.run.smithi116.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-24T23:34:19.499 INFO:teuthology.orchestra.run.smithi174.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-24T23:34:19.501 INFO:teuthology.orchestra.run.smithi174.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-24T23:34:19.510 INFO:teuthology.orchestra.run.smithi116.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-24T23:34:19.510 INFO:teuthology.orchestra.run.smithi116.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-24T23:34:19.511 INFO:teuthology.orchestra.run.smithi174.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-24T23:34:19.512 INFO:teuthology.orchestra.run.smithi174.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-24T23:34:19.516 INFO:teuthology.orchestra.run.smithi116.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-24T23:34:19.517 INFO:teuthology.orchestra.run.smithi116.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-24T23:34:19.530 INFO:teuthology.orchestra.run.smithi174.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-24T23:34:19.531 INFO:teuthology.orchestra.run.smithi174.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-24T23:34:19.534 INFO:teuthology.orchestra.run.smithi174.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-24T23:34:19.537 INFO:teuthology.orchestra.run.smithi174.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-24T23:34:19.539 INFO:teuthology.orchestra.run.smithi174.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-24T23:34:19.542 INFO:teuthology.orchestra.run.smithi174.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-24T23:34:19.545 INFO:teuthology.orchestra.run.smithi116.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-24T23:34:19.546 INFO:teuthology.orchestra.run.smithi116.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-24T23:34:19.548 INFO:teuthology.orchestra.run.smithi116.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-24T23:34:19.549 INFO:teuthology.orchestra.run.smithi116.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-24T23:34:19.549 INFO:teuthology.orchestra.run.smithi116.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-24T23:34:19.552 INFO:teuthology.orchestra.run.smithi116.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-24T23:34:19.553 INFO:teuthology.orchestra.run.smithi088.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-24T23:34:19.554 INFO:teuthology.orchestra.run.smithi088.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-24T23:34:19.556 INFO:teuthology.orchestra.run.smithi088.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-24T23:34:19.556 INFO:teuthology.orchestra.run.smithi088.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-24T23:34:19.557 INFO:teuthology.orchestra.run.smithi088.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-24T23:34:19.571 INFO:teuthology.orchestra.run.smithi174.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-24T23:34:19.575 INFO:teuthology.orchestra.run.smithi174.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-24T23:34:19.576 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-24T23:34:19.576 INFO:teuthology.orchestra.run.smithi174.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-24T23:34:19.578 INFO:teuthology.orchestra.run.smithi174.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-24T23:34:19.586 INFO:teuthology.orchestra.run.smithi088.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-24T23:34:19.588 INFO:teuthology.orchestra.run.smithi116.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-24T23:34:19.589 INFO:teuthology.orchestra.run.smithi088.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-24T23:34:19.590 INFO:teuthology.orchestra.run.smithi116.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-24T23:34:19.592 INFO:teuthology.orchestra.run.smithi088.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-24T23:34:19.599 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2445-gd2c45d97-1jammy [711 kB] 2024-04-24T23:34:19.600 INFO:teuthology.orchestra.run.smithi116.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-24T23:34:19.600 INFO:teuthology.orchestra.run.smithi116.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-24T23:34:19.614 INFO:teuthology.orchestra.run.smithi174.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-24T23:34:19.614 INFO:teuthology.orchestra.run.smithi088.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-24T23:34:19.615 INFO:teuthology.orchestra.run.smithi088.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-24T23:34:19.629 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2445-gd2c45d97-1jammy [356 kB] 2024-04-24T23:34:19.644 INFO:teuthology.orchestra.run.smithi057.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2445-gd2c45d97-1jammy [32.8 kB] 2024-04-24T23:34:19.645 INFO:teuthology.orchestra.run.smithi116.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-24T23:34:19.646 INFO:teuthology.orchestra.run.smithi057.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2445-gd2c45d97-1jammy [180 kB] 2024-04-24T23:34:19.646 INFO:teuthology.orchestra.run.smithi116.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-24T23:34:19.648 INFO:teuthology.orchestra.run.smithi116.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-24T23:34:19.652 INFO:teuthology.orchestra.run.smithi057.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2445-gd2c45d97-1jammy [65.7 kB] 2024-04-24T23:34:19.652 INFO:teuthology.orchestra.run.smithi116.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-24T23:34:19.653 INFO:teuthology.orchestra.run.smithi088.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-24T23:34:19.654 INFO:teuthology.orchestra.run.smithi116.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-24T23:34:19.654 INFO:teuthology.orchestra.run.smithi088.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-24T23:34:19.654 INFO:teuthology.orchestra.run.smithi088.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-24T23:34:19.655 INFO:teuthology.orchestra.run.smithi057.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2445-gd2c45d97-1jammy [330 kB] 2024-04-24T23:34:19.655 INFO:teuthology.orchestra.run.smithi088.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-24T23:34:19.656 INFO:teuthology.orchestra.run.smithi088.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-24T23:34:19.656 INFO:teuthology.orchestra.run.smithi088.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-24T23:34:19.657 INFO:teuthology.orchestra.run.smithi116.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-24T23:34:19.660 INFO:teuthology.orchestra.run.smithi088.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-24T23:34:19.669 INFO:teuthology.orchestra.run.smithi057.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2445-gd2c45d97-1jammy [6,775 kB] 2024-04-24T23:34:19.670 INFO:teuthology.orchestra.run.smithi057.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-24T23:34:19.684 INFO:teuthology.orchestra.run.smithi057.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-24T23:34:19.686 INFO:teuthology.orchestra.run.smithi116.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-24T23:34:19.690 INFO:teuthology.orchestra.run.smithi116.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-24T23:34:19.691 INFO:teuthology.orchestra.run.smithi088.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-24T23:34:19.691 INFO:teuthology.orchestra.run.smithi116.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-24T23:34:19.693 INFO:teuthology.orchestra.run.smithi088.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-24T23:34:19.693 INFO:teuthology.orchestra.run.smithi116.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-24T23:34:19.694 INFO:teuthology.orchestra.run.smithi088.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-24T23:34:19.699 INFO:teuthology.orchestra.run.smithi174.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-24T23:34:19.699 INFO:teuthology.orchestra.run.smithi174.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-24T23:34:19.701 INFO:teuthology.orchestra.run.smithi174.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-24T23:34:19.701 INFO:teuthology.orchestra.run.smithi174.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-24T23:34:19.702 INFO:teuthology.orchestra.run.smithi174.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-24T23:34:19.723 INFO:teuthology.orchestra.run.smithi116.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-24T23:34:19.723 INFO:teuthology.orchestra.run.smithi174.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-24T23:34:19.731 INFO:teuthology.orchestra.run.smithi088.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-24T23:34:19.736 INFO:teuthology.orchestra.run.smithi057.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-24T23:34:19.736 INFO:teuthology.orchestra.run.smithi088.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-24T23:34:19.737 INFO:teuthology.orchestra.run.smithi088.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-24T23:34:19.739 INFO:teuthology.orchestra.run.smithi088.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-24T23:34:19.740 INFO:teuthology.orchestra.run.smithi088.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-24T23:34:19.749 INFO:teuthology.orchestra.run.smithi088.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-24T23:34:19.750 INFO:teuthology.orchestra.run.smithi088.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-24T23:34:19.757 INFO:teuthology.orchestra.run.smithi174.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-24T23:34:19.757 INFO:teuthology.orchestra.run.smithi174.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-24T23:34:19.786 INFO:teuthology.orchestra.run.smithi088.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-24T23:34:19.786 INFO:teuthology.orchestra.run.smithi088.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-24T23:34:19.788 INFO:teuthology.orchestra.run.smithi088.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-24T23:34:19.822 INFO:teuthology.orchestra.run.smithi088.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-24T23:34:19.826 INFO:teuthology.orchestra.run.smithi088.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-24T23:34:19.828 INFO:teuthology.orchestra.run.smithi088.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-24T23:34:19.841 INFO:teuthology.orchestra.run.smithi174.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-24T23:34:19.842 INFO:teuthology.orchestra.run.smithi174.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-24T23:34:19.843 INFO:teuthology.orchestra.run.smithi174.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-24T23:34:19.844 INFO:teuthology.orchestra.run.smithi088.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-24T23:34:19.845 INFO:teuthology.orchestra.run.smithi174.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-24T23:34:19.845 INFO:teuthology.orchestra.run.smithi088.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-24T23:34:19.845 INFO:teuthology.orchestra.run.smithi174.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-24T23:34:19.846 INFO:teuthology.orchestra.run.smithi088.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-24T23:34:19.847 INFO:teuthology.orchestra.run.smithi174.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-24T23:34:19.848 INFO:teuthology.orchestra.run.smithi174.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-24T23:34:19.849 INFO:teuthology.orchestra.run.smithi174.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-24T23:34:19.851 INFO:teuthology.orchestra.run.smithi088.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-24T23:34:19.852 INFO:teuthology.orchestra.run.smithi088.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-24T23:34:19.856 INFO:teuthology.orchestra.run.smithi116.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-24T23:34:19.856 INFO:teuthology.orchestra.run.smithi174.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-24T23:34:19.857 INFO:teuthology.orchestra.run.smithi116.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-24T23:34:19.859 INFO:teuthology.orchestra.run.smithi116.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-24T23:34:19.860 INFO:teuthology.orchestra.run.smithi116.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-24T23:34:19.861 INFO:teuthology.orchestra.run.smithi116.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-24T23:34:19.879 INFO:teuthology.orchestra.run.smithi174.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-24T23:34:19.889 INFO:teuthology.orchestra.run.smithi116.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-24T23:34:19.892 INFO:teuthology.orchestra.run.smithi116.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-24T23:34:19.892 INFO:teuthology.orchestra.run.smithi116.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-24T23:34:19.901 INFO:teuthology.orchestra.run.smithi174.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-24T23:34:19.902 INFO:teuthology.orchestra.run.smithi174.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-24T23:34:19.910 INFO:teuthology.orchestra.run.smithi057.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-24T23:34:19.910 INFO:teuthology.orchestra.run.smithi174.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-24T23:34:19.917 INFO:teuthology.orchestra.run.smithi174.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-24T23:34:19.918 INFO:teuthology.orchestra.run.smithi174.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-24T23:34:19.919 INFO:teuthology.orchestra.run.smithi057.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-24T23:34:19.920 INFO:teuthology.orchestra.run.smithi174.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-24T23:34:19.921 INFO:teuthology.orchestra.run.smithi174.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-24T23:34:19.927 INFO:teuthology.orchestra.run.smithi116.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-24T23:34:19.928 INFO:teuthology.orchestra.run.smithi116.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-24T23:34:19.931 INFO:teuthology.orchestra.run.smithi116.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-24T23:34:19.932 INFO:teuthology.orchestra.run.smithi174.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-24T23:34:19.932 INFO:teuthology.orchestra.run.smithi116.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-24T23:34:19.933 INFO:teuthology.orchestra.run.smithi116.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-24T23:34:19.933 INFO:teuthology.orchestra.run.smithi174.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-24T23:34:19.933 INFO:teuthology.orchestra.run.smithi116.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-24T23:34:19.934 INFO:teuthology.orchestra.run.smithi116.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-24T23:34:19.935 INFO:teuthology.orchestra.run.smithi116.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-24T23:34:19.940 INFO:teuthology.orchestra.run.smithi116.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-24T23:34:19.946 INFO:teuthology.orchestra.run.smithi057.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-24T23:34:19.950 INFO:teuthology.orchestra.run.smithi174.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-24T23:34:19.951 INFO:teuthology.orchestra.run.smithi174.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-24T23:34:19.952 INFO:teuthology.orchestra.run.smithi174.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-24T23:34:19.953 INFO:teuthology.orchestra.run.smithi174.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-24T23:34:19.954 INFO:teuthology.orchestra.run.smithi057.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-24T23:34:19.955 INFO:teuthology.orchestra.run.smithi174.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-24T23:34:19.956 INFO:teuthology.orchestra.run.smithi116.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-24T23:34:19.959 INFO:teuthology.orchestra.run.smithi116.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-24T23:34:19.959 INFO:teuthology.orchestra.run.smithi116.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-24T23:34:19.961 INFO:teuthology.orchestra.run.smithi057.stdout:Get:21 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2445-gd2c45d97-1jammy [112 kB] 2024-04-24T23:34:19.964 INFO:teuthology.orchestra.run.smithi057.stdout:Get:22 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2445-gd2c45d97-1jammy [466 kB] 2024-04-24T23:34:19.970 INFO:teuthology.orchestra.run.smithi174.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-24T23:34:19.980 INFO:teuthology.orchestra.run.smithi116.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-24T23:34:19.983 INFO:teuthology.orchestra.run.smithi174.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-24T23:34:19.983 INFO:teuthology.orchestra.run.smithi174.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-24T23:34:19.984 INFO:teuthology.orchestra.run.smithi174.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-24T23:34:19.984 INFO:teuthology.orchestra.run.smithi116.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-24T23:34:19.985 INFO:teuthology.orchestra.run.smithi116.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-24T23:34:19.985 INFO:teuthology.orchestra.run.smithi057.stdout:Get:23 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2445-gd2c45d97-1jammy [25.6 MB] 2024-04-24T23:34:19.986 INFO:teuthology.orchestra.run.smithi116.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-24T23:34:19.987 INFO:teuthology.orchestra.run.smithi116.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-24T23:34:19.988 INFO:teuthology.orchestra.run.smithi174.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-24T23:34:19.993 INFO:teuthology.orchestra.run.smithi116.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-24T23:34:19.994 INFO:teuthology.orchestra.run.smithi174.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-24T23:34:19.994 INFO:teuthology.orchestra.run.smithi116.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-24T23:34:20.014 INFO:teuthology.orchestra.run.smithi116.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-24T23:34:20.014 INFO:teuthology.orchestra.run.smithi116.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-24T23:34:20.015 INFO:teuthology.orchestra.run.smithi116.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-24T23:34:20.034 INFO:teuthology.orchestra.run.smithi116.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-24T23:34:20.036 INFO:teuthology.orchestra.run.smithi116.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-24T23:34:20.038 INFO:teuthology.orchestra.run.smithi116.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-24T23:34:20.048 INFO:teuthology.orchestra.run.smithi116.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-24T23:34:20.048 INFO:teuthology.orchestra.run.smithi116.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-24T23:34:20.049 INFO:teuthology.orchestra.run.smithi116.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-24T23:34:20.051 INFO:teuthology.orchestra.run.smithi116.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-24T23:34:20.055 INFO:teuthology.orchestra.run.smithi116.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-24T23:34:20.080 INFO:teuthology.orchestra.run.smithi088.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2445-gd2c45d97-1jammy [3,218 kB] 2024-04-24T23:34:20.120 INFO:teuthology.orchestra.run.smithi057.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-24T23:34:20.584 INFO:teuthology.orchestra.run.smithi088.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2445-gd2c45d97-1jammy [711 kB] 2024-04-24T23:34:20.679 INFO:teuthology.orchestra.run.smithi088.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2445-gd2c45d97-1jammy [356 kB] 2024-04-24T23:34:20.687 INFO:teuthology.orchestra.run.smithi057.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-24T23:34:20.703 INFO:teuthology.orchestra.run.smithi057.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-24T23:34:20.719 INFO:teuthology.orchestra.run.smithi057.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-24T23:34:20.728 INFO:teuthology.orchestra.run.smithi057.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-24T23:34:20.728 INFO:teuthology.orchestra.run.smithi057.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-24T23:34:20.744 INFO:teuthology.orchestra.run.smithi088.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2445-gd2c45d97-1jammy [32.8 kB] 2024-04-24T23:34:20.745 INFO:teuthology.orchestra.run.smithi057.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-24T23:34:20.746 INFO:teuthology.orchestra.run.smithi088.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2445-gd2c45d97-1jammy [180 kB] 2024-04-24T23:34:20.761 INFO:teuthology.orchestra.run.smithi088.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2445-gd2c45d97-1jammy [65.7 kB] 2024-04-24T23:34:20.767 INFO:teuthology.orchestra.run.smithi088.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2445-gd2c45d97-1jammy [330 kB] 2024-04-24T23:34:20.782 INFO:teuthology.orchestra.run.smithi057.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-24T23:34:20.796 INFO:teuthology.orchestra.run.smithi057.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-24T23:34:20.800 INFO:teuthology.orchestra.run.smithi057.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-24T23:34:20.802 INFO:teuthology.orchestra.run.smithi057.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-24T23:34:20.829 INFO:teuthology.orchestra.run.smithi088.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2445-gd2c45d97-1jammy [6,775 kB] 2024-04-24T23:34:20.972 INFO:teuthology.orchestra.run.smithi057.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-24T23:34:21.055 INFO:teuthology.orchestra.run.smithi057.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-24T23:34:21.074 INFO:teuthology.orchestra.run.smithi057.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-24T23:34:21.137 INFO:teuthology.orchestra.run.smithi057.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-24T23:34:21.174 INFO:teuthology.orchestra.run.smithi057.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-24T23:34:21.194 INFO:teuthology.orchestra.run.smithi057.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-24T23:34:21.220 INFO:teuthology.orchestra.run.smithi057.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-24T23:34:21.403 INFO:teuthology.orchestra.run.smithi057.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-24T23:34:21.419 INFO:teuthology.orchestra.run.smithi057.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-24T23:34:21.495 INFO:teuthology.orchestra.run.smithi057.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-24T23:34:21.495 INFO:teuthology.orchestra.run.smithi057.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-24T23:34:21.497 INFO:teuthology.orchestra.run.smithi057.stdout:Get:46 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2445-gd2c45d97-1jammy [5,084 kB] 2024-04-24T23:34:21.628 INFO:teuthology.orchestra.run.smithi088.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2445-gd2c45d97-1jammy [112 kB] 2024-04-24T23:34:21.642 INFO:teuthology.orchestra.run.smithi088.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2445-gd2c45d97-1jammy [466 kB] 2024-04-24T23:34:21.705 INFO:teuthology.orchestra.run.smithi088.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2445-gd2c45d97-1jammy [25.6 MB] 2024-04-24T23:34:21.732 INFO:teuthology.orchestra.run.smithi057.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-24T23:34:21.793 INFO:teuthology.orchestra.run.smithi057.stdout:Get:48 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2445-gd2c45d97-1jammy [244 kB] 2024-04-24T23:34:21.810 INFO:teuthology.orchestra.run.smithi057.stdout:Get:49 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2445-gd2c45d97-1jammy [124 kB] 2024-04-24T23:34:21.814 INFO:teuthology.orchestra.run.smithi057.stdout:Get:50 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2445-gd2c45d97-1jammy [1,525 kB] 2024-04-24T23:34:21.815 INFO:teuthology.orchestra.run.smithi057.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-24T23:34:21.830 INFO:teuthology.orchestra.run.smithi057.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-24T23:34:21.900 INFO:teuthology.orchestra.run.smithi057.stdout:Get:53 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2445-gd2c45d97-1jammy [6,245 kB] 2024-04-24T23:34:22.018 INFO:teuthology.orchestra.run.smithi057.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-24T23:34:22.032 INFO:teuthology.orchestra.run.smithi116.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2445-gd2c45d97-1jammy [3,218 kB] 2024-04-24T23:34:22.070 INFO:teuthology.orchestra.run.smithi057.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-24T23:34:22.083 INFO:teuthology.orchestra.run.smithi057.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-24T23:34:22.105 INFO:teuthology.orchestra.run.smithi174.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2445-gd2c45d97-1jammy [3,218 kB] 2024-04-24T23:34:22.241 INFO:teuthology.orchestra.run.smithi057.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-24T23:34:22.241 INFO:teuthology.orchestra.run.smithi057.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-24T23:34:22.246 INFO:teuthology.orchestra.run.smithi057.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-24T23:34:22.251 INFO:teuthology.orchestra.run.smithi057.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-24T23:34:22.257 INFO:teuthology.orchestra.run.smithi057.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2445-gd2c45d97-1jammy [22.7 MB] 2024-04-24T23:34:22.265 INFO:teuthology.orchestra.run.smithi057.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-24T23:34:22.452 INFO:teuthology.orchestra.run.smithi057.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-24T23:34:22.716 INFO:teuthology.orchestra.run.smithi057.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-24T23:34:22.832 INFO:teuthology.orchestra.run.smithi057.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-24T23:34:22.876 INFO:teuthology.orchestra.run.smithi057.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-24T23:34:22.974 INFO:teuthology.orchestra.run.smithi057.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-24T23:34:22.993 INFO:teuthology.orchestra.run.smithi057.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-24T23:34:23.133 INFO:teuthology.orchestra.run.smithi057.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-24T23:34:23.515 INFO:teuthology.orchestra.run.smithi057.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-24T23:34:23.647 INFO:teuthology.orchestra.run.smithi057.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2445-gd2c45d97-1jammy [14.0 kB] 2024-04-24T23:34:23.648 INFO:teuthology.orchestra.run.smithi057.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [869 kB] 2024-04-24T23:34:23.666 INFO:teuthology.orchestra.run.smithi057.stdout:Get:73 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2445-gd2c45d97-1jammy [2,437 kB] 2024-04-24T23:34:23.775 INFO:teuthology.orchestra.run.smithi057.stdout:Get:74 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2445-gd2c45d97-1jammy [790 kB] 2024-04-24T23:34:23.821 INFO:teuthology.orchestra.run.smithi057.stdout:Get:75 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2445-gd2c45d97-1jammy [147 kB] 2024-04-24T23:34:23.829 INFO:teuthology.orchestra.run.smithi057.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2445-gd2c45d97-1jammy [2,293 kB] 2024-04-24T23:34:23.859 INFO:teuthology.orchestra.run.smithi116.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2445-gd2c45d97-1jammy [711 kB] 2024-04-24T23:34:23.965 INFO:teuthology.orchestra.run.smithi057.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2445-gd2c45d97-1jammy [8,625 kB] 2024-04-24T23:34:24.060 INFO:teuthology.orchestra.run.smithi174.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2445-gd2c45d97-1jammy [711 kB] 2024-04-24T23:34:24.272 INFO:teuthology.orchestra.run.smithi116.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2445-gd2c45d97-1jammy [356 kB] 2024-04-24T23:34:24.366 INFO:teuthology.orchestra.run.smithi088.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2445-gd2c45d97-1jammy [5,084 kB] 2024-04-24T23:34:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:Get:78 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2445-gd2c45d97-1jammy [14.2 kB] 2024-04-24T23:34:24.501 INFO:teuthology.orchestra.run.smithi057.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2445-gd2c45d97-1jammy [50.7 MB] 2024-04-24T23:34:24.509 INFO:teuthology.orchestra.run.smithi116.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2445-gd2c45d97-1jammy [32.8 kB] 2024-04-24T23:34:24.512 INFO:teuthology.orchestra.run.smithi116.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2445-gd2c45d97-1jammy [180 kB] 2024-04-24T23:34:24.528 INFO:teuthology.orchestra.run.smithi174.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2445-gd2c45d97-1jammy [356 kB] 2024-04-24T23:34:24.659 INFO:teuthology.orchestra.run.smithi116.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2445-gd2c45d97-1jammy [65.7 kB] 2024-04-24T23:34:24.664 INFO:teuthology.orchestra.run.smithi116.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2445-gd2c45d97-1jammy [330 kB] 2024-04-24T23:34:24.747 INFO:teuthology.orchestra.run.smithi174.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2445-gd2c45d97-1jammy [32.8 kB] 2024-04-24T23:34:24.748 INFO:teuthology.orchestra.run.smithi174.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2445-gd2c45d97-1jammy [180 kB] 2024-04-24T23:34:24.784 INFO:teuthology.orchestra.run.smithi088.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2445-gd2c45d97-1jammy [244 kB] 2024-04-24T23:34:24.802 INFO:teuthology.orchestra.run.smithi088.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2445-gd2c45d97-1jammy [124 kB] 2024-04-24T23:34:24.809 INFO:teuthology.orchestra.run.smithi088.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2445-gd2c45d97-1jammy [1,525 kB] 2024-04-24T23:34:24.887 INFO:teuthology.orchestra.run.smithi116.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2445-gd2c45d97-1jammy [6,775 kB] 2024-04-24T23:34:24.899 INFO:teuthology.orchestra.run.smithi174.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2445-gd2c45d97-1jammy [65.7 kB] 2024-04-24T23:34:24.903 INFO:teuthology.orchestra.run.smithi174.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2445-gd2c45d97-1jammy [330 kB] 2024-04-24T23:34:24.959 INFO:teuthology.orchestra.run.smithi088.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2445-gd2c45d97-1jammy [6,245 kB] 2024-04-24T23:34:25.133 INFO:teuthology.orchestra.run.smithi174.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2445-gd2c45d97-1jammy [6,775 kB] 2024-04-24T23:34:25.563 INFO:teuthology.orchestra.run.smithi088.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2445-gd2c45d97-1jammy [22.7 MB] 2024-04-24T23:34:27.000 INFO:teuthology.orchestra.run.smithi057.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-24T23:34:27.041 INFO:teuthology.orchestra.run.smithi057.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-24T23:34:27.168 INFO:teuthology.orchestra.run.smithi057.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-24T23:34:27.336 INFO:teuthology.orchestra.run.smithi057.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-24T23:34:27.698 INFO:teuthology.orchestra.run.smithi057.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-24T23:34:27.763 INFO:teuthology.orchestra.run.smithi057.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2445-gd2c45d97-1jammy [121 kB] 2024-04-24T23:34:27.765 INFO:teuthology.orchestra.run.smithi057.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-2445-gd2c45d97-1jammy [229 kB] 2024-04-24T23:34:27.770 INFO:teuthology.orchestra.run.smithi057.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-2445-gd2c45d97-1jammy [34.0 kB] 2024-04-24T23:34:27.771 INFO:teuthology.orchestra.run.smithi057.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-2445-gd2c45d97-1jammy [23.4 kB] 2024-04-24T23:34:27.772 INFO:teuthology.orchestra.run.smithi057.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2445-gd2c45d97-1jammy [38.9 kB] 2024-04-24T23:34:27.773 INFO:teuthology.orchestra.run.smithi057.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2445-gd2c45d97-1jammy [13.4 MB] 2024-04-24T23:34:27.825 INFO:teuthology.orchestra.run.smithi088.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2445-gd2c45d97-1jammy [14.0 kB] 2024-04-24T23:34:27.826 INFO:teuthology.orchestra.run.smithi088.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [869 kB] 2024-04-24T23:34:27.843 INFO:teuthology.orchestra.run.smithi088.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2445-gd2c45d97-1jammy [2,437 kB] 2024-04-24T23:34:28.038 INFO:teuthology.orchestra.run.smithi088.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2445-gd2c45d97-1jammy [790 kB] 2024-04-24T23:34:28.094 INFO:teuthology.orchestra.run.smithi057.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-24T23:34:28.104 INFO:teuthology.orchestra.run.smithi057.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-24T23:34:28.105 INFO:teuthology.orchestra.run.smithi057.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-24T23:34:28.127 INFO:teuthology.orchestra.run.smithi088.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2445-gd2c45d97-1jammy [147 kB] 2024-04-24T23:34:28.150 INFO:teuthology.orchestra.run.smithi088.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2445-gd2c45d97-1jammy [2,293 kB] 2024-04-24T23:34:28.173 INFO:teuthology.orchestra.run.smithi057.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-24T23:34:28.174 INFO:teuthology.orchestra.run.smithi057.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-24T23:34:28.176 INFO:teuthology.orchestra.run.smithi057.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-24T23:34:28.177 INFO:teuthology.orchestra.run.smithi057.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-24T23:34:28.178 INFO:teuthology.orchestra.run.smithi057.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-24T23:34:28.344 INFO:teuthology.orchestra.run.smithi057.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-24T23:34:28.368 INFO:teuthology.orchestra.run.smithi088.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2445-gd2c45d97-1jammy [8,625 kB] 2024-04-24T23:34:28.448 INFO:teuthology.orchestra.run.smithi057.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [91.2 kB] 2024-04-24T23:34:28.448 INFO:teuthology.orchestra.run.smithi057.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-24T23:34:28.465 INFO:teuthology.orchestra.run.smithi116.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2445-gd2c45d97-1jammy [112 kB] 2024-04-24T23:34:28.472 INFO:teuthology.orchestra.run.smithi116.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2445-gd2c45d97-1jammy [466 kB] 2024-04-24T23:34:28.528 INFO:teuthology.orchestra.run.smithi057.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-24T23:34:28.620 INFO:teuthology.orchestra.run.smithi116.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2445-gd2c45d97-1jammy [25.6 MB] 2024-04-24T23:34:28.658 INFO:teuthology.orchestra.run.smithi174.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2445-gd2c45d97-1jammy [112 kB] 2024-04-24T23:34:28.698 INFO:teuthology.orchestra.run.smithi174.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2445-gd2c45d97-1jammy [466 kB] 2024-04-24T23:34:28.825 INFO:teuthology.orchestra.run.smithi174.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2445-gd2c45d97-1jammy [25.6 MB] 2024-04-24T23:34:28.904 INFO:teuthology.orchestra.run.smithi088.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2445-gd2c45d97-1jammy [14.2 kB] 2024-04-24T23:34:28.904 INFO:teuthology.orchestra.run.smithi088.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2445-gd2c45d97-1jammy [50.7 MB] 2024-04-24T23:34:29.057 INFO:teuthology.orchestra.run.smithi057.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-24T23:34:29.375 INFO:teuthology.orchestra.run.smithi057.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-24T23:34:29.624 INFO:teuthology.orchestra.run.smithi057.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-24T23:34:29.707 INFO:teuthology.orchestra.run.smithi057.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-24T23:34:30.298 INFO:teuthology.orchestra.run.smithi057.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-24T23:34:30.816 INFO:teuthology.orchestra.run.smithi057.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-24T23:34:30.841 INFO:teuthology.orchestra.run.smithi057.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-24T23:34:30.998 INFO:teuthology.orchestra.run.smithi057.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-24T23:34:31.203 INFO:teuthology.orchestra.run.smithi057.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-24T23:34:31.909 INFO:teuthology.orchestra.run.smithi057.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-24T23:34:31.920 INFO:teuthology.orchestra.run.smithi057.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-24T23:34:32.220 INFO:teuthology.orchestra.run.smithi057.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-24T23:34:32.222 INFO:teuthology.orchestra.run.smithi057.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-24T23:34:32.344 INFO:teuthology.orchestra.run.smithi057.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-24T23:34:32.378 INFO:teuthology.orchestra.run.smithi057.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-24T23:34:32.544 INFO:teuthology.orchestra.run.smithi057.stdout:Get:118 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-24T23:34:32.577 INFO:teuthology.orchestra.run.smithi057.stdout:Get:119 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-24T23:34:33.195 INFO:teuthology.orchestra.run.smithi057.stdout:Get:120 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-24T23:34:33.203 INFO:teuthology.orchestra.run.smithi057.stdout:Get:121 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-24T23:34:33.373 INFO:teuthology.orchestra.run.smithi057.stdout:Get:122 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-24T23:34:33.817 INFO:teuthology.orchestra.run.smithi057.stdout:Get:123 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-24T23:34:33.837 INFO:teuthology.orchestra.run.smithi057.stdout:Get:124 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-24T23:34:34.786 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 180 MB in 15s (12.0 MB/s) 2024-04-24T23:34:34.906 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-24T23:34:34.952 INFO:teuthology.orchestra.run.smithi088.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2445-gd2c45d97-1jammy [121 kB] 2024-04-24T23:34:34.955 INFO:teuthology.orchestra.run.smithi088.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-2445-gd2c45d97-1jammy [229 kB] 2024-04-24T23:34:34.959 INFO:teuthology.orchestra.run.smithi088.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-2445-gd2c45d97-1jammy [34.0 kB] 2024-04-24T23:34:34.960 INFO:teuthology.orchestra.run.smithi088.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-2445-gd2c45d97-1jammy [23.4 kB] 2024-04-24T23:34:34.961 INFO:teuthology.orchestra.run.smithi088.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2445-gd2c45d97-1jammy [38.9 kB] 2024-04-24T23:34:34.962 INFO:teuthology.orchestra.run.smithi088.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2445-gd2c45d97-1jammy [13.4 MB] 2024-04-24T23:34:34.980 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-24T23:34:34.985 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-24T23:34:35.021 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-24T23:34:35.282 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-24T23:34:35.308 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-24T23:34:35.357 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-24T23:34:35.676 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cmd2. 2024-04-24T23:34:35.703 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-24T23:34:35.743 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-24T23:34:36.096 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-24T23:34:36.122 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-24T23:34:36.177 INFO:teuthology.orchestra.run.smithi116.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2445-gd2c45d97-1jammy [5,084 kB] 2024-04-24T23:34:36.204 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-24T23:34:36.566 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-24T23:34:36.592 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-24T23:34:36.632 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-24T23:34:36.927 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-24T23:34:36.953 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-24T23:34:36.985 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-24T23:34:37.423 INFO:teuthology.orchestra.run.smithi088.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [91.2 kB] 2024-04-24T23:34:37.438 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-24T23:34:37.465 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-24T23:34:37.513 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T23:34:37.754 INFO:teuthology.orchestra.run.smithi116.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2445-gd2c45d97-1jammy [244 kB] 2024-04-24T23:34:37.815 INFO:teuthology.orchestra.run.smithi174.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2445-gd2c45d97-1jammy [5,084 kB] 2024-04-24T23:34:37.815 INFO:teuthology.orchestra.run.smithi116.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2445-gd2c45d97-1jammy [124 kB] 2024-04-24T23:34:37.819 INFO:teuthology.orchestra.run.smithi116.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2445-gd2c45d97-1jammy [1,525 kB] 2024-04-24T23:34:37.925 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-24T23:34:37.952 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-24T23:34:37.983 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T23:34:38.032 INFO:teuthology.orchestra.run.smithi088.stdout:Fetched 180 MB in 18s (9,749 kB/s) 2024-04-24T23:34:38.174 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-24T23:34:38.266 INFO:teuthology.orchestra.run.smithi088.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-24T23:34:38.271 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-24T23:34:38.314 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-24T23:34:38.328 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-24T23:34:38.355 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-24T23:34:38.394 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T23:34:38.403 INFO:teuthology.orchestra.run.smithi116.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2445-gd2c45d97-1jammy [6,245 kB] 2024-04-24T23:34:38.583 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-24T23:34:38.609 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-24T23:34:38.642 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-24T23:34:38.747 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-24T23:34:38.774 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-24T23:34:38.813 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-24T23:34:38.944 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-cmd2. 2024-04-24T23:34:38.970 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-24T23:34:39.019 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-24T23:34:39.142 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package librados2. 2024-04-24T23:34:39.169 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../010-librados2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:34:39.208 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:34:39.389 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-24T23:34:39.415 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-24T23:34:39.497 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-24T23:34:39.610 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package librbd1. 2024-04-24T23:34:39.627 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../011-librbd1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:34:39.629 INFO:teuthology.orchestra.run.smithi174.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2445-gd2c45d97-1jammy [244 kB] 2024-04-24T23:34:39.669 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:34:39.738 INFO:teuthology.orchestra.run.smithi174.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2445-gd2c45d97-1jammy [124 kB] 2024-04-24T23:34:39.786 INFO:teuthology.orchestra.run.smithi174.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2445-gd2c45d97-1jammy [1,525 kB] 2024-04-24T23:34:39.843 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-24T23:34:39.869 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-24T23:34:39.909 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-24T23:34:40.113 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libcephfs2. 2024-04-24T23:34:40.140 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:34:40.180 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:34:40.229 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-24T23:34:40.255 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-24T23:34:40.283 INFO:teuthology.orchestra.run.smithi116.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2445-gd2c45d97-1jammy [22.7 MB] 2024-04-24T23:34:40.295 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-24T23:34:40.401 INFO:teuthology.orchestra.run.smithi174.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2445-gd2c45d97-1jammy [6,245 kB] 2024-04-24T23:34:40.466 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rados. 2024-04-24T23:34:40.493 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../013-python3-rados_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:34:40.532 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:34:40.749 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-24T23:34:40.775 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-24T23:34:40.826 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T23:34:40.835 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-24T23:34:40.862 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:34:40.902 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:34:41.129 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cephfs. 2024-04-24T23:34:41.145 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:34:41.179 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:34:41.204 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-24T23:34:41.230 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-24T23:34:41.270 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T23:34:41.515 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-24T23:34:41.541 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:34:41.581 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:34:41.623 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-24T23:34:41.650 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-24T23:34:41.690 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T23:34:41.901 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-prettytable. 2024-04-24T23:34:41.928 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-24T23:34:41.968 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-24T23:34:42.060 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-24T23:34:42.086 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-24T23:34:42.126 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-24T23:34:42.237 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rbd. 2024-04-24T23:34:42.263 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:34:42.303 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:34:42.471 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package librados2. 2024-04-24T23:34:42.497 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../010-librados2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:34:42.537 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:34:42.623 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-24T23:34:42.649 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-24T23:34:42.689 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-24T23:34:42.942 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-24T23:34:42.969 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-24T23:34:43.009 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-24T23:34:43.123 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package librbd1. 2024-04-24T23:34:43.149 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../011-librbd1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:34:43.190 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:34:43.311 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-24T23:34:43.328 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-24T23:34:43.370 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-24T23:34:43.621 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libcephfs2. 2024-04-24T23:34:43.644 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:34:43.676 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:34:43.714 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package lua5.1. 2024-04-24T23:34:43.741 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-24T23:34:43.781 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-24T23:34:43.849 INFO:teuthology.orchestra.run.smithi174.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2445-gd2c45d97-1jammy [22.7 MB] 2024-04-24T23:34:43.928 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-rados. 2024-04-24T23:34:43.955 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../013-python3-rados_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:34:43.995 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:34:44.076 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package lua-any. 2024-04-24T23:34:44.102 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-24T23:34:44.134 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-24T23:34:44.315 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-24T23:34:44.341 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:34:44.361 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package zip. 2024-04-24T23:34:44.378 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-24T23:34:44.381 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:34:44.420 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking zip (3.0-12build2) ... 2024-04-24T23:34:44.633 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-cephfs. 2024-04-24T23:34:44.660 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:34:44.700 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:34:44.748 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package unzip. 2024-04-24T23:34:44.774 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-24T23:34:44.814 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-24T23:34:44.986 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-24T23:34:45.012 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:34:45.053 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:34:45.254 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package luarocks. 2024-04-24T23:34:45.279 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-24T23:34:45.318 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-24T23:34:45.364 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-prettytable. 2024-04-24T23:34:45.390 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-24T23:34:45.422 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-24T23:34:45.667 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package librgw2. 2024-04-24T23:34:45.683 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-rbd. 2024-04-24T23:34:45.683 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../027-librgw2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:34:45.698 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:34:45.725 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:34:45.741 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:34:46.095 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-24T23:34:46.121 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-24T23:34:46.161 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-24T23:34:46.253 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rgw. 2024-04-24T23:34:46.269 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:34:46.311 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:34:46.447 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-24T23:34:46.473 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-24T23:34:46.513 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-24T23:34:46.655 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-24T23:34:46.682 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-24T23:34:46.722 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-24T23:34:46.816 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-24T23:34:46.842 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-24T23:34:46.874 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-24T23:34:47.025 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libradosstriper1. 2024-04-24T23:34:47.052 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:34:47.091 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:34:47.220 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package lua5.1. 2024-04-24T23:34:47.245 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-24T23:34:47.286 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-24T23:34:47.445 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-common. 2024-04-24T23:34:47.472 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../031-ceph-common_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:34:47.503 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:34:47.606 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package lua-any. 2024-04-24T23:34:47.632 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-24T23:34:47.672 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-24T23:34:47.908 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package zip. 2024-04-24T23:34:47.923 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-24T23:34:47.958 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking zip (3.0-12build2) ... 2024-04-24T23:34:48.386 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package unzip. 2024-04-24T23:34:48.412 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-24T23:34:48.453 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-24T23:34:48.858 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package luarocks. 2024-04-24T23:34:48.883 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-24T23:34:48.891 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-base. 2024-04-24T23:34:48.918 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../032-ceph-base_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:34:48.923 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-24T23:34:48.959 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:34:49.305 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package librgw2. 2024-04-24T23:34:49.334 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../027-librgw2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:34:49.372 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:34:49.416 INFO:teuthology.orchestra.run.smithi116.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2445-gd2c45d97-1jammy [14.0 kB] 2024-04-24T23:34:49.417 INFO:teuthology.orchestra.run.smithi116.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [869 kB] 2024-04-24T23:34:49.504 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-24T23:34:49.530 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-24T23:34:49.570 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-24T23:34:49.632 INFO:teuthology.orchestra.run.smithi116.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2445-gd2c45d97-1jammy [2,437 kB] 2024-04-24T23:34:49.856 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cheroot. 2024-04-24T23:34:49.883 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-24T23:34:49.899 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-rgw. 2024-04-24T23:34:49.914 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:34:49.922 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-24T23:34:49.949 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:34:50.226 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-24T23:34:50.253 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-24T23:34:50.261 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-24T23:34:50.287 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-24T23:34:50.327 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-24T23:34:50.417 INFO:teuthology.orchestra.run.smithi116.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2445-gd2c45d97-1jammy [790 kB] 2024-04-24T23:34:50.584 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-24T23:34:50.621 INFO:teuthology.orchestra.run.smithi116.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2445-gd2c45d97-1jammy [147 kB] 2024-04-24T23:34:50.689 INFO:teuthology.orchestra.run.smithi116.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2445-gd2c45d97-1jammy [2,293 kB] 2024-04-24T23:34:50.861 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-24T23:34:50.888 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-24T23:34:50.928 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-24T23:34:51.085 INFO:teuthology.orchestra.run.smithi116.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2445-gd2c45d97-1jammy [8,625 kB] 2024-04-24T23:34:51.231 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-24T23:34:51.257 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-24T23:34:51.297 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-24T23:34:51.514 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libradosstriper1. 2024-04-24T23:34:51.540 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:34:51.582 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:34:51.600 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-tempora. 2024-04-24T23:34:51.627 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-24T23:34:51.667 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-24T23:34:51.919 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-portend. 2024-04-24T23:34:51.935 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-24T23:34:51.950 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-common. 2024-04-24T23:34:51.969 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-24T23:34:51.976 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../031-ceph-common_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:34:52.008 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:34:52.280 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-24T23:34:52.307 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-24T23:34:52.664 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-24T23:34:53.022 INFO:teuthology.orchestra.run.smithi116.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2445-gd2c45d97-1jammy [14.2 kB] 2024-04-24T23:34:53.023 INFO:teuthology.orchestra.run.smithi116.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2445-gd2c45d97-1jammy [50.7 MB] 2024-04-24T23:34:53.192 INFO:teuthology.orchestra.run.smithi174.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2445-gd2c45d97-1jammy [14.0 kB] 2024-04-24T23:34:53.263 INFO:teuthology.orchestra.run.smithi174.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [869 kB] 2024-04-24T23:34:53.292 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-24T23:34:53.319 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-24T23:34:53.338 INFO:teuthology.orchestra.run.smithi174.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2445-gd2c45d97-1jammy [2,437 kB] 2024-04-24T23:34:53.355 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-base. 2024-04-24T23:34:53.358 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-24T23:34:53.381 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../032-ceph-base_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:34:53.431 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:34:53.704 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-natsort. 2024-04-24T23:34:53.730 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-24T23:34:53.770 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-24T23:34:53.786 INFO:teuthology.orchestra.run.smithi174.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2445-gd2c45d97-1jammy [790 kB] 2024-04-24T23:34:53.897 INFO:teuthology.orchestra.run.smithi174.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2445-gd2c45d97-1jammy [147 kB] 2024-04-24T23:34:53.931 INFO:teuthology.orchestra.run.smithi174.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2445-gd2c45d97-1jammy [2,293 kB] 2024-04-24T23:34:53.976 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-24T23:34:54.002 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-24T23:34:54.051 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-24T23:34:54.081 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-logutils. 2024-04-24T23:34:54.108 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-24T23:34:54.139 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-24T23:34:54.320 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-cheroot. 2024-04-24T23:34:54.330 INFO:teuthology.orchestra.run.smithi174.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2445-gd2c45d97-1jammy [8,625 kB] 2024-04-24T23:34:54.346 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-24T23:34:54.378 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-24T23:34:54.417 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-24T23:34:54.444 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-24T23:34:54.484 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-24T23:34:54.673 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-24T23:34:54.688 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-24T23:34:54.731 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-24T23:34:54.786 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-mako. 2024-04-24T23:34:54.813 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-24T23:34:54.853 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-24T23:34:55.034 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-24T23:34:55.060 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-24T23:34:55.109 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-24T23:34:55.189 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-24T23:34:55.216 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-24T23:34:55.256 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-24T23:34:55.437 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-24T23:34:55.463 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-24T23:34:55.503 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-24T23:34:55.534 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-24T23:34:55.561 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-24T23:34:55.600 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-24T23:34:55.634 INFO:teuthology.orchestra.run.smithi174.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2445-gd2c45d97-1jammy [14.2 kB] 2024-04-24T23:34:55.635 INFO:teuthology.orchestra.run.smithi174.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2445-gd2c45d97-1jammy [50.7 MB] 2024-04-24T23:34:55.781 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-tempora. 2024-04-24T23:34:55.807 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-24T23:34:55.839 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-24T23:34:55.911 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-webob. 2024-04-24T23:34:55.938 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-24T23:34:55.978 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-24T23:34:56.125 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-portend. 2024-04-24T23:34:56.151 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-24T23:34:56.191 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-24T23:34:56.322 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-waitress. 2024-04-24T23:34:56.349 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-24T23:34:56.392 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-24T23:34:56.453 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-24T23:34:56.468 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-24T23:34:56.511 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-24T23:34:56.709 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-tempita. 2024-04-24T23:34:56.735 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-24T23:34:56.775 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-24T23:34:56.814 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-24T23:34:56.840 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-24T23:34:56.880 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-24T23:34:57.053 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-paste. 2024-04-24T23:34:57.080 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-24T23:34:57.119 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-24T23:34:57.226 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-natsort. 2024-04-24T23:34:57.252 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-24T23:34:57.292 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-24T23:34:57.448 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-24T23:34:57.463 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-24T23:34:57.505 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-24T23:34:57.587 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-logutils. 2024-04-24T23:34:57.613 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-24T23:34:57.653 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-24T23:34:57.792 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-24T23:34:57.818 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-24T23:34:57.866 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-24T23:34:57.964 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-24T23:34:57.991 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-24T23:34:58.031 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-24T23:34:58.128 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-webtest. 2024-04-24T23:34:58.144 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-24T23:34:58.177 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-24T23:34:58.447 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pecan. 2024-04-24T23:34:58.474 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-24T23:34:58.509 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-mako. 2024-04-24T23:34:58.514 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-24T23:34:58.536 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-24T23:34:58.575 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-24T23:34:58.868 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-certifi. 2024-04-24T23:34:58.895 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-24T23:34:58.912 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-24T23:34:58.935 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-24T23:34:58.939 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-24T23:34:58.979 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-24T23:34:59.280 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-idna. 2024-04-24T23:34:59.281 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-24T23:34:59.306 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-24T23:34:59.308 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-24T23:34:59.346 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-24T23:34:59.348 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-24T23:34:59.665 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-urllib3. 2024-04-24T23:34:59.667 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-webob. 2024-04-24T23:34:59.692 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-24T23:34:59.694 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-24T23:34:59.731 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-24T23:34:59.742 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-24T23:35:00.060 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-requests. 2024-04-24T23:35:00.062 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-waitress. 2024-04-24T23:35:00.077 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-24T23:35:00.087 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-24T23:35:00.114 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-24T23:35:00.126 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-24T23:35:00.415 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-tempita. 2024-04-24T23:35:00.438 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-24T23:35:00.441 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-24T23:35:00.464 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-24T23:35:00.481 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-24T23:35:00.504 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-24T23:35:00.774 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-24T23:35:00.784 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-paste. 2024-04-24T23:35:00.789 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:00.810 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-24T23:35:00.832 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:00.859 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-24T23:35:00.886 INFO:teuthology.orchestra.run.smithi116.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2445-gd2c45d97-1jammy [121 kB] 2024-04-24T23:35:00.889 INFO:teuthology.orchestra.run.smithi116.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-2445-gd2c45d97-1jammy [229 kB] 2024-04-24T23:35:00.893 INFO:teuthology.orchestra.run.smithi116.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-2445-gd2c45d97-1jammy [34.0 kB] 2024-04-24T23:35:00.894 INFO:teuthology.orchestra.run.smithi116.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-2445-gd2c45d97-1jammy [23.4 kB] 2024-04-24T23:35:00.895 INFO:teuthology.orchestra.run.smithi116.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2445-gd2c45d97-1jammy [38.9 kB] 2024-04-24T23:35:00.896 INFO:teuthology.orchestra.run.smithi116.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2445-gd2c45d97-1jammy [13.4 MB] 2024-04-24T23:35:01.162 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-24T23:35:01.170 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-24T23:35:01.177 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-24T23:35:01.197 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:01.220 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-24T23:35:01.228 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:01.531 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-24T23:35:01.539 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-24T23:35:01.557 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-24T23:35:01.566 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-24T23:35:01.597 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-24T23:35:01.606 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-24T23:35:01.918 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-webtest. 2024-04-24T23:35:01.926 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-openssl. 2024-04-24T23:35:01.945 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-24T23:35:01.952 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-24T23:35:01.984 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-24T23:35:01.992 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-24T23:35:02.149 INFO:teuthology.orchestra.run.smithi174.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2445-gd2c45d97-1jammy [121 kB] 2024-04-24T23:35:02.153 INFO:teuthology.orchestra.run.smithi174.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-2445-gd2c45d97-1jammy [229 kB] 2024-04-24T23:35:02.158 INFO:teuthology.orchestra.run.smithi174.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-2445-gd2c45d97-1jammy [34.0 kB] 2024-04-24T23:35:02.159 INFO:teuthology.orchestra.run.smithi174.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-2445-gd2c45d97-1jammy [23.4 kB] 2024-04-24T23:35:02.159 INFO:teuthology.orchestra.run.smithi174.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2445-gd2c45d97-1jammy [38.9 kB] 2024-04-24T23:35:02.161 INFO:teuthology.orchestra.run.smithi174.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2445-gd2c45d97-1jammy [13.4 MB] 2024-04-24T23:35:02.254 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pecan. 2024-04-24T23:35:02.269 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-24T23:35:02.295 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr. 2024-04-24T23:35:02.304 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-24T23:35:02.322 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:02.361 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:02.625 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-certifi. 2024-04-24T23:35:02.640 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-24T23:35:02.674 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-24T23:35:02.715 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mon. 2024-04-24T23:35:02.741 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:02.829 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:02.994 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-idna. 2024-04-24T23:35:03.021 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-24T23:35:03.061 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-24T23:35:03.380 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-urllib3. 2024-04-24T23:35:03.407 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-24T23:35:03.435 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-osd. 2024-04-24T23:35:03.447 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-24T23:35:03.462 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:03.501 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:03.707 INFO:teuthology.orchestra.run.smithi174.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [91.2 kB] 2024-04-24T23:35:03.767 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-requests. 2024-04-24T23:35:03.793 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-24T23:35:03.833 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-24T23:35:04.128 INFO:teuthology.orchestra.run.smithi116.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [91.2 kB] 2024-04-24T23:35:04.194 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-24T23:35:04.221 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-24T23:35:04.261 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-24T23:35:04.305 INFO:teuthology.orchestra.run.smithi174.stdout:Fetched 180 MB in 45s (4,031 kB/s) 2024-04-24T23:35:04.417 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-24T23:35:04.473 INFO:teuthology.orchestra.run.smithi174.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-24T23:35:04.478 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-24T23:35:04.516 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-24T23:35:04.545 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph. 2024-04-24T23:35:04.556 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-24T23:35:04.561 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../068-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:04.582 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:04.604 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:04.622 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:04.736 INFO:teuthology.orchestra.run.smithi116.stdout:Fetched 180 MB in 45s (3,997 kB/s) 2024-04-24T23:35:04.760 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-24T23:35:04.786 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-24T23:35:04.827 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-24T23:35:04.871 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-24T23:35:04.923 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-fuse. 2024-04-24T23:35:04.950 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:04.960 INFO:teuthology.orchestra.run.smithi116.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-24T23:35:04.965 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-24T23:35:04.989 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:05.002 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-24T23:35:05.027 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-24T23:35:05.053 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:05.093 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:05.121 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-cmd2. 2024-04-24T23:35:05.148 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-24T23:35:05.187 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-24T23:35:05.297 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-24T23:35:05.318 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mds. 2024-04-24T23:35:05.323 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-24T23:35:05.345 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:05.346 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-24T23:35:05.361 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-24T23:35:05.363 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-24T23:35:05.376 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:05.396 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-24T23:35:05.566 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-24T23:35:05.592 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-24T23:35:05.674 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-24T23:35:05.683 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-cmd2. 2024-04-24T23:35:05.699 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-openssl. 2024-04-24T23:35:05.709 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-24T23:35:05.725 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-24T23:35:05.749 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-24T23:35:05.762 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package cephadm. 2024-04-24T23:35:05.765 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-24T23:35:05.789 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../071-cephadm_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:05.828 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:06.019 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-24T23:35:06.045 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-24T23:35:06.085 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-24T23:35:06.111 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-24T23:35:06.118 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr. 2024-04-24T23:35:06.137 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-24T23:35:06.139 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-24T23:35:06.145 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:06.166 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-24T23:35:06.185 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:06.206 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-24T23:35:06.211 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-24T23:35:06.363 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-24T23:35:06.390 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-24T23:35:06.430 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-24T23:35:06.550 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-24T23:35:06.577 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-24T23:35:06.588 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mon. 2024-04-24T23:35:06.615 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:06.616 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-24T23:35:06.655 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:06.657 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-24T23:35:06.683 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-24T23:35:06.723 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-24T23:35:06.859 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-24T23:35:06.885 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-24T23:35:06.933 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T23:35:07.059 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-24T23:35:07.085 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-24T23:35:07.126 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-24T23:35:07.328 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-24T23:35:07.355 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-24T23:35:07.358 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-osd. 2024-04-24T23:35:07.385 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:07.394 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T23:35:07.424 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:07.546 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-24T23:35:07.572 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-24T23:35:07.620 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T23:35:07.697 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-24T23:35:07.724 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-24T23:35:07.771 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-babel. 2024-04-24T23:35:07.789 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T23:35:07.799 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-24T23:35:07.829 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-24T23:35:08.007 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-24T23:35:08.033 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-24T23:35:08.074 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T23:35:08.116 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-jinja2. 2024-04-24T23:35:08.134 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-24T23:35:08.143 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-24T23:35:08.160 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-24T23:35:08.182 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-24T23:35:08.200 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-24T23:35:08.436 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-24T23:35:08.462 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-24T23:35:08.494 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph. 2024-04-24T23:35:08.502 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T23:35:08.510 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../068-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:08.520 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package librados2. 2024-04-24T23:35:08.536 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-24T23:35:08.546 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../010-librados2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:08.552 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:08.563 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:08.586 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:08.602 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:08.830 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-24T23:35:08.856 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-24T23:35:08.888 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-24T23:35:08.897 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-24T23:35:08.924 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-24T23:35:08.963 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-24T23:35:09.005 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-fuse. 2024-04-24T23:35:09.031 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:09.071 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:09.208 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package librados2. 2024-04-24T23:35:09.214 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package librbd1. 2024-04-24T23:35:09.234 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../010-librados2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:09.241 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../011-librbd1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:09.266 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-routes. 2024-04-24T23:35:09.274 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:09.280 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:09.293 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-24T23:35:09.332 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-24T23:35:09.449 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mds. 2024-04-24T23:35:09.475 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:09.516 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:09.662 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-24T23:35:09.683 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libcephfs2. 2024-04-24T23:35:09.690 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:09.710 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:09.719 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package librbd1. 2024-04-24T23:35:09.729 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:09.745 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../011-librbd1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:09.749 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:09.785 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:09.894 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package cephadm. 2024-04-24T23:35:09.909 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../071-cephadm_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:09.943 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:10.027 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-rados. 2024-04-24T23:35:10.043 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../013-python3-rados_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:10.085 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:10.196 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libcephfs2. 2024-04-24T23:35:10.211 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:10.246 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:10.255 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-24T23:35:10.281 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-24T23:35:10.321 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-24T23:35:10.405 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-24T23:35:10.431 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:10.471 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:10.507 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-rados. 2024-04-24T23:35:10.522 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../013-python3-rados_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:10.565 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:10.640 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-24T23:35:10.655 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-24T23:35:10.698 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-24T23:35:10.723 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-cephfs. 2024-04-24T23:35:10.750 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:10.798 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:10.893 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-24T23:35:10.919 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:10.959 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:11.076 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-24T23:35:11.103 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:11.134 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:11.167 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-24T23:35:11.195 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-24T23:35:11.195 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-cephfs. 2024-04-24T23:35:11.210 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:11.233 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-24T23:35:11.254 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:11.454 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-prettytable. 2024-04-24T23:35:11.481 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-24T23:35:11.520 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-24T23:35:11.556 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-24T23:35:11.571 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:11.606 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:11.737 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-babel. 2024-04-24T23:35:11.737 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-joblib. 2024-04-24T23:35:11.753 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-24T23:35:11.765 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-24T23:35:11.773 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-rbd. 2024-04-24T23:35:11.786 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-24T23:35:11.788 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:11.803 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-24T23:35:11.831 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:11.892 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-prettytable. 2024-04-24T23:35:11.919 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-24T23:35:11.951 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-24T23:35:12.064 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-jinja2. 2024-04-24T23:35:12.091 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-24T23:35:12.140 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-24T23:35:12.168 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-24T23:35:12.176 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-24T23:35:12.181 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-24T23:35:12.202 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-24T23:35:12.213 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-rbd. 2024-04-24T23:35:12.238 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:12.242 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-24T23:35:12.278 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:12.292 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-24T23:35:12.494 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-24T23:35:12.509 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-24T23:35:12.510 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-24T23:35:12.536 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:12.553 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-24T23:35:12.567 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:12.581 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-24T23:35:12.603 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-sklearn. 2024-04-24T23:35:12.607 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-24T23:35:12.631 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-24T23:35:12.639 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-24T23:35:12.670 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-24T23:35:12.830 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-24T23:35:12.846 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-24T23:35:12.883 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-24T23:35:12.889 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-24T23:35:12.899 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-24T23:35:12.904 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-24T23:35:12.930 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-24T23:35:12.942 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-24T23:35:12.962 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-24T23:35:13.201 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package lua5.1. 2024-04-24T23:35:13.227 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-24T23:35:13.237 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-24T23:35:13.252 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-24T23:35:13.264 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-routes. 2024-04-24T23:35:13.267 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-24T23:35:13.291 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-24T23:35:13.295 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-24T23:35:13.331 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-24T23:35:13.445 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-24T23:35:13.473 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:13.511 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:13.578 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package lua-any. 2024-04-24T23:35:13.605 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-24T23:35:13.623 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package lua5.1. 2024-04-24T23:35:13.645 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-24T23:35:13.649 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-24T23:35:13.651 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-24T23:35:13.678 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:13.689 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-24T23:35:13.717 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:13.889 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package zip. 2024-04-24T23:35:13.915 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-24T23:35:13.955 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking zip (3.0-12build2) ... 2024-04-24T23:35:13.992 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package lua-any. 2024-04-24T23:35:14.007 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-24T23:35:14.050 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-24T23:35:14.312 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package zip. 2024-04-24T23:35:14.327 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-24T23:35:14.370 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking zip (3.0-12build2) ... 2024-04-24T23:35:14.375 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package unzip. 2024-04-24T23:35:14.402 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-24T23:35:14.442 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-24T23:35:14.465 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cachetools. 2024-04-24T23:35:14.492 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-24T23:35:14.523 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-24T23:35:14.673 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package unzip. 2024-04-24T23:35:14.699 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-24T23:35:14.739 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-24T23:35:14.792 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-24T23:35:14.812 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package luarocks. 2024-04-24T23:35:14.820 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-24T23:35:14.839 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-24T23:35:14.858 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-24T23:35:14.878 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-24T23:35:15.093 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package luarocks. 2024-04-24T23:35:15.106 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-24T23:35:15.119 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-24T23:35:15.122 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-24T23:35:15.151 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-24T23:35:15.164 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-24T23:35:15.187 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-24T23:35:15.215 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-24T23:35:15.253 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-24T23:35:15.286 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package librgw2. 2024-04-24T23:35:15.313 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../027-librgw2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:15.353 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:15.492 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package librgw2. 2024-04-24T23:35:15.519 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../027-librgw2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:15.559 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:15.565 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rsa. 2024-04-24T23:35:15.592 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-24T23:35:15.617 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-joblib. 2024-04-24T23:35:15.631 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-24T23:35:15.645 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-24T23:35:15.675 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-24T23:35:15.888 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-rgw. 2024-04-24T23:35:15.915 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:15.951 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-google-auth. 2024-04-24T23:35:15.955 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:15.979 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-24T23:35:16.018 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-24T23:35:16.021 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-24T23:35:16.048 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-24T23:35:16.094 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-rgw. 2024-04-24T23:35:16.110 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:16.153 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:16.172 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-24T23:35:16.258 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-24T23:35:16.284 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-24T23:35:16.296 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-24T23:35:16.324 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-24T23:35:16.324 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-24T23:35:16.362 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-24T23:35:16.484 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-sklearn. 2024-04-24T23:35:16.489 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-24T23:35:16.510 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-24T23:35:16.516 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-24T23:35:16.556 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-24T23:35:16.558 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-24T23:35:16.577 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libradosstriper1. 2024-04-24T23:35:16.599 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-websocket. 2024-04-24T23:35:16.604 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:16.627 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-24T23:35:16.644 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:16.657 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-24T23:35:16.875 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libradosstriper1. 2024-04-24T23:35:16.902 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:16.942 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:16.968 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-24T23:35:16.996 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-24T23:35:17.035 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-24T23:35:17.064 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-common. 2024-04-24T23:35:17.090 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../031-ceph-common_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:17.130 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:17.329 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-common. 2024-04-24T23:35:17.351 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-24T23:35:17.355 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../031-ceph-common_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:17.378 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:17.386 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:17.417 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:17.740 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-24T23:35:17.757 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:17.798 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:18.068 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-24T23:35:18.095 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-24T23:35:18.126 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-24T23:35:18.354 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-cachetools. 2024-04-24T23:35:18.380 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-24T23:35:18.420 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-24T23:35:18.462 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-24T23:35:18.490 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-24T23:35:18.529 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-24T23:35:18.543 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-base. 2024-04-24T23:35:18.570 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../032-ceph-base_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:18.620 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:18.723 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-24T23:35:18.750 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-24T23:35:18.758 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-base. 2024-04-24T23:35:18.773 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package jq. 2024-04-24T23:35:18.785 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../032-ceph-base_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:18.789 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-24T23:35:18.801 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-24T23:35:18.831 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-24T23:35:18.834 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:19.050 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package socat. 2024-04-24T23:35:19.067 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-24T23:35:19.108 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-24T23:35:19.128 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-24T23:35:19.155 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-24T23:35:19.194 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-24T23:35:19.197 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-24T23:35:19.224 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-24T23:35:19.299 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-24T23:35:19.412 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package xmlstarlet. 2024-04-24T23:35:19.421 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-24T23:35:19.428 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-24T23:35:19.448 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-24T23:35:19.470 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-24T23:35:19.480 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-rsa. 2024-04-24T23:35:19.487 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-24T23:35:19.508 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-24T23:35:19.547 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-24T23:35:19.642 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-cheroot. 2024-04-24T23:35:19.668 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-24T23:35:19.708 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-24T23:35:19.790 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-cheroot. 2024-04-24T23:35:19.817 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-24T23:35:19.832 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-test. 2024-04-24T23:35:19.842 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-google-auth. 2024-04-24T23:35:19.849 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../099-ceph-test_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:19.857 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-24T23:35:19.869 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-24T23:35:19.882 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:19.909 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-24T23:35:19.986 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-24T23:35:20.001 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-24T23:35:20.036 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-24T23:35:20.202 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-24T23:35:20.228 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-24T23:35:20.237 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-24T23:35:20.264 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-24T23:35:20.268 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-24T23:35:20.303 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-24T23:35:20.322 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-24T23:35:20.349 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-24T23:35:20.388 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-24T23:35:20.563 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-24T23:35:20.589 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-24T23:35:20.615 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-websocket. 2024-04-24T23:35:20.629 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-24T23:35:20.642 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-24T23:35:20.681 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-24T23:35:20.692 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-24T23:35:20.718 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-24T23:35:20.758 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-24T23:35:20.932 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-24T23:35:20.958 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-24T23:35:20.993 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-24T23:35:20.998 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-24T23:35:21.020 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-24T23:35:21.044 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-tempora. 2024-04-24T23:35:21.059 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-24T23:35:21.070 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-24T23:35:21.111 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-24T23:35:21.260 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-tempora. 2024-04-24T23:35:21.286 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-24T23:35:21.318 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-24T23:35:21.413 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-portend. 2024-04-24T23:35:21.440 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-24T23:35:21.480 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-24T23:35:21.614 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-portend. 2024-04-24T23:35:21.641 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-24T23:35:21.681 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-24T23:35:21.757 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-24T23:35:21.765 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-24T23:35:21.773 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-24T23:35:21.781 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:21.807 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-24T23:35:21.814 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:21.984 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-24T23:35:22.010 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-24T23:35:22.050 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-24T23:35:22.076 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-24T23:35:22.103 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-24T23:35:22.134 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-24T23:35:22.135 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-24T23:35:22.162 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-24T23:35:22.169 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-volume. 2024-04-24T23:35:22.197 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:22.202 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-24T23:35:22.236 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:22.311 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-24T23:35:22.326 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-24T23:35:22.361 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-24T23:35:22.487 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-24T23:35:22.514 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-24T23:35:22.522 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-natsort. 2024-04-24T23:35:22.549 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-24T23:35:22.553 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-24T23:35:22.565 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-24T23:35:22.581 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:22.588 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-24T23:35:22.615 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking cephfs-mirror (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:22.715 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-natsort. 2024-04-24T23:35:22.741 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-24T23:35:22.781 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-24T23:35:22.822 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package jq. 2024-04-24T23:35:22.838 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-24T23:35:22.875 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-logutils. 2024-04-24T23:35:22.881 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-24T23:35:22.902 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-24T23:35:22.926 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-colorama. 2024-04-24T23:35:22.942 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-24T23:35:22.954 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-24T23:35:22.992 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-24T23:35:23.068 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-logutils. 2024-04-24T23:35:23.094 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-24T23:35:23.125 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package socat. 2024-04-24T23:35:23.134 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-24T23:35:23.152 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-24T23:35:23.191 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-24T23:35:23.253 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package cephfs-shell. 2024-04-24T23:35:23.281 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:23.311 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-24T23:35:23.320 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking cephfs-shell (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:23.337 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-24T23:35:23.377 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-24T23:35:23.387 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-24T23:35:23.413 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-24T23:35:23.453 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-24T23:35:23.503 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package xmlstarlet. 2024-04-24T23:35:23.519 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-24T23:35:23.561 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-24T23:35:23.589 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package cephfs-top. 2024-04-24T23:35:23.617 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:23.655 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking cephfs-top (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:23.680 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-mako. 2024-04-24T23:35:23.706 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-24T23:35:23.746 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-24T23:35:23.765 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-mako. 2024-04-24T23:35:23.791 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-24T23:35:23.831 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-24T23:35:23.891 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-24T23:35:23.899 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-test. 2024-04-24T23:35:23.908 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:23.915 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../099-ceph-test_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:23.941 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:23.957 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:24.092 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-24T23:35:24.118 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-24T23:35:24.158 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-24T23:35:24.159 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-24T23:35:24.186 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-24T23:35:24.218 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-24T23:35:24.226 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-24T23:35:24.247 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-24T23:35:24.302 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-24T23:35:24.504 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-24T23:35:24.530 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-24T23:35:24.561 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-24T23:35:24.570 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-24T23:35:24.587 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-24T23:35:24.619 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-24T23:35:24.623 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-24T23:35:24.651 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-24T23:35:24.689 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-24T23:35:24.840 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-webob. 2024-04-24T23:35:24.867 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-24T23:35:24.906 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-24T23:35:24.922 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-webob. 2024-04-24T23:35:24.948 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-24T23:35:24.988 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-24T23:35:25.085 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package nvme-cli. 2024-04-24T23:35:25.113 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-24T23:35:25.151 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-24T23:35:25.234 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-waitress. 2024-04-24T23:35:25.261 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-24T23:35:25.305 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-24T23:35:25.341 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-waitress. 2024-04-24T23:35:25.368 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-24T23:35:25.411 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-24T23:35:25.565 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package pkg-config. 2024-04-24T23:35:25.593 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-24T23:35:25.631 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-24T23:35:25.654 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-tempita. 2024-04-24T23:35:25.680 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-24T23:35:25.711 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-tempita. 2024-04-24T23:35:25.720 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-24T23:35:25.737 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-24T23:35:25.777 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-24T23:35:25.892 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-24T23:35:25.920 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-24T23:35:25.958 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-24T23:35:26.022 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-paste. 2024-04-24T23:35:26.032 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-paste. 2024-04-24T23:35:26.048 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-24T23:35:26.058 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-24T23:35:26.088 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-24T23:35:26.098 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-24T23:35:26.261 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-volume. 2024-04-24T23:35:26.289 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:26.327 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:26.366 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-24T23:35:26.381 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-24T23:35:26.395 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-24T23:35:26.416 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-24T23:35:26.423 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-24T23:35:26.426 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-24T23:35:26.442 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-24T23:35:26.462 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-24T23:35:26.484 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-24T23:35:26.707 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-24T23:35:26.722 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pastescript. 2024-04-24T23:35:26.727 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-24T23:35:26.734 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:26.750 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-24T23:35:26.754 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-24T23:35:26.770 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-24T23:35:26.773 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking cephfs-mirror (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:26.781 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-24T23:35:26.794 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-24T23:35:26.797 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-24T23:35:26.837 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-24T23:35:27.042 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pluggy. 2024-04-24T23:35:27.070 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-24T23:35:27.076 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-colorama. 2024-04-24T23:35:27.100 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-24T23:35:27.103 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-24T23:35:27.105 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-webtest. 2024-04-24T23:35:27.123 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-webtest. 2024-04-24T23:35:27.132 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-24T23:35:27.142 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-24T23:35:27.150 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-24T23:35:27.171 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-24T23:35:27.182 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-24T23:35:27.395 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package cephfs-shell. 2024-04-24T23:35:27.410 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:27.411 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-psutil. 2024-04-24T23:35:27.439 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-24T23:35:27.444 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking cephfs-shell (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:27.468 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pecan. 2024-04-24T23:35:27.483 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pecan. 2024-04-24T23:35:27.486 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-24T23:35:27.494 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-24T23:35:27.509 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-24T23:35:27.534 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-24T23:35:27.549 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-24T23:35:27.689 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package cephfs-top. 2024-04-24T23:35:27.716 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:27.755 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking cephfs-top (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:27.798 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-py. 2024-04-24T23:35:27.826 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-24T23:35:27.864 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-24T23:35:27.897 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-certifi. 2024-04-24T23:35:27.904 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-certifi. 2024-04-24T23:35:27.924 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-24T23:35:27.930 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-24T23:35:27.964 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-24T23:35:27.970 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-24T23:35:28.008 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-24T23:35:28.035 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:28.074 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:28.192 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pygments. 2024-04-24T23:35:28.220 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-24T23:35:28.248 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-idna. 2024-04-24T23:35:28.258 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-24T23:35:28.274 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-24T23:35:28.292 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-idna. 2024-04-24T23:35:28.314 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-24T23:35:28.318 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-24T23:35:28.358 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-24T23:35:28.394 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-24T23:35:28.421 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-24T23:35:28.460 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-24T23:35:28.617 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-urllib3. 2024-04-24T23:35:28.627 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-urllib3. 2024-04-24T23:35:28.643 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-24T23:35:28.644 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-24T23:35:28.677 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-24T23:35:28.684 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-24T23:35:28.730 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-24T23:35:28.758 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-24T23:35:28.790 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-24T23:35:28.796 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-24T23:35:28.818 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-24T23:35:28.856 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-24T23:35:28.948 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-requests. 2024-04-24T23:35:28.971 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-requests. 2024-04-24T23:35:28.974 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-24T23:35:28.997 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-24T23:35:29.014 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-24T23:35:29.028 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-24T23:35:29.107 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-toml. 2024-04-24T23:35:29.135 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-24T23:35:29.173 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-24T23:35:29.185 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package nvme-cli. 2024-04-24T23:35:29.212 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-24T23:35:29.251 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-24T23:35:29.331 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-24T23:35:29.334 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-24T23:35:29.358 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-24T23:35:29.360 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-24T23:35:29.398 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-24T23:35:29.400 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-24T23:35:29.451 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pytest. 2024-04-24T23:35:29.479 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-24T23:35:29.517 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-24T23:35:29.662 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-24T23:35:29.673 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package pkg-config. 2024-04-24T23:35:29.677 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:29.701 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-24T23:35:29.701 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-24T23:35:29.711 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:29.717 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:29.739 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-24T23:35:29.751 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:29.879 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-simplejson. 2024-04-24T23:35:29.907 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-24T23:35:29.946 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-24T23:35:29.992 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-24T23:35:30.020 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-24T23:35:30.084 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-24T23:35:30.105 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-24T23:35:30.108 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-24T23:35:30.132 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:30.135 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:30.172 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:30.174 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:30.223 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-24T23:35:30.251 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-24T23:35:30.290 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-24T23:35:30.433 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-24T23:35:30.459 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-24T23:35:30.485 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-24T23:35:30.499 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-24T23:35:30.512 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-24T23:35:30.529 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-24T23:35:30.552 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-24T23:35:30.556 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-24T23:35:30.595 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-24T23:35:30.802 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-openssl. 2024-04-24T23:35:30.829 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-24T23:35:30.869 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-24T23:35:30.898 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pastescript. 2024-04-24T23:35:30.925 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-24T23:35:30.952 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package radosgw. 2024-04-24T23:35:30.972 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-24T23:35:30.980 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../122-radosgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:31.001 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-openssl. 2024-04-24T23:35:31.010 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:31.028 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-24T23:35:31.113 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-24T23:35:31.205 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr. 2024-04-24T23:35:31.232 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:31.271 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:31.293 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pluggy. 2024-04-24T23:35:31.320 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-24T23:35:31.359 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-24T23:35:31.449 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mgr. 2024-04-24T23:35:31.476 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:31.516 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:31.620 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-psutil. 2024-04-24T23:35:31.624 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mon. 2024-04-24T23:35:31.648 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-24T23:35:31.651 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:31.678 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-24T23:35:31.682 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:31.821 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package rbd-fuse. 2024-04-24T23:35:31.850 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:31.888 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:31.902 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mon. 2024-04-24T23:35:31.929 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:31.969 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:32.014 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-py. 2024-04-24T23:35:32.042 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-24T23:35:32.081 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-24T23:35:32.193 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-24T23:35:32.278 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-osd. 2024-04-24T23:35:32.304 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:32.344 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:32.409 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pygments. 2024-04-24T23:35:32.437 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-24T23:35:32.443 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-24T23:35:32.475 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-24T23:35:32.539 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-osd. 2024-04-24T23:35:32.566 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:32.594 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-24T23:35:32.597 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:32.865 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-24T23:35:32.947 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-24T23:35:32.974 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-24T23:35:33.013 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-24T23:35:33.181 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-24T23:35:33.290 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-toml. 2024-04-24T23:35:33.318 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-24T23:35:33.349 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-24T23:35:33.414 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph. 2024-04-24T23:35:33.427 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../068-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:33.455 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:33.564 INFO:teuthology.orchestra.run.smithi057.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-24T23:35:33.593 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pytest. 2024-04-24T23:35:33.609 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-24T23:35:33.646 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:33.650 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph. 2024-04-24T23:35:33.651 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-24T23:35:33.665 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../068-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:33.708 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:33.758 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-fuse. 2024-04-24T23:35:33.774 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:33.816 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:34.005 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-simplejson. 2024-04-24T23:35:34.032 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-24T23:35:34.044 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-fuse. 2024-04-24T23:35:34.071 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:34.071 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-24T23:35:34.111 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:34.162 INFO:teuthology.orchestra.run.smithi057.stdout:Adding system user cephadm....done 2024-04-24T23:35:34.178 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mds. 2024-04-24T23:35:34.204 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:34.244 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:34.332 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-24T23:35:34.352 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-24T23:35:34.360 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-24T23:35:34.424 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-24T23:35:34.489 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mds. 2024-04-24T23:35:34.515 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:34.555 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:34.613 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package cephadm. 2024-04-24T23:35:34.629 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../071-cephadm_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:34.811 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-24T23:35:34.830 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:34.892 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package cephadm. 2024-04-24T23:35:34.907 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../071-cephadm_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:34.941 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:35.083 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-24T23:35:35.089 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-24T23:35:35.109 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-24T23:35:35.128 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package radosgw. 2024-04-24T23:35:35.141 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-24T23:35:35.155 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../122-radosgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:35.186 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:35.207 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-24T23:35:35.261 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-24T23:35:35.287 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-24T23:35:35.327 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-24T23:35:35.420 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-24T23:35:35.436 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-24T23:35:35.449 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-24T23:35:35.470 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-24T23:35:35.622 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-24T23:35:35.648 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-24T23:35:35.679 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-24T23:35:35.709 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-24T23:35:35.835 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-24T23:35:35.997 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package rbd-fuse. 2024-04-24T23:35:36.025 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:36.055 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:36.136 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-24T23:35:36.505 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-24T23:35:36.533 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-babel. 2024-04-24T23:35:36.560 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-24T23:35:36.576 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-24T23:35:36.599 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-24T23:35:36.635 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-babel. 2024-04-24T23:35:36.662 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-24T23:35:36.701 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-24T23:35:36.748 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-24T23:35:36.827 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-24T23:35:36.919 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-jinja2. 2024-04-24T23:35:36.928 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-24T23:35:36.935 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-24T23:35:36.977 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-24T23:35:36.999 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-24T23:35:37.037 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-jinja2. 2024-04-24T23:35:37.064 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-24T23:35:37.104 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-24T23:35:37.188 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-24T23:35:37.275 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-24T23:35:37.339 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-24T23:35:37.366 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:37.405 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:37.474 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-24T23:35:37.501 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:37.505 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-24T23:35:37.518 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-24T23:35:37.540 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:37.742 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-24T23:35:37.769 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-24T23:35:37.778 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-24T23:35:37.808 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-24T23:35:37.860 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-24T23:35:37.887 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-24T23:35:37.926 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-24T23:35:37.951 INFO:teuthology.orchestra.run.smithi088.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-24T23:35:38.021 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:38.054 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-24T23:35:38.111 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-routes. 2024-04-24T23:35:38.138 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-24T23:35:38.177 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-24T23:35:38.212 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-routes. 2024-04-24T23:35:38.240 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-24T23:35:38.279 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-24T23:35:38.396 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:38.531 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-24T23:35:38.537 INFO:teuthology.orchestra.run.smithi088.stdout:Adding system user cephadm....done 2024-04-24T23:35:38.558 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:38.597 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:38.599 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-24T23:35:38.626 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:38.665 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:38.677 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-24T23:35:38.681 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-24T23:35:38.807 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-24T23:35:38.908 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-24T23:35:38.945 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-24T23:35:39.150 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-24T23:35:39.196 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-24T23:35:39.259 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-24T23:35:39.322 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-24T23:35:39.519 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-24T23:35:39.573 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-24T23:35:39.824 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-24T23:35:39.911 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-24T23:35:39.918 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-24T23:35:39.934 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-24T23:35:39.935 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-24T23:35:39.942 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-24T23:35:39.970 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-24T23:35:39.977 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-24T23:35:39.997 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-24T23:35:39.998 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-24T23:35:40.037 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-24T23:35:40.123 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-24T23:35:40.227 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-24T23:35:40.472 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-joblib. 2024-04-24T23:35:40.474 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-24T23:35:40.499 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-24T23:35:40.507 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-joblib. 2024-04-24T23:35:40.530 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-24T23:35:40.534 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-24T23:35:40.565 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-24T23:35:40.596 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-24T23:35:40.600 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-24T23:35:40.855 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-24T23:35:40.858 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-24T23:35:40.876 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-24T23:35:40.886 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-24T23:35:40.952 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-24T23:35:40.979 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-24T23:35:41.002 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-24T23:35:41.104 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-24T23:35:41.114 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-24T23:35:41.152 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-24T23:35:41.322 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-sklearn. 2024-04-24T23:35:41.349 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-24T23:35:41.382 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-sklearn. 2024-04-24T23:35:41.388 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-24T23:35:41.390 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-24T23:35:41.408 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-24T23:35:41.448 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-24T23:35:41.478 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up zip (3.0-12build2) ... 2024-04-24T23:35:41.604 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-24T23:35:41.659 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-24T23:35:41.893 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-24T23:35:42.088 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-24T23:35:42.116 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:42.144 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-24T23:35:42.154 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:42.166 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-24T23:35:42.182 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:42.215 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:42.315 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-24T23:35:42.395 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:42.557 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-24T23:35:42.655 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-24T23:35:42.658 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-24T23:35:42.759 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-24T23:35:42.781 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-24T23:35:42.907 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-24T23:35:43.069 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-24T23:35:43.124 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-cachetools. 2024-04-24T23:35:43.127 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-cachetools. 2024-04-24T23:35:43.152 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-24T23:35:43.154 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-24T23:35:43.166 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-24T23:35:43.191 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-24T23:35:43.193 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-24T23:35:43.275 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-24T23:35:43.452 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-24T23:35:43.461 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-24T23:35:43.467 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-24T23:35:43.496 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-24T23:35:43.510 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-24T23:35:43.518 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-24T23:35:43.523 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-24T23:35:43.563 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-24T23:35:43.721 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-24T23:35:43.822 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-24T23:35:43.838 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-24T23:35:43.871 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-24T23:35:43.878 INFO:teuthology.orchestra.run.smithi088.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-24T23:35:43.907 INFO:teuthology.orchestra.run.smithi088.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-24T23:35:43.916 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-24T23:35:43.944 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-24T23:35:43.971 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-24T23:35:43.983 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-24T23:35:44.097 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-24T23:35:44.098 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-24T23:35:44.107 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-rsa. 2024-04-24T23:35:44.124 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-24T23:35:44.166 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-24T23:35:44.277 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-rsa. 2024-04-24T23:35:44.305 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-24T23:35:44.344 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-24T23:35:44.373 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-24T23:35:44.457 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-24T23:35:44.497 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-google-auth. 2024-04-24T23:35:44.522 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-24T23:35:44.561 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-24T23:35:44.582 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-24T23:35:44.658 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-24T23:35:44.672 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-google-auth. 2024-04-24T23:35:44.700 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-24T23:35:44.739 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-24T23:35:44.850 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-24T23:35:45.009 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-24T23:35:45.017 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-24T23:35:45.036 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-24T23:35:45.045 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-24T23:35:45.063 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-24T23:35:45.075 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-24T23:35:45.101 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-24T23:35:45.131 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-24T23:35:45.268 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-24T23:35:45.394 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up zip (3.0-12build2) ... 2024-04-24T23:35:45.395 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:45.412 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-websocket. 2024-04-24T23:35:45.425 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-websocket. 2024-04-24T23:35:45.439 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-24T23:35:45.453 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-24T23:35:45.478 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-24T23:35:45.492 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-24T23:35:45.520 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-24T23:35:45.721 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-idna (3.3-1) ... 2024-04-24T23:35:45.798 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-24T23:35:45.820 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-24T23:35:45.826 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-24T23:35:45.848 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-24T23:35:45.865 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-24T23:35:45.886 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-24T23:35:46.072 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-24T23:35:46.205 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-24T23:35:46.465 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-24T23:35:46.512 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-24T23:35:46.528 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:46.534 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-24T23:35:46.562 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:46.562 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:46.591 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-24T23:35:46.600 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:46.856 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-24T23:35:46.883 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-24T23:35:46.923 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-24T23:35:46.928 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-24T23:35:46.938 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-24T23:35:46.956 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-24T23:35:46.994 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-24T23:35:47.218 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-24T23:35:47.267 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-24T23:35:47.285 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-24T23:35:47.294 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-24T23:35:47.334 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-24T23:35:47.364 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-24T23:35:47.392 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-24T23:35:47.430 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-24T23:35:47.546 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T23:35:47.594 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package jq. 2024-04-24T23:35:47.610 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-24T23:35:47.612 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-24T23:35:47.644 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-24T23:35:47.671 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-24T23:35:47.683 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package jq. 2024-04-24T23:35:47.711 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-24T23:35:47.749 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-24T23:35:47.855 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package socat. 2024-04-24T23:35:47.861 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-24T23:35:47.871 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-24T23:35:47.905 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-24T23:35:47.931 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-24T23:35:47.993 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package socat. 2024-04-24T23:35:48.009 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-24T23:35:48.043 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-24T23:35:48.048 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-24T23:35:48.149 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-24T23:35:48.184 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package xmlstarlet. 2024-04-24T23:35:48.211 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-24T23:35:48.238 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-24T23:35:48.250 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-24T23:35:48.330 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package xmlstarlet. 2024-04-24T23:35:48.358 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-24T23:35:48.396 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-24T23:35:48.442 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-24T23:35:48.531 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-24T23:35:48.646 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-test. 2024-04-24T23:35:48.661 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../099-ceph-test_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:48.702 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-24T23:35:48.704 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:48.742 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-test. 2024-04-24T23:35:48.759 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../099-ceph-test_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:48.800 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:48.832 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-24T23:35:48.970 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T23:35:49.096 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-24T23:35:49.183 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-24T23:35:49.418 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-24T23:35:49.430 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-24T23:35:49.535 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:49.698 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-24T23:35:49.837 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-idna (3.3-1) ... 2024-04-24T23:35:49.949 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-24T23:35:50.146 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-24T23:35:50.200 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-24T23:35:50.501 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-24T23:35:50.777 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-24T23:35:50.903 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-24T23:35:50.975 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-volume. 2024-04-24T23:35:51.002 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:51.041 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:51.088 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-volume. 2024-04-24T23:35:51.116 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:51.154 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:51.187 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-24T23:35:51.313 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-24T23:35:51.360 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-24T23:35:51.412 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-24T23:35:51.439 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:51.478 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking cephfs-mirror (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:51.533 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-24T23:35:51.561 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:51.600 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking cephfs-mirror (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:51.620 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T23:35:51.623 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-24T23:35:51.754 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-24T23:35:51.756 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-colorama. 2024-04-24T23:35:51.784 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-24T23:35:51.814 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-24T23:35:51.902 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-colorama. 2024-04-24T23:35:51.930 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-24T23:35:51.964 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-24T23:35:51.977 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-24T23:35:52.030 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-24T23:35:52.050 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package cephfs-shell. 2024-04-24T23:35:52.066 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:52.108 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking cephfs-shell (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:52.173 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-24T23:35:52.230 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package cephfs-shell. 2024-04-24T23:35:52.245 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:52.280 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking cephfs-shell (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:52.299 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-24T23:35:52.411 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package cephfs-top. 2024-04-24T23:35:52.439 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:52.477 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking cephfs-top (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:52.532 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package cephfs-top. 2024-04-24T23:35:52.548 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T23:35:52.567 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-24T23:35:52.590 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking cephfs-top (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:52.666 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-24T23:35:52.730 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-24T23:35:52.758 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:52.792 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-24T23:35:52.796 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:52.801 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-24T23:35:52.842 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-24T23:35:52.858 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:52.901 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:52.918 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-24T23:35:53.032 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-24T23:35:53.052 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T23:35:53.091 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-24T23:35:53.118 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-24T23:35:53.157 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-24T23:35:53.178 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-24T23:35:53.229 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-24T23:35:53.257 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-24T23:35:53.261 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-24T23:35:53.295 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-24T23:35:53.388 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-24T23:35:53.445 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-24T23:35:53.461 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-24T23:35:53.480 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-24T23:35:53.495 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-24T23:35:53.633 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-24T23:35:53.660 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-24T23:35:53.699 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-24T23:35:53.739 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-24T23:35:53.781 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-24T23:35:53.866 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package nvme-cli. 2024-04-24T23:35:53.894 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-24T23:35:53.932 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-24T23:35:53.998 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-24T23:35:54.032 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-24T23:35:54.078 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package nvme-cli. 2024-04-24T23:35:54.106 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-24T23:35:54.145 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-24T23:35:54.149 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-24T23:35:54.249 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-24T23:35:54.354 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package pkg-config. 2024-04-24T23:35:54.381 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-24T23:35:54.408 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T23:35:54.420 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-24T23:35:54.492 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-24T23:35:54.534 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-24T23:35:54.558 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package pkg-config. 2024-04-24T23:35:54.586 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-24T23:35:54.624 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-24T23:35:54.673 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-24T23:35:54.689 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-24T23:35:54.731 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-24T23:35:54.743 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-24T23:35:54.869 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-24T23:35:54.877 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-24T23:35:54.885 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-24T23:35:54.913 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-24T23:35:54.952 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-24T23:35:55.145 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-24T23:35:55.159 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-24T23:35:55.180 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-24T23:35:55.187 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-24T23:35:55.226 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-24T23:35:55.271 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-24T23:35:55.448 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-24T23:35:55.495 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pastescript. 2024-04-24T23:35:55.522 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-24T23:35:55.522 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-24T23:35:55.550 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-24T23:35:55.553 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-24T23:35:55.564 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-24T23:35:55.635 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-24T23:35:55.655 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-24T23:35:55.823 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pluggy. 2024-04-24T23:35:55.839 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-24T23:35:55.873 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-24T23:35:55.890 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-24T23:35:55.920 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-24T23:35:55.941 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pastescript. 2024-04-24T23:35:55.969 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-24T23:35:56.007 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-24T23:35:56.116 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-24T23:35:56.196 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-24T23:35:56.226 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-psutil. 2024-04-24T23:35:56.242 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-24T23:35:56.253 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-24T23:35:56.292 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-24T23:35:56.327 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pluggy. 2024-04-24T23:35:56.351 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-24T23:35:56.355 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-24T23:35:56.393 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-24T23:35:56.440 INFO:teuthology.orchestra.run.smithi088.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-24T23:35:56.481 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-24T23:35:56.621 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-py. 2024-04-24T23:35:56.648 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-24T23:35:56.678 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-24T23:35:56.680 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-psutil. 2024-04-24T23:35:56.687 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-24T23:35:56.696 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-24T23:35:56.729 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-24T23:35:56.804 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-24T23:35:56.874 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-24T23:35:57.024 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pygments. 2024-04-24T23:35:57.024 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-py. 2024-04-24T23:35:57.051 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-24T23:35:57.052 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-24T23:35:57.090 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-24T23:35:57.091 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-24T23:35:57.143 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-24T23:35:57.372 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-24T23:35:57.386 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pygments. 2024-04-24T23:35:57.402 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-24T23:35:57.435 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-24T23:35:57.487 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-24T23:35:57.544 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-24T23:35:57.571 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-24T23:35:57.611 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-24T23:35:57.622 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:57.640 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-24T23:35:57.748 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:57.749 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-24T23:35:57.857 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-24T23:35:57.871 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-toml. 2024-04-24T23:35:57.881 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-24T23:35:57.887 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-24T23:35:57.909 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-24T23:35:57.921 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-24T23:35:57.972 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-24T23:35:57.983 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T23:35:58.084 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-24T23:35:58.160 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:58.199 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pytest. 2024-04-24T23:35:58.227 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-24T23:35:58.265 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-24T23:35:58.286 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:58.291 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-toml. 2024-04-24T23:35:58.320 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-24T23:35:58.358 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-24T23:35:58.402 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-24T23:35:58.412 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-24T23:35:58.569 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-simplejson. 2024-04-24T23:35:58.585 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-24T23:35:58.618 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-24T23:35:58.661 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pytest. 2024-04-24T23:35:58.689 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-24T23:35:58.695 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-24T23:35:58.714 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:58.727 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-24T23:35:58.829 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-24T23:35:58.832 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:58.845 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-24T23:35:58.879 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-24T23:35:58.933 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:58.971 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-24T23:35:59.081 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-simplejson. 2024-04-24T23:35:59.109 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-24T23:35:59.147 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-24T23:35:59.148 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-24T23:35:59.148 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-24T23:35:59.182 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-24T23:35:59.416 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-24T23:35:59.432 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-24T23:35:59.433 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-24T23:35:59.474 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-24T23:35:59.594 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package radosgw. 2024-04-24T23:35:59.622 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../122-radosgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:35:59.651 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:59.660 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:59.685 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-24T23:35:59.777 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:59.903 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:35:59.944 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-24T23:36:00.029 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up cephfs-top (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:00.180 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-24T23:36:00.253 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package radosgw. 2024-04-24T23:36:00.281 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../122-radosgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:36:00.320 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:00.329 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-24T23:36:00.438 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package rbd-fuse. 2024-04-24T23:36:00.454 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:36:00.496 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:00.614 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-24T23:36:00.784 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-24T23:36:00.950 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-24T23:36:01.034 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-24T23:36:01.062 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:01.114 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package rbd-fuse. 2024-04-24T23:36:01.131 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T23:36:01.161 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-24T23:36:01.172 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:01.185 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:01.311 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-24T23:36:01.426 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-24T23:36:01.468 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-24T23:36:01.509 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:01.635 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:01.647 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:01.736 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-24T23:36:01.761 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:01.773 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:01.776 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-24T23:36:01.870 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-24T23:36:01.883 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-24T23:36:01.887 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:01.997 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up cephfs-shell (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:02.098 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:02.103 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-24T23:36:02.151 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:02.219 INFO:teuthology.orchestra.run.smithi116.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-24T23:36:02.277 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:02.403 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:02.413 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-24T23:36:02.571 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:02.619 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-24T23:36:02.619 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-24T23:36:02.625 INFO:teuthology.orchestra.run.smithi057.stdout:Adding group ceph....done 2024-04-24T23:36:02.858 INFO:teuthology.orchestra.run.smithi174.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-24T23:36:03.018 INFO:teuthology.orchestra.run.smithi057.stdout:Adding system user ceph....done 2024-04-24T23:36:03.054 INFO:teuthology.orchestra.run.smithi116.stdout:Adding system user cephadm....done 2024-04-24T23:36:03.120 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:03.148 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:03.161 INFO:teuthology.orchestra.run.smithi057.stdout:Setting system user ceph properties....done 2024-04-24T23:36:03.179 INFO:teuthology.orchestra.run.smithi057.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-24T23:36:03.202 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-24T23:36:03.246 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:03.323 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-24T23:36:03.372 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:03.478 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-24T23:36:03.498 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up cephfs-top (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:03.599 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-24T23:36:03.644 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-24T23:36:03.680 INFO:teuthology.orchestra.run.smithi174.stdout:Adding system user cephadm....done 2024-04-24T23:36:03.738 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-24T23:36:03.837 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-24T23:36:03.864 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-24T23:36:04.098 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-24T23:36:04.108 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up cephfs-mirror (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:04.121 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-24T23:36:04.306 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-24T23:36:04.306 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-24T23:36:04.349 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-24T23:36:04.364 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-24T23:36:04.476 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-24T23:36:04.490 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-24T23:36:04.733 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-24T23:36:04.743 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:04.777 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-24T23:36:04.786 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:04.869 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:04.937 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:04.984 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-24T23:36:05.063 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:05.118 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-24T23:36:05.121 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-24T23:36:05.189 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:05.290 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up cephfs-shell (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:05.313 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-24T23:36:05.313 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-24T23:36:05.364 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-24T23:36:05.391 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:05.446 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-24T23:36:05.615 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-24T23:36:05.755 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:05.788 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-24T23:36:05.891 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-24T23:36:05.927 INFO:teuthology.orchestra.run.smithi088.stdout:Adding group ceph....done 2024-04-24T23:36:06.073 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-24T23:36:06.079 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-24T23:36:06.143 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-24T23:36:06.296 INFO:teuthology.orchestra.run.smithi088.stdout:Adding system user ceph....done 2024-04-24T23:36:06.333 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-24T23:36:06.394 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-24T23:36:06.456 INFO:teuthology.orchestra.run.smithi088.stdout:Setting system user ceph properties....done 2024-04-24T23:36:06.467 INFO:teuthology.orchestra.run.smithi088.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-24T23:36:06.542 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:06.583 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-24T23:36:06.610 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-24T23:36:06.695 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-24T23:36:06.827 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-24T23:36:06.837 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-24T23:36:06.837 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-24T23:36:06.934 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-24T23:36:06.963 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:07.078 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-24T23:36:07.197 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-24T23:36:07.307 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-24T23:36:07.352 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:07.379 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-24T23:36:07.433 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-24T23:36:07.452 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up cephfs-mirror (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:07.579 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-24T23:36:07.579 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-24T23:36:07.622 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:07.661 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-24T23:36:07.661 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-24T23:36:07.717 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-24T23:36:07.843 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-24T23:36:07.881 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-24T23:36:08.007 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-24T23:36:08.063 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:08.094 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-24T23:36:08.129 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:08.149 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-24T23:36:08.255 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:08.361 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-24T23:36:08.361 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-24T23:36:08.400 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-24T23:36:08.458 INFO:teuthology.orchestra.run.smithi116.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-24T23:36:08.492 INFO:teuthology.orchestra.run.smithi116.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-24T23:36:08.510 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-24T23:36:08.547 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-24T23:36:08.673 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-24T23:36:08.733 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-24T23:36:08.734 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-24T23:36:08.769 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-24T23:36:08.839 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:08.949 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:09.024 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-24T23:36:09.076 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:09.159 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-24T23:36:09.178 INFO:teuthology.orchestra.run.smithi174.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-24T23:36:09.200 INFO:teuthology.orchestra.run.smithi174.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-24T23:36:09.240 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:09.256 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-24T23:36:09.294 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-24T23:36:09.294 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-24T23:36:09.382 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-24T23:36:09.419 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-24T23:36:09.563 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-24T23:36:09.686 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-24T23:36:09.741 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-24T23:36:09.777 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:09.842 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-24T23:36:09.928 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:09.996 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up zip (3.0-12build2) ... 2024-04-24T23:36:10.054 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:10.058 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:10.093 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-24T23:36:10.097 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-24T23:36:10.205 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:10.277 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-24T23:36:10.277 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-24T23:36:10.361 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-24T23:36:10.542 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-24T23:36:10.645 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-24T23:36:10.845 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-24T23:36:10.845 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:10.847 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-24T23:36:10.847 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up zip (3.0-12build2) ... 2024-04-24T23:36:10.848 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-24T23:36:10.983 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-24T23:36:10.983 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-24T23:36:11.058 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-24T23:36:11.184 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-24T23:36:11.310 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-24T23:36:11.448 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-24T23:36:11.521 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:11.613 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-24T23:36:11.619 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-24T23:36:11.699 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-24T23:36:11.825 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-24T23:36:11.938 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-24T23:36:11.938 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-24T23:36:11.951 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-24T23:36:12.012 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-24T23:36:12.238 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-24T23:36:12.243 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-24T23:36:12.259 INFO:teuthology.orchestra.run.smithi057.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-24T23:36:12.263 DEBUG:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-24T23:36:12.316 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2024-04-24T23:36:12.456 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:12.520 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2024-04-24T23:36:12.521 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2024-04-24T23:36:12.574 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:12.615 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-24T23:36:12.653 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-24T23:36:12.723 INFO:teuthology.orchestra.run.smithi057.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-24T23:36:12.723 INFO:teuthology.orchestra.run.smithi057.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-24T23:36:12.723 INFO:teuthology.orchestra.run.smithi057.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-24T23:36:12.723 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T23:36:12.724 INFO:teuthology.orchestra.run.smithi057.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T23:36:12.724 INFO:teuthology.orchestra.run.smithi057.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T23:36:12.724 INFO:teuthology.orchestra.run.smithi057.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T23:36:12.724 INFO:teuthology.orchestra.run.smithi057.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-24T23:36:12.724 INFO:teuthology.orchestra.run.smithi057.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-24T23:36:12.724 INFO:teuthology.orchestra.run.smithi057.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T23:36:12.724 INFO:teuthology.orchestra.run.smithi057.stdout:The following additional packages will be installed: 2024-04-24T23:36:12.724 INFO:teuthology.orchestra.run.smithi057.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-24T23:36:12.724 INFO:teuthology.orchestra.run.smithi057.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-24T23:36:12.724 INFO:teuthology.orchestra.run.smithi057.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-24T23:36:12.724 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-24T23:36:12.724 INFO:teuthology.orchestra.run.smithi057.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-24T23:36:12.724 INFO:teuthology.orchestra.run.smithi057.stdout:Suggested packages: 2024-04-24T23:36:12.725 INFO:teuthology.orchestra.run.smithi057.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-24T23:36:12.725 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-24T23:36:12.725 INFO:teuthology.orchestra.run.smithi057.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-24T23:36:12.725 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:12.765 INFO:teuthology.orchestra.run.smithi057.stdout:The following NEW packages will be installed: 2024-04-24T23:36:12.765 INFO:teuthology.orchestra.run.smithi057.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-24T23:36:12.765 INFO:teuthology.orchestra.run.smithi057.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-24T23:36:12.766 INFO:teuthology.orchestra.run.smithi057.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-24T23:36:12.766 INFO:teuthology.orchestra.run.smithi057.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-24T23:36:12.766 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-24T23:36:12.767 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-24T23:36:12.767 INFO:teuthology.orchestra.run.smithi057.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-24T23:36:12.767 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages will be upgraded: 2024-04-24T23:36:12.768 INFO:teuthology.orchestra.run.smithi057.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-24T23:36:12.887 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-24T23:36:12.926 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-24T23:36:12.972 INFO:teuthology.orchestra.run.smithi057.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-24T23:36:12.972 INFO:teuthology.orchestra.run.smithi057.stdout:Need to get 55.7 MB of archives. 2024-04-24T23:36:12.972 INFO:teuthology.orchestra.run.smithi057.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-24T23:36:12.972 INFO:teuthology.orchestra.run.smithi057.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-24T23:36:13.098 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-24T23:36:13.099 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-24T23:36:13.251 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-24T23:36:13.264 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-24T23:36:13.557 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-24T23:36:13.602 INFO:teuthology.orchestra.run.smithi057.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-24T23:36:13.604 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:13.619 INFO:teuthology.orchestra.run.smithi057.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-24T23:36:13.619 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-24T23:36:13.744 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-24T23:36:13.745 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-24T23:36:13.746 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-24T23:36:13.747 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:13.775 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-24T23:36:13.776 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-24T23:36:13.780 INFO:teuthology.orchestra.run.smithi057.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-24T23:36:13.783 INFO:teuthology.orchestra.run.smithi057.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-24T23:36:13.784 INFO:teuthology.orchestra.run.smithi057.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-24T23:36:13.848 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:13.849 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-24T23:36:13.870 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-24T23:36:13.950 INFO:teuthology.orchestra.run.smithi057.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-24T23:36:13.988 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:13.991 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:14.193 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-24T23:36:14.245 INFO:teuthology.orchestra.run.smithi057.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-24T23:36:14.254 INFO:teuthology.orchestra.run.smithi057.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-24T23:36:14.259 INFO:teuthology.orchestra.run.smithi057.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-24T23:36:14.264 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-idna (3.3-1) ... 2024-04-24T23:36:14.336 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-24T23:36:14.344 INFO:teuthology.orchestra.run.smithi057.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-24T23:36:14.436 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-24T23:36:14.443 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-24T23:36:14.556 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-24T23:36:14.567 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-24T23:36:14.570 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:14.846 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-idna (3.3-1) ... 2024-04-24T23:36:15.138 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-24T23:36:15.347 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-24T23:36:15.738 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-24T23:36:15.955 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T23:36:16.000 INFO:teuthology.orchestra.run.smithi088.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-24T23:36:16.003 DEBUG:teuthology.orchestra.run.smithi088:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-24T23:36:16.065 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-24T23:36:16.104 INFO:teuthology.orchestra.run.smithi088.stdout:Reading package lists... 2024-04-24T23:36:16.311 INFO:teuthology.orchestra.run.smithi088.stdout:Building dependency tree... 2024-04-24T23:36:16.312 INFO:teuthology.orchestra.run.smithi088.stdout:Reading state information... 2024-04-24T23:36:16.324 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-24T23:36:16.459 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-24T23:36:16.469 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-24T23:36:16.506 INFO:teuthology.orchestra.run.smithi088.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-24T23:36:16.506 INFO:teuthology.orchestra.run.smithi088.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-24T23:36:16.506 INFO:teuthology.orchestra.run.smithi088.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-24T23:36:16.506 INFO:teuthology.orchestra.run.smithi088.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T23:36:16.506 INFO:teuthology.orchestra.run.smithi088.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T23:36:16.507 INFO:teuthology.orchestra.run.smithi088.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T23:36:16.507 INFO:teuthology.orchestra.run.smithi088.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T23:36:16.507 INFO:teuthology.orchestra.run.smithi088.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-24T23:36:16.507 INFO:teuthology.orchestra.run.smithi088.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-24T23:36:16.507 INFO:teuthology.orchestra.run.smithi088.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T23:36:16.508 INFO:teuthology.orchestra.run.smithi088.stdout:The following additional packages will be installed: 2024-04-24T23:36:16.508 INFO:teuthology.orchestra.run.smithi088.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-24T23:36:16.508 INFO:teuthology.orchestra.run.smithi088.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-24T23:36:16.509 INFO:teuthology.orchestra.run.smithi088.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-24T23:36:16.509 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-24T23:36:16.509 INFO:teuthology.orchestra.run.smithi088.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-24T23:36:16.510 INFO:teuthology.orchestra.run.smithi088.stdout:Suggested packages: 2024-04-24T23:36:16.510 INFO:teuthology.orchestra.run.smithi088.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-24T23:36:16.510 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-24T23:36:16.510 INFO:teuthology.orchestra.run.smithi088.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-24T23:36:16.550 INFO:teuthology.orchestra.run.smithi088.stdout:The following NEW packages will be installed: 2024-04-24T23:36:16.551 INFO:teuthology.orchestra.run.smithi088.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-24T23:36:16.551 INFO:teuthology.orchestra.run.smithi088.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-24T23:36:16.552 INFO:teuthology.orchestra.run.smithi088.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-24T23:36:16.552 INFO:teuthology.orchestra.run.smithi088.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-24T23:36:16.552 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-24T23:36:16.552 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-24T23:36:16.552 INFO:teuthology.orchestra.run.smithi088.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-24T23:36:16.553 INFO:teuthology.orchestra.run.smithi088.stdout:The following packages will be upgraded: 2024-04-24T23:36:16.553 INFO:teuthology.orchestra.run.smithi088.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-24T23:36:16.585 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-24T23:36:16.611 INFO:teuthology.orchestra.run.smithi088.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-24T23:36:16.611 INFO:teuthology.orchestra.run.smithi088.stdout:Need to get 55.7 MB of archives. 2024-04-24T23:36:16.611 INFO:teuthology.orchestra.run.smithi088.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-24T23:36:16.611 INFO:teuthology.orchestra.run.smithi088.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-24T23:36:16.704 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T23:36:16.764 INFO:teuthology.orchestra.run.smithi088.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-24T23:36:16.771 INFO:teuthology.orchestra.run.smithi088.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-24T23:36:16.810 INFO:teuthology.orchestra.run.smithi088.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-24T23:36:16.811 INFO:teuthology.orchestra.run.smithi088.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-24T23:36:16.812 INFO:teuthology.orchestra.run.smithi088.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-24T23:36:16.813 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-24T23:36:16.823 INFO:teuthology.orchestra.run.smithi088.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-24T23:36:16.824 INFO:teuthology.orchestra.run.smithi088.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-24T23:36:16.826 INFO:teuthology.orchestra.run.smithi088.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-24T23:36:16.827 INFO:teuthology.orchestra.run.smithi088.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-24T23:36:16.828 INFO:teuthology.orchestra.run.smithi088.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-24T23:36:16.829 INFO:teuthology.orchestra.run.smithi088.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-24T23:36:16.831 INFO:teuthology.orchestra.run.smithi088.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-24T23:36:16.850 INFO:teuthology.orchestra.run.smithi088.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-24T23:36:16.851 INFO:teuthology.orchestra.run.smithi088.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-24T23:36:16.852 INFO:teuthology.orchestra.run.smithi088.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-24T23:36:16.886 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-24T23:36:17.081 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-24T23:36:17.145 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-24T23:36:17.175 INFO:teuthology.orchestra.run.smithi088.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-24T23:36:17.178 INFO:teuthology.orchestra.run.smithi088.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-24T23:36:17.178 INFO:teuthology.orchestra.run.smithi088.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-24T23:36:17.181 INFO:teuthology.orchestra.run.smithi088.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-24T23:36:17.181 INFO:teuthology.orchestra.run.smithi088.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-24T23:36:17.185 INFO:teuthology.orchestra.run.smithi088.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-24T23:36:17.187 INFO:teuthology.orchestra.run.smithi088.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-24T23:36:17.194 INFO:teuthology.orchestra.run.smithi088.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-24T23:36:17.194 INFO:teuthology.orchestra.run.smithi088.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-24T23:36:17.207 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-24T23:36:17.216 INFO:teuthology.orchestra.run.smithi088.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-24T23:36:17.216 INFO:teuthology.orchestra.run.smithi088.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-24T23:36:17.227 INFO:teuthology.orchestra.run.smithi088.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-24T23:36:17.251 INFO:teuthology.orchestra.run.smithi088.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-24T23:36:17.254 INFO:teuthology.orchestra.run.smithi088.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-24T23:36:17.255 INFO:teuthology.orchestra.run.smithi088.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-24T23:36:17.255 INFO:teuthology.orchestra.run.smithi088.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-24T23:36:17.256 INFO:teuthology.orchestra.run.smithi088.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-24T23:36:17.266 INFO:teuthology.orchestra.run.smithi088.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-24T23:36:17.268 INFO:teuthology.orchestra.run.smithi088.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-24T23:36:17.333 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-24T23:36:17.372 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T23:36:17.472 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-24T23:36:17.489 INFO:teuthology.orchestra.run.smithi088.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-24T23:36:17.489 INFO:teuthology.orchestra.run.smithi088.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-24T23:36:17.489 INFO:teuthology.orchestra.run.smithi088.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-24T23:36:17.489 INFO:teuthology.orchestra.run.smithi088.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-24T23:36:17.489 INFO:teuthology.orchestra.run.smithi088.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-24T23:36:17.490 INFO:teuthology.orchestra.run.smithi088.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-24T23:36:17.501 INFO:teuthology.orchestra.run.smithi088.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-24T23:36:17.502 INFO:teuthology.orchestra.run.smithi088.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-24T23:36:17.626 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-24T23:36:17.749 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-24T23:36:17.894 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-24T23:36:17.902 INFO:teuthology.orchestra.run.smithi088.stdout:Preconfiguring packages ... 2024-04-24T23:36:18.008 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-24T23:36:18.055 INFO:teuthology.orchestra.run.smithi088.stdout:Fetched 55.7 MB in 1s (59.2 MB/s) 2024-04-24T23:36:18.153 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T23:36:18.254 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-24T23:36:18.268 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-24T23:36:18.519 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-24T23:36:18.547 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-24T23:36:18.770 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-24T23:36:18.815 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-24T23:36:19.029 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-24T23:36:19.030 INFO:teuthology.orchestra.run.smithi088.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173984 files and directories currently installed.) 2024-04-24T23:36:19.036 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-24T23:36:19.074 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-24T23:36:19.130 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-24T23:36:19.181 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-24T23:36:19.342 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-24T23:36:19.414 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-24T23:36:19.532 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-24T23:36:19.618 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-24T23:36:19.811 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-24T23:36:19.833 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-24T23:36:19.885 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-24T23:36:19.997 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-24T23:36:20.143 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-24T23:36:20.265 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-24T23:36:20.391 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-24T23:36:20.394 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-24T23:36:20.520 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-24T23:36:20.646 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-24T23:36:20.683 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-24T23:36:20.717 INFO:teuthology.orchestra.run.smithi116.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-24T23:36:20.790 INFO:teuthology.orchestra.run.smithi088.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-24T23:36:20.949 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-24T23:36:20.985 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-24T23:36:21.045 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package flex. 2024-04-24T23:36:21.048 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-24T23:36:21.138 INFO:teuthology.orchestra.run.smithi088.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173984 files and directories currently installed.) 2024-04-24T23:36:21.149 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-24T23:36:21.185 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-24T23:36:21.244 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-24T23:36:21.369 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-24T23:36:21.442 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-24T23:36:21.479 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-24T23:36:21.560 INFO:teuthology.orchestra.run.smithi174.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-24T23:36:21.701 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-24T23:36:21.709 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-24T23:36:21.806 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-24T23:36:21.835 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-24T23:36:21.874 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-24T23:36:21.931 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-24T23:36:22.095 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T23:36:22.221 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-24T23:36:22.313 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-24T23:36:22.341 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-24T23:36:22.538 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-24T23:36:22.600 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-24T23:36:22.726 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-24T23:36:22.812 INFO:teuthology.orchestra.run.smithi088.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174057 files and directories currently installed.) 2024-04-24T23:36:22.814 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-24T23:36:22.817 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-24T23:36:22.940 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-24T23:36:22.985 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T23:36:23.074 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-24T23:36:23.137 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-24T23:36:23.294 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-24T23:36:23.349 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-24T23:36:23.438 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-24T23:36:23.463 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-24T23:36:23.562 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-24T23:36:23.722 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-24T23:36:23.773 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-24T23:36:23.830 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-24T23:36:23.990 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-24T23:36:24.072 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-24T23:36:24.189 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package bison. 2024-04-24T23:36:24.210 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-24T23:36:24.294 INFO:teuthology.orchestra.run.smithi088.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174057 files and directories currently installed.) 2024-04-24T23:36:24.299 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-24T23:36:24.350 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-24T23:36:24.424 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-24T23:36:24.460 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-24T23:36:24.718 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-24T23:36:24.728 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-24T23:36:24.775 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-24T23:36:24.803 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-24T23:36:24.842 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-24T23:36:24.971 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-24T23:36:25.070 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-24T23:36:25.179 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:25.220 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package dump. 2024-04-24T23:36:25.247 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-24T23:36:25.280 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:25.295 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking dump (0.4b47-3) ... 2024-04-24T23:36:25.315 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-24T23:36:25.390 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-24T23:36:25.600 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-24T23:36:25.641 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package indent. 2024-04-24T23:36:25.668 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-24T23:36:25.715 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-24T23:36:25.734 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:25.860 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:25.943 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-24T23:36:25.968 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-24T23:36:25.984 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-24T23:36:25.986 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-24T23:36:26.029 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-24T23:36:26.069 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:26.179 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:26.271 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:26.313 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-24T23:36:26.372 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:26.405 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-24T23:36:26.433 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-24T23:36:26.473 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:26.480 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-24T23:36:26.666 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:26.677 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-24T23:36:26.677 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-24T23:36:26.792 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:26.800 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-24T23:36:26.827 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-24T23:36:26.876 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-24T23:36:26.943 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-24T23:36:27.183 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:27.212 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-24T23:36:27.219 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:27.240 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-24T23:36:27.278 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-24T23:36:27.310 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:27.329 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:27.430 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:27.486 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:27.587 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up cephfs-top (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:27.628 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-24T23:36:27.628 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-24T23:36:27.696 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-24T23:36:27.722 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-24T23:36:27.749 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-24T23:36:27.839 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-24T23:36:28.123 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:28.125 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libjson-perl. 2024-04-24T23:36:28.141 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-24T23:36:28.192 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-24T23:36:28.249 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:28.375 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:28.500 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up cephfs-top (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:28.529 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-24T23:36:28.556 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-24T23:36:28.595 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-24T23:36:28.626 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-24T23:36:28.887 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:28.996 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:29.097 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:29.207 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:29.333 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up cephfs-shell (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:29.458 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:29.772 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:29.889 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:29.993 INFO:teuthology.orchestra.run.smithi116.stdout:Adding group ceph....done 2024-04-24T23:36:30.015 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:30.141 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:30.265 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-24T23:36:30.292 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up cephfs-shell (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:30.293 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-24T23:36:30.331 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T23:36:30.386 INFO:teuthology.orchestra.run.smithi116.stdout:Adding system user ceph....done 2024-04-24T23:36:30.418 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:30.564 INFO:teuthology.orchestra.run.smithi116.stdout:Setting system user ceph properties....done 2024-04-24T23:36:30.582 INFO:teuthology.orchestra.run.smithi116.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-24T23:36:30.593 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-24T23:36:30.621 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-24T23:36:30.659 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T23:36:30.717 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-24T23:36:30.919 INFO:teuthology.orchestra.run.smithi174.stdout:Adding group ceph....done 2024-04-24T23:36:30.953 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-24T23:36:30.982 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-24T23:36:31.020 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T23:36:31.020 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-24T23:36:31.321 INFO:teuthology.orchestra.run.smithi174.stdout:Adding system user ceph....done 2024-04-24T23:36:31.331 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-24T23:36:31.359 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-24T23:36:31.398 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-24T23:36:31.460 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up cephfs-mirror (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:31.488 INFO:teuthology.orchestra.run.smithi174.stdout:Setting system user ceph properties....done 2024-04-24T23:36:31.506 INFO:teuthology.orchestra.run.smithi174.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-24T23:36:31.640 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-24T23:36:31.668 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-24T23:36:31.668 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-24T23:36:31.734 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-24T23:36:31.762 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-24T23:36:31.801 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-24T23:36:31.934 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-24T23:36:32.144 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:32.162 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-24T23:36:32.190 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-24T23:36:32.229 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T23:36:32.262 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:32.394 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up cephfs-mirror (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:32.573 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-24T23:36:32.595 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-24T23:36:32.595 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-24T23:36:32.601 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-24T23:36:32.640 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T23:36:32.709 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-24T23:36:32.710 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-24T23:36:32.943 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-24T23:36:32.959 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-24T23:36:32.993 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T23:36:33.062 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:33.172 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:33.188 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:33.220 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-24T23:36:33.236 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-24T23:36:33.278 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-24T23:36:33.522 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-24T23:36:33.681 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-24T23:36:33.681 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-24T23:36:33.816 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-24T23:36:33.843 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-24T23:36:33.882 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-24T23:36:33.986 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:34.164 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:34.177 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package modemmanager. 2024-04-24T23:36:34.204 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-24T23:36:34.226 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-24T23:36:34.226 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-24T23:36:34.235 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T23:36:34.486 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-24T23:36:34.696 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:34.867 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package network-manager. 2024-04-24T23:36:34.895 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-24T23:36:34.910 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-24T23:36:34.910 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-24T23:36:34.924 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:34.942 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-24T23:36:35.156 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-24T23:36:35.156 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-24T23:36:35.405 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:35.618 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:35.633 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ppp. 2024-04-24T23:36:35.661 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-24T23:36:35.685 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-24T23:36:35.685 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-24T23:36:35.833 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-24T23:36:35.834 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-24T23:36:35.938 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-24T23:36:36.140 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:36.221 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package pptp-linux. 2024-04-24T23:36:36.249 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-24T23:36:36.249 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:36.288 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-24T23:36:36.310 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:36.393 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:36.524 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-24T23:36:36.540 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-24T23:36:36.576 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-24T23:36:36.577 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-24T23:36:36.577 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-24T23:36:36.613 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-24T23:36:36.613 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-24T23:36:36.869 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-24T23:36:36.896 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-24T23:36:36.935 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql-client-common (238) ... 2024-04-24T23:36:37.070 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:37.123 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:37.222 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-24T23:36:37.250 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-24T23:36:37.289 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T23:36:37.328 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:37.400 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:37.437 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:37.551 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:37.588 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:37.771 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-24T23:36:37.771 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-24T23:36:37.794 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql-common. 2024-04-24T23:36:37.822 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-24T23:36:37.878 INFO:teuthology.orchestra.run.smithi088.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-24T23:36:37.908 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql-common (238) ... 2024-04-24T23:36:38.235 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:38.261 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-24T23:36:38.358 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-24T23:36:38.370 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:38.376 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql-14. 2024-04-24T23:36:38.404 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-24T23:36:38.446 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T23:36:38.520 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-24T23:36:38.530 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:38.672 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T23:36:39.001 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-24T23:36:39.161 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-24T23:36:39.219 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-24T23:36:39.398 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-24T23:36:39.804 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql. 2024-04-24T23:36:39.833 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-24T23:36:39.870 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql (14+238) ... 2024-04-24T23:36:39.874 INFO:teuthology.orchestra.run.smithi116.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-24T23:36:39.877 DEBUG:teuthology.orchestra.run.smithi116:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-24T23:36:39.976 INFO:teuthology.orchestra.run.smithi116.stdout:Reading package lists... 2024-04-24T23:36:40.106 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql-client. 2024-04-24T23:36:40.122 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-24T23:36:40.156 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql-client (14+238) ... 2024-04-24T23:36:40.177 INFO:teuthology.orchestra.run.smithi116.stdout:Building dependency tree... 2024-04-24T23:36:40.178 INFO:teuthology.orchestra.run.smithi116.stdout:Reading state information... 2024-04-24T23:36:40.366 INFO:teuthology.orchestra.run.smithi116.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-24T23:36:40.366 INFO:teuthology.orchestra.run.smithi116.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-24T23:36:40.366 INFO:teuthology.orchestra.run.smithi116.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-24T23:36:40.367 INFO:teuthology.orchestra.run.smithi116.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T23:36:40.367 INFO:teuthology.orchestra.run.smithi116.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T23:36:40.367 INFO:teuthology.orchestra.run.smithi116.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T23:36:40.367 INFO:teuthology.orchestra.run.smithi116.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T23:36:40.367 INFO:teuthology.orchestra.run.smithi116.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-24T23:36:40.367 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-24T23:36:40.368 INFO:teuthology.orchestra.run.smithi116.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-24T23:36:40.368 INFO:teuthology.orchestra.run.smithi116.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T23:36:40.368 INFO:teuthology.orchestra.run.smithi116.stdout:The following additional packages will be installed: 2024-04-24T23:36:40.369 INFO:teuthology.orchestra.run.smithi116.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-24T23:36:40.369 INFO:teuthology.orchestra.run.smithi116.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-24T23:36:40.369 INFO:teuthology.orchestra.run.smithi116.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-24T23:36:40.369 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-24T23:36:40.369 INFO:teuthology.orchestra.run.smithi116.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-24T23:36:40.369 INFO:teuthology.orchestra.run.smithi116.stdout:Suggested packages: 2024-04-24T23:36:40.369 INFO:teuthology.orchestra.run.smithi116.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-24T23:36:40.370 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-24T23:36:40.370 INFO:teuthology.orchestra.run.smithi116.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-24T23:36:40.383 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-24T23:36:40.409 INFO:teuthology.orchestra.run.smithi116.stdout:The following NEW packages will be installed: 2024-04-24T23:36:40.410 INFO:teuthology.orchestra.run.smithi116.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-24T23:36:40.410 INFO:teuthology.orchestra.run.smithi116.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-24T23:36:40.410 INFO:teuthology.orchestra.run.smithi116.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-24T23:36:40.410 INFO:teuthology.orchestra.run.smithi116.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-24T23:36:40.410 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-24T23:36:40.410 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-24T23:36:40.410 INFO:teuthology.orchestra.run.smithi116.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-24T23:36:40.411 INFO:teuthology.orchestra.run.smithi116.stdout:The following packages will be upgraded: 2024-04-24T23:36:40.411 INFO:teuthology.orchestra.run.smithi116.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-24T23:36:40.424 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-24T23:36:40.591 INFO:teuthology.orchestra.run.smithi116.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-24T23:36:40.591 INFO:teuthology.orchestra.run.smithi116.stdout:Need to get 55.7 MB of archives. 2024-04-24T23:36:40.591 INFO:teuthology.orchestra.run.smithi116.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-24T23:36:40.592 INFO:teuthology.orchestra.run.smithi116.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-24T23:36:40.619 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-24T23:36:40.744 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package tcl8.6. 2024-04-24T23:36:40.772 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-24T23:36:40.810 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-24T23:36:41.096 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package tcl. 2024-04-24T23:36:41.124 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-24T23:36:41.168 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-24T23:36:41.218 INFO:teuthology.orchestra.run.smithi116.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-24T23:36:41.235 INFO:teuthology.orchestra.run.smithi116.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-24T23:36:41.309 INFO:teuthology.orchestra.run.smithi174.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-24T23:36:41.312 DEBUG:teuthology.orchestra.run.smithi174:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-24T23:36:41.360 INFO:teuthology.orchestra.run.smithi116.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-24T23:36:41.361 INFO:teuthology.orchestra.run.smithi116.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-24T23:36:41.362 INFO:teuthology.orchestra.run.smithi116.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-24T23:36:41.369 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2024-04-24T23:36:41.391 INFO:teuthology.orchestra.run.smithi116.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-24T23:36:41.393 INFO:teuthology.orchestra.run.smithi116.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-24T23:36:41.396 INFO:teuthology.orchestra.run.smithi116.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-24T23:36:41.399 INFO:teuthology.orchestra.run.smithi116.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-24T23:36:41.400 INFO:teuthology.orchestra.run.smithi116.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-24T23:36:41.483 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package wpasupplicant. 2024-04-24T23:36:41.510 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-24T23:36:41.541 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-24T23:36:41.556 INFO:teuthology.orchestra.run.smithi174.stdout:Building dependency tree... 2024-04-24T23:36:41.557 INFO:teuthology.orchestra.run.smithi174.stdout:Reading state information... 2024-04-24T23:36:41.566 INFO:teuthology.orchestra.run.smithi116.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-24T23:36:41.729 INFO:teuthology.orchestra.run.smithi174.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-24T23:36:41.729 INFO:teuthology.orchestra.run.smithi174.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-24T23:36:41.729 INFO:teuthology.orchestra.run.smithi174.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-24T23:36:41.729 INFO:teuthology.orchestra.run.smithi174.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T23:36:41.729 INFO:teuthology.orchestra.run.smithi174.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T23:36:41.729 INFO:teuthology.orchestra.run.smithi174.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T23:36:41.729 INFO:teuthology.orchestra.run.smithi174.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T23:36:41.730 INFO:teuthology.orchestra.run.smithi174.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-24T23:36:41.730 INFO:teuthology.orchestra.run.smithi174.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-24T23:36:41.730 INFO:teuthology.orchestra.run.smithi174.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T23:36:41.731 INFO:teuthology.orchestra.run.smithi174.stdout:The following additional packages will be installed: 2024-04-24T23:36:41.731 INFO:teuthology.orchestra.run.smithi174.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-24T23:36:41.731 INFO:teuthology.orchestra.run.smithi174.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-24T23:36:41.731 INFO:teuthology.orchestra.run.smithi174.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-24T23:36:41.731 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-24T23:36:41.731 INFO:teuthology.orchestra.run.smithi174.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-24T23:36:41.732 INFO:teuthology.orchestra.run.smithi174.stdout:Suggested packages: 2024-04-24T23:36:41.732 INFO:teuthology.orchestra.run.smithi174.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-24T23:36:41.732 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-24T23:36:41.732 INFO:teuthology.orchestra.run.smithi174.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-24T23:36:41.773 INFO:teuthology.orchestra.run.smithi174.stdout:The following NEW packages will be installed: 2024-04-24T23:36:41.774 INFO:teuthology.orchestra.run.smithi174.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-24T23:36:41.774 INFO:teuthology.orchestra.run.smithi174.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-24T23:36:41.774 INFO:teuthology.orchestra.run.smithi174.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-24T23:36:41.774 INFO:teuthology.orchestra.run.smithi174.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-24T23:36:41.774 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-24T23:36:41.775 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-24T23:36:41.775 INFO:teuthology.orchestra.run.smithi174.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-24T23:36:41.775 INFO:teuthology.orchestra.run.smithi174.stdout:The following packages will be upgraded: 2024-04-24T23:36:41.776 INFO:teuthology.orchestra.run.smithi174.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-24T23:36:41.864 INFO:teuthology.orchestra.run.smithi116.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-24T23:36:41.872 INFO:teuthology.orchestra.run.smithi116.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-24T23:36:41.878 INFO:teuthology.orchestra.run.smithi116.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-24T23:36:41.895 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-24T23:36:41.923 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-24T23:36:41.956 INFO:teuthology.orchestra.run.smithi174.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-24T23:36:41.957 INFO:teuthology.orchestra.run.smithi174.stdout:Need to get 55.7 MB of archives. 2024-04-24T23:36:41.957 INFO:teuthology.orchestra.run.smithi174.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-24T23:36:41.957 INFO:teuthology.orchestra.run.smithi174.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-24T23:36:41.962 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-24T23:36:41.964 INFO:teuthology.orchestra.run.smithi116.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-24T23:36:42.340 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-24T23:36:42.368 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-24T23:36:42.415 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-24T23:36:42.594 INFO:teuthology.orchestra.run.smithi174.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-24T23:36:42.610 INFO:teuthology.orchestra.run.smithi174.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-24T23:36:42.729 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql-client-common (238) ... 2024-04-24T23:36:42.758 INFO:teuthology.orchestra.run.smithi174.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-24T23:36:42.759 INFO:teuthology.orchestra.run.smithi174.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-24T23:36:42.761 INFO:teuthology.orchestra.run.smithi174.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-24T23:36:42.796 INFO:teuthology.orchestra.run.smithi174.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-24T23:36:42.798 INFO:teuthology.orchestra.run.smithi174.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-24T23:36:42.801 INFO:teuthology.orchestra.run.smithi174.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-24T23:36:42.803 INFO:teuthology.orchestra.run.smithi174.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-24T23:36:42.804 INFO:teuthology.orchestra.run.smithi174.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-24T23:36:42.938 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-24T23:36:42.971 INFO:teuthology.orchestra.run.smithi174.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-24T23:36:43.035 INFO:teuthology.orchestra.run.smithi116.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-24T23:36:43.040 INFO:teuthology.orchestra.run.smithi116.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-24T23:36:43.040 INFO:teuthology.orchestra.run.smithi116.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-24T23:36:43.046 INFO:teuthology.orchestra.run.smithi116.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-24T23:36:43.047 INFO:teuthology.orchestra.run.smithi116.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-24T23:36:43.058 INFO:teuthology.orchestra.run.smithi116.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-24T23:36:43.063 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-24T23:36:43.190 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T23:36:43.226 INFO:teuthology.orchestra.run.smithi116.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-24T23:36:43.264 INFO:teuthology.orchestra.run.smithi174.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-24T23:36:43.274 INFO:teuthology.orchestra.run.smithi174.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-24T23:36:43.279 INFO:teuthology.orchestra.run.smithi174.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-24T23:36:43.308 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-24T23:36:43.364 INFO:teuthology.orchestra.run.smithi174.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-24T23:36:43.408 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-24T23:36:43.560 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T23:36:44.044 INFO:teuthology.orchestra.run.smithi088.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-24T23:36:44.132 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-24T23:36:44.313 INFO:teuthology.orchestra.run.smithi116.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-24T23:36:44.317 INFO:teuthology.orchestra.run.smithi116.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-24T23:36:44.466 INFO:teuthology.orchestra.run.smithi174.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-24T23:36:44.470 INFO:teuthology.orchestra.run.smithi174.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-24T23:36:44.471 INFO:teuthology.orchestra.run.smithi174.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-24T23:36:44.477 INFO:teuthology.orchestra.run.smithi174.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-24T23:36:44.478 INFO:teuthology.orchestra.run.smithi174.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-24T23:36:44.488 INFO:teuthology.orchestra.run.smithi174.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-24T23:36:44.508 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-24T23:36:44.508 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-24T23:36:44.656 INFO:teuthology.orchestra.run.smithi174.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-24T23:36:44.987 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-24T23:36:45.121 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-24T23:36:45.230 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-24T23:36:45.251 INFO:teuthology.orchestra.run.smithi174.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-24T23:36:45.252 INFO:teuthology.orchestra.run.smithi174.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-24T23:36:45.365 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-24T23:36:45.431 INFO:teuthology.orchestra.run.smithi174.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-24T23:36:45.432 INFO:teuthology.orchestra.run.smithi174.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-24T23:36:45.470 INFO:teuthology.orchestra.run.smithi174.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-24T23:36:45.491 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-24T23:36:45.531 INFO:teuthology.orchestra.run.smithi174.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-24T23:36:45.538 INFO:teuthology.orchestra.run.smithi174.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-24T23:36:45.539 INFO:teuthology.orchestra.run.smithi174.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-24T23:36:45.540 INFO:teuthology.orchestra.run.smithi174.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-24T23:36:45.541 INFO:teuthology.orchestra.run.smithi174.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-24T23:36:45.625 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-24T23:36:45.748 INFO:teuthology.orchestra.run.smithi174.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-24T23:36:45.751 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-24T23:36:45.877 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-24T23:36:45.921 INFO:teuthology.orchestra.run.smithi116.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-24T23:36:45.923 INFO:teuthology.orchestra.run.smithi116.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-24T23:36:46.153 INFO:teuthology.orchestra.run.smithi174.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-24T23:36:46.156 INFO:teuthology.orchestra.run.smithi057.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-24T23:36:46.318 INFO:teuthology.orchestra.run.smithi057.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-24T23:36:46.322 INFO:teuthology.orchestra.run.smithi057.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-24T23:36:46.474 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-24T23:36:46.600 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up dump (0.4b47-3) ... 2024-04-24T23:36:46.694 INFO:teuthology.orchestra.run.smithi088.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-24T23:36:46.730 INFO:teuthology.orchestra.run.smithi057.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-24T23:36:46.745 INFO:teuthology.orchestra.run.smithi057.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-24T23:36:46.760 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T23:36:46.886 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-24T23:36:46.892 INFO:teuthology.orchestra.run.smithi116.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-24T23:36:46.976 INFO:teuthology.orchestra.run.smithi174.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-24T23:36:46.976 INFO:teuthology.orchestra.run.smithi174.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-24T23:36:46.976 INFO:teuthology.orchestra.run.smithi174.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-24T23:36:46.977 INFO:teuthology.orchestra.run.smithi174.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-24T23:36:46.978 INFO:teuthology.orchestra.run.smithi174.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-24T23:36:46.978 INFO:teuthology.orchestra.run.smithi174.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-24T23:36:47.003 INFO:teuthology.orchestra.run.smithi174.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-24T23:36:47.003 INFO:teuthology.orchestra.run.smithi174.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-24T23:36:47.020 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-24T23:36:47.121 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-24T23:36:47.222 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-24T23:36:47.304 INFO:teuthology.orchestra.run.smithi088.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-24T23:36:47.373 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-24T23:36:47.405 INFO:teuthology.orchestra.run.smithi057.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-24T23:36:47.409 INFO:teuthology.orchestra.run.smithi174.stdout:Preconfiguring packages ... 2024-04-24T23:36:47.499 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-24T23:36:47.562 INFO:teuthology.orchestra.run.smithi174.stdout:Fetched 55.7 MB in 5s (10.7 MB/s) 2024-04-24T23:36:47.676 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-24T23:36:47.782 INFO:teuthology.orchestra.run.smithi057.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-24T23:36:47.801 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T23:36:47.866 INFO:teuthology.orchestra.run.smithi174.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173984 files and directories currently installed.) 2024-04-24T23:36:47.872 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-24T23:36:47.927 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-24T23:36:48.018 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-24T23:36:48.087 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql-client (14+238) ... 2024-04-24T23:36:48.205 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-24T23:36:48.372 INFO:teuthology.orchestra.run.smithi057.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-24T23:36:48.373 INFO:teuthology.orchestra.run.smithi057.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-24T23:36:48.553 INFO:teuthology.orchestra.run.smithi057.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-24T23:36:48.553 INFO:teuthology.orchestra.run.smithi057.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-24T23:36:48.591 INFO:teuthology.orchestra.run.smithi057.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-24T23:36:48.649 INFO:teuthology.orchestra.run.smithi057.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-24T23:36:48.656 INFO:teuthology.orchestra.run.smithi057.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-24T23:36:48.657 INFO:teuthology.orchestra.run.smithi057.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-24T23:36:48.659 INFO:teuthology.orchestra.run.smithi057.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-24T23:36:48.660 INFO:teuthology.orchestra.run.smithi057.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-24T23:36:48.672 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-24T23:36:48.711 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:36:48.711 INFO:teuthology.orchestra.run.smithi088.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-24T23:36:48.711 INFO:teuthology.orchestra.run.smithi088.stdout:which means they are currently configured by ifupdown: 2024-04-24T23:36:48.712 INFO:teuthology.orchestra.run.smithi088.stdout:- enp3s0f1 2024-04-24T23:36:48.712 INFO:teuthology.orchestra.run.smithi088.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-24T23:36:48.712 INFO:teuthology.orchestra.run.smithi088.stdout:remove their configuration from /etc/network/interfaces. 2024-04-24T23:36:48.712 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:36:48.835 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-24T23:36:48.864 INFO:teuthology.orchestra.run.smithi057.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-24T23:36:48.892 INFO:teuthology.orchestra.run.smithi116.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-24T23:36:49.007 INFO:teuthology.orchestra.run.smithi116.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-24T23:36:49.029 INFO:teuthology.orchestra.run.smithi116.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-24T23:36:49.037 INFO:teuthology.orchestra.run.smithi116.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-24T23:36:49.045 INFO:teuthology.orchestra.run.smithi116.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-24T23:36:49.158 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-24T23:36:49.269 INFO:teuthology.orchestra.run.smithi057.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-24T23:36:49.493 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-24T23:36:49.594 INFO:teuthology.orchestra.run.smithi174.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-24T23:36:49.873 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package flex. 2024-04-24T23:36:49.974 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T23:36:49.975 INFO:teuthology.orchestra.run.smithi174.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173984 files and directories currently installed.) 2024-04-24T23:36:49.981 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-24T23:36:50.021 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-24T23:36:50.056 INFO:teuthology.orchestra.run.smithi057.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-24T23:36:50.099 INFO:teuthology.orchestra.run.smithi057.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-24T23:36:50.099 INFO:teuthology.orchestra.run.smithi057.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-24T23:36:50.099 INFO:teuthology.orchestra.run.smithi057.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-24T23:36:50.100 INFO:teuthology.orchestra.run.smithi057.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-24T23:36:50.100 INFO:teuthology.orchestra.run.smithi057.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-24T23:36:50.117 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-24T23:36:50.130 INFO:teuthology.orchestra.run.smithi057.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-24T23:36:50.132 INFO:teuthology.orchestra.run.smithi057.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-24T23:36:50.243 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-24T23:36:50.369 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql-common (238) ... 2024-04-24T23:36:50.503 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-24T23:36:50.549 INFO:teuthology.orchestra.run.smithi057.stdout:Preconfiguring packages ... 2024-04-24T23:36:50.668 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-24T23:36:50.720 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 55.7 MB in 37s (1,492 kB/s) 2024-04-24T23:36:50.721 INFO:teuthology.orchestra.run.smithi116.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-24T23:36:51.047 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173984 files and directories currently installed.) 2024-04-24T23:36:51.052 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-24T23:36:51.095 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-24T23:36:51.134 INFO:teuthology.orchestra.run.smithi116.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-24T23:36:51.197 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-24T23:36:51.618 INFO:teuthology.orchestra.run.smithi174.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174057 files and directories currently installed.) 2024-04-24T23:36:51.625 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-24T23:36:51.767 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-24T23:36:51.786 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-24T23:36:51.951 INFO:teuthology.orchestra.run.smithi116.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-24T23:36:51.951 INFO:teuthology.orchestra.run.smithi116.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-24T23:36:51.952 INFO:teuthology.orchestra.run.smithi116.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-24T23:36:51.952 INFO:teuthology.orchestra.run.smithi116.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-24T23:36:51.981 INFO:teuthology.orchestra.run.smithi116.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-24T23:36:51.982 INFO:teuthology.orchestra.run.smithi116.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-24T23:36:52.012 INFO:teuthology.orchestra.run.smithi116.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-24T23:36:52.013 INFO:teuthology.orchestra.run.smithi116.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-24T23:36:52.087 INFO:teuthology.orchestra.run.smithi088.stdout:Adding user postgres to group ssl-cert 2024-04-24T23:36:52.168 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-24T23:36:52.306 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-24T23:36:52.331 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:36:52.332 INFO:teuthology.orchestra.run.smithi088.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-24T23:36:52.417 INFO:teuthology.orchestra.run.smithi116.stdout:Preconfiguring packages ... 2024-04-24T23:36:52.505 INFO:teuthology.orchestra.run.smithi088.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-24T23:36:52.505 INFO:teuthology.orchestra.run.smithi088.stdout:Removing obsolete dictionary files: 2024-04-24T23:36:52.562 INFO:teuthology.orchestra.run.smithi116.stdout:Fetched 55.7 MB in 12s (4,806 kB/s) 2024-04-24T23:36:52.651 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-24T23:36:52.657 INFO:teuthology.orchestra.run.smithi057.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-24T23:36:52.841 INFO:teuthology.orchestra.run.smithi116.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173984 files and directories currently installed.) 2024-04-24T23:36:52.846 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-24T23:36:52.911 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package flex. 2024-04-24T23:36:52.976 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-24T23:36:52.993 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173984 files and directories currently installed.) 2024-04-24T23:36:52.999 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-24T23:36:53.031 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package bison. 2024-04-24T23:36:53.043 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-24T23:36:53.088 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-24T23:36:53.108 INFO:teuthology.orchestra.run.smithi174.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174057 files and directories currently installed.) 2024-04-24T23:36:53.113 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-24T23:36:53.159 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-24T23:36:53.462 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T23:36:53.526 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-24T23:36:53.542 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-24T23:36:53.561 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-24T23:36:53.576 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-24T23:36:53.588 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-24T23:36:53.733 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-24T23:36:53.778 INFO:teuthology.orchestra.run.smithi088.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-24T23:36:53.796 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-24T23:36:53.836 INFO:teuthology.orchestra.run.smithi088.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-24T23:36:53.836 INFO:teuthology.orchestra.run.smithi088.stdout:This user must also own the server process. 2024-04-24T23:36:53.836 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:36:53.836 INFO:teuthology.orchestra.run.smithi088.stdout:The database cluster will be initialized with locale "en_US". 2024-04-24T23:36:53.836 INFO:teuthology.orchestra.run.smithi088.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-24T23:36:53.836 INFO:teuthology.orchestra.run.smithi088.stdout:The default text search configuration will be set to "english". 2024-04-24T23:36:53.836 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:36:53.837 INFO:teuthology.orchestra.run.smithi088.stdout:Data page checksums are disabled. 2024-04-24T23:36:53.837 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:36:53.837 INFO:teuthology.orchestra.run.smithi088.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-24T23:36:53.837 INFO:teuthology.orchestra.run.smithi088.stdout:creating subdirectories ... ok 2024-04-24T23:36:53.837 INFO:teuthology.orchestra.run.smithi088.stdout:selecting dynamic shared memory implementation ... posix 2024-04-24T23:36:53.849 INFO:teuthology.orchestra.run.smithi088.stdout:selecting default max_connections ... 100 2024-04-24T23:36:53.867 INFO:teuthology.orchestra.run.smithi088.stdout:selecting default shared_buffers ... 128MB 2024-04-24T23:36:53.883 INFO:teuthology.orchestra.run.smithi088.stdout:selecting default time zone ... Etc/UTC 2024-04-24T23:36:53.885 INFO:teuthology.orchestra.run.smithi088.stdout:creating configuration files ... ok 2024-04-24T23:36:53.895 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package dump. 2024-04-24T23:36:53.923 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-24T23:36:53.962 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking dump (0.4b47-3) ... 2024-04-24T23:36:53.997 INFO:teuthology.orchestra.run.smithi088.stdout:running bootstrap script ... ok 2024-04-24T23:36:54.170 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-24T23:36:54.258 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package indent. 2024-04-24T23:36:54.274 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-24T23:36:54.316 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-24T23:36:54.541 INFO:teuthology.orchestra.run.smithi116.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-24T23:36:54.585 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-24T23:36:54.613 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-24T23:36:54.622 INFO:teuthology.orchestra.run.smithi088.stdout:performing post-bootstrap initialization ... ok 2024-04-24T23:36:54.651 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-24T23:36:54.713 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174057 files and directories currently installed.) 2024-04-24T23:36:54.719 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-24T23:36:54.787 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package flex. 2024-04-24T23:36:54.850 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-24T23:36:54.884 INFO:teuthology.orchestra.run.smithi116.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173984 files and directories currently installed.) 2024-04-24T23:36:54.889 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-24T23:36:54.929 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-24T23:36:54.964 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-24T23:36:54.991 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-24T23:36:55.030 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-24T23:36:55.318 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-24T23:36:55.324 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-24T23:36:55.341 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-24T23:36:55.383 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-24T23:36:55.423 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-24T23:36:55.424 INFO:teuthology.orchestra.run.smithi088.stdout:syncing data to disk ... ok 2024-04-24T23:36:55.462 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-24T23:36:55.635 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-24T23:36:55.728 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-24T23:36:55.755 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-24T23:36:55.760 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-24T23:36:55.794 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-24T23:36:55.816 INFO:teuthology.orchestra.run.smithi088.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-24T23:36:56.014 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-24T23:36:56.030 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-24T23:36:56.062 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-24T23:36:56.063 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-24T23:36:56.159 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package bison. 2024-04-24T23:36:56.266 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174057 files and directories currently installed.) 2024-04-24T23:36:56.272 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-24T23:36:56.274 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libjson-perl. 2024-04-24T23:36:56.302 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-24T23:36:56.319 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-24T23:36:56.341 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-24T23:36:56.593 INFO:teuthology.orchestra.run.smithi116.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174057 files and directories currently installed.) 2024-04-24T23:36:56.599 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-24T23:36:56.661 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-24T23:36:56.688 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-24T23:36:56.725 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-24T23:36:56.727 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-24T23:36:56.745 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-24T23:36:56.773 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-24T23:36:56.812 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-24T23:36:57.098 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-24T23:36:57.098 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package dump. 2024-04-24T23:36:57.116 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-24T23:36:57.148 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking dump (0.4b47-3) ... 2024-04-24T23:36:57.207 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-24T23:36:57.428 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package indent. 2024-04-24T23:36:57.456 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-24T23:36:57.528 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-24T23:36:57.534 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-24T23:36:57.789 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-24T23:36:57.817 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-24T23:36:57.855 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-24T23:36:57.941 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package bison. 2024-04-24T23:36:58.044 INFO:teuthology.orchestra.run.smithi116.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174057 files and directories currently installed.) 2024-04-24T23:36:58.050 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-24T23:36:58.092 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-24T23:36:58.151 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-24T23:36:58.180 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-24T23:36:58.218 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-24T23:36:58.405 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-24T23:36:58.433 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-24T23:36:58.472 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T23:36:58.479 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-24T23:36:58.488 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-24T23:36:58.506 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-24T23:36:58.516 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-24T23:36:58.537 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-24T23:36:58.554 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-24T23:36:58.576 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T23:36:58.703 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-24T23:36:58.716 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-24T23:36:58.732 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-24T23:36:58.765 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T23:36:58.829 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql (14+238) ... 2024-04-24T23:36:58.857 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package dump. 2024-04-24T23:36:58.884 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-24T23:36:58.891 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-24T23:36:58.920 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-24T23:36:58.923 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking dump (0.4b47-3) ... 2024-04-24T23:36:58.954 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T23:36:58.958 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-24T23:36:59.077 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-24T23:36:59.080 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T23:36:59.105 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-24T23:36:59.143 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T23:36:59.194 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-24T23:36:59.211 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-24T23:36:59.256 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-24T23:36:59.269 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package indent. 2024-04-24T23:36:59.297 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-24T23:36:59.336 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-24T23:36:59.336 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-24T23:36:59.336 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-24T23:36:59.496 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-24T23:36:59.524 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-24T23:36:59.562 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-24T23:36:59.605 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-24T23:36:59.621 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-24T23:36:59.663 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-24T23:36:59.780 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libjson-perl. 2024-04-24T23:36:59.797 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-24T23:36:59.839 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-24T23:36:59.874 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-24T23:36:59.900 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-24T23:36:59.902 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-24T23:36:59.940 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-24T23:36:59.958 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-24T23:36:59.986 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-24T23:36:59.991 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-24T23:37:00.025 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-24T23:37:00.150 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-24T23:37:00.179 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-24T23:37:00.217 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-24T23:37:00.268 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-24T23:37:00.294 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-24T23:37:00.296 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-24T23:37:00.303 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-24T23:37:00.322 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-24T23:37:00.335 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T23:37:00.361 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-24T23:37:00.463 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-24T23:37:00.688 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-24T23:37:00.689 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-24T23:37:00.716 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-24T23:37:00.717 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-24T23:37:00.754 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T23:37:00.756 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-24T23:37:00.992 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-24T23:37:01.007 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-24T23:37:01.042 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-24T23:37:01.065 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-24T23:37:01.081 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-24T23:37:01.124 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T23:37:01.294 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libjson-perl. 2024-04-24T23:37:01.310 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-24T23:37:01.334 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-24T23:37:01.351 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-24T23:37:01.352 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-24T23:37:01.384 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-24T23:37:01.697 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-24T23:37:01.725 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-24T23:37:01.764 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-24T23:37:01.782 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-24T23:37:01.882 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-24T23:37:01.905 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-24T23:37:01.932 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-24T23:37:01.954 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-24T23:37:01.971 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-24T23:37:01.982 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-24T23:37:02.020 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T23:37:02.290 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-24T23:37:02.291 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package modemmanager. 2024-04-24T23:37:02.307 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-24T23:37:02.319 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-24T23:37:02.348 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T23:37:02.357 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T23:37:02.399 INFO:teuthology.orchestra.run.smithi088.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-24T23:37:02.405 DEBUG:teuthology.parallel:result is None 2024-04-24T23:37:02.676 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-24T23:37:02.705 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-24T23:37:02.743 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T23:37:03.022 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package network-manager. 2024-04-24T23:37:03.050 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-24T23:37:03.063 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-24T23:37:03.092 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-24T23:37:03.097 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-24T23:37:03.129 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-24T23:37:03.442 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-24T23:37:03.466 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-24T23:37:03.469 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-24T23:37:03.495 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-24T23:37:03.508 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T23:37:03.532 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-24T23:37:03.721 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ppp. 2024-04-24T23:37:03.744 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-24T23:37:03.749 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-24T23:37:03.760 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-24T23:37:03.803 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T23:37:03.919 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-24T23:37:03.948 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-24T23:37:03.994 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T23:37:04.016 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-24T23:37:04.113 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-24T23:37:04.141 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-24T23:37:04.180 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T23:37:04.292 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package pptp-linux. 2024-04-24T23:37:04.320 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-24T23:37:04.359 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-24T23:37:04.364 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-24T23:37:04.393 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-24T23:37:04.431 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T23:37:04.533 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-24T23:37:04.560 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-24T23:37:04.599 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-24T23:37:04.611 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-24T23:37:04.639 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-24T23:37:04.678 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-24T23:37:04.742 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-24T23:37:04.759 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-24T23:37:04.800 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T23:37:04.903 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-24T23:37:04.930 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-24T23:37:04.961 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-24T23:37:04.966 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-24T23:37:04.994 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-24T23:37:05.032 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking postgresql-client-common (238) ... 2024-04-24T23:37:05.053 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-24T23:37:05.081 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-24T23:37:05.128 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-24T23:37:05.311 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-24T23:37:05.339 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-24T23:37:05.339 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-24T23:37:05.366 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-24T23:37:05.377 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T23:37:05.405 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T23:37:05.657 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-24T23:37:05.685 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-24T23:37:05.723 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-24T23:37:05.758 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-24T23:37:05.786 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-24T23:37:05.824 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T23:37:05.941 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package postgresql-common. 2024-04-24T23:37:05.968 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-24T23:37:06.026 INFO:teuthology.orchestra.run.smithi174.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-24T23:37:06.055 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking postgresql-common (238) ... 2024-04-24T23:37:06.069 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package modemmanager. 2024-04-24T23:37:06.097 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-24T23:37:06.119 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-24T23:37:06.135 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T23:37:06.143 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-24T23:37:06.178 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T23:37:06.405 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-24T23:37:06.432 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-24T23:37:06.471 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-24T23:37:06.497 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package postgresql-14. 2024-04-24T23:37:06.525 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-24T23:37:06.567 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T23:37:06.784 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package network-manager. 2024-04-24T23:37:06.812 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-24T23:37:06.859 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-24T23:37:06.983 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-24T23:37:07.011 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-24T23:37:07.049 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-24T23:37:07.411 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package modemmanager. 2024-04-24T23:37:07.439 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-24T23:37:07.478 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T23:37:07.551 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ppp. 2024-04-24T23:37:07.579 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-24T23:37:07.844 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-24T23:37:07.907 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package postgresql. 2024-04-24T23:37:07.924 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-24T23:37:07.966 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking postgresql (14+238) ... 2024-04-24T23:37:08.109 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package network-manager. 2024-04-24T23:37:08.137 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-24T23:37:08.164 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package pptp-linux. 2024-04-24T23:37:08.181 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-24T23:37:08.183 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-24T23:37:08.210 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package postgresql-client. 2024-04-24T23:37:08.237 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-24T23:37:08.245 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-24T23:37:08.276 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking postgresql-client (14+238) ... 2024-04-24T23:37:08.501 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-24T23:37:08.503 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-24T23:37:08.519 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-24T23:37:08.529 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-24T23:37:08.553 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-24T23:37:08.567 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-24T23:37:08.750 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ppp. 2024-04-24T23:37:08.778 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-24T23:37:08.837 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-24T23:37:08.855 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package tcl8.6. 2024-04-24T23:37:08.866 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-24T23:37:08.883 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-24T23:37:08.904 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking postgresql-client-common (238) ... 2024-04-24T23:37:08.922 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-24T23:37:09.035 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-24T23:37:09.190 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package tcl. 2024-04-24T23:37:09.191 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-24T23:37:09.207 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-24T23:37:09.219 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-24T23:37:09.255 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-24T23:37:09.257 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T23:37:09.521 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package pptp-linux. 2024-04-24T23:37:09.538 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-24T23:37:09.579 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-24T23:37:09.619 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package wpasupplicant. 2024-04-24T23:37:09.650 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-24T23:37:09.693 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-24T23:37:09.823 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-24T23:37:09.840 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-24T23:37:09.873 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-24T23:37:09.888 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package postgresql-common. 2024-04-24T23:37:09.916 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-24T23:37:09.974 INFO:teuthology.orchestra.run.smithi057.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-24T23:37:10.004 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking postgresql-common (238) ... 2024-04-24T23:37:10.014 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-24T23:37:10.031 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-24T23:37:10.064 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-24T23:37:10.143 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-24T23:37:10.159 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-24T23:37:10.193 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking postgresql-client-common (238) ... 2024-04-24T23:37:10.429 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package postgresql-14. 2024-04-24T23:37:10.442 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-24T23:37:10.458 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-24T23:37:10.470 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-24T23:37:10.480 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-24T23:37:10.498 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T23:37:10.508 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-24T23:37:10.517 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-24T23:37:10.546 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T23:37:10.830 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up postgresql-client-common (238) ... 2024-04-24T23:37:11.014 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-24T23:37:11.115 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-24T23:37:11.126 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package postgresql-common. 2024-04-24T23:37:11.154 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-24T23:37:11.211 INFO:teuthology.orchestra.run.smithi116.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-24T23:37:11.224 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T23:37:11.233 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking postgresql-common (238) ... 2024-04-24T23:37:11.375 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-24T23:37:11.501 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-24T23:37:11.627 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T23:37:11.691 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package postgresql-14. 2024-04-24T23:37:11.719 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-24T23:37:11.761 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T23:37:11.884 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package postgresql. 2024-04-24T23:37:11.902 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-24T23:37:11.942 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking postgresql (14+238) ... 2024-04-24T23:37:12.144 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package postgresql-client. 2024-04-24T23:37:12.150 INFO:teuthology.orchestra.run.smithi174.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-24T23:37:12.161 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-24T23:37:12.203 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking postgresql-client (14+238) ... 2024-04-24T23:37:12.232 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-24T23:37:12.472 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-24T23:37:12.500 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-24T23:37:12.538 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-24T23:37:12.627 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-24T23:37:12.627 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-24T23:37:12.857 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package tcl8.6. 2024-04-24T23:37:12.886 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-24T23:37:12.926 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-24T23:37:13.127 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-24T23:37:13.201 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package tcl. 2024-04-24T23:37:13.203 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package postgresql. 2024-04-24T23:37:13.230 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-24T23:37:13.230 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-24T23:37:13.269 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-24T23:37:13.272 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-24T23:37:13.277 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking postgresql (14+238) ... 2024-04-24T23:37:13.395 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-24T23:37:13.513 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package postgresql-client. 2024-04-24T23:37:13.541 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-24T23:37:13.562 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package wpasupplicant. 2024-04-24T23:37:13.571 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking postgresql-client (14+238) ... 2024-04-24T23:37:13.591 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-24T23:37:13.637 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-24T23:37:13.773 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-24T23:37:13.789 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-24T23:37:13.831 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-24T23:37:13.930 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-24T23:37:14.000 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-24T23:37:14.028 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-24T23:37:14.030 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-24T23:37:14.066 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-24T23:37:14.151 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-24T23:37:14.159 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package tcl8.6. 2024-04-24T23:37:14.187 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-24T23:37:14.274 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-24T23:37:14.400 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-24T23:37:14.409 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-24T23:37:14.444 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-24T23:37:14.473 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-24T23:37:14.519 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-24T23:37:14.807 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up postgresql-client-common (238) ... 2024-04-24T23:37:14.828 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package tcl. 2024-04-24T23:37:14.856 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-24T23:37:14.899 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-24T23:37:15.016 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-24T23:37:15.038 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-24T23:37:15.139 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up dump (0.4b47-3) ... 2024-04-24T23:37:15.142 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-24T23:37:15.216 INFO:teuthology.orchestra.run.smithi174.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-24T23:37:15.247 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package wpasupplicant. 2024-04-24T23:37:15.268 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T23:37:15.275 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-24T23:37:15.282 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T23:37:15.314 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-24T23:37:15.408 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-24T23:37:15.419 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-24T23:37:15.529 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-24T23:37:15.542 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-24T23:37:15.638 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T23:37:15.651 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-24T23:37:15.668 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-24T23:37:15.679 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-24T23:37:15.709 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-24T23:37:15.794 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-24T23:37:15.885 INFO:teuthology.orchestra.run.smithi174.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-24T23:37:15.954 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-24T23:37:16.072 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-24T23:37:16.079 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-24T23:37:16.108 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-24T23:37:16.155 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-24T23:37:16.171 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-24T23:37:16.222 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-24T23:37:16.260 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-24T23:37:16.324 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T23:37:16.434 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up postgresql-client-common (238) ... 2024-04-24T23:37:16.450 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-24T23:37:16.618 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up postgresql-client (14+238) ... 2024-04-24T23:37:16.623 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-24T23:37:16.624 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-24T23:37:16.643 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-24T23:37:16.743 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-24T23:37:16.769 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-24T23:37:16.904 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T23:37:17.013 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-24T23:37:17.113 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-24T23:37:17.114 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-24T23:37:17.230 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-24T23:37:17.240 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T23:37:17.241 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:17.241 INFO:teuthology.orchestra.run.smithi174.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-24T23:37:17.241 INFO:teuthology.orchestra.run.smithi174.stdout:which means they are currently configured by ifupdown: 2024-04-24T23:37:17.241 INFO:teuthology.orchestra.run.smithi174.stdout:- enp3s0f1 2024-04-24T23:37:17.241 INFO:teuthology.orchestra.run.smithi174.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-24T23:37:17.242 INFO:teuthology.orchestra.run.smithi174.stdout:remove their configuration from /etc/network/interfaces. 2024-04-24T23:37:17.242 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:17.354 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-24T23:37:17.356 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-24T23:37:17.482 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-24T23:37:17.600 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-24T23:37:17.665 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-24T23:37:17.740 INFO:teuthology.orchestra.run.smithi116.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-24T23:37:17.750 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-24T23:37:17.820 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-24T23:37:17.876 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-24T23:37:17.950 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-24T23:37:18.002 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-24T23:37:18.156 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-24T23:37:18.157 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-24T23:37:18.421 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T23:37:18.564 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-24T23:37:18.616 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-24T23:37:18.623 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-24T23:37:18.673 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-24T23:37:18.749 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-24T23:37:18.774 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up postgresql-common (238) ... 2024-04-24T23:37:18.804 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up dump (0.4b47-3) ... 2024-04-24T23:37:18.875 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-24T23:37:18.936 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-24T23:37:19.001 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-24T23:37:19.026 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T23:37:19.127 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-24T23:37:19.152 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-24T23:37:19.261 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-24T23:37:19.278 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-24T23:37:19.387 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-24T23:37:19.413 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-24T23:37:19.488 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-24T23:37:19.539 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-24T23:37:19.628 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-24T23:37:19.690 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-24T23:37:19.791 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-24T23:37:19.959 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-24T23:37:20.011 INFO:teuthology.orchestra.run.smithi174.stdout:Adding user postgres to group ssl-cert 2024-04-24T23:37:20.085 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T23:37:20.110 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-24T23:37:20.211 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-24T23:37:20.236 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up dump (0.4b47-3) ... 2024-04-24T23:37:20.248 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:20.248 INFO:teuthology.orchestra.run.smithi174.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-24T23:37:20.330 INFO:teuthology.orchestra.run.smithi116.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-24T23:37:20.379 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up postgresql-client (14+238) ... 2024-04-24T23:37:20.429 INFO:teuthology.orchestra.run.smithi174.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-24T23:37:20.429 INFO:teuthology.orchestra.run.smithi174.stdout:Removing obsolete dictionary files: 2024-04-24T23:37:20.479 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T23:37:20.505 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-24T23:37:20.580 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-24T23:37:20.706 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-24T23:37:20.815 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-24T23:37:20.941 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-24T23:37:20.948 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-24T23:37:20.975 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:20.976 INFO:teuthology.orchestra.run.smithi057.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-24T23:37:20.976 INFO:teuthology.orchestra.run.smithi057.stdout:which means they are currently configured by ifupdown: 2024-04-24T23:37:20.976 INFO:teuthology.orchestra.run.smithi057.stdout:- ens1f0 2024-04-24T23:37:20.976 INFO:teuthology.orchestra.run.smithi057.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-24T23:37:20.976 INFO:teuthology.orchestra.run.smithi057.stdout:remove their configuration from /etc/network/interfaces. 2024-04-24T23:37:20.976 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:21.032 INFO:teuthology.orchestra.run.smithi116.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-24T23:37:21.101 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-24T23:37:21.118 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-24T23:37:21.227 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-24T23:37:21.300 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T23:37:21.412 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-24T23:37:21.452 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-24T23:37:21.538 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T23:37:21.627 INFO:teuthology.orchestra.run.smithi174.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-24T23:37:21.647 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-24T23:37:21.710 INFO:teuthology.orchestra.run.smithi174.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-24T23:37:21.749 INFO:teuthology.orchestra.run.smithi174.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-24T23:37:21.750 INFO:teuthology.orchestra.run.smithi174.stdout:This user must also own the server process. 2024-04-24T23:37:21.750 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:21.750 INFO:teuthology.orchestra.run.smithi174.stdout:The database cluster will be initialized with locale "en_US". 2024-04-24T23:37:21.750 INFO:teuthology.orchestra.run.smithi174.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-24T23:37:21.750 INFO:teuthology.orchestra.run.smithi174.stdout:The default text search configuration will be set to "english". 2024-04-24T23:37:21.750 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:21.750 INFO:teuthology.orchestra.run.smithi174.stdout:Data page checksums are disabled. 2024-04-24T23:37:21.750 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:21.750 INFO:teuthology.orchestra.run.smithi174.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-24T23:37:21.750 INFO:teuthology.orchestra.run.smithi174.stdout:creating subdirectories ... ok 2024-04-24T23:37:21.750 INFO:teuthology.orchestra.run.smithi174.stdout:selecting dynamic shared memory implementation ... posix 2024-04-24T23:37:21.766 INFO:teuthology.orchestra.run.smithi174.stdout:selecting default max_connections ... 100 2024-04-24T23:37:21.787 INFO:teuthology.orchestra.run.smithi174.stdout:selecting default shared_buffers ... 128MB 2024-04-24T23:37:21.790 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up postgresql-client (14+238) ... 2024-04-24T23:37:21.792 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-24T23:37:21.803 INFO:teuthology.orchestra.run.smithi174.stdout:selecting default time zone ... Etc/UTC 2024-04-24T23:37:21.805 INFO:teuthology.orchestra.run.smithi174.stdout:creating configuration files ... ok 2024-04-24T23:37:21.899 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-24T23:37:21.923 INFO:teuthology.orchestra.run.smithi174.stdout:running bootstrap script ... ok 2024-04-24T23:37:22.282 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T23:37:22.358 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:22.358 INFO:teuthology.orchestra.run.smithi116.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-24T23:37:22.358 INFO:teuthology.orchestra.run.smithi116.stdout:which means they are currently configured by ifupdown: 2024-04-24T23:37:22.358 INFO:teuthology.orchestra.run.smithi116.stdout:- enp3s0f1 2024-04-24T23:37:22.358 INFO:teuthology.orchestra.run.smithi116.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-24T23:37:22.358 INFO:teuthology.orchestra.run.smithi116.stdout:remove their configuration from /etc/network/interfaces. 2024-04-24T23:37:22.358 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:22.417 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-24T23:37:22.470 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-24T23:37:22.543 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-24T23:37:22.572 INFO:teuthology.orchestra.run.smithi174.stdout:performing post-bootstrap initialization ... ok 2024-04-24T23:37:22.677 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up postgresql-common (238) ... 2024-04-24T23:37:22.802 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-24T23:37:23.122 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-24T23:37:23.237 INFO:teuthology.orchestra.run.smithi174.stdout:syncing data to disk ... ok 2024-04-24T23:37:23.578 INFO:teuthology.orchestra.run.smithi057.stdout:Adding user postgres to group ssl-cert 2024-04-24T23:37:23.618 INFO:teuthology.orchestra.run.smithi174.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-24T23:37:23.618 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T23:37:23.770 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-24T23:37:23.790 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:23.790 INFO:teuthology.orchestra.run.smithi057.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-24T23:37:23.879 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-24T23:37:23.980 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up postgresql-common (238) ... 2024-04-24T23:37:23.981 INFO:teuthology.orchestra.run.smithi057.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-24T23:37:23.981 INFO:teuthology.orchestra.run.smithi057.stdout:Removing obsolete dictionary files: 2024-04-24T23:37:24.516 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-24T23:37:24.850 INFO:teuthology.orchestra.run.smithi116.stdout:Adding user postgres to group ssl-cert 2024-04-24T23:37:24.878 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T23:37:25.075 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:25.075 INFO:teuthology.orchestra.run.smithi116.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-24T23:37:25.216 INFO:teuthology.orchestra.run.smithi057.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-24T23:37:25.230 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-24T23:37:25.268 INFO:teuthology.orchestra.run.smithi057.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-24T23:37:25.268 INFO:teuthology.orchestra.run.smithi057.stdout:This user must also own the server process. 2024-04-24T23:37:25.268 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:25.268 INFO:teuthology.orchestra.run.smithi057.stdout:The database cluster will be initialized with locale "en_US". 2024-04-24T23:37:25.268 INFO:teuthology.orchestra.run.smithi057.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-24T23:37:25.269 INFO:teuthology.orchestra.run.smithi057.stdout:The default text search configuration will be set to "english". 2024-04-24T23:37:25.269 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:25.269 INFO:teuthology.orchestra.run.smithi057.stdout:Data page checksums are disabled. 2024-04-24T23:37:25.269 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:25.269 INFO:teuthology.orchestra.run.smithi057.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-24T23:37:25.269 INFO:teuthology.orchestra.run.smithi057.stdout:creating subdirectories ... ok 2024-04-24T23:37:25.269 INFO:teuthology.orchestra.run.smithi057.stdout:selecting dynamic shared memory implementation ... posix 2024-04-24T23:37:25.284 INFO:teuthology.orchestra.run.smithi057.stdout:selecting default max_connections ... 100 2024-04-24T23:37:25.285 INFO:teuthology.orchestra.run.smithi116.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-24T23:37:25.285 INFO:teuthology.orchestra.run.smithi116.stdout:Removing obsolete dictionary files: 2024-04-24T23:37:25.304 INFO:teuthology.orchestra.run.smithi057.stdout:selecting default shared_buffers ... 128MB 2024-04-24T23:37:25.314 INFO:teuthology.orchestra.run.smithi057.stdout:selecting default time zone ... Etc/UTC 2024-04-24T23:37:25.315 INFO:teuthology.orchestra.run.smithi057.stdout:creating configuration files ... ok 2024-04-24T23:37:25.431 INFO:teuthology.orchestra.run.smithi057.stdout:running bootstrap script ... ok 2024-04-24T23:37:25.865 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-24T23:37:26.061 INFO:teuthology.orchestra.run.smithi057.stdout:performing post-bootstrap initialization ... ok 2024-04-24T23:37:26.231 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T23:37:26.372 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T23:37:26.498 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-24T23:37:26.567 INFO:teuthology.orchestra.run.smithi116.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-24T23:37:26.581 INFO:teuthology.orchestra.run.smithi116.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-24T23:37:26.624 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up postgresql (14+238) ... 2024-04-24T23:37:26.634 INFO:teuthology.orchestra.run.smithi116.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-24T23:37:26.634 INFO:teuthology.orchestra.run.smithi116.stdout:This user must also own the server process. 2024-04-24T23:37:26.634 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:26.634 INFO:teuthology.orchestra.run.smithi116.stdout:The database cluster will be initialized with locale "en_US". 2024-04-24T23:37:26.634 INFO:teuthology.orchestra.run.smithi116.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-24T23:37:26.635 INFO:teuthology.orchestra.run.smithi116.stdout:The default text search configuration will be set to "english". 2024-04-24T23:37:26.635 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:26.635 INFO:teuthology.orchestra.run.smithi116.stdout:Data page checksums are disabled. 2024-04-24T23:37:26.635 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:26.635 INFO:teuthology.orchestra.run.smithi116.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-24T23:37:26.635 INFO:teuthology.orchestra.run.smithi116.stdout:creating subdirectories ... ok 2024-04-24T23:37:26.635 INFO:teuthology.orchestra.run.smithi116.stdout:selecting dynamic shared memory implementation ... posix 2024-04-24T23:37:26.649 INFO:teuthology.orchestra.run.smithi116.stdout:selecting default max_connections ... 100 2024-04-24T23:37:26.668 INFO:teuthology.orchestra.run.smithi116.stdout:selecting default shared_buffers ... 128MB 2024-04-24T23:37:26.678 INFO:teuthology.orchestra.run.smithi116.stdout:selecting default time zone ... Etc/UTC 2024-04-24T23:37:26.679 INFO:teuthology.orchestra.run.smithi116.stdout:creating configuration files ... ok 2024-04-24T23:37:26.705 INFO:teuthology.orchestra.run.smithi057.stdout:syncing data to disk ... ok 2024-04-24T23:37:26.750 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T23:37:26.793 INFO:teuthology.orchestra.run.smithi116.stdout:running bootstrap script ... ok 2024-04-24T23:37:26.876 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T23:37:27.103 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-24T23:37:27.130 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-24T23:37:27.130 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-24T23:37:27.460 INFO:teuthology.orchestra.run.smithi116.stdout:performing post-bootstrap initialization ... ok 2024-04-24T23:37:27.728 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-24T23:37:27.821 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-24T23:37:28.084 INFO:teuthology.orchestra.run.smithi116.stdout:syncing data to disk ... ok 2024-04-24T23:37:28.131 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-24T23:37:28.274 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-24T23:37:28.465 INFO:teuthology.orchestra.run.smithi116.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-24T23:37:29.594 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-24T23:37:29.694 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-24T23:37:29.876 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T23:37:29.985 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-24T23:37:30.111 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up postgresql (14+238) ... 2024-04-24T23:37:30.179 INFO:teuthology.orchestra.run.smithi174.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-24T23:37:30.184 DEBUG:teuthology.parallel:result is None 2024-04-24T23:37:30.245 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T23:37:30.371 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T23:37:30.635 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-24T23:37:30.635 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-24T23:37:31.174 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-24T23:37:31.195 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T23:37:31.266 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-24T23:37:31.322 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-24T23:37:31.422 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up postgresql (14+238) ... 2024-04-24T23:37:31.523 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T23:37:31.551 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-24T23:37:31.633 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T23:37:31.703 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-24T23:37:31.888 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-24T23:37:31.889 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-24T23:37:32.451 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-24T23:37:32.544 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-24T23:37:32.855 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-24T23:37:32.998 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-24T23:37:32.998 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-24T23:37:33.097 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-24T23:37:33.632 INFO:teuthology.orchestra.run.smithi057.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-24T23:37:33.637 DEBUG:teuthology.parallel:result is None 2024-04-24T23:37:34.342 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-24T23:37:34.442 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-24T23:37:34.926 INFO:teuthology.orchestra.run.smithi116.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-24T23:37:34.930 DEBUG:teuthology.parallel:result is None 2024-04-24T23:37:34.931 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T23:37:35.151 DEBUG:teuthology.orchestra.run.smithi057:> dpkg-query -W -f '${Version}' ceph 2024-04-24T23:37:35.171 INFO:teuthology.orchestra.run.smithi057.stdout:19.0.0-2445-gd2c45d97-1jammy 2024-04-24T23:37:35.172 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445-gd2c45d97-1jammy 2024-04-24T23:37:35.172 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445-gd2c45d97-1jammy is installed. 2024-04-24T23:37:35.174 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T23:37:35.312 DEBUG:teuthology.orchestra.run.smithi088:> dpkg-query -W -f '${Version}' ceph 2024-04-24T23:37:35.332 INFO:teuthology.orchestra.run.smithi088.stdout:19.0.0-2445-gd2c45d97-1jammy 2024-04-24T23:37:35.332 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445-gd2c45d97-1jammy 2024-04-24T23:37:35.332 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445-gd2c45d97-1jammy is installed. 2024-04-24T23:37:35.334 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T23:37:35.475 DEBUG:teuthology.orchestra.run.smithi116:> dpkg-query -W -f '${Version}' ceph 2024-04-24T23:37:35.491 INFO:teuthology.orchestra.run.smithi116.stdout:19.0.0-2445-gd2c45d97-1jammy 2024-04-24T23:37:35.491 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445-gd2c45d97-1jammy 2024-04-24T23:37:35.491 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445-gd2c45d97-1jammy is installed. 2024-04-24T23:37:35.493 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T23:37:35.707 DEBUG:teuthology.orchestra.run.smithi174:> dpkg-query -W -f '${Version}' ceph 2024-04-24T23:37:35.727 INFO:teuthology.orchestra.run.smithi174.stdout:19.0.0-2445-gd2c45d97-1jammy 2024-04-24T23:37:35.727 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445-gd2c45d97-1jammy 2024-04-24T23:37:35.727 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445-gd2c45d97-1jammy is installed. 2024-04-24T23:37:35.729 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-24T23:37:35.729 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T23:37:35.730 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-24T23:37:35.745 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T23:37:35.745 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-24T23:37:35.759 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-24T23:37:35.759 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-24T23:37:35.773 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-24T23:37:35.774 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-24T23:37:35.788 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-24T23:37:35.788 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T23:37:35.788 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/daemon-helper 2024-04-24T23:37:35.801 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-24T23:37:35.860 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T23:37:35.861 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/daemon-helper 2024-04-24T23:37:35.874 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-24T23:37:35.928 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-24T23:37:35.928 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/daemon-helper 2024-04-24T23:37:35.941 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-24T23:37:35.994 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-24T23:37:35.994 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/daemon-helper 2024-04-24T23:37:36.008 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-24T23:37:36.062 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-24T23:37:36.062 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T23:37:36.062 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-24T23:37:36.076 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-24T23:37:36.133 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T23:37:36.133 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-24T23:37:36.148 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-24T23:37:36.204 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-24T23:37:36.204 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-24T23:37:36.218 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-24T23:37:36.270 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-24T23:37:36.270 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-24T23:37:36.284 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-24T23:37:36.337 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-24T23:37:36.338 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T23:37:36.338 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/stdin-killer 2024-04-24T23:37:36.351 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-24T23:37:36.404 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T23:37:36.404 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/stdin-killer 2024-04-24T23:37:36.418 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-24T23:37:36.476 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-24T23:37:36.476 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/stdin-killer 2024-04-24T23:37:36.490 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-24T23:37:36.545 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-24T23:37:36.545 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/stdin-killer 2024-04-24T23:37:36.559 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-24T23:37:36.614 INFO:teuthology.run_tasks:Running task ceph... 2024-04-24T23:37:36.705 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-24T23:37:36.705 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 777 /var/log/ceph 2024-04-24T23:37:36.707 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 777 /var/log/ceph 2024-04-24T23:37:36.710 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 777 /var/log/ceph 2024-04-24T23:37:36.712 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 777 /var/log/ceph 2024-04-24T23:37:36.725 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-24T23:37:36.725 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-24T23:37:36.762 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-24T23:37:36.766 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-24T23:37:36.768 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-24T23:37:36.780 INFO:tasks.ceph:Creating extra log directories... 2024-04-24T23:37:36.780 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-24T23:37:36.818 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-24T23:37:36.822 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-24T23:37:36.824 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-24T23:37:36.843 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-24T23:37:36.843 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-24T23:37:36.844 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-24T23:37:36.844 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T23:37:36.844 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-24T23:37:36.878 DEBUG:teuthology.orchestra.run.smithi057:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-24T23:37:36.954 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T23:37:36.954 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-24T23:37:36.960 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-24T23:37:37.032 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-24T23:37:37.032 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-24T23:37:37.038 DEBUG:teuthology.orchestra.run.smithi116:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-24T23:37:37.117 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-24T23:37:37.117 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-24T23:37:37.124 DEBUG:teuthology.orchestra.run.smithi174:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-24T23:37:37.204 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-24T23:37:37.204 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-24T23:37:37.204 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672197', 'branch': 'squid', 'description': 'fs/multiclient/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-2-client conf/{client mds mgr mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/ior-shared-file}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7672197', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0'], ['client.1']], 'seed': 8528, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'sleep_before_teardown': 0, 'subset': '122/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi057.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFISaJcw9ZfB19SZGzbjXdSDdu3IwfUw1EHZYOIQAOl1jrCK6FB760bjmcSHN9zGzStVN58iTl3LW0WaQ4RxsAw=', 'smithi088.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIpXt2UmyDgQSUep9K7nYumg4KspDSdfqK5kwLYzA9soikizGRPS/B9xT3kFiyP+3BjUDVjUuAVwywh3Ch1xKVM=', 'smithi116.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPctkgTH9hRnwlxHK/IRyasr3aEygt7snpmDjvM9nvxnRyzhhK2sS/6u0GdsY2uVWLwxmHbcnW4Bh2gpTixI10Y=', 'smithi174.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBM1T37Cqx2gkOq4ZA1I3ig4y9rcRP8Cr0UtFO4tYvmNbfHvAAbL33RMKWL6//qkwtOCLRhPAxoNdk+9IG/DlCs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'pexec': {'clients': ['set -x', 'cd $TESTDIR', 'sudo apt purge -y mpich', 'sudo apt install -y mpich', 'wget http://download.ceph.com/qa/ior-3.3.0.tar.bz2', 'tar xvfj ior-3.3.0.tar.bz2', 'cd ior-3.3.0', './configure', 'make', 'make install DESTDIR=$TESTDIR/binary/', 'cd $TESTDIR/', 'sudo apt install -y tree', 'tree binary/', 'rm ior-3.3.0.tar.bz2', 'rm -r ior-3.3.0', 'ln -s $TESTDIR/mnt.* $TESTDIR/gmnt']}}, {'ssh_keys': None}, {'mpi': {'exec': '$TESTDIR/binary/usr/local/bin/ior -e -w -r -W -b 10m -a POSIX -o $TESTDIR/gmnt/ior.testfile'}}, {'pexec': {'clients': ['rm -f $TESTDIR/gmnt/ior.testfile', 'rm -f $TESTDIR/gmnt', 'rm -rf $TESTDIR/binary']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-24_21:24:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-24T23:37:37.205 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-24T23:37:37.207 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-24T23:37:37.210 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-24T23:37:37.213 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-24T23:37:37.248 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/run/ceph 2024-04-24T23:37:37.255 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/run/ceph 2024-04-24T23:37:37.258 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m0777 -- /var/run/ceph 2024-04-24T23:37:37.261 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/run/ceph 2024-04-24T23:37:37.304 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T23:37:37.304 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/scratch_devs of=/dev/stdout 2024-04-24T23:37:37.314 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-24T23:37:37.314 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_1 2024-04-24T23:37:37.362 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-24T23:37:37.362 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T23:37:37.362 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 865 Links: 1 2024-04-24T23:37:37.362 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T23:37:37.362 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-04-24 23:30:49.920616862 +0000 2024-04-24T23:37:37.363 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-04-24 23:30:49.632619436 +0000 2024-04-24T23:37:37.363 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-04-24 23:30:49.632619436 +0000 2024-04-24T23:37:37.363 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2024-04-24T23:37:37.363 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-24T23:37:37.416 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-04-24T23:37:37.416 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-04-24T23:37:37.416 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000500546 s, 1.0 MB/s 2024-04-24T23:37:37.418 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-24T23:37:37.467 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_2 2024-04-24T23:37:37.513 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-24T23:37:37.513 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T23:37:37.514 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 883 Links: 1 2024-04-24T23:37:37.514 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T23:37:37.514 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-04-24 23:30:50.452612108 +0000 2024-04-24T23:37:37.514 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-04-24 23:30:50.172614611 +0000 2024-04-24T23:37:37.514 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-04-24 23:30:50.172614611 +0000 2024-04-24T23:37:37.514 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2024-04-24T23:37:37.514 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-24T23:37:37.568 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-04-24T23:37:37.568 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-04-24T23:37:37.569 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000491154 s, 1.0 MB/s 2024-04-24T23:37:37.570 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-24T23:37:37.619 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_3 2024-04-24T23:37:37.665 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-24T23:37:37.665 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T23:37:37.665 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 894 Links: 1 2024-04-24T23:37:37.665 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T23:37:37.666 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-04-24 23:30:50.948607675 +0000 2024-04-24T23:37:37.666 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-04-24 23:30:50.676610106 +0000 2024-04-24T23:37:37.666 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-04-24 23:30:50.676610106 +0000 2024-04-24T23:37:37.666 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2024-04-24T23:37:37.666 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-24T23:37:37.720 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-04-24T23:37:37.721 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-04-24T23:37:37.721 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000442132 s, 1.2 MB/s 2024-04-24T23:37:37.722 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-24T23:37:37.771 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_4 2024-04-24T23:37:37.821 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-24T23:37:37.821 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T23:37:37.821 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 918 Links: 1 2024-04-24T23:37:37.821 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T23:37:37.821 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-04-24 23:30:51.476602955 +0000 2024-04-24T23:37:37.822 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-04-24 23:30:51.200605422 +0000 2024-04-24T23:37:37.822 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-04-24 23:30:51.200605422 +0000 2024-04-24T23:37:37.822 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2024-04-24T23:37:37.822 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-24T23:37:37.876 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-04-24T23:37:37.876 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-04-24T23:37:37.876 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000485626 s, 1.1 MB/s 2024-04-24T23:37:37.877 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-24T23:37:37.927 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-24T23:37:37.927 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T23:37:37.927 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/scratch_devs of=/dev/stdout 2024-04-24T23:37:37.932 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-24T23:37:37.933 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_1 2024-04-24T23:37:37.981 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-24T23:37:37.981 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T23:37:37.982 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 878 Links: 1 2024-04-24T23:37:37.982 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T23:37:37.982 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-04-24 23:30:45.718990319 +0000 2024-04-24T23:37:37.982 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-04-24 23:30:45.470992531 +0000 2024-04-24T23:37:37.982 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-04-24 23:30:45.470992531 +0000 2024-04-24T23:37:37.982 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2024-04-24T23:37:37.982 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-24T23:37:38.036 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-04-24T23:37:38.036 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-04-24T23:37:38.036 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000398344 s, 1.3 MB/s 2024-04-24T23:37:38.037 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-24T23:37:38.086 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_2 2024-04-24T23:37:38.133 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-24T23:37:38.133 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T23:37:38.133 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 895 Links: 1 2024-04-24T23:37:38.134 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T23:37:38.134 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-04-24 23:30:46.238985679 +0000 2024-04-24T23:37:38.134 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-04-24 23:30:45.958988177 +0000 2024-04-24T23:37:38.134 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-04-24 23:30:45.958988177 +0000 2024-04-24T23:37:38.134 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2024-04-24T23:37:38.134 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-24T23:37:38.187 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-04-24T23:37:38.187 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-04-24T23:37:38.187 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000403637 s, 1.3 MB/s 2024-04-24T23:37:38.188 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-24T23:37:38.238 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_3 2024-04-24T23:37:38.285 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-24T23:37:38.285 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T23:37:38.285 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 907 Links: 1 2024-04-24T23:37:38.285 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T23:37:38.285 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-04-24 23:30:46.774980898 +0000 2024-04-24T23:37:38.285 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-04-24 23:30:46.526983110 +0000 2024-04-24T23:37:38.285 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-04-24 23:30:46.526983110 +0000 2024-04-24T23:37:38.285 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2024-04-24T23:37:38.285 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-24T23:37:38.339 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-04-24T23:37:38.339 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-04-24T23:37:38.339 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000403131 s, 1.3 MB/s 2024-04-24T23:37:38.340 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-24T23:37:38.390 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_4 2024-04-24T23:37:38.437 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-24T23:37:38.437 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T23:37:38.437 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 929 Links: 1 2024-04-24T23:37:38.437 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T23:37:38.437 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-04-24 23:30:47.246976687 +0000 2024-04-24T23:37:38.437 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-04-24 23:30:46.990978971 +0000 2024-04-24T23:37:38.438 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-04-24 23:30:46.990978971 +0000 2024-04-24T23:37:38.438 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2024-04-24T23:37:38.438 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-24T23:37:38.491 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-04-24T23:37:38.491 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-04-24T23:37:38.491 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000319183 s, 1.6 MB/s 2024-04-24T23:37:38.492 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-24T23:37:38.542 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-24T23:37:38.542 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-24T23:37:38.543 INFO:tasks.ceph:Generating config... 2024-04-24T23:37:38.544 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-24T23:37:38.544 INFO:tasks.ceph:[client] debug client = 20 2024-04-24T23:37:38.544 INFO:tasks.ceph:[client] debug ms = 1 2024-04-24T23:37:38.544 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-24T23:37:38.544 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-24T23:37:38.544 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-24T23:37:38.544 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-24T23:37:38.544 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-24T23:37:38.544 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-24T23:37:38.544 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-24T23:37:38.545 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-24T23:37:38.545 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-24T23:37:38.545 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-24T23:37:38.545 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-24T23:37:38.545 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-24T23:37:38.545 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-24T23:37:38.545 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-24T23:37:38.545 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-24T23:37:38.545 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-24T23:37:38.545 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-24T23:37:38.545 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-24T23:37:38.545 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-24T23:37:38.545 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-24T23:37:38.545 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-24T23:37:38.545 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-04-24T23:37:38.546 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-24T23:37:38.546 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-24T23:37:38.546 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-24T23:37:38.546 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-24T23:37:38.546 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-24T23:37:38.546 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-24T23:37:38.546 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-24T23:37:38.546 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-24T23:37:38.546 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-24T23:37:38.546 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-24T23:37:38.546 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-24T23:37:38.546 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-24T23:37:38.547 INFO:tasks.ceph:Setting up mon.a... 2024-04-24T23:37:38.547 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-24T23:37:38.582 INFO:teuthology.orchestra.run.smithi057.stdout:creating /etc/ceph/ceph.keyring 2024-04-24T23:37:38.594 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-24T23:37:38.673 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T23:37:38.729 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.57'), ('mon.b', '172.21.15.88'), ('mon.c', '[v2:172.21.15.88:3301,v1:172.21.15.88:6790]')] 2024-04-24T23:37:38.730 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.57,172.21.15.88,[v2:172.21.15.88:3301,v1:172.21.15.88:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-24T23:37:38.731 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T23:37:38.731 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-24T23:37:38.777 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.57 --add b 172.21.15.88 --addv c '[v2:172.21.15.88:3301,v1:172.21.15.88:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-24T23:37:38.864 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-24T23:37:38.864 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: generated fsid 1ea31698-444a-4667-bcd9-b2608ad103c3 2024-04-24T23:37:38.864 INFO:teuthology.orchestra.run.smithi057.stdout:setting min_mon_release = quincy 2024-04-24T23:37:38.864 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 0 2024-04-24T23:37:38.864 INFO:teuthology.orchestra.run.smithi057.stdout:fsid 1ea31698-444a-4667-bcd9-b2608ad103c3 2024-04-24T23:37:38.864 INFO:teuthology.orchestra.run.smithi057.stdout:last_changed 2024-04-24T23:37:38.865694+0000 2024-04-24T23:37:38.864 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-04-24T23:37:38.865694+0000 2024-04-24T23:37:38.865 INFO:teuthology.orchestra.run.smithi057.stdout:min_mon_release 17 (quincy) 2024-04-24T23:37:38.865 INFO:teuthology.orchestra.run.smithi057.stdout:election_strategy: 1 2024-04-24T23:37:38.865 INFO:teuthology.orchestra.run.smithi057.stdout:0: [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] mon.a 2024-04-24T23:37:38.865 INFO:teuthology.orchestra.run.smithi057.stdout:1: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.b 2024-04-24T23:37:38.865 INFO:teuthology.orchestra.run.smithi057.stdout:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-04-24T23:37:38.865 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-24T23:37:38.866 DEBUG:teuthology.orchestra.run.smithi057:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-24T23:37:38.918 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 1ea31698-444a-4667-bcd9-b2608ad103c3... 2024-04-24T23:37:38.919 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-24T23:37:38.962 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-24T23:37:38.965 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-24T23:37:38.967 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-24T23:37:38.992 INFO:teuthology.orchestra.run.smithi057.stdout:[global] 2024-04-24T23:37:38.993 INFO:teuthology.orchestra.run.smithi057.stdout: chdir = "" 2024-04-24T23:37:38.993 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-24T23:37:38.993 INFO:teuthology.orchestra.run.smithi057.stdout: auth supported = cephx 2024-04-24T23:37:38.993 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:38.993 INFO:teuthology.orchestra.run.smithi057.stdout: filestore xattr use omap = true 2024-04-24T23:37:38.993 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:38.993 INFO:teuthology.orchestra.run.smithi057.stdout: mon clock drift allowed = 1.000 2024-04-24T23:37:38.993 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:38.993 INFO:teuthology.orchestra.run.smithi057.stdout: osd crush chooseleaf type = 0 2024-04-24T23:37:38.993 INFO:teuthology.orchestra.run.smithi057.stdout: auth debug = true 2024-04-24T23:37:38.993 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:38.993 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on old message = true 2024-04-24T23:37:38.993 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on bug = true 2024-04-24T23:37:38.994 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:38.994 INFO:teuthology.orchestra.run.smithi057.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-24T23:37:38.994 INFO:teuthology.orchestra.run.smithi057.stdout: mon pg warn max object skew = 0 2024-04-24T23:37:38.994 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:38.994 INFO:teuthology.orchestra.run.smithi057.stdout: # disable pg_autoscaler by default for new pools 2024-04-24T23:37:38.994 INFO:teuthology.orchestra.run.smithi057.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-24T23:37:38.994 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:38.994 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default size = 2 2024-04-24T23:37:38.994 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:38.994 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow primary affinity = true 2024-04-24T23:37:38.994 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow pg remap = true 2024-04-24T23:37:38.994 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on legacy crush tunables = false 2024-04-24T23:37:38.994 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on crush straw calc version zero = false 2024-04-24T23:37:38.995 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on no sortbitwise = false 2024-04-24T23:37:38.995 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on osd down out interval zero = false 2024-04-24T23:37:38.995 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on too few osds = false 2024-04-24T23:37:38.995 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-24T23:37:38.995 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-24T23:37:38.995 INFO:teuthology.orchestra.run.smithi057.stdout: mon_allow_pool_size_one = true 2024-04-24T23:37:38.995 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:38.995 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-24T23:37:38.995 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:38.995 INFO:teuthology.orchestra.run.smithi057.stdout: osd default data pool replay window = 5 2024-04-24T23:37:38.995 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:38.995 INFO:teuthology.orchestra.run.smithi057.stdout: mon allow pool delete = true 2024-04-24T23:37:38.995 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:38.995 INFO:teuthology.orchestra.run.smithi057.stdout: mon cluster log file level = debug 2024-04-24T23:37:38.996 INFO:teuthology.orchestra.run.smithi057.stdout: debug asserts on shutdown = true 2024-04-24T23:37:38.996 INFO:teuthology.orchestra.run.smithi057.stdout: mon health detail to clog = false 2024-04-24T23:37:38.996 INFO:teuthology.orchestra.run.smithi057.stdout: mon host = "172.21.15.57,172.21.15.88,[v2:172.21.15.88:3301,v1:172.21.15.88:6790]" 2024-04-24T23:37:38.996 INFO:teuthology.orchestra.run.smithi057.stdout: fsid = 1ea31698-444a-4667-bcd9-b2608ad103c3 2024-04-24T23:37:38.996 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:38.996 INFO:teuthology.orchestra.run.smithi057.stdout:[osd] 2024-04-24T23:37:38.996 INFO:teuthology.orchestra.run.smithi057.stdout: osd journal size = 100 2024-04-24T23:37:38.996 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:38.996 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub load threshold = 5.0 2024-04-24T23:37:38.996 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub max interval = 600 2024-04-24T23:37:38.996 INFO:teuthology.orchestra.run.smithi057.stdout: osd mclock profile = high_recovery_ops 2024-04-24T23:37:38.996 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:38.996 INFO:teuthology.orchestra.run.smithi057.stdout: osd recover clone overlap = true 2024-04-24T23:37:38.996 INFO:teuthology.orchestra.run.smithi057.stdout: osd recovery max chunk = 1048576 2024-04-24T23:37:38.997 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:38.997 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug shutdown = true 2024-04-24T23:37:38.997 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug op order = true 2024-04-24T23:37:38.997 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug verify stray on activate = true 2024-04-24T23:37:38.997 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug trim objects = true 2024-04-24T23:37:38.997 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:38.997 INFO:teuthology.orchestra.run.smithi057.stdout: osd open classes on start = true 2024-04-24T23:37:38.997 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug pg log writeout = true 2024-04-24T23:37:38.997 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:38.997 INFO:teuthology.orchestra.run.smithi057.stdout: osd deep scrub update digest min age = 30 2024-04-24T23:37:38.997 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:38.997 INFO:teuthology.orchestra.run.smithi057.stdout: osd map max advance = 10 2024-04-24T23:37:38.997 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:38.997 INFO:teuthology.orchestra.run.smithi057.stdout: journal zero on create = true 2024-04-24T23:37:38.997 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:38.998 INFO:teuthology.orchestra.run.smithi057.stdout: filestore ondisk finisher threads = 3 2024-04-24T23:37:38.998 INFO:teuthology.orchestra.run.smithi057.stdout: filestore apply finisher threads = 3 2024-04-24T23:37:38.998 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:38.998 INFO:teuthology.orchestra.run.smithi057.stdout: bdev debug aio = true 2024-04-24T23:37:38.998 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug misdirected ops = true 2024-04-24T23:37:38.998 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore block size = 96636764160 2024-04-24T23:37:38.998 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore compression mode = aggressive 2024-04-24T23:37:38.998 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore fsck on mount = True 2024-04-24T23:37:38.998 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluefs = 20 2024-04-24T23:37:38.998 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluestore = 20 2024-04-24T23:37:38.998 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-04-24T23:37:38.998 INFO:teuthology.orchestra.run.smithi057.stdout: debug osd = 20 2024-04-24T23:37:38.998 INFO:teuthology.orchestra.run.smithi057.stdout: debug rocksdb = 10 2024-04-24T23:37:38.998 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd backfillfull_ratio = 0.85 2024-04-24T23:37:38.999 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd full ratio = 0.9 2024-04-24T23:37:38.999 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd nearfull ratio = 0.8 2024-04-24T23:37:38.999 INFO:teuthology.orchestra.run.smithi057.stdout: osd failsafe full ratio = 0.95 2024-04-24T23:37:38.999 INFO:teuthology.orchestra.run.smithi057.stdout: osd objectstore = bluestore 2024-04-24T23:37:38.999 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2024-04-24T23:37:38.999 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:38.999 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr] 2024-04-24T23:37:38.999 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-04-24T23:37:38.999 INFO:teuthology.orchestra.run.smithi057.stdout: debug mgr = 20 2024-04-24T23:37:38.999 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2024-04-24T23:37:38.999 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2024-04-24T23:37:38.999 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2024-04-24T23:37:38.999 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2024-04-24T23:37:38.999 INFO:teuthology.orchestra.run.smithi057.stdout: mgr/telemetry/nag = false 2024-04-24T23:37:39.000 INFO:teuthology.orchestra.run.smithi057.stdout: debug client = 20 2024-04-24T23:37:39.000 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:39.000 INFO:teuthology.orchestra.run.smithi057.stdout:[mon] 2024-04-24T23:37:39.000 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-04-24T23:37:39.000 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2024-04-24T23:37:39.000 INFO:teuthology.orchestra.run.smithi057.stdout: debug paxos = 20 2024-04-24T23:37:39.000 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2024-04-24T23:37:39.000 INFO:teuthology.orchestra.run.smithi057.stdout: mon data avail warn = 5 2024-04-24T23:37:39.000 INFO:teuthology.orchestra.run.smithi057.stdout: mon mgr mkfs grace = 240 2024-04-24T23:37:39.000 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2024-04-24T23:37:39.000 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd reporter subtree level = osd 2024-04-24T23:37:39.000 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd prime pg temp = true 2024-04-24T23:37:39.000 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2024-04-24T23:37:39.000 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:39.000 INFO:teuthology.orchestra.run.smithi057.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-24T23:37:39.001 INFO:teuthology.orchestra.run.smithi057.stdout: auth mon ticket ttl = 660 # 11m 2024-04-24T23:37:39.001 INFO:teuthology.orchestra.run.smithi057.stdout: auth service ticket ttl = 240 # 4m 2024-04-24T23:37:39.001 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:39.001 INFO:teuthology.orchestra.run.smithi057.stdout: # don't complain about insecure global_id in the test suite 2024-04-24T23:37:39.001 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-24T23:37:39.001 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-24T23:37:39.001 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:39.001 INFO:teuthology.orchestra.run.smithi057.stdout: # 1m isn't quite enough 2024-04-24T23:37:39.001 INFO:teuthology.orchestra.run.smithi057.stdout: mon_down_mkfs_grace = 2m 2024-04-24T23:37:39.001 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:39.002 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_filestore_osds = false 2024-04-24T23:37:39.002 INFO:teuthology.orchestra.run.smithi057.stdout: mon down mkfs grace = 300 2024-04-24T23:37:39.002 INFO:teuthology.orchestra.run.smithi057.stdout: mon op complaint time = 120 2024-04-24T23:37:39.002 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:37:39.002 INFO:teuthology.orchestra.run.smithi057.stdout:[client] 2024-04-24T23:37:39.002 INFO:teuthology.orchestra.run.smithi057.stdout: rgw cache enabled = true 2024-04-24T23:37:39.002 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable ops log = true 2024-04-24T23:37:39.002 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable usage log = true 2024-04-24T23:37:39.002 INFO:teuthology.orchestra.run.smithi057.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-24T23:37:39.002 INFO:teuthology.orchestra.run.smithi057.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-24T23:37:39.002 INFO:teuthology.orchestra.run.smithi057.stdout: client mount timeout = 600 2024-04-24T23:37:39.002 INFO:teuthology.orchestra.run.smithi057.stdout: debug client = 20 2024-04-24T23:37:39.002 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-04-24T23:37:39.002 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 900 2024-04-24T23:37:39.003 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 900 2024-04-24T23:37:39.003 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.a] 2024-04-24T23:37:39.003 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.b] 2024-04-24T23:37:39.003 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.c] 2024-04-24T23:37:39.003 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2024-04-24T23:37:39.003 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.c] 2024-04-24T23:37:39.003 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.b] 2024-04-24T23:37:39.003 INFO:teuthology.orchestra.run.smithi057.stdout:[mds] 2024-04-24T23:37:39.003 INFO:teuthology.orchestra.run.smithi057.stdout: debug mds = 20 2024-04-24T23:37:39.003 INFO:teuthology.orchestra.run.smithi057.stdout: debug mds balancer = 20 2024-04-24T23:37:39.003 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-04-24T23:37:39.003 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug frag = True 2024-04-24T23:37:39.003 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug scatterstat = True 2024-04-24T23:37:39.003 INFO:teuthology.orchestra.run.smithi057.stdout: mds op complaint time = 180 2024-04-24T23:37:39.004 INFO:teuthology.orchestra.run.smithi057.stdout: mds verify scatter = True 2024-04-24T23:37:39.004 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2024-04-24T23:37:39.004 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 900 2024-04-24T23:37:39.004 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 900 2024-04-24T23:37:39.005 INFO:teuthology.orchestra.run.smithi174.stdout:[global] 2024-04-24T23:37:39.005 INFO:teuthology.orchestra.run.smithi174.stdout: chdir = "" 2024-04-24T23:37:39.005 INFO:teuthology.orchestra.run.smithi174.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-24T23:37:39.005 INFO:teuthology.orchestra.run.smithi174.stdout: auth supported = cephx 2024-04-24T23:37:39.005 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:39.005 INFO:teuthology.orchestra.run.smithi174.stdout: filestore xattr use omap = true 2024-04-24T23:37:39.005 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:39.005 INFO:teuthology.orchestra.run.smithi174.stdout: mon clock drift allowed = 1.000 2024-04-24T23:37:39.005 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:39.006 INFO:teuthology.orchestra.run.smithi174.stdout: osd crush chooseleaf type = 0 2024-04-24T23:37:39.006 INFO:teuthology.orchestra.run.smithi174.stdout: auth debug = true 2024-04-24T23:37:39.006 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:39.006 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on old message = true 2024-04-24T23:37:39.006 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on bug = true 2024-04-24T23:37:39.006 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:39.006 INFO:teuthology.orchestra.run.smithi174.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-24T23:37:39.006 INFO:teuthology.orchestra.run.smithi174.stdout: mon pg warn max object skew = 0 2024-04-24T23:37:39.006 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:39.006 INFO:teuthology.orchestra.run.smithi174.stdout: # disable pg_autoscaler by default for new pools 2024-04-24T23:37:39.006 INFO:teuthology.orchestra.run.smithi174.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-24T23:37:39.006 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:39.006 INFO:teuthology.orchestra.run.smithi174.stdout: osd pool default size = 2 2024-04-24T23:37:39.006 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:39.007 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd allow primary affinity = true 2024-04-24T23:37:39.007 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd allow pg remap = true 2024-04-24T23:37:39.007 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on legacy crush tunables = false 2024-04-24T23:37:39.007 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on crush straw calc version zero = false 2024-04-24T23:37:39.007 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on no sortbitwise = false 2024-04-24T23:37:39.007 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on osd down out interval zero = false 2024-04-24T23:37:39.007 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on too few osds = false 2024-04-24T23:37:39.007 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-24T23:37:39.007 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-24T23:37:39.007 INFO:teuthology.orchestra.run.smithi174.stdout: mon_allow_pool_size_one = true 2024-04-24T23:37:39.007 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:39.007 INFO:teuthology.orchestra.run.smithi174.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-24T23:37:39.007 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:39.007 INFO:teuthology.orchestra.run.smithi174.stdout: osd default data pool replay window = 5 2024-04-24T23:37:39.008 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:39.008 INFO:teuthology.orchestra.run.smithi174.stdout: mon allow pool delete = true 2024-04-24T23:37:39.008 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:39.008 INFO:teuthology.orchestra.run.smithi174.stdout: mon cluster log file level = debug 2024-04-24T23:37:39.008 INFO:teuthology.orchestra.run.smithi174.stdout: debug asserts on shutdown = true 2024-04-24T23:37:39.008 INFO:teuthology.orchestra.run.smithi174.stdout: mon health detail to clog = false 2024-04-24T23:37:39.008 INFO:teuthology.orchestra.run.smithi174.stdout: mon host = "172.21.15.57,172.21.15.88,[v2:172.21.15.88:3301,v1:172.21.15.88:6790]" 2024-04-24T23:37:39.008 INFO:teuthology.orchestra.run.smithi174.stdout: fsid = 1ea31698-444a-4667-bcd9-b2608ad103c3 2024-04-24T23:37:39.008 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:39.008 INFO:teuthology.orchestra.run.smithi174.stdout:[osd] 2024-04-24T23:37:39.008 INFO:teuthology.orchestra.run.smithi174.stdout: osd journal size = 100 2024-04-24T23:37:39.008 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:39.008 INFO:teuthology.orchestra.run.smithi174.stdout: osd scrub load threshold = 5.0 2024-04-24T23:37:39.008 INFO:teuthology.orchestra.run.smithi174.stdout: osd scrub max interval = 600 2024-04-24T23:37:39.008 INFO:teuthology.orchestra.run.smithi174.stdout: osd mclock profile = high_recovery_ops 2024-04-24T23:37:39.009 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:39.009 INFO:teuthology.orchestra.run.smithi174.stdout: osd recover clone overlap = true 2024-04-24T23:37:39.009 INFO:teuthology.orchestra.run.smithi174.stdout: osd recovery max chunk = 1048576 2024-04-24T23:37:39.009 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:39.009 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug shutdown = true 2024-04-24T23:37:39.009 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug op order = true 2024-04-24T23:37:39.009 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug verify stray on activate = true 2024-04-24T23:37:39.009 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug trim objects = true 2024-04-24T23:37:39.009 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:39.009 INFO:teuthology.orchestra.run.smithi174.stdout: osd open classes on start = true 2024-04-24T23:37:39.009 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug pg log writeout = true 2024-04-24T23:37:39.009 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:39.009 INFO:teuthology.orchestra.run.smithi174.stdout: osd deep scrub update digest min age = 30 2024-04-24T23:37:39.009 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:39.009 INFO:teuthology.orchestra.run.smithi174.stdout: osd map max advance = 10 2024-04-24T23:37:39.010 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:39.010 INFO:teuthology.orchestra.run.smithi174.stdout: journal zero on create = true 2024-04-24T23:37:39.010 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:39.010 INFO:teuthology.orchestra.run.smithi174.stdout: filestore ondisk finisher threads = 3 2024-04-24T23:37:39.010 INFO:teuthology.orchestra.run.smithi174.stdout: filestore apply finisher threads = 3 2024-04-24T23:37:39.010 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:39.010 INFO:teuthology.orchestra.run.smithi174.stdout: bdev debug aio = true 2024-04-24T23:37:39.010 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug misdirected ops = true 2024-04-24T23:37:39.010 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore block size = 96636764160 2024-04-24T23:37:39.010 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore compression mode = aggressive 2024-04-24T23:37:39.010 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore fsck on mount = True 2024-04-24T23:37:39.010 INFO:teuthology.orchestra.run.smithi174.stdout: debug bluefs = 20 2024-04-24T23:37:39.010 INFO:teuthology.orchestra.run.smithi174.stdout: debug bluestore = 20 2024-04-24T23:37:39.010 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-04-24T23:37:39.011 INFO:teuthology.orchestra.run.smithi174.stdout: debug osd = 20 2024-04-24T23:37:39.011 INFO:teuthology.orchestra.run.smithi174.stdout: debug rocksdb = 10 2024-04-24T23:37:39.011 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd backfillfull_ratio = 0.85 2024-04-24T23:37:39.011 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd full ratio = 0.9 2024-04-24T23:37:39.011 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd nearfull ratio = 0.8 2024-04-24T23:37:39.011 INFO:teuthology.orchestra.run.smithi174.stdout: osd failsafe full ratio = 0.95 2024-04-24T23:37:39.011 INFO:teuthology.orchestra.run.smithi174.stdout: osd objectstore = bluestore 2024-04-24T23:37:39.011 INFO:teuthology.orchestra.run.smithi174.stdout: osd op complaint time = 180 2024-04-24T23:37:39.011 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:39.011 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr] 2024-04-24T23:37:39.011 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-04-24T23:37:39.011 INFO:teuthology.orchestra.run.smithi174.stdout: debug mgr = 20 2024-04-24T23:37:39.011 INFO:teuthology.orchestra.run.smithi174.stdout: debug mon = 20 2024-04-24T23:37:39.011 INFO:teuthology.orchestra.run.smithi174.stdout: debug auth = 20 2024-04-24T23:37:39.011 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min pgs per osd = 4 2024-04-24T23:37:39.012 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min bytes per osd = 10 2024-04-24T23:37:39.012 INFO:teuthology.orchestra.run.smithi174.stdout: mgr/telemetry/nag = false 2024-04-24T23:37:39.012 INFO:teuthology.orchestra.run.smithi174.stdout: debug client = 20 2024-04-24T23:37:39.012 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:39.012 INFO:teuthology.orchestra.run.smithi174.stdout:[mon] 2024-04-24T23:37:39.012 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-04-24T23:37:39.012 INFO:teuthology.orchestra.run.smithi174.stdout: debug mon = 20 2024-04-24T23:37:39.012 INFO:teuthology.orchestra.run.smithi174.stdout: debug paxos = 20 2024-04-24T23:37:39.012 INFO:teuthology.orchestra.run.smithi174.stdout: debug auth = 20 2024-04-24T23:37:39.012 INFO:teuthology.orchestra.run.smithi174.stdout: mon data avail warn = 5 2024-04-24T23:37:39.012 INFO:teuthology.orchestra.run.smithi174.stdout: mon mgr mkfs grace = 240 2024-04-24T23:37:39.012 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min pgs per osd = 4 2024-04-24T23:37:39.012 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd reporter subtree level = osd 2024-04-24T23:37:39.012 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd prime pg temp = true 2024-04-24T23:37:39.013 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min bytes per osd = 10 2024-04-24T23:37:39.013 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:39.013 INFO:teuthology.orchestra.run.smithi174.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-24T23:37:39.013 INFO:teuthology.orchestra.run.smithi174.stdout: auth mon ticket ttl = 660 # 11m 2024-04-24T23:37:39.013 INFO:teuthology.orchestra.run.smithi174.stdout: auth service ticket ttl = 240 # 4m 2024-04-24T23:37:39.013 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:39.013 INFO:teuthology.orchestra.run.smithi174.stdout: # don't complain about insecure global_id in the test suite 2024-04-24T23:37:39.013 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-24T23:37:39.013 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-24T23:37:39.013 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:39.013 INFO:teuthology.orchestra.run.smithi174.stdout: # 1m isn't quite enough 2024-04-24T23:37:39.013 INFO:teuthology.orchestra.run.smithi174.stdout: mon_down_mkfs_grace = 2m 2024-04-24T23:37:39.013 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:39.013 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_filestore_osds = false 2024-04-24T23:37:39.013 INFO:teuthology.orchestra.run.smithi174.stdout: mon down mkfs grace = 300 2024-04-24T23:37:39.014 INFO:teuthology.orchestra.run.smithi174.stdout: mon op complaint time = 120 2024-04-24T23:37:39.014 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:37:39.014 INFO:teuthology.orchestra.run.smithi174.stdout:[client] 2024-04-24T23:37:39.014 INFO:teuthology.orchestra.run.smithi174.stdout: rgw cache enabled = true 2024-04-24T23:37:39.014 INFO:teuthology.orchestra.run.smithi174.stdout: rgw enable ops log = true 2024-04-24T23:37:39.014 INFO:teuthology.orchestra.run.smithi174.stdout: rgw enable usage log = true 2024-04-24T23:37:39.014 INFO:teuthology.orchestra.run.smithi174.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-24T23:37:39.014 INFO:teuthology.orchestra.run.smithi174.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-24T23:37:39.014 INFO:teuthology.orchestra.run.smithi174.stdout: client mount timeout = 600 2024-04-24T23:37:39.014 INFO:teuthology.orchestra.run.smithi174.stdout: debug client = 20 2024-04-24T23:37:39.014 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-04-24T23:37:39.014 INFO:teuthology.orchestra.run.smithi174.stdout: rados mon op timeout = 900 2024-04-24T23:37:39.014 INFO:teuthology.orchestra.run.smithi174.stdout: rados osd op timeout = 900 2024-04-24T23:37:39.014 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.a] 2024-04-24T23:37:39.015 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.b] 2024-04-24T23:37:39.015 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.c] 2024-04-24T23:37:39.015 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.a] 2024-04-24T23:37:39.015 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.c] 2024-04-24T23:37:39.015 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.b] 2024-04-24T23:37:39.015 INFO:teuthology.orchestra.run.smithi174.stdout:[mds] 2024-04-24T23:37:39.015 INFO:teuthology.orchestra.run.smithi174.stdout: debug mds = 20 2024-04-24T23:37:39.015 INFO:teuthology.orchestra.run.smithi174.stdout: debug mds balancer = 20 2024-04-24T23:37:39.015 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-04-24T23:37:39.015 INFO:teuthology.orchestra.run.smithi174.stdout: mds debug frag = True 2024-04-24T23:37:39.015 INFO:teuthology.orchestra.run.smithi174.stdout: mds debug scatterstat = True 2024-04-24T23:37:39.015 INFO:teuthology.orchestra.run.smithi174.stdout: mds op complaint time = 180 2024-04-24T23:37:39.015 INFO:teuthology.orchestra.run.smithi174.stdout: mds verify scatter = True 2024-04-24T23:37:39.015 INFO:teuthology.orchestra.run.smithi174.stdout: osd op complaint time = 180 2024-04-24T23:37:39.015 INFO:teuthology.orchestra.run.smithi174.stdout: rados mon op timeout = 900 2024-04-24T23:37:39.016 INFO:teuthology.orchestra.run.smithi174.stdout: rados osd op timeout = 900 2024-04-24T23:37:39.016 INFO:teuthology.orchestra.run.smithi116.stdout:[global] 2024-04-24T23:37:39.016 INFO:teuthology.orchestra.run.smithi116.stdout: chdir = "" 2024-04-24T23:37:39.016 INFO:teuthology.orchestra.run.smithi116.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-24T23:37:39.016 INFO:teuthology.orchestra.run.smithi116.stdout: auth supported = cephx 2024-04-24T23:37:39.016 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:39.016 INFO:teuthology.orchestra.run.smithi116.stdout: filestore xattr use omap = true 2024-04-24T23:37:39.016 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:39.016 INFO:teuthology.orchestra.run.smithi116.stdout: mon clock drift allowed = 1.000 2024-04-24T23:37:39.016 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:39.016 INFO:teuthology.orchestra.run.smithi116.stdout: osd crush chooseleaf type = 0 2024-04-24T23:37:39.016 INFO:teuthology.orchestra.run.smithi116.stdout: auth debug = true 2024-04-24T23:37:39.016 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:39.017 INFO:teuthology.orchestra.run.smithi116.stdout: ms die on old message = true 2024-04-24T23:37:39.017 INFO:teuthology.orchestra.run.smithi116.stdout: ms die on bug = true 2024-04-24T23:37:39.017 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:39.017 INFO:teuthology.orchestra.run.smithi116.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-24T23:37:39.017 INFO:teuthology.orchestra.run.smithi116.stdout: mon pg warn max object skew = 0 2024-04-24T23:37:39.017 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:39.017 INFO:teuthology.orchestra.run.smithi116.stdout: # disable pg_autoscaler by default for new pools 2024-04-24T23:37:39.017 INFO:teuthology.orchestra.run.smithi116.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-24T23:37:39.017 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:39.017 INFO:teuthology.orchestra.run.smithi116.stdout: osd pool default size = 2 2024-04-24T23:37:39.017 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:39.017 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd allow primary affinity = true 2024-04-24T23:37:39.017 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd allow pg remap = true 2024-04-24T23:37:39.017 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on legacy crush tunables = false 2024-04-24T23:37:39.017 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on crush straw calc version zero = false 2024-04-24T23:37:39.018 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on no sortbitwise = false 2024-04-24T23:37:39.018 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on osd down out interval zero = false 2024-04-24T23:37:39.018 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on too few osds = false 2024-04-24T23:37:39.018 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-24T23:37:39.018 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-24T23:37:39.018 INFO:teuthology.orchestra.run.smithi116.stdout: mon_allow_pool_size_one = true 2024-04-24T23:37:39.018 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:39.018 INFO:teuthology.orchestra.run.smithi116.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-24T23:37:39.018 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:39.018 INFO:teuthology.orchestra.run.smithi116.stdout: osd default data pool replay window = 5 2024-04-24T23:37:39.018 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:39.018 INFO:teuthology.orchestra.run.smithi116.stdout: mon allow pool delete = true 2024-04-24T23:37:39.018 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:39.018 INFO:teuthology.orchestra.run.smithi116.stdout: mon cluster log file level = debug 2024-04-24T23:37:39.019 INFO:teuthology.orchestra.run.smithi116.stdout: debug asserts on shutdown = true 2024-04-24T23:37:39.019 INFO:teuthology.orchestra.run.smithi116.stdout: mon health detail to clog = false 2024-04-24T23:37:39.019 INFO:teuthology.orchestra.run.smithi116.stdout: mon host = "172.21.15.57,172.21.15.88,[v2:172.21.15.88:3301,v1:172.21.15.88:6790]" 2024-04-24T23:37:39.019 INFO:teuthology.orchestra.run.smithi116.stdout: fsid = 1ea31698-444a-4667-bcd9-b2608ad103c3 2024-04-24T23:37:39.019 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:39.019 INFO:teuthology.orchestra.run.smithi116.stdout:[osd] 2024-04-24T23:37:39.019 INFO:teuthology.orchestra.run.smithi116.stdout: osd journal size = 100 2024-04-24T23:37:39.019 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:39.019 INFO:teuthology.orchestra.run.smithi116.stdout: osd scrub load threshold = 5.0 2024-04-24T23:37:39.019 INFO:teuthology.orchestra.run.smithi116.stdout: osd scrub max interval = 600 2024-04-24T23:37:39.019 INFO:teuthology.orchestra.run.smithi116.stdout: osd mclock profile = high_recovery_ops 2024-04-24T23:37:39.019 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:39.019 INFO:teuthology.orchestra.run.smithi116.stdout: osd recover clone overlap = true 2024-04-24T23:37:39.019 INFO:teuthology.orchestra.run.smithi116.stdout: osd recovery max chunk = 1048576 2024-04-24T23:37:39.020 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:39.020 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug shutdown = true 2024-04-24T23:37:39.020 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug op order = true 2024-04-24T23:37:39.020 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug verify stray on activate = true 2024-04-24T23:37:39.020 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug trim objects = true 2024-04-24T23:37:39.020 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:39.020 INFO:teuthology.orchestra.run.smithi116.stdout: osd open classes on start = true 2024-04-24T23:37:39.020 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug pg log writeout = true 2024-04-24T23:37:39.020 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:39.020 INFO:teuthology.orchestra.run.smithi116.stdout: osd deep scrub update digest min age = 30 2024-04-24T23:37:39.020 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:39.020 INFO:teuthology.orchestra.run.smithi116.stdout: osd map max advance = 10 2024-04-24T23:37:39.020 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:39.020 INFO:teuthology.orchestra.run.smithi116.stdout: journal zero on create = true 2024-04-24T23:37:39.020 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:39.021 INFO:teuthology.orchestra.run.smithi116.stdout: filestore ondisk finisher threads = 3 2024-04-24T23:37:39.021 INFO:teuthology.orchestra.run.smithi116.stdout: filestore apply finisher threads = 3 2024-04-24T23:37:39.021 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:39.021 INFO:teuthology.orchestra.run.smithi116.stdout: bdev debug aio = true 2024-04-24T23:37:39.021 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug misdirected ops = true 2024-04-24T23:37:39.021 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore block size = 96636764160 2024-04-24T23:37:39.021 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore compression mode = aggressive 2024-04-24T23:37:39.021 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore fsck on mount = True 2024-04-24T23:37:39.021 INFO:teuthology.orchestra.run.smithi116.stdout: debug bluefs = 20 2024-04-24T23:37:39.021 INFO:teuthology.orchestra.run.smithi116.stdout: debug bluestore = 20 2024-04-24T23:37:39.021 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-04-24T23:37:39.021 INFO:teuthology.orchestra.run.smithi116.stdout: debug osd = 20 2024-04-24T23:37:39.021 INFO:teuthology.orchestra.run.smithi116.stdout: debug rocksdb = 10 2024-04-24T23:37:39.021 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd backfillfull_ratio = 0.85 2024-04-24T23:37:39.022 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd full ratio = 0.9 2024-04-24T23:37:39.022 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd nearfull ratio = 0.8 2024-04-24T23:37:39.022 INFO:teuthology.orchestra.run.smithi116.stdout: osd failsafe full ratio = 0.95 2024-04-24T23:37:39.022 INFO:teuthology.orchestra.run.smithi116.stdout: osd objectstore = bluestore 2024-04-24T23:37:39.022 INFO:teuthology.orchestra.run.smithi116.stdout: osd op complaint time = 180 2024-04-24T23:37:39.022 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:39.022 INFO:teuthology.orchestra.run.smithi116.stdout:[mgr] 2024-04-24T23:37:39.022 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-04-24T23:37:39.022 INFO:teuthology.orchestra.run.smithi116.stdout: debug mgr = 20 2024-04-24T23:37:39.022 INFO:teuthology.orchestra.run.smithi116.stdout: debug mon = 20 2024-04-24T23:37:39.022 INFO:teuthology.orchestra.run.smithi116.stdout: debug auth = 20 2024-04-24T23:37:39.022 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min pgs per osd = 4 2024-04-24T23:37:39.022 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min bytes per osd = 10 2024-04-24T23:37:39.022 INFO:teuthology.orchestra.run.smithi116.stdout: mgr/telemetry/nag = false 2024-04-24T23:37:39.023 INFO:teuthology.orchestra.run.smithi116.stdout: debug client = 20 2024-04-24T23:37:39.023 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:39.023 INFO:teuthology.orchestra.run.smithi116.stdout:[mon] 2024-04-24T23:37:39.023 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-04-24T23:37:39.023 INFO:teuthology.orchestra.run.smithi116.stdout: debug mon = 20 2024-04-24T23:37:39.023 INFO:teuthology.orchestra.run.smithi116.stdout: debug paxos = 20 2024-04-24T23:37:39.023 INFO:teuthology.orchestra.run.smithi116.stdout: debug auth = 20 2024-04-24T23:37:39.023 INFO:teuthology.orchestra.run.smithi116.stdout: mon data avail warn = 5 2024-04-24T23:37:39.023 INFO:teuthology.orchestra.run.smithi116.stdout: mon mgr mkfs grace = 240 2024-04-24T23:37:39.023 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min pgs per osd = 4 2024-04-24T23:37:39.023 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd reporter subtree level = osd 2024-04-24T23:37:39.023 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd prime pg temp = true 2024-04-24T23:37:39.023 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min bytes per osd = 10 2024-04-24T23:37:39.023 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:39.024 INFO:teuthology.orchestra.run.smithi116.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-24T23:37:39.024 INFO:teuthology.orchestra.run.smithi116.stdout: auth mon ticket ttl = 660 # 11m 2024-04-24T23:37:39.024 INFO:teuthology.orchestra.run.smithi116.stdout: auth service ticket ttl = 240 # 4m 2024-04-24T23:37:39.024 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:39.024 INFO:teuthology.orchestra.run.smithi116.stdout: # don't complain about insecure global_id in the test suite 2024-04-24T23:37:39.024 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-24T23:37:39.024 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-24T23:37:39.024 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:39.024 INFO:teuthology.orchestra.run.smithi116.stdout: # 1m isn't quite enough 2024-04-24T23:37:39.024 INFO:teuthology.orchestra.run.smithi116.stdout: mon_down_mkfs_grace = 2m 2024-04-24T23:37:39.024 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:39.024 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_filestore_osds = false 2024-04-24T23:37:39.024 INFO:teuthology.orchestra.run.smithi116.stdout: mon down mkfs grace = 300 2024-04-24T23:37:39.024 INFO:teuthology.orchestra.run.smithi116.stdout: mon op complaint time = 120 2024-04-24T23:37:39.025 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:37:39.025 INFO:teuthology.orchestra.run.smithi116.stdout:[client] 2024-04-24T23:37:39.025 INFO:teuthology.orchestra.run.smithi116.stdout: rgw cache enabled = true 2024-04-24T23:37:39.025 INFO:teuthology.orchestra.run.smithi116.stdout: rgw enable ops log = true 2024-04-24T23:37:39.025 INFO:teuthology.orchestra.run.smithi116.stdout: rgw enable usage log = true 2024-04-24T23:37:39.025 INFO:teuthology.orchestra.run.smithi116.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-24T23:37:39.025 INFO:teuthology.orchestra.run.smithi116.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-24T23:37:39.025 INFO:teuthology.orchestra.run.smithi116.stdout: client mount timeout = 600 2024-04-24T23:37:39.025 INFO:teuthology.orchestra.run.smithi116.stdout: debug client = 20 2024-04-24T23:37:39.025 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-04-24T23:37:39.025 INFO:teuthology.orchestra.run.smithi116.stdout: rados mon op timeout = 900 2024-04-24T23:37:39.025 INFO:teuthology.orchestra.run.smithi116.stdout: rados osd op timeout = 900 2024-04-24T23:37:39.025 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.a] 2024-04-24T23:37:39.025 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.b] 2024-04-24T23:37:39.025 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.c] 2024-04-24T23:37:39.026 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.a] 2024-04-24T23:37:39.026 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.c] 2024-04-24T23:37:39.026 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.b] 2024-04-24T23:37:39.026 INFO:teuthology.orchestra.run.smithi116.stdout:[mds] 2024-04-24T23:37:39.026 INFO:teuthology.orchestra.run.smithi116.stdout: debug mds = 20 2024-04-24T23:37:39.026 INFO:teuthology.orchestra.run.smithi116.stdout: debug mds balancer = 20 2024-04-24T23:37:39.026 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-04-24T23:37:39.026 INFO:teuthology.orchestra.run.smithi116.stdout: mds debug frag = True 2024-04-24T23:37:39.026 INFO:teuthology.orchestra.run.smithi116.stdout: mds debug scatterstat = True 2024-04-24T23:37:39.026 INFO:teuthology.orchestra.run.smithi116.stdout: mds op complaint time = 180 2024-04-24T23:37:39.026 INFO:teuthology.orchestra.run.smithi116.stdout: mds verify scatter = True 2024-04-24T23:37:39.026 INFO:teuthology.orchestra.run.smithi116.stdout: osd op complaint time = 180 2024-04-24T23:37:39.026 INFO:teuthology.orchestra.run.smithi116.stdout: rados mon op timeout = 900 2024-04-24T23:37:39.026 INFO:teuthology.orchestra.run.smithi116.stdout: rados osd op timeout = 900 2024-04-24T23:37:39.028 INFO:teuthology.orchestra.run.smithi088.stdout:[global] 2024-04-24T23:37:39.028 INFO:teuthology.orchestra.run.smithi088.stdout: chdir = "" 2024-04-24T23:37:39.028 INFO:teuthology.orchestra.run.smithi088.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-24T23:37:39.028 INFO:teuthology.orchestra.run.smithi088.stdout: auth supported = cephx 2024-04-24T23:37:39.028 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:37:39.028 INFO:teuthology.orchestra.run.smithi088.stdout: filestore xattr use omap = true 2024-04-24T23:37:39.028 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:37:39.028 INFO:teuthology.orchestra.run.smithi088.stdout: mon clock drift allowed = 1.000 2024-04-24T23:37:39.028 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:37:39.028 INFO:teuthology.orchestra.run.smithi088.stdout: osd crush chooseleaf type = 0 2024-04-24T23:37:39.029 INFO:teuthology.orchestra.run.smithi088.stdout: auth debug = true 2024-04-24T23:37:39.029 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:37:39.029 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on old message = true 2024-04-24T23:37:39.029 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on bug = true 2024-04-24T23:37:39.029 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:37:39.029 INFO:teuthology.orchestra.run.smithi088.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-24T23:37:39.029 INFO:teuthology.orchestra.run.smithi088.stdout: mon pg warn max object skew = 0 2024-04-24T23:37:39.029 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:37:39.029 INFO:teuthology.orchestra.run.smithi088.stdout: # disable pg_autoscaler by default for new pools 2024-04-24T23:37:39.029 INFO:teuthology.orchestra.run.smithi088.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-24T23:37:39.029 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:37:39.029 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default size = 2 2024-04-24T23:37:39.029 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:37:39.029 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow primary affinity = true 2024-04-24T23:37:39.030 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow pg remap = true 2024-04-24T23:37:39.030 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on legacy crush tunables = false 2024-04-24T23:37:39.030 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on crush straw calc version zero = false 2024-04-24T23:37:39.030 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on no sortbitwise = false 2024-04-24T23:37:39.030 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on osd down out interval zero = false 2024-04-24T23:37:39.030 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on too few osds = false 2024-04-24T23:37:39.030 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-24T23:37:39.030 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-24T23:37:39.030 INFO:teuthology.orchestra.run.smithi088.stdout: mon_allow_pool_size_one = true 2024-04-24T23:37:39.030 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:37:39.030 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-24T23:37:39.030 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:37:39.030 INFO:teuthology.orchestra.run.smithi088.stdout: osd default data pool replay window = 5 2024-04-24T23:37:39.031 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:37:39.031 INFO:teuthology.orchestra.run.smithi088.stdout: mon allow pool delete = true 2024-04-24T23:37:39.031 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:37:39.031 INFO:teuthology.orchestra.run.smithi088.stdout: mon cluster log file level = debug 2024-04-24T23:37:39.031 INFO:teuthology.orchestra.run.smithi088.stdout: debug asserts on shutdown = true 2024-04-24T23:37:39.031 INFO:teuthology.orchestra.run.smithi088.stdout: mon health detail to clog = false 2024-04-24T23:37:39.031 INFO:teuthology.orchestra.run.smithi088.stdout: mon host = "172.21.15.57,172.21.15.88,[v2:172.21.15.88:3301,v1:172.21.15.88:6790]" 2024-04-24T23:37:39.031 INFO:teuthology.orchestra.run.smithi088.stdout: fsid = 1ea31698-444a-4667-bcd9-b2608ad103c3 2024-04-24T23:37:39.031 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:37:39.031 INFO:teuthology.orchestra.run.smithi088.stdout:[osd] 2024-04-24T23:37:39.031 INFO:teuthology.orchestra.run.smithi088.stdout: osd journal size = 100 2024-04-24T23:37:39.032 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:37:39.032 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub load threshold = 5.0 2024-04-24T23:37:39.032 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub max interval = 600 2024-04-24T23:37:39.032 INFO:teuthology.orchestra.run.smithi088.stdout: osd mclock profile = high_recovery_ops 2024-04-24T23:37:39.032 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:37:39.032 INFO:teuthology.orchestra.run.smithi088.stdout: osd recover clone overlap = true 2024-04-24T23:37:39.032 INFO:teuthology.orchestra.run.smithi088.stdout: osd recovery max chunk = 1048576 2024-04-24T23:37:39.032 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:37:39.032 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug shutdown = true 2024-04-24T23:37:39.032 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug op order = true 2024-04-24T23:37:39.032 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug verify stray on activate = true 2024-04-24T23:37:39.032 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug trim objects = true 2024-04-24T23:37:39.032 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:37:39.032 INFO:teuthology.orchestra.run.smithi088.stdout: osd open classes on start = true 2024-04-24T23:37:39.033 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug pg log writeout = true 2024-04-24T23:37:39.033 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:37:39.033 INFO:teuthology.orchestra.run.smithi088.stdout: osd deep scrub update digest min age = 30 2024-04-24T23:37:39.033 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:37:39.033 INFO:teuthology.orchestra.run.smithi088.stdout: osd map max advance = 10 2024-04-24T23:37:39.033 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:37:39.033 INFO:teuthology.orchestra.run.smithi088.stdout: journal zero on create = true 2024-04-24T23:37:39.033 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:37:39.033 INFO:teuthology.orchestra.run.smithi088.stdout: filestore ondisk finisher threads = 3 2024-04-24T23:37:39.033 INFO:teuthology.orchestra.run.smithi088.stdout: filestore apply finisher threads = 3 2024-04-24T23:37:39.033 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:37:39.033 INFO:teuthology.orchestra.run.smithi088.stdout: bdev debug aio = true 2024-04-24T23:37:39.033 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug misdirected ops = true 2024-04-24T23:37:39.033 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore block size = 96636764160 2024-04-24T23:37:39.034 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore compression mode = aggressive 2024-04-24T23:37:39.034 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore fsck on mount = True 2024-04-24T23:37:39.034 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluefs = 20 2024-04-24T23:37:39.034 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluestore = 20 2024-04-24T23:37:39.034 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-04-24T23:37:39.034 INFO:teuthology.orchestra.run.smithi088.stdout: debug osd = 20 2024-04-24T23:37:39.034 INFO:teuthology.orchestra.run.smithi088.stdout: debug rocksdb = 10 2024-04-24T23:37:39.034 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd backfillfull_ratio = 0.85 2024-04-24T23:37:39.034 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd full ratio = 0.9 2024-04-24T23:37:39.034 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd nearfull ratio = 0.8 2024-04-24T23:37:39.034 INFO:teuthology.orchestra.run.smithi088.stdout: osd failsafe full ratio = 0.95 2024-04-24T23:37:39.034 INFO:teuthology.orchestra.run.smithi088.stdout: osd objectstore = bluestore 2024-04-24T23:37:39.034 INFO:teuthology.orchestra.run.smithi088.stdout: osd op complaint time = 180 2024-04-24T23:37:39.034 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:37:39.035 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr] 2024-04-24T23:37:39.035 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-04-24T23:37:39.035 INFO:teuthology.orchestra.run.smithi088.stdout: debug mgr = 20 2024-04-24T23:37:39.035 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2024-04-24T23:37:39.035 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2024-04-24T23:37:39.035 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2024-04-24T23:37:39.035 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2024-04-24T23:37:39.035 INFO:teuthology.orchestra.run.smithi088.stdout: mgr/telemetry/nag = false 2024-04-24T23:37:39.035 INFO:teuthology.orchestra.run.smithi088.stdout: debug client = 20 2024-04-24T23:37:39.035 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:37:39.035 INFO:teuthology.orchestra.run.smithi088.stdout:[mon] 2024-04-24T23:37:39.035 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-04-24T23:37:39.035 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2024-04-24T23:37:39.035 INFO:teuthology.orchestra.run.smithi088.stdout: debug paxos = 20 2024-04-24T23:37:39.036 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2024-04-24T23:37:39.036 INFO:teuthology.orchestra.run.smithi088.stdout: mon data avail warn = 5 2024-04-24T23:37:39.036 INFO:teuthology.orchestra.run.smithi088.stdout: mon mgr mkfs grace = 240 2024-04-24T23:37:39.036 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2024-04-24T23:37:39.036 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd reporter subtree level = osd 2024-04-24T23:37:39.036 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd prime pg temp = true 2024-04-24T23:37:39.036 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2024-04-24T23:37:39.036 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:37:39.036 INFO:teuthology.orchestra.run.smithi088.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-24T23:37:39.036 INFO:teuthology.orchestra.run.smithi088.stdout: auth mon ticket ttl = 660 # 11m 2024-04-24T23:37:39.036 INFO:teuthology.orchestra.run.smithi088.stdout: auth service ticket ttl = 240 # 4m 2024-04-24T23:37:39.036 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:37:39.036 INFO:teuthology.orchestra.run.smithi088.stdout: # don't complain about insecure global_id in the test suite 2024-04-24T23:37:39.036 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-24T23:37:39.036 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-24T23:37:39.037 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:37:39.037 INFO:teuthology.orchestra.run.smithi088.stdout: # 1m isn't quite enough 2024-04-24T23:37:39.037 INFO:teuthology.orchestra.run.smithi088.stdout: mon_down_mkfs_grace = 2m 2024-04-24T23:37:39.037 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:37:39.037 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_filestore_osds = false 2024-04-24T23:37:39.037 INFO:teuthology.orchestra.run.smithi088.stdout: mon down mkfs grace = 300 2024-04-24T23:37:39.037 INFO:teuthology.orchestra.run.smithi088.stdout: mon op complaint time = 120 2024-04-24T23:37:39.037 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-24T23:37:39.037 INFO:teuthology.orchestra.run.smithi088.stdout:[client] 2024-04-24T23:37:39.037 INFO:teuthology.orchestra.run.smithi088.stdout: rgw cache enabled = true 2024-04-24T23:37:39.037 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable ops log = true 2024-04-24T23:37:39.037 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable usage log = true 2024-04-24T23:37:39.037 INFO:teuthology.orchestra.run.smithi088.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-24T23:37:39.037 INFO:teuthology.orchestra.run.smithi088.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-24T23:37:39.038 INFO:teuthology.orchestra.run.smithi088.stdout: client mount timeout = 600 2024-04-24T23:37:39.038 INFO:teuthology.orchestra.run.smithi088.stdout: debug client = 20 2024-04-24T23:37:39.038 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-04-24T23:37:39.038 INFO:teuthology.orchestra.run.smithi088.stdout: rados mon op timeout = 900 2024-04-24T23:37:39.038 INFO:teuthology.orchestra.run.smithi088.stdout: rados osd op timeout = 900 2024-04-24T23:37:39.038 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.a] 2024-04-24T23:37:39.038 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.b] 2024-04-24T23:37:39.038 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.c] 2024-04-24T23:37:39.038 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.a] 2024-04-24T23:37:39.038 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.c] 2024-04-24T23:37:39.038 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.b] 2024-04-24T23:37:39.038 INFO:teuthology.orchestra.run.smithi088.stdout:[mds] 2024-04-24T23:37:39.038 INFO:teuthology.orchestra.run.smithi088.stdout: debug mds = 20 2024-04-24T23:37:39.038 INFO:teuthology.orchestra.run.smithi088.stdout: debug mds balancer = 20 2024-04-24T23:37:39.039 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-04-24T23:37:39.039 INFO:teuthology.orchestra.run.smithi088.stdout: mds debug frag = True 2024-04-24T23:37:39.039 INFO:teuthology.orchestra.run.smithi088.stdout: mds debug scatterstat = True 2024-04-24T23:37:39.039 INFO:teuthology.orchestra.run.smithi088.stdout: mds op complaint time = 180 2024-04-24T23:37:39.039 INFO:teuthology.orchestra.run.smithi088.stdout: mds verify scatter = True 2024-04-24T23:37:39.039 INFO:teuthology.orchestra.run.smithi088.stdout: osd op complaint time = 180 2024-04-24T23:37:39.039 INFO:teuthology.orchestra.run.smithi088.stdout: rados mon op timeout = 900 2024-04-24T23:37:39.039 INFO:teuthology.orchestra.run.smithi088.stdout: rados osd op timeout = 900 2024-04-24T23:37:39.041 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-24T23:37:39.041 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-24T23:37:39.121 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-24T23:37:39.121 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T23:37:39.121 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-24T23:37:39.127 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T23:37:39.127 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-24T23:37:39.173 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi057.front.sepia.ceph.com 2024-04-24T23:37:39.173 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T23:37:39.173 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-24T23:37:39.174 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T23:37:39.239 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T23:37:39.239 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-24T23:37:39.289 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi088.front.sepia.ceph.com 2024-04-24T23:37:39.290 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T23:37:39.290 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-24T23:37:39.290 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T23:37:39.313 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T23:37:39.313 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-24T23:37:39.361 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi116.front.sepia.ceph.com 2024-04-24T23:37:39.361 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-24T23:37:39.361 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-24T23:37:39.361 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T23:37:39.386 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-24T23:37:39.386 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-24T23:37:39.435 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi174.front.sepia.ceph.com 2024-04-24T23:37:39.435 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-24T23:37:39.435 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-24T23:37:39.435 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T23:37:39.458 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-24T23:37:39.458 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-24T23:37:39.507 INFO:tasks.ceph:Setting up mon nodes... 2024-04-24T23:37:39.507 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-24T23:37:39.507 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-24T23:37:39.552 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-24T23:37:39.556 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-24T23:37:39.597 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-24T23:37:39.608 INFO:tasks.ceph:Setting up mds nodes... 2024-04-24T23:37:39.609 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-24T23:37:39.651 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-24T23:37:39.654 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-24T23:37:39.709 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-24T23:37:39.796 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-24T23:37:39.799 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-24T23:37:39.854 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-24T23:37:39.898 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-24T23:37:39.901 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-24T23:37:39.956 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-24T23:37:39.956 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-24T23:37:39.992 INFO:teuthology.orchestra.run.smithi116.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-24T23:37:40.029 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-24T23:37:40.065 INFO:teuthology.orchestra.run.smithi174.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-24T23:37:40.093 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-24T23:37:40.094 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-24T23:37:40.094 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-24T23:37:40.108 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-24T23:37:40.108 INFO:tasks.ceph:role: osd.0 2024-04-24T23:37:40.108 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com 2024-04-24T23:37:40.108 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-24T23:37:40.191 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T23:37:40.192 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T23:37:40.192 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T23:37:40.192 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T23:37:40.192 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T23:37:40.192 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2024-04-24T23:37:40.192 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T23:37:40.192 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T23:37:40.192 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T23:37:40.192 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T23:37:41.481 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2024-04-24T23:37:41.484 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2024-04-24T23:37:41.484 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-24T23:37:41.545 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-24T23:37:41.599 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:37:41.599 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T23:37:41.599 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-24T23:37:41.652 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-24T23:37:41.652 INFO:tasks.ceph:role: osd.1 2024-04-24T23:37:41.652 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi057.front.sepia.ceph.com 2024-04-24T23:37:41.653 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-24T23:37:41.740 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T23:37:41.740 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T23:37:41.741 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T23:37:41.741 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T23:37:41.741 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T23:37:41.741 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2024-04-24T23:37:41.741 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T23:37:41.741 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T23:37:41.742 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T23:37:41.742 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T23:37:43.039 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2024-04-24T23:37:43.041 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2024-04-24T23:37:43.041 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-24T23:37:43.106 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-24T23:37:43.160 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:37:43.160 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T23:37:43.161 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-24T23:37:43.217 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-24T23:37:43.217 INFO:tasks.ceph:role: osd.2 2024-04-24T23:37:43.217 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi057.front.sepia.ceph.com 2024-04-24T23:37:43.218 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-24T23:37:43.302 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T23:37:43.302 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T23:37:43.303 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T23:37:43.303 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T23:37:43.303 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T23:37:43.303 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2024-04-24T23:37:43.303 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T23:37:43.303 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T23:37:43.303 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T23:37:43.303 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T23:37:44.587 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2024-04-24T23:37:44.589 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2024-04-24T23:37:44.589 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-24T23:37:44.652 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-24T23:37:44.705 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T23:37:44.706 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:37:44.707 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-24T23:37:44.760 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-24T23:37:44.760 INFO:tasks.ceph:role: osd.3 2024-04-24T23:37:44.760 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi057.front.sepia.ceph.com 2024-04-24T23:37:44.760 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-24T23:37:44.846 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T23:37:44.846 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T23:37:44.846 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T23:37:44.847 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T23:37:44.847 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T23:37:44.847 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2024-04-24T23:37:44.847 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T23:37:44.847 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T23:37:44.847 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T23:37:44.847 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T23:37:46.128 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2024-04-24T23:37:46.130 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2024-04-24T23:37:46.130 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-24T23:37:46.192 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-24T23:37:46.243 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T23:37:46.243 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:37:46.244 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T23:37:46.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:37:46.353+0000 7f589a3cc7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-24T23:37:46.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:37:46.357+0000 7f589a3cc7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-24T23:37:46.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:37:46.357+0000 7f589a3cc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-24T23:37:46.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:37:46.357+0000 7f589a3cc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-24T23:37:46.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:37:46.357+0000 7f589a3cc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-24T23:37:46.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:37:46.357+0000 7f589a3cc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-24T23:37:49.338 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-24T23:37:49.353 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T23:37:49.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:37:49.437+0000 7f57616a97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-24T23:37:49.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:37:49.437+0000 7f57616a97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-24T23:37:49.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:37:49.437+0000 7f57616a97c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-24T23:37:49.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:37:49.437+0000 7f57616a97c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-24T23:37:49.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:37:49.437+0000 7f57616a97c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-24T23:37:49.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:37:49.437+0000 7f57616a97c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-24T23:37:52.508 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-24T23:37:52.563 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T23:37:52.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:37:52.645+0000 7f885795a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-24T23:37:52.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:37:52.645+0000 7f885795a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-24T23:37:52.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:37:52.645+0000 7f885795a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-24T23:37:52.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:37:52.645+0000 7f885795a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-24T23:37:52.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:37:52.645+0000 7f885795a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-24T23:37:52.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:37:52.645+0000 7f885795a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-24T23:37:55.643 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-24T23:37:55.699 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T23:37:55.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:37:55.781+0000 7fd8340157c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-24T23:37:55.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:37:55.781+0000 7fd8340157c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-24T23:37:55.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:37:55.781+0000 7fd8340157c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-24T23:37:55.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:37:55.781+0000 7fd8340157c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-24T23:37:55.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:37:55.781+0000 7fd8340157c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-24T23:37:55.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:37:55.781+0000 7fd8340157c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-24T23:37:58.796 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-24T23:37:58.854 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-24T23:37:58.869 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-24T23:37:58.869 INFO:tasks.ceph:role: osd.4 2024-04-24T23:37:58.869 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com 2024-04-24T23:37:58.870 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-24T23:37:58.937 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T23:37:58.938 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T23:37:58.938 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T23:37:58.938 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T23:37:58.938 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T23:37:58.938 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2024-04-24T23:37:58.938 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T23:37:58.938 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T23:37:58.938 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T23:37:58.938 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T23:37:59.392 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2024-04-24T23:37:59.394 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2024-04-24T23:37:59.394 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-24T23:37:59.486 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-24T23:37:59.496 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:37:59.496 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T23:37:59.496 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-24T23:37:59.547 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-24T23:37:59.547 INFO:tasks.ceph:role: osd.5 2024-04-24T23:37:59.547 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi088.front.sepia.ceph.com 2024-04-24T23:37:59.547 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-24T23:37:59.610 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T23:37:59.611 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T23:37:59.611 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T23:37:59.611 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T23:37:59.611 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T23:37:59.611 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2024-04-24T23:37:59.611 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T23:37:59.611 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T23:37:59.611 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T23:37:59.611 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T23:38:00.076 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2024-04-24T23:38:00.078 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2024-04-24T23:38:00.079 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-24T23:38:00.210 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-24T23:38:00.221 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:38:00.221 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T23:38:00.221 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-24T23:38:00.277 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-24T23:38:00.278 INFO:tasks.ceph:role: osd.6 2024-04-24T23:38:00.278 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi088.front.sepia.ceph.com 2024-04-24T23:38:00.278 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-24T23:38:00.340 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T23:38:00.340 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T23:38:00.341 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T23:38:00.341 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T23:38:00.341 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T23:38:00.341 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2024-04-24T23:38:00.341 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T23:38:00.341 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T23:38:00.341 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T23:38:00.341 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T23:38:00.802 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2024-04-24T23:38:00.804 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2024-04-24T23:38:00.804 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-24T23:38:00.944 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-24T23:38:00.956 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:38:00.956 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T23:38:00.956 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-24T23:38:01.008 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-24T23:38:01.008 INFO:tasks.ceph:role: osd.7 2024-04-24T23:38:01.008 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi088.front.sepia.ceph.com 2024-04-24T23:38:01.008 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-24T23:38:01.068 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T23:38:01.069 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T23:38:01.069 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T23:38:01.069 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T23:38:01.069 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T23:38:01.069 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2024-04-24T23:38:01.069 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T23:38:01.069 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T23:38:01.069 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T23:38:01.069 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T23:38:01.485 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2024-04-24T23:38:01.487 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2024-04-24T23:38:01.487 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-24T23:38:01.582 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-24T23:38:01.592 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:38:01.592 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T23:38:01.592 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T23:38:01.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:01.695+0000 7f97eb24b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-24T23:38:01.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:01.695+0000 7f97eb24b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-24T23:38:01.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:01.695+0000 7f97eb24b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-24T23:38:01.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:01.695+0000 7f97eb24b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-24T23:38:01.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:01.695+0000 7f97eb24b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-24T23:38:01.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:01.699+0000 7f97eb24b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-24T23:38:04.689 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-24T23:38:04.706 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T23:38:04.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:04.786+0000 7fd3337d67c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-24T23:38:04.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:04.786+0000 7fd3337d67c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-24T23:38:04.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:04.786+0000 7fd3337d67c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-24T23:38:04.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:04.786+0000 7fd3337d67c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-24T23:38:04.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:04.786+0000 7fd3337d67c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-24T23:38:04.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:04.790+0000 7fd3337d67c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-24T23:38:07.206 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:38:07.210 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:38:07.213 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:38:07.215 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:38:07.774 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-24T23:38:07.789 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T23:38:07.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:07.870+0000 7f28ccf1f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-24T23:38:07.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:07.870+0000 7f28ccf1f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-24T23:38:07.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:07.870+0000 7f28ccf1f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-24T23:38:07.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:07.870+0000 7f28ccf1f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-24T23:38:07.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:07.870+0000 7f28ccf1f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-24T23:38:07.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:07.870+0000 7f28ccf1f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-24T23:38:10.849 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-24T23:38:10.902 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T23:38:10.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:10.982+0000 7f28b0e467c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-24T23:38:10.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:10.982+0000 7f28b0e467c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-24T23:38:10.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:10.982+0000 7f28b0e467c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-24T23:38:10.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:10.986+0000 7f28b0e467c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-24T23:38:10.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:10.986+0000 7f28b0e467c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-24T23:38:10.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:10.986+0000 7f28b0e467c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-24T23:38:13.949 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-24T23:38:14.006 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-24T23:38:14.006 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T23:38:14.006 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-24T23:38:14.022 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T23:38:14.022 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-24T23:38:14.076 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T23:38:14.076 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-24T23:38:14.135 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T23:38:14.135 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-24T23:38:14.188 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T23:38:14.188 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-24T23:38:14.245 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T23:38:14.245 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-24T23:38:14.301 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T23:38:14.302 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-24T23:38:14.357 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T23:38:14.357 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-24T23:38:14.371 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T23:38:14.371 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-24T23:38:14.425 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T23:38:14.425 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-24T23:38:14.481 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T23:38:14.481 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-24T23:38:14.537 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T23:38:14.537 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-24T23:38:14.593 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T23:38:14.593 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-24T23:38:14.648 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-24T23:38:14.648 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-24T23:38:14.655 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-24T23:38:14.655 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-24T23:38:14.661 INFO:tasks.ceph:Adding keys to all mons... 2024-04-24T23:38:14.661 DEBUG:teuthology.orchestra.run.smithi057:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-24T23:38:14.664 DEBUG:teuthology.orchestra.run.smithi088:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-24T23:38:14.691 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr.y] 2024-04-24T23:38:14.691 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDDlylmslQMIRAAsdOVQgsJCTQnL6e0PoFwMA== 2024-04-24T23:38:14.692 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2024-04-24T23:38:14.692 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDDlylmwObnJhAAwvI11+pcprQG+YkqwSWm3A== 2024-04-24T23:38:14.692 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.c] 2024-04-24T23:38:14.692 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDDlylmbRmKLxAARy0m7anGjo8nHWq9lPyO4g== 2024-04-24T23:38:14.692 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.0] 2024-04-24T23:38:14.692 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDKlylm5IxcFRAA/NFiwm+BVrw0uqaKLFe+Rg== 2024-04-24T23:38:14.692 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.1] 2024-04-24T23:38:14.692 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDNlylmHQUmGhAAdpMIbXwF/uTliE+cIlIP0A== 2024-04-24T23:38:14.692 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.2] 2024-04-24T23:38:14.692 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDQlylmyouLJhAAxMLQ5tBcfsIThbPmJJAHow== 2024-04-24T23:38:14.692 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.3] 2024-04-24T23:38:14.692 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDTlylmfnujLhAA3Oo1OmmMQ/sBa8+8QIdnGw== 2024-04-24T23:38:14.692 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr.x] 2024-04-24T23:38:14.693 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDDlylmHWvRIxAASM7gTA161O1ETKY8SNtu+w== 2024-04-24T23:38:14.693 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.b] 2024-04-24T23:38:14.693 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDDlylmOFK8NRAAN26OaUpgXcdCWaBkufjFxw== 2024-04-24T23:38:14.693 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.4] 2024-04-24T23:38:14.693 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDZlylmytCVKRAA/S0x/fdLXEbppeav+0hXXA== 2024-04-24T23:38:14.693 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.5] 2024-04-24T23:38:14.693 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDclylmCoYeLxAAPBq0vx40bTW0nLLCPjOLmw== 2024-04-24T23:38:14.693 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.6] 2024-04-24T23:38:14.693 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDflylmmBQZNBAABi+RYVR/9D8RfUopZWTh+g== 2024-04-24T23:38:14.693 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.7] 2024-04-24T23:38:14.693 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDilylm8VrWOhAAMlQyyIV8/rT+sUpVlnblkw== 2024-04-24T23:38:14.693 INFO:teuthology.orchestra.run.smithi057.stdout:[client.0] 2024-04-24T23:38:14.693 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDDlylm2CtJOxAAHR4IiU2/MCKr2gBRy3TSjQ== 2024-04-24T23:38:14.693 INFO:teuthology.orchestra.run.smithi057.stdout:[client.1] 2024-04-24T23:38:14.694 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDElylmKvP9AxAA+lcWapGoFHvTzeBd3AGTaw== 2024-04-24T23:38:14.698 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr.y] 2024-04-24T23:38:14.699 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDDlylmslQMIRAAsdOVQgsJCTQnL6e0PoFwMA== 2024-04-24T23:38:14.699 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.a] 2024-04-24T23:38:14.699 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDDlylmwObnJhAAwvI11+pcprQG+YkqwSWm3A== 2024-04-24T23:38:14.699 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.c] 2024-04-24T23:38:14.699 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDDlylmbRmKLxAARy0m7anGjo8nHWq9lPyO4g== 2024-04-24T23:38:14.699 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.0] 2024-04-24T23:38:14.699 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDKlylm5IxcFRAA/NFiwm+BVrw0uqaKLFe+Rg== 2024-04-24T23:38:14.699 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.1] 2024-04-24T23:38:14.699 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDNlylmHQUmGhAAdpMIbXwF/uTliE+cIlIP0A== 2024-04-24T23:38:14.699 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.2] 2024-04-24T23:38:14.699 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDQlylmyouLJhAAxMLQ5tBcfsIThbPmJJAHow== 2024-04-24T23:38:14.699 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.3] 2024-04-24T23:38:14.700 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDTlylmfnujLhAA3Oo1OmmMQ/sBa8+8QIdnGw== 2024-04-24T23:38:14.700 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr.x] 2024-04-24T23:38:14.700 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDDlylmHWvRIxAASM7gTA161O1ETKY8SNtu+w== 2024-04-24T23:38:14.700 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.b] 2024-04-24T23:38:14.700 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDDlylmOFK8NRAAN26OaUpgXcdCWaBkufjFxw== 2024-04-24T23:38:14.700 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.4] 2024-04-24T23:38:14.700 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDZlylmytCVKRAA/S0x/fdLXEbppeav+0hXXA== 2024-04-24T23:38:14.700 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.5] 2024-04-24T23:38:14.700 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDclylmCoYeLxAAPBq0vx40bTW0nLLCPjOLmw== 2024-04-24T23:38:14.700 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.6] 2024-04-24T23:38:14.700 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDflylmmBQZNBAABi+RYVR/9D8RfUopZWTh+g== 2024-04-24T23:38:14.700 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.7] 2024-04-24T23:38:14.700 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDilylm8VrWOhAAMlQyyIV8/rT+sUpVlnblkw== 2024-04-24T23:38:14.700 INFO:teuthology.orchestra.run.smithi088.stdout:[client.0] 2024-04-24T23:38:14.701 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDDlylm2CtJOxAAHR4IiU2/MCKr2gBRy3TSjQ== 2024-04-24T23:38:14.701 INFO:teuthology.orchestra.run.smithi088.stdout:[client.1] 2024-04-24T23:38:14.701 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDElylmKvP9AxAA+lcWapGoFHvTzeBd3AGTaw== 2024-04-24T23:38:14.702 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-24T23:38:14.738 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-24T23:38:14.789 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-24T23:38:14.792 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-24T23:38:14.839 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-24T23:38:14.882 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-24T23:38:14.928 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:38:14.930 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:38:15.009 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:38:15.011 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:38:15.097 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:38:15.099 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:38:15.186 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:38:15.189 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:38:15.233 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-24T23:38:15.278 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-24T23:38:15.322 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-24T23:38:15.362 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-24T23:38:15.409 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:38:15.411 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:38:15.496 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:38:15.498 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:38:15.577 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:38:15.586 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:38:15.665 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:38:15.670 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T23:38:15.751 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T23:38:15.758 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T23:38:15.836 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T23:38:15.846 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T23:38:15.925 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-24T23:38:15.925 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-24T23:38:15.945 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-24T23:38:16.052 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-24T23:38:16.065 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-24T23:38:16.078 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-24T23:38:16.172 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-24T23:38:16.183 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-24T23:38:16.235 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-24T23:38:16.327 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-24T23:38:16.337 DEBUG:teuthology.orchestra.run.smithi057:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-24T23:38:16.340 DEBUG:teuthology.orchestra.run.smithi088:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-24T23:38:16.385 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-24T23:38:16.385 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-24T23:38:16.385 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-24T23:38:16.388 INFO:tasks.ceph.mon.a:Started 2024-04-24T23:38:16.388 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-24T23:38:16.388 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-24T23:38:16.430 INFO:tasks.ceph.mon.b:Started 2024-04-24T23:38:16.431 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-24T23:38:16.431 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-24T23:38:16.433 INFO:tasks.ceph.mon.c:Started 2024-04-24T23:38:16.433 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-24T23:38:16.433 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-24T23:38:16.433 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-24T23:38:16.436 INFO:tasks.ceph.mgr.y:Started 2024-04-24T23:38:16.436 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-24T23:38:16.436 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-24T23:38:16.438 INFO:tasks.ceph.mgr.x:Started 2024-04-24T23:38:16.438 INFO:tasks.ceph:Setting crush tunables to default 2024-04-24T23:38:16.438 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd crush tunables default 2024-04-24T23:38:16.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.553+0000 7f73cb4e8640 1 Processor -- start 2024-04-24T23:38:16.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.553+0000 7f73cb4e8640 1 -- start start 2024-04-24T23:38:16.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.553+0000 7f73cb4e8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f73c406fc30 0x7f73c4072e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:16.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.553+0000 7f73cb4e8640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f73c4070010 0x7f73c414cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:16.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.553+0000 7f73cb4e8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73c40beff0 con 0x7f73c40be730 2024-04-24T23:38:16.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.553+0000 7f73cb4e8640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f73c40a1d60 con 0x7f73c4070010 2024-04-24T23:38:16.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.553+0000 7f73cb4e8640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f73c40a2040 con 0x7f73c406fc30 2024-04-24T23:38:16.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.553+0000 7f73c9a85640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f73c4070010 0x7f73c414cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:16.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.553+0000 7f73c9a85640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f73c4070010 0x7f73c414cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53776/0 (socket says 172.21.15.57:53776) 2024-04-24T23:38:16.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.553+0000 7f73c9a85640 1 -- 172.21.15.57:0/3835259980 learned_addr learned my addr 172.21.15.57:0/3835259980 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:16.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.553+0000 7f73c9a85640 1 -- 172.21.15.57:0/3835259980 >> v2:172.21.15.57:3300/0 conn(0x7f73c4070010 msgr2=0x7f73c414cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-24T23:38:16.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.553+0000 7f73c9a85640 1 -- 172.21.15.57:0/3835259980 >> v2:172.21.15.57:3300/0 conn(0x7f73c4070010 msgr2=0x7f73c414cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T23:38:16.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.553+0000 7f73c9a85640 1 --2- 172.21.15.57:0/3835259980 >> v2:172.21.15.57:3300/0 conn(0x7f73c4070010 0x7f73c414cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T23:38:16.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.557+0000 7f73c9a85640 1 --2- 172.21.15.57:0/3835259980 >> v2:172.21.15.57:3300/0 conn(0x7f73c4070010 0x7f73c414cd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-24T23:38:16.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.557+0000 7f73c9284640 1 --2- 172.21.15.57:0/3835259980 >> v2:172.21.15.88:3300/0 conn(0x7f73c406fc30 0x7f73c4072e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:16.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.557+0000 7f73c9284640 1 -- 172.21.15.57:0/3835259980 >> v2:172.21.15.88:3300/0 conn(0x7f73c406fc30 msgr2=0x7f73c4072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-24T23:38:16.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.557+0000 7f73c9284640 1 -- 172.21.15.57:0/3835259980 >> v2:172.21.15.88:3300/0 conn(0x7f73c406fc30 msgr2=0x7f73c4072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T23:38:16.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.557+0000 7f73c9284640 1 --2- 172.21.15.57:0/3835259980 >> v2:172.21.15.88:3300/0 conn(0x7f73c406fc30 0x7f73c4072e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T23:38:16.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.557+0000 7f73c9284640 1 --2- 172.21.15.57:0/3835259980 >> v2:172.21.15.88:3300/0 conn(0x7f73c406fc30 0x7f73c4072e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-24T23:38:16.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.761+0000 7f73c9a85640 1 --2- 172.21.15.57:0/3835259980 >> v2:172.21.15.57:3300/0 conn(0x7f73c4070010 0x7f73c414cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:16.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.761+0000 7f73c9284640 1 --2- 172.21.15.57:0/3835259980 >> v2:172.21.15.88:3300/0 conn(0x7f73c406fc30 0x7f73c4072e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:16.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.761+0000 7f73c9a85640 1 -- 172.21.15.57:0/3835259980 >> v2:172.21.15.57:3300/0 conn(0x7f73c4070010 msgr2=0x7f73c414cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-24T23:38:16.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.761+0000 7f73c9a85640 1 -- 172.21.15.57:0/3835259980 >> v2:172.21.15.57:3300/0 conn(0x7f73c4070010 msgr2=0x7f73c414cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T23:38:16.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.761+0000 7f73c9a85640 1 --2- 172.21.15.57:0/3835259980 >> v2:172.21.15.57:3300/0 conn(0x7f73c4070010 0x7f73c414cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T23:38:16.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.761+0000 7f73c9a85640 1 --2- 172.21.15.57:0/3835259980 >> v2:172.21.15.57:3300/0 conn(0x7f73c4070010 0x7f73c414cd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-24T23:38:16.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.761+0000 7f73c9284640 1 -- 172.21.15.57:0/3835259980 >> v2:172.21.15.88:3300/0 conn(0x7f73c406fc30 msgr2=0x7f73c4072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-24T23:38:16.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.761+0000 7f73c9284640 1 -- 172.21.15.57:0/3835259980 >> v2:172.21.15.88:3300/0 conn(0x7f73c406fc30 msgr2=0x7f73c4072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T23:38:16.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.761+0000 7f73c9284640 1 --2- 172.21.15.57:0/3835259980 >> v2:172.21.15.88:3300/0 conn(0x7f73c406fc30 0x7f73c4072e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T23:38:16.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.761+0000 7f73c9284640 1 --2- 172.21.15.57:0/3835259980 >> v2:172.21.15.88:3300/0 conn(0x7f73c406fc30 0x7f73c4072e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-24T23:38:16.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.773+0000 7f73bbfff640 1 -- 172.21.15.57:0/3835259980 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3428414852 0 0) 0x7f73c40beff0 con 0x7f73c40be730 2024-04-24T23:38:16.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.773+0000 7f73bbfff640 1 -- 172.21.15.57:0/3835259980 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73b0003530 con 0x7f73c40be730 2024-04-24T23:38:16.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.781+0000 7f73bbfff640 1 -- 172.21.15.57:0/3835259980 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1891832286 0 0) 0x7f73b0003530 con 0x7f73c40be730 2024-04-24T23:38:16.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.781+0000 7f73bbfff640 1 -- 172.21.15.57:0/3835259980 >> v2:172.21.15.88:3300/0 conn(0x7f73c406fc30 msgr2=0x7f73c4072e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-24T23:38:16.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.781+0000 7f73bbfff640 1 --2- 172.21.15.57:0/3835259980 >> v2:172.21.15.88:3300/0 conn(0x7f73c406fc30 0x7f73c4072e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:16.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.781+0000 7f73bbfff640 1 -- 172.21.15.57:0/3835259980 >> v2:172.21.15.57:3300/0 conn(0x7f73c4070010 msgr2=0x7f73c414cd70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-24T23:38:16.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.781+0000 7f73bbfff640 1 --2- 172.21.15.57:0/3835259980 >> v2:172.21.15.57:3300/0 conn(0x7f73c4070010 0x7f73c414cd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:16.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.781+0000 7f73bbfff640 1 -- 172.21.15.57:0/3835259980 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c406c930 con 0x7f73c40be730 2024-04-24T23:38:16.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.781+0000 7f73bbfff640 1 -- 172.21.15.57:0/3835259980 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7f73b4001680 con 0x7f73c40be730 2024-04-24T23:38:16.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.781+0000 7f73bbfff640 1 -- 172.21.15.57:0/3835259980 >> v1:172.21.15.88:6789/0 conn(0x7f73c40be730 legacy=0x7f73c406c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:16.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.781+0000 7f73bbfff640 1 --2- 172.21.15.57:0/3835259980 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73b00039c0 0x7f73b0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:16.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.781+0000 7f73bbfff640 1 --2- 172.21.15.57:0/3835259980 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f73b0004810 0x7f73b0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:16.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.781+0000 7f73bbfff640 1 --2- 172.21.15.57:0/3835259980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73b00051d0 0x7f73b000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:16.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.781+0000 7f73bbfff640 1 -- 172.21.15.57:0/3835259980 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f73c40a1d60 con 0x7f73b00039c0 2024-04-24T23:38:16.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.781+0000 7f73bbfff640 1 -- 172.21.15.57:0/3835259980 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f73c40a2040 con 0x7f73b00051d0 2024-04-24T23:38:16.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.781+0000 7f73bbfff640 1 -- 172.21.15.57:0/3835259980 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f73b000e2e0 con 0x7f73b0004810 2024-04-24T23:38:16.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.781+0000 7f73c9284640 1 --2- 172.21.15.57:0/3835259980 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73b00039c0 0x7f73b0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:16.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.781+0000 7f73c8a83640 1 --2- 172.21.15.57:0/3835259980 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f73b0004810 0x7f73b0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:16.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.781+0000 7f73c9a85640 1 --2- 172.21.15.57:0/3835259980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73b00051d0 0x7f73b000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:16.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.781+0000 7f73c9284640 1 -- 172.21.15.57:0/3835259980 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f73b0004810 msgr2=0x7f73b0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:16.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.781+0000 7f73c9284640 1 --2- 172.21.15.57:0/3835259980 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f73b0004810 0x7f73b0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:16.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.781+0000 7f73c9284640 1 -- 172.21.15.57:0/3835259980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73b00051d0 msgr2=0x7f73b000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:16.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.781+0000 7f73c9284640 1 --2- 172.21.15.57:0/3835259980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73b00051d0 0x7f73b000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:16.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.781+0000 7f73c9284640 1 -- 172.21.15.57:0/3835259980 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b0003530 con 0x7f73b00039c0 2024-04-24T23:38:16.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.781+0000 7f73c9a85640 1 --2- 172.21.15.57:0/3835259980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73b00051d0 0x7f73b000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:38:16.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.781+0000 7f73c9a85640 1 -- 172.21.15.57:0/3835259980 reap_dead start 2024-04-24T23:38:16.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.785+0000 7f73c9284640 1 --2- 172.21.15.57:0/3835259980 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73b00039c0 0x7f73b0003de0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f73c000e8d0 tx=0x7f73c001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a63310422c237fe server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:16.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.789+0000 7f73bbfff640 1 -- 172.21.15.57:0/3835259980 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c00ae020 con 0x7f73b00039c0 2024-04-24T23:38:16.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.789+0000 7f73bbfff640 1 -- 172.21.15.57:0/3835259980 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73c00a6670 con 0x7f73b00039c0 2024-04-24T23:38:16.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.789+0000 7f73bbfff640 1 -- 172.21.15.57:0/3835259980 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c000f040 con 0x7f73b00039c0 2024-04-24T23:38:16.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.789+0000 7f73cb4e8640 1 -- 172.21.15.57:0/3835259980 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73b00039c0 msgr2=0x7f73b0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:16.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.789+0000 7f73cb4e8640 1 --2- 172.21.15.57:0/3835259980 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73b00039c0 0x7f73b0003de0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f73c000e8d0 tx=0x7f73c001c870 comp rx=0 tx=0).stop 2024-04-24T23:38:16.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.789+0000 7f73cb4e8640 1 -- 172.21.15.57:0/3835259980 shutdown_connections 2024-04-24T23:38:16.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.789+0000 7f73cb4e8640 1 --2- 172.21.15.57:0/3835259980 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73b00039c0 0x7f73b0003de0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:16.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.789+0000 7f73cb4e8640 1 -- 172.21.15.57:0/3835259980 >> 172.21.15.57:0/3835259980 conn(0x7f73c40bf220 msgr2=0x7f73c40bf630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:16.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.793+0000 7f73cb4e8640 1 -- 172.21.15.57:0/3835259980 shutdown_connections 2024-04-24T23:38:16.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.793+0000 7f73cb4e8640 1 -- 172.21.15.57:0/3835259980 wait complete. 2024-04-24T23:38:16.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.793+0000 7f73cb4e8640 1 Processor -- start 2024-04-24T23:38:16.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.793+0000 7f73cb4e8640 1 -- start start 2024-04-24T23:38:16.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.793+0000 7f73cb4e8640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73b00039c0 0x7f73c414abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:16.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.793+0000 7f73cb4e8640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f73c40a6f00 0x7f73c4071b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:16.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.793+0000 7f73cb4e8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73c4147800 0x7f73c40a64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:16.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.793+0000 7f73cb4e8640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f73c40bcdd0 con 0x7f73b00039c0 2024-04-24T23:38:16.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.793+0000 7f73cb4e8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f73c40bcc50 con 0x7f73c4147800 2024-04-24T23:38:16.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.793+0000 7f73cb4e8640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f73c4072e70 con 0x7f73c40a6f00 2024-04-24T23:38:16.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.793+0000 7f73c8a83640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f73c40a6f00 0x7f73c4071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:16.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.793+0000 7f73c9284640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73b00039c0 0x7f73c414abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:16.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.793+0000 7f73c8a83640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f73c40a6f00 0x7f73c4071b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.57:34578/0 (socket says 172.21.15.57:34578) 2024-04-24T23:38:16.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.793+0000 7f73c8a83640 1 -- 172.21.15.57:0/1862287947 learned_addr learned my addr 172.21.15.57:0/1862287947 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:16.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.793+0000 7f73c9a85640 1 --2- 172.21.15.57:0/1862287947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73c4147800 0x7f73c40a64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:16.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.797+0000 7f73c8a83640 1 -- 172.21.15.57:0/1862287947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73c4147800 msgr2=0x7f73c40a64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:16.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.797+0000 7f73c8a83640 1 --2- 172.21.15.57:0/1862287947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73c4147800 0x7f73c40a64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:16.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.797+0000 7f73c8a83640 1 -- 172.21.15.57:0/1862287947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73b00039c0 msgr2=0x7f73c414abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:16.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.797+0000 7f73c8a83640 1 --2- 172.21.15.57:0/1862287947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73b00039c0 0x7f73c414abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:16.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.797+0000 7f73c8a83640 1 -- 172.21.15.57:0/1862287947 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c40720b0 con 0x7f73c40a6f00 2024-04-24T23:38:16.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.797+0000 7f73c8a83640 1 --2- 172.21.15.57:0/1862287947 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f73c40a6f00 0x7f73c4071b70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f73b40116a0 tx=0x7f73b4011b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:16.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.797+0000 7f73b9ffb640 1 -- 172.21.15.57:0/1862287947 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b4019020 con 0x7f73c40a6f00 2024-04-24T23:38:16.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.797+0000 7f73b9ffb640 1 -- 172.21.15.57:0/1862287947 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73b40050d0 con 0x7f73c40a6f00 2024-04-24T23:38:16.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.797+0000 7f73b9ffb640 1 -- 172.21.15.57:0/1862287947 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b40054a0 con 0x7f73c40a6f00 2024-04-24T23:38:16.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.797+0000 7f73cb4e8640 1 -- 172.21.15.57:0/1862287947 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73c40a7390 con 0x7f73c40a6f00 2024-04-24T23:38:16.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.797+0000 7f73cb4e8640 1 -- 172.21.15.57:0/1862287947 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f73c414d520 con 0x7f73c40a6f00 2024-04-24T23:38:16.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.797+0000 7f73b9ffb640 1 -- 172.21.15.57:0/1862287947 <== mon.2 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f73b401c020 con 0x7f73c40a6f00 2024-04-24T23:38:16.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.797+0000 7f73b9ffb640 1 -- 172.21.15.57:0/1862287947 <== mon.2 v2:172.21.15.88:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f73b4015470 con 0x7f73c40a6f00 2024-04-24T23:38:16.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.797+0000 7f73cb4e8640 1 -- 172.21.15.57:0/1862287947 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73c414db50 con 0x7f73c40a6f00 2024-04-24T23:38:16.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.813+0000 7f73b9ffb640 1 -- 172.21.15.57:0/1862287947 <== mon.2 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f73b4023030 con 0x7f73c40a6f00 2024-04-24T23:38:16.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.881+0000 7f73cb4e8640 1 -- 172.21.15.57:0/1862287947 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f73c4068930 con 0x7f73c40a6f00 2024-04-24T23:38:16.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.889+0000 7f73b9ffb640 1 -- 172.21.15.57:0/1862287947 <== mon.2 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f73c40720b0 con 0x7f73c40a6f00 2024-04-24T23:38:16.889 INFO:teuthology.orchestra.run.smithi057.stderr:adjusted tunables profile to default 2024-04-24T23:38:16.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.889+0000 7f73cb4e8640 1 -- 172.21.15.57:0/1862287947 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f73c40a6f00 msgr2=0x7f73c4071b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:16.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.889+0000 7f73cb4e8640 1 --2- 172.21.15.57:0/1862287947 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f73c40a6f00 0x7f73c4071b70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f73b40116a0 tx=0x7f73b4011b60 comp rx=0 tx=0).stop 2024-04-24T23:38:16.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.889+0000 7f73cb4e8640 1 -- 172.21.15.57:0/1862287947 shutdown_connections 2024-04-24T23:38:16.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.889+0000 7f73cb4e8640 1 --2- 172.21.15.57:0/1862287947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73c4147800 0x7f73c40a64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:16.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.889+0000 7f73cb4e8640 1 --2- 172.21.15.57:0/1862287947 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f73c40a6f00 0x7f73c4071b70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:16.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.889+0000 7f73cb4e8640 1 --2- 172.21.15.57:0/1862287947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73b00039c0 0x7f73c414abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:16.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.889+0000 7f73cb4e8640 1 -- 172.21.15.57:0/1862287947 >> 172.21.15.57:0/1862287947 conn(0x7f73c40bf220 msgr2=0x7f73c40bd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:16.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.889+0000 7f73cb4e8640 1 -- 172.21.15.57:0/1862287947 shutdown_connections 2024-04-24T23:38:16.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:16.889+0000 7f73cb4e8640 1 -- 172.21.15.57:0/1862287947 wait complete. 2024-04-24T23:38:16.909 INFO:tasks.ceph:check_enable_crimson: False 2024-04-24T23:38:16.909 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-24T23:38:16.910 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T23:38:16.910 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-24T23:38:16.922 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T23:38:16.922 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-24T23:38:16.976 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T23:38:16.976 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-24T23:38:17.028 INFO:tasks.ceph.mgr.x.smithi088.stderr:2024-04-24T23:38:17.026+0000 7ff7b7154180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-24T23:38:17.036 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T23:38:17.036 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-24T23:38:17.097 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T23:38:17.097 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-24T23:38:17.110 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T23:38:17.111 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-24T23:38:17.127 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-24T23:38:17.125+0000 7fe04def4180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-24T23:38:17.165 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T23:38:17.165 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-24T23:38:17.221 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T23:38:17.221 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-24T23:38:17.276 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd new 35ce67bc-9b25-416e-ab1e-774c717631f6 0 2024-04-24T23:38:17.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.438+0000 7fe321a97640 1 Processor -- start 2024-04-24T23:38:17.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.438+0000 7fe321a97640 1 -- start start 2024-04-24T23:38:17.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.438+0000 7fe321a97640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe31c073380 0x7fe31c0a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:17.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.438+0000 7fe321a97640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe31c0be720 con 0x7fe31c0bebd0 2024-04-24T23:38:17.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.438+0000 7fe321a97640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe31c072c90 con 0x7fe31c06fe10 2024-04-24T23:38:17.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.438+0000 7fe321a97640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fe31c0678a0 con 0x7fe31c073380 2024-04-24T23:38:17.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.438+0000 7fe313fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe31c073380 0x7fe31c0a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:17.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.438+0000 7fe31b7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe31c06fe10 0x7fe31c150220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37340/0 (socket says 172.21.15.88:37340) 2024-04-24T23:38:17.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.438+0000 7fe31b7fe640 1 -- 172.21.15.88:0/3233097763 learned_addr learned my addr 172.21.15.88:0/3233097763 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T23:38:17.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.438+0000 7fe313fff640 1 -- 172.21.15.88:0/3233097763 >> v1:172.21.15.88:6789/0 conn(0x7fe31c06fe10 legacy=0x7fe31c150220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:17.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.438+0000 7fe313fff640 1 -- 172.21.15.88:0/3233097763 >> v1:172.21.15.57:6789/0 conn(0x7fe31c0bebd0 legacy=0x7fe31c067190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:17.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.438+0000 7fe313fff640 1 -- 172.21.15.88:0/3233097763 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe31c150930 con 0x7fe31c073380 2024-04-24T23:38:17.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.438+0000 7fe313fff640 1 --2- 172.21.15.88:0/3233097763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe31c073380 0x7fe31c0a1e30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe3040097c0 tx=0x7fe30401ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a62795ff49359055 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:17.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe31affd640 1 -- 172.21.15.88:0/3233097763 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3040b5070 con 0x7fe31c073380 2024-04-24T23:38:17.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe31affd640 1 -- 172.21.15.88:0/3233097763 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3040a8950 con 0x7fe31c073380 2024-04-24T23:38:17.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe31affd640 1 -- 172.21.15.88:0/3233097763 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3040a8d20 con 0x7fe31c073380 2024-04-24T23:38:17.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe321a97640 1 -- 172.21.15.88:0/3233097763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe31c073380 msgr2=0x7fe31c0a1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:17.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe321a97640 1 --2- 172.21.15.88:0/3233097763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe31c073380 0x7fe31c0a1e30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe3040097c0 tx=0x7fe30401ec50 comp rx=0 tx=0).stop 2024-04-24T23:38:17.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe321a97640 1 -- 172.21.15.88:0/3233097763 shutdown_connections 2024-04-24T23:38:17.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe321a97640 1 --2- 172.21.15.88:0/3233097763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe31c073380 0x7fe31c0a1e30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:17.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe321a97640 1 -- 172.21.15.88:0/3233097763 >> 172.21.15.88:0/3233097763 conn(0x7fe31c0bf220 msgr2=0x7fe31c0bf630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:17.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe321a97640 1 -- 172.21.15.88:0/3233097763 shutdown_connections 2024-04-24T23:38:17.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe321a97640 1 -- 172.21.15.88:0/3233097763 wait complete. 2024-04-24T23:38:17.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe321a97640 1 Processor -- start 2024-04-24T23:38:17.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe321a97640 1 -- start start 2024-04-24T23:38:17.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe321a97640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe31c06fe10 0x7fe31c153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:17.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe321a97640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe31c073380 0x7fe31c149720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:17.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe321a97640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe31c0bebd0 0x7fe31c149c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:17.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe321a97640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c0bea00 con 0x7fe31c0bebd0 2024-04-24T23:38:17.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe321a97640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c0701f0 con 0x7fe31c073380 2024-04-24T23:38:17.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe321a97640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fe31c06c220 con 0x7fe31c06fe10 2024-04-24T23:38:17.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe31b7fe640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe31c06fe10 0x7fe31c153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:17.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe313fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe31c073380 0x7fe31c149720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:17.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe313fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe31c073380 0x7fe31c149720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42528/0 (socket says 172.21.15.88:42528) 2024-04-24T23:38:17.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe313fff640 1 -- 172.21.15.88:0/1787548880 learned_addr learned my addr 172.21.15.88:0/1787548880 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T23:38:17.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe31b7fe640 1 --2- 172.21.15.88:0/1787548880 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe31c06fe10 0x7fe31c153020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:42312/0 (socket says 172.21.15.88:42312) 2024-04-24T23:38:17.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe31bfff640 1 --2- 172.21.15.88:0/1787548880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe31c0bebd0 0x7fe31c149c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:17.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe31b7fe640 1 -- 172.21.15.88:0/1787548880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe31c073380 msgr2=0x7fe31c149720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:17.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe31b7fe640 1 --2- 172.21.15.88:0/1787548880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe31c073380 0x7fe31c149720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:17.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe31b7fe640 1 -- 172.21.15.88:0/1787548880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe31c0bebd0 msgr2=0x7fe31c149c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:17.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe31b7fe640 1 --2- 172.21.15.88:0/1787548880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe31c0bebd0 0x7fe31c149c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:17.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe31b7fe640 1 -- 172.21.15.88:0/1787548880 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe31c1e4aa0 con 0x7fe31c06fe10 2024-04-24T23:38:17.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe313fff640 1 --2- 172.21.15.88:0/1787548880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe31c073380 0x7fe31c149720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:38:17.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe31bfff640 1 --2- 172.21.15.88:0/1787548880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe31c0bebd0 0x7fe31c149c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:38:17.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe31b7fe640 1 --2- 172.21.15.88:0/1787548880 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe31c06fe10 0x7fe31c153020 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe30c00c3c0 tx=0x7fe30c00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:17.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe318ff9640 1 -- 172.21.15.88:0/1787548880 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c017070 con 0x7fe31c06fe10 2024-04-24T23:38:17.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.442+0000 7fe318ff9640 1 -- 172.21.15.88:0/1787548880 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe30c005cf0 con 0x7fe31c06fe10 2024-04-24T23:38:17.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.446+0000 7fe321a97640 1 -- 172.21.15.88:0/1787548880 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe31c1e4d40 con 0x7fe31c06fe10 2024-04-24T23:38:17.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.446+0000 7fe318ff9640 1 -- 172.21.15.88:0/1787548880 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c0072f0 con 0x7fe31c06fe10 2024-04-24T23:38:17.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.446+0000 7fe321a97640 1 -- 172.21.15.88:0/1787548880 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe31c0be310 con 0x7fe31c06fe10 2024-04-24T23:38:17.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.446+0000 7fe318ff9640 1 -- 172.21.15.88:0/1787548880 <== mon.2 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe30c01a070 con 0x7fe31c06fe10 2024-04-24T23:38:17.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.446+0000 7fe318ff9640 1 -- 172.21.15.88:0/1787548880 <== mon.2 v2:172.21.15.88:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fe30c012740 con 0x7fe31c06fe10 2024-04-24T23:38:17.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.446+0000 7fe321a97640 1 -- 172.21.15.88:0/1787548880 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe31c068930 con 0x7fe31c06fe10 2024-04-24T23:38:17.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.446+0000 7fe318ff9640 1 -- 172.21.15.88:0/1787548880 <== mon.2 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe30c021020 con 0x7fe31c06fe10 2024-04-24T23:38:17.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.514+0000 7fe321a97640 1 -- 172.21.15.88:0/1787548880 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd new", "uuid": "35ce67bc-9b25-416e-ab1e-774c717631f6", "id": 0} v 0) -- 0x7fe31c0729d0 con 0x7fe31c06fe10 2024-04-24T23:38:17.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.522+0000 7fe318ff9640 1 -- 172.21.15.88:0/1787548880 <== mon.2 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "35ce67bc-9b25-416e-ab1e-774c717631f6", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fe30c007560 con 0x7fe31c06fe10 2024-04-24T23:38:17.522 INFO:teuthology.orchestra.run.smithi088.stdout:0 2024-04-24T23:38:17.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.522+0000 7fe321a97640 1 -- 172.21.15.88:0/1787548880 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe31c06fe10 msgr2=0x7fe31c153020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:17.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.522+0000 7fe321a97640 1 --2- 172.21.15.88:0/1787548880 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe31c06fe10 0x7fe31c153020 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe30c00c3c0 tx=0x7fe30c00c880 comp rx=0 tx=0).stop 2024-04-24T23:38:17.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.522+0000 7fe321a97640 1 -- 172.21.15.88:0/1787548880 shutdown_connections 2024-04-24T23:38:17.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.522+0000 7fe321a97640 1 --2- 172.21.15.88:0/1787548880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe31c0bebd0 0x7fe31c149c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:17.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.522+0000 7fe321a97640 1 --2- 172.21.15.88:0/1787548880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe31c073380 0x7fe31c149720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:17.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.522+0000 7fe321a97640 1 --2- 172.21.15.88:0/1787548880 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe31c06fe10 0x7fe31c153020 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:17.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.522+0000 7fe321a97640 1 -- 172.21.15.88:0/1787548880 >> 172.21.15.88:0/1787548880 conn(0x7fe31c0bf220 msgr2=0x7fe31c06efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:17.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.522+0000 7fe321a97640 1 -- 172.21.15.88:0/1787548880 shutdown_connections 2024-04-24T23:38:17.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.522+0000 7fe321a97640 1 -- 172.21.15.88:0/1787548880 wait complete. 2024-04-24T23:38:17.538 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd new 38f6f4ef-3bc2-4453-9946-7d1d17e735ab 1 2024-04-24T23:38:17.548 INFO:tasks.ceph.mgr.x.smithi088.stderr:2024-04-24T23:38:17.546+0000 7ff7b7154180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-24T23:38:17.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.646+0000 7fdb3648f640 1 Processor -- start 2024-04-24T23:38:17.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.646+0000 7fdb3648f640 1 -- start start 2024-04-24T23:38:17.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.650+0000 7fdb3648f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdb300bd670 0x7fdb3014a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:17.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.650+0000 7fdb3648f640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdb3014aaf0 0x7fdb3015b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:17.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.650+0000 7fdb3648f640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb3006fd80 con 0x7fdb300c3b70 2024-04-24T23:38:17.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.650+0000 7fdb3648f640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fdb300712f0 con 0x7fdb3014aaf0 2024-04-24T23:38:17.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.650+0000 7fdb3648f640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fdb301508f0 con 0x7fdb300bd670 2024-04-24T23:38:17.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.650+0000 7fdb2ffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdb300bd670 0x7fdb3014a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:17.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.650+0000 7fdb2f7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdb300c3b70 0x7fdb30150df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37352/0 (socket says 172.21.15.88:37352) 2024-04-24T23:38:17.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.650+0000 7fdb2f7fe640 1 -- 172.21.15.88:0/1000239129 learned_addr learned my addr 172.21.15.88:0/1000239129 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T23:38:17.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.650+0000 7fdb2ffff640 1 -- 172.21.15.88:0/1000239129 >> v2:172.21.15.57:3300/0 conn(0x7fdb3014aaf0 msgr2=0x7fdb3015b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:17.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.650+0000 7fdb2ffff640 1 --2- 172.21.15.88:0/1000239129 >> v2:172.21.15.57:3300/0 conn(0x7fdb3014aaf0 0x7fdb3015b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:17.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.650+0000 7fdb2ffff640 1 -- 172.21.15.88:0/1000239129 >> v1:172.21.15.88:6789/0 conn(0x7fdb300c3b70 legacy=0x7fdb30150df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:17.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.650+0000 7fdb2ffff640 1 -- 172.21.15.88:0/1000239129 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb300c1ee0 con 0x7fdb300bd670 2024-04-24T23:38:17.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.650+0000 7fdb2ffff640 1 --2- 172.21.15.88:0/1000239129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb300bd670 0x7fdb3014a5b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdb30050650 tx=0x7fdb2001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4d0b1920f33d0dd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:17.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.650+0000 7fdb2effd640 1 -- 172.21.15.88:0/1000239129 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb200b1070 con 0x7fdb300bd670 2024-04-24T23:38:17.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.650+0000 7fdb2effd640 1 -- 172.21.15.88:0/1000239129 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb200ac620 con 0x7fdb300bd670 2024-04-24T23:38:17.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.650+0000 7fdb2effd640 1 -- 172.21.15.88:0/1000239129 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb200ac9f0 con 0x7fdb300bd670 2024-04-24T23:38:17.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb3648f640 1 -- 172.21.15.88:0/1000239129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb300bd670 msgr2=0x7fdb3014a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:17.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb3648f640 1 --2- 172.21.15.88:0/1000239129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb300bd670 0x7fdb3014a5b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdb30050650 tx=0x7fdb2001c3c0 comp rx=0 tx=0).stop 2024-04-24T23:38:17.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb3648f640 1 -- 172.21.15.88:0/1000239129 shutdown_connections 2024-04-24T23:38:17.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb3648f640 1 --2- 172.21.15.88:0/1000239129 >> v2:172.21.15.57:3300/0 conn(0x7fdb3014aaf0 0x7fdb3015b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:17.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb3648f640 1 --2- 172.21.15.88:0/1000239129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb300bd670 0x7fdb3014a5b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:17.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb3648f640 1 -- 172.21.15.88:0/1000239129 >> 172.21.15.88:0/1000239129 conn(0x7fdb300a5d90 msgr2=0x7fdb300a61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:17.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb3648f640 1 -- 172.21.15.88:0/1000239129 shutdown_connections 2024-04-24T23:38:17.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb3648f640 1 -- 172.21.15.88:0/1000239129 wait complete. 2024-04-24T23:38:17.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb3648f640 1 Processor -- start 2024-04-24T23:38:17.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb3648f640 1 -- start start 2024-04-24T23:38:17.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb3648f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb300bd670 0x7fdb300a9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:17.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb3648f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb300c3b70 0x7fdb301ed150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:17.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb3648f640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdb3014aaf0 0x7fdb301ed690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:17.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb3648f640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fdb300bdbd0 con 0x7fdb300bd670 2024-04-24T23:38:17.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb3648f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fdb300bda50 con 0x7fdb300c3b70 2024-04-24T23:38:17.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb3648f640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fdb30070c40 con 0x7fdb3014aaf0 2024-04-24T23:38:17.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb2f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb300c3b70 0x7fdb301ed150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:17.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb34a2c640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdb3014aaf0 0x7fdb301ed690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:17.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb2f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb300c3b70 0x7fdb301ed150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42548/0 (socket says 172.21.15.88:42548) 2024-04-24T23:38:17.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb2f7fe640 1 -- 172.21.15.88:0/3402728823 learned_addr learned my addr 172.21.15.88:0/3402728823 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T23:38:17.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb2ffff640 1 --2- 172.21.15.88:0/3402728823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb300bd670 0x7fdb300a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:17.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb2f7fe640 1 -- 172.21.15.88:0/3402728823 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdb3014aaf0 msgr2=0x7fdb301ed690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:17.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb2f7fe640 1 --2- 172.21.15.88:0/3402728823 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdb3014aaf0 0x7fdb301ed690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:17.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb2f7fe640 1 -- 172.21.15.88:0/3402728823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb300bd670 msgr2=0x7fdb300a9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:17.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb2f7fe640 1 --2- 172.21.15.88:0/3402728823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb300bd670 0x7fdb300a9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:17.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb2f7fe640 1 -- 172.21.15.88:0/3402728823 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb30140ff0 con 0x7fdb300c3b70 2024-04-24T23:38:17.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb2ffff640 1 --2- 172.21.15.88:0/3402728823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb300bd670 0x7fdb300a9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:38:17.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb2f7fe640 1 --2- 172.21.15.88:0/3402728823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb300c3b70 0x7fdb301ed150 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdb2400c3d0 tx=0x7fdb2400c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:17.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb2cff9640 1 -- 172.21.15.88:0/3402728823 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb24017070 con 0x7fdb300c3b70 2024-04-24T23:38:17.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb2cff9640 1 -- 172.21.15.88:0/3402728823 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb24005cf0 con 0x7fdb300c3b70 2024-04-24T23:38:17.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb3648f640 1 -- 172.21.15.88:0/3402728823 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb30154a60 con 0x7fdb300c3b70 2024-04-24T23:38:17.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb2cff9640 1 -- 172.21.15.88:0/3402728823 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb240072f0 con 0x7fdb300c3b70 2024-04-24T23:38:17.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb3648f640 1 -- 172.21.15.88:0/3402728823 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb30141260 con 0x7fdb300c3b70 2024-04-24T23:38:17.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb2cff9640 1 -- 172.21.15.88:0/3402728823 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdb2401a070 con 0x7fdb300c3b70 2024-04-24T23:38:17.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.654+0000 7fdb2cff9640 1 -- 172.21.15.88:0/3402728823 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fdb240127b0 con 0x7fdb300c3b70 2024-04-24T23:38:17.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.658+0000 7fdb3648f640 1 -- 172.21.15.88:0/3402728823 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb30068930 con 0x7fdb300c3b70 2024-04-24T23:38:17.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.658+0000 7fdb2cff9640 1 -- 172.21.15.88:0/3402728823 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fdb24021070 con 0x7fdb300c3b70 2024-04-24T23:38:17.714 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-24T23:38:17.713+0000 7fe04def4180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-24T23:38:17.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.726+0000 7fdb3648f640 1 -- 172.21.15.88:0/3402728823 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd new", "uuid": "38f6f4ef-3bc2-4453-9946-7d1d17e735ab", "id": 1} v 0) -- 0x7fdb300be2e0 con 0x7fdb300c3b70 2024-04-24T23:38:17.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.734+0000 7fdb2cff9640 1 -- 172.21.15.88:0/3402728823 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "38f6f4ef-3bc2-4453-9946-7d1d17e735ab", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fdb24007560 con 0x7fdb300c3b70 2024-04-24T23:38:17.735 INFO:teuthology.orchestra.run.smithi088.stdout:1 2024-04-24T23:38:17.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.734+0000 7fdb3648f640 1 -- 172.21.15.88:0/3402728823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb300c3b70 msgr2=0x7fdb301ed150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:17.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.734+0000 7fdb3648f640 1 --2- 172.21.15.88:0/3402728823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb300c3b70 0x7fdb301ed150 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdb2400c3d0 tx=0x7fdb2400c890 comp rx=0 tx=0).stop 2024-04-24T23:38:17.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.734+0000 7fdb3648f640 1 -- 172.21.15.88:0/3402728823 shutdown_connections 2024-04-24T23:38:17.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.734+0000 7fdb3648f640 1 --2- 172.21.15.88:0/3402728823 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdb3014aaf0 0x7fdb301ed690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:17.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.734+0000 7fdb3648f640 1 --2- 172.21.15.88:0/3402728823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb300c3b70 0x7fdb301ed150 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:17.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.734+0000 7fdb3648f640 1 --2- 172.21.15.88:0/3402728823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb300bd670 0x7fdb300a9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:17.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.734+0000 7fdb3648f640 1 -- 172.21.15.88:0/3402728823 >> 172.21.15.88:0/3402728823 conn(0x7fdb300a5d90 msgr2=0x7fdb300744f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:17.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.734+0000 7fdb3648f640 1 -- 172.21.15.88:0/3402728823 shutdown_connections 2024-04-24T23:38:17.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.734+0000 7fdb3648f640 1 -- 172.21.15.88:0/3402728823 wait complete. 2024-04-24T23:38:17.751 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd new d77a0a49-b39a-464e-a1c9-49e19280c440 2 2024-04-24T23:38:17.754 INFO:tasks.ceph.mgr.x.smithi088.stderr:2024-04-24T23:38:17.754+0000 7ff7b7154180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-24T23:38:17.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.858+0000 7ff1f7106640 1 Processor -- start 2024-04-24T23:38:17.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.858+0000 7ff1f7106640 1 -- start start 2024-04-24T23:38:17.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.858+0000 7ff1f7106640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1f00723e0 0x7ff1f014a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:17.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.858+0000 7ff1f7106640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff1f00a7de0 0x7ff1f014ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:17.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.858+0000 7ff1f7106640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1f0070240 con 0x7ff1f00a5d00 2024-04-24T23:38:17.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.858+0000 7ff1f7106640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7ff1f00bed70 con 0x7ff1f00a7de0 2024-04-24T23:38:17.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.858+0000 7ff1f7106640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7ff1f00bf050 con 0x7ff1f00723e0 2024-04-24T23:38:17.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.858+0000 7ff1f4ea2640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1f00723e0 0x7ff1f014a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:17.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.858+0000 7ff1f4ea2640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1f00723e0 0x7ff1f014a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:42324/0 (socket says 172.21.15.88:42324) 2024-04-24T23:38:17.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.858+0000 7ff1f4ea2640 1 -- 172.21.15.88:0/1636765043 learned_addr learned my addr 172.21.15.88:0/1636765043 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T23:38:17.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.858+0000 7ff1f4ea2640 1 -- 172.21.15.88:0/1636765043 >> v2:172.21.15.57:3300/0 conn(0x7ff1f00a7de0 msgr2=0x7ff1f014ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:17.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.858+0000 7ff1f56a3640 1 --2- 172.21.15.88:0/1636765043 >> v2:172.21.15.57:3300/0 conn(0x7ff1f00a7de0 0x7ff1f014ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:17.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.858+0000 7ff1ef7fe640 1 -- 172.21.15.88:0/1636765043 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 7749722 0 0) 0x7ff1f0070240 con 0x7ff1f00a5d00 2024-04-24T23:38:17.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.858+0000 7ff1f4ea2640 1 --2- 172.21.15.88:0/1636765043 >> v2:172.21.15.57:3300/0 conn(0x7ff1f00a7de0 0x7ff1f014ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:17.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.858+0000 7ff1f4ea2640 1 -- 172.21.15.88:0/1636765043 >> v1:172.21.15.88:6789/0 conn(0x7ff1f00a5d00 legacy=0x7ff1f0150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:17.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.858+0000 7ff1f4ea2640 1 -- 172.21.15.88:0/1636765043 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f00bf330 con 0x7ff1f00723e0 2024-04-24T23:38:17.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.862+0000 7ff1f4ea2640 1 --2- 172.21.15.88:0/1636765043 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1f00723e0 0x7ff1f014a830 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000bb10 tx=0x7ff1e001eba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbc9edb21d03daea server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:17.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.862+0000 7ff1ef7fe640 1 -- 172.21.15.88:0/1636765043 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e00b4070 con 0x7ff1f00723e0 2024-04-24T23:38:17.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.862+0000 7ff1ef7fe640 1 -- 172.21.15.88:0/1636765043 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e00a7a80 con 0x7ff1f00723e0 2024-04-24T23:38:17.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.862+0000 7ff1ef7fe640 1 -- 172.21.15.88:0/1636765043 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e00a7e50 con 0x7ff1f00723e0 2024-04-24T23:38:17.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.862+0000 7ff1f7106640 1 -- 172.21.15.88:0/1636765043 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1f00723e0 msgr2=0x7ff1f014a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:17.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.862+0000 7ff1f7106640 1 --2- 172.21.15.88:0/1636765043 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1f00723e0 0x7ff1f014a830 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000bb10 tx=0x7ff1e001eba0 comp rx=0 tx=0).stop 2024-04-24T23:38:17.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.862+0000 7ff1f7106640 1 -- 172.21.15.88:0/1636765043 shutdown_connections 2024-04-24T23:38:17.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.862+0000 7ff1f7106640 1 --2- 172.21.15.88:0/1636765043 >> v2:172.21.15.57:3300/0 conn(0x7ff1f00a7de0 0x7ff1f014ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:17.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.862+0000 7ff1f7106640 1 --2- 172.21.15.88:0/1636765043 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1f00723e0 0x7ff1f014a830 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:17.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.862+0000 7ff1f7106640 1 -- 172.21.15.88:0/1636765043 >> 172.21.15.88:0/1636765043 conn(0x7ff1f00c30c0 msgr2=0x7ff1f00c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:17.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.862+0000 7ff1f7106640 1 -- 172.21.15.88:0/1636765043 shutdown_connections 2024-04-24T23:38:17.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.862+0000 7ff1f7106640 1 -- 172.21.15.88:0/1636765043 wait complete. 2024-04-24T23:38:17.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.862+0000 7ff1f7106640 1 Processor -- start 2024-04-24T23:38:17.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.862+0000 7ff1f7106640 1 -- start start 2024-04-24T23:38:17.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.866+0000 7ff1f7106640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1f00723e0 0x7ff1f01e8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:17.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.866+0000 7ff1f7106640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1f00a5d00 0x7ff1f01389d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:17.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.866+0000 7ff1f7106640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1f00a7de0 0x7ff1f0138f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:17.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.866+0000 7ff1f7106640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f006bba0 con 0x7ff1f00723e0 2024-04-24T23:38:17.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.866+0000 7ff1f7106640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f006ba20 con 0x7ff1f00a7de0 2024-04-24T23:38:17.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.866+0000 7ff1f7106640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7ff1f006bd20 con 0x7ff1f00a5d00 2024-04-24T23:38:17.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.866+0000 7ff1f56a3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1f00a7de0 0x7ff1f0138f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:17.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.866+0000 7ff1effff640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1f00a5d00 0x7ff1f01389d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:17.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.866+0000 7ff1effff640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1f00a5d00 0x7ff1f01389d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:42332/0 (socket says 172.21.15.88:42332) 2024-04-24T23:38:17.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.866+0000 7ff1f56a3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1f00a7de0 0x7ff1f0138f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42554/0 (socket says 172.21.15.88:42554) 2024-04-24T23:38:17.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.866+0000 7ff1effff640 1 -- 172.21.15.88:0/300541380 learned_addr learned my addr 172.21.15.88:0/300541380 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T23:38:17.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.866+0000 7ff1f4ea2640 1 --2- 172.21.15.88:0/300541380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1f00723e0 0x7ff1f01e8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:17.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.866+0000 7ff1effff640 1 -- 172.21.15.88:0/300541380 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1f00a7de0 msgr2=0x7ff1f0138f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:17.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.866+0000 7ff1effff640 1 --2- 172.21.15.88:0/300541380 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1f00a7de0 0x7ff1f0138f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:17.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.866+0000 7ff1effff640 1 -- 172.21.15.88:0/300541380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1f00723e0 msgr2=0x7ff1f01e8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:17.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.866+0000 7ff1effff640 1 --2- 172.21.15.88:0/300541380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1f00723e0 0x7ff1f01e8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:17.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.866+0000 7ff1effff640 1 -- 172.21.15.88:0/300541380 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f014f810 con 0x7ff1f00a5d00 2024-04-24T23:38:17.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.866+0000 7ff1effff640 1 --2- 172.21.15.88:0/300541380 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1f00a5d00 0x7ff1f01389d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400c4d0 tx=0x7ff1e400c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:17.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.866+0000 7ff1ed7fa640 1 -- 172.21.15.88:0/300541380 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4017070 con 0x7ff1f00a5d00 2024-04-24T23:38:17.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.866+0000 7ff1ed7fa640 1 -- 172.21.15.88:0/300541380 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e4005480 con 0x7ff1f00a5d00 2024-04-24T23:38:17.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.866+0000 7ff1f7106640 1 -- 172.21.15.88:0/300541380 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1f014faf0 con 0x7ff1f00a5d00 2024-04-24T23:38:17.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.866+0000 7ff1ed7fa640 1 -- 172.21.15.88:0/300541380 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4003840 con 0x7ff1f00a5d00 2024-04-24T23:38:17.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.866+0000 7ff1f7106640 1 -- 172.21.15.88:0/300541380 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1f01e92d0 con 0x7ff1f00a5d00 2024-04-24T23:38:17.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.866+0000 7ff1ed7fa640 1 -- 172.21.15.88:0/300541380 <== mon.2 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff1e401a070 con 0x7ff1f00a5d00 2024-04-24T23:38:17.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.866+0000 7ff1ed7fa640 1 -- 172.21.15.88:0/300541380 <== mon.2 v2:172.21.15.88:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7ff1e4003e00 con 0x7ff1f00a5d00 2024-04-24T23:38:17.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.866+0000 7ff1f7106640 1 -- 172.21.15.88:0/300541380 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1f014fed0 con 0x7ff1f00a5d00 2024-04-24T23:38:17.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.870+0000 7ff1ed7fa640 1 -- 172.21.15.88:0/300541380 <== mon.2 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7ff1f014fed0 con 0x7ff1f00a5d00 2024-04-24T23:38:17.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.938+0000 7ff1f7106640 1 -- 172.21.15.88:0/300541380 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d77a0a49-b39a-464e-a1c9-49e19280c440", "id": 2} v 0) -- 0x7ff1f0068930 con 0x7ff1f00a5d00 2024-04-24T23:38:17.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.942+0000 7ff1ed7fa640 1 -- 172.21.15.88:0/300541380 <== mon.2 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d77a0a49-b39a-464e-a1c9-49e19280c440", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7ff1e4021070 con 0x7ff1f00a5d00 2024-04-24T23:38:17.942 INFO:teuthology.orchestra.run.smithi088.stdout:2 2024-04-24T23:38:17.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.942+0000 7ff1f7106640 1 -- 172.21.15.88:0/300541380 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1f00a5d00 msgr2=0x7ff1f01389d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:17.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.942+0000 7ff1f7106640 1 --2- 172.21.15.88:0/300541380 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1f00a5d00 0x7ff1f01389d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400c4d0 tx=0x7ff1e400c990 comp rx=0 tx=0).stop 2024-04-24T23:38:17.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.942+0000 7ff1f7106640 1 -- 172.21.15.88:0/300541380 shutdown_connections 2024-04-24T23:38:17.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.942+0000 7ff1f7106640 1 --2- 172.21.15.88:0/300541380 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1f00a7de0 0x7ff1f0138f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:17.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.942+0000 7ff1f7106640 1 --2- 172.21.15.88:0/300541380 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1f00a5d00 0x7ff1f01389d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:17.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.942+0000 7ff1f7106640 1 --2- 172.21.15.88:0/300541380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1f00723e0 0x7ff1f01e8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:17.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.942+0000 7ff1f7106640 1 -- 172.21.15.88:0/300541380 >> 172.21.15.88:0/300541380 conn(0x7ff1f00c30c0 msgr2=0x7ff1f0149a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:17.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.942+0000 7ff1f7106640 1 -- 172.21.15.88:0/300541380 shutdown_connections 2024-04-24T23:38:17.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:17.942+0000 7ff1f7106640 1 -- 172.21.15.88:0/300541380 wait complete. 2024-04-24T23:38:17.951 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-24T23:38:17.949+0000 7fe04def4180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-24T23:38:17.958 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd new f8ea9bfe-d839-44a6-a185-0f0985da314c 3 2024-04-24T23:38:18.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.062+0000 7f6cdab75640 1 Processor -- start 2024-04-24T23:38:18.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.062+0000 7f6cdab75640 1 -- start start 2024-04-24T23:38:18.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.062+0000 7f6cdab75640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6cd414aa90 0x7f6cd41548a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:18.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.062+0000 7f6cdab75640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6cd40bd0c0 0x7f6cd406b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:18.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.062+0000 7f6cdab75640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cd41509b0 con 0x7f6cd406b750 2024-04-24T23:38:18.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.062+0000 7f6cdab75640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f6cd4154de0 con 0x7f6cd414aa90 2024-04-24T23:38:18.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.062+0000 7f6cdab75640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f6cd40bc820 con 0x7f6cd40bd0c0 2024-04-24T23:38:18.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.062+0000 7f6cd3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6cd40bd0c0 0x7f6cd406b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:18.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.062+0000 7f6cd3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6cd40bd0c0 0x7f6cd406b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42558/0 (socket says 172.21.15.88:42558) 2024-04-24T23:38:18.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.062+0000 7f6cd3fff640 1 -- 172.21.15.88:0/1854049115 learned_addr learned my addr 172.21.15.88:0/1854049115 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T23:38:18.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.062+0000 7f6cd3fff640 1 -- 172.21.15.88:0/1854049115 >> v2:172.21.15.57:3300/0 conn(0x7f6cd414aa90 msgr2=0x7f6cd41548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:18.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.062+0000 7f6cd8911640 1 --2- 172.21.15.88:0/1854049115 >> v2:172.21.15.57:3300/0 conn(0x7f6cd414aa90 0x7f6cd41548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:18.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.062+0000 7f6cd3fff640 1 --2- 172.21.15.88:0/1854049115 >> v2:172.21.15.57:3300/0 conn(0x7f6cd414aa90 0x7f6cd41548a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.062+0000 7f6cd3fff640 1 -- 172.21.15.88:0/1854049115 >> v1:172.21.15.57:6789/0 conn(0x7f6cd406b750 legacy=0x7f6cd4150e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:18.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.062+0000 7f6cd3fff640 1 -- 172.21.15.88:0/1854049115 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd40bcb00 con 0x7f6cd40bd0c0 2024-04-24T23:38:18.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.066+0000 7f6cd3fff640 1 --2- 172.21.15.88:0/1854049115 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cd40bd0c0 0x7f6cd406b210 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6cd406e4d0 tx=0x7f6cc001c4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99137391b3c586c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:18.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.066+0000 7f6cd37fe640 1 -- 172.21.15.88:0/1854049115 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc00aa620 con 0x7f6cd40bd0c0 2024-04-24T23:38:18.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.066+0000 7f6cd37fe640 1 -- 172.21.15.88:0/1854049115 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cc00af070 con 0x7f6cd40bd0c0 2024-04-24T23:38:18.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.066+0000 7f6cd37fe640 1 -- 172.21.15.88:0/1854049115 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc00aa9e0 con 0x7f6cd40bd0c0 2024-04-24T23:38:18.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.066+0000 7f6cdab75640 1 -- 172.21.15.88:0/1854049115 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cd40bd0c0 msgr2=0x7f6cd406b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:18.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.066+0000 7f6cdab75640 1 --2- 172.21.15.88:0/1854049115 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cd40bd0c0 0x7f6cd406b210 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6cd406e4d0 tx=0x7f6cc001c4e0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.066+0000 7f6cdab75640 1 -- 172.21.15.88:0/1854049115 shutdown_connections 2024-04-24T23:38:18.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.066+0000 7f6cdab75640 1 --2- 172.21.15.88:0/1854049115 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cd40bd0c0 0x7f6cd406b210 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.066+0000 7f6cdab75640 1 --2- 172.21.15.88:0/1854049115 >> v2:172.21.15.57:3300/0 conn(0x7f6cd414aa90 0x7f6cd41548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.066+0000 7f6cdab75640 1 -- 172.21.15.88:0/1854049115 >> 172.21.15.88:0/1854049115 conn(0x7f6cd40c30c0 msgr2=0x7f6cd40c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:18.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.066+0000 7f6cdab75640 1 -- 172.21.15.88:0/1854049115 shutdown_connections 2024-04-24T23:38:18.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.066+0000 7f6cdab75640 1 -- 172.21.15.88:0/1854049115 wait complete. 2024-04-24T23:38:18.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.066+0000 7f6cdab75640 1 Processor -- start 2024-04-24T23:38:18.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.066+0000 7f6cdab75640 1 -- start start 2024-04-24T23:38:18.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.070+0000 7f6cdab75640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cd406b750 0x7f6cd41eca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:18.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.070+0000 7f6cdab75640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6cd40bd0c0 0x7f6cd4141620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:18.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.070+0000 7f6cdab75640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6cd414aa90 0x7f6cd414ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:18.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.070+0000 7f6cdab75640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd415ddd0 con 0x7f6cd414aa90 2024-04-24T23:38:18.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.070+0000 7f6cdab75640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd415dc50 con 0x7f6cd406b750 2024-04-24T23:38:18.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.070+0000 7f6cdab75640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f6cd415df50 con 0x7f6cd40bd0c0 2024-04-24T23:38:18.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.070+0000 7f6cd8911640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cd406b750 0x7f6cd41eca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:18.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.070+0000 7f6cd3fff640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6cd40bd0c0 0x7f6cd4141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:18.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.070+0000 7f6cd8911640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cd406b750 0x7f6cd41eca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42570/0 (socket says 172.21.15.88:42570) 2024-04-24T23:38:18.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.070+0000 7f6cd8911640 1 -- 172.21.15.88:0/3469805214 learned_addr learned my addr 172.21.15.88:0/3469805214 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T23:38:18.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.070+0000 7f6cd9112640 1 --2- 172.21.15.88:0/3469805214 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6cd414aa90 0x7f6cd414ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:18.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.070+0000 7f6cd3fff640 1 -- 172.21.15.88:0/3469805214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cd406b750 msgr2=0x7f6cd41eca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:18.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.070+0000 7f6cd3fff640 1 --2- 172.21.15.88:0/3469805214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cd406b750 0x7f6cd41eca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.070+0000 7f6cd3fff640 1 -- 172.21.15.88:0/3469805214 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6cd414aa90 msgr2=0x7f6cd414ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:18.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.070+0000 7f6cd3fff640 1 --2- 172.21.15.88:0/3469805214 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6cd414aa90 0x7f6cd414ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.070+0000 7f6cd3fff640 1 -- 172.21.15.88:0/3469805214 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd4141b60 con 0x7f6cd40bd0c0 2024-04-24T23:38:18.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.070+0000 7f6cd8911640 1 --2- 172.21.15.88:0/3469805214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cd406b750 0x7f6cd41eca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:38:18.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.070+0000 7f6cd3fff640 1 --2- 172.21.15.88:0/3469805214 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6cd40bd0c0 0x7f6cd4141620 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4150b80 tx=0x7f6cc001ad20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:18.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.070+0000 7f6cd17fa640 1 -- 172.21.15.88:0/3469805214 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc00bd3f0 con 0x7f6cd40bd0c0 2024-04-24T23:38:18.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.070+0000 7f6cd17fa640 1 -- 172.21.15.88:0/3469805214 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cc00bd590 con 0x7f6cd40bd0c0 2024-04-24T23:38:18.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.070+0000 7f6cdab75640 1 -- 172.21.15.88:0/3469805214 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd4142f90 con 0x7f6cd40bd0c0 2024-04-24T23:38:18.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.070+0000 7f6cd17fa640 1 -- 172.21.15.88:0/3469805214 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc00bd980 con 0x7f6cd40bd0c0 2024-04-24T23:38:18.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.070+0000 7f6cdab75640 1 -- 172.21.15.88:0/3469805214 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd4142cb0 con 0x7f6cd40bd0c0 2024-04-24T23:38:18.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.070+0000 7f6cd17fa640 1 -- 172.21.15.88:0/3469805214 <== mon.2 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6cc00b33f0 con 0x7f6cd40bd0c0 2024-04-24T23:38:18.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.070+0000 7f6cd17fa640 1 -- 172.21.15.88:0/3469805214 <== mon.2 v2:172.21.15.88:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f6cc00b2810 con 0x7f6cd40bd0c0 2024-04-24T23:38:18.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.070+0000 7f6cdab75640 1 -- 172.21.15.88:0/3469805214 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cd4068930 con 0x7f6cd40bd0c0 2024-04-24T23:38:18.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.074+0000 7f6cd17fa640 1 -- 172.21.15.88:0/3469805214 <== mon.2 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f6cc00c3060 con 0x7f6cd40bd0c0 2024-04-24T23:38:18.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.142+0000 7f6cdab75640 1 -- 172.21.15.88:0/3469805214 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f8ea9bfe-d839-44a6-a185-0f0985da314c", "id": 3} v 0) -- 0x7f6cd40a8650 con 0x7f6cd40bd0c0 2024-04-24T23:38:18.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.150+0000 7f6cd17fa640 1 -- 172.21.15.88:0/3469805214 <== mon.2 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f8ea9bfe-d839-44a6-a185-0f0985da314c", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f6cd4141b60 con 0x7f6cd40bd0c0 2024-04-24T23:38:18.150 INFO:teuthology.orchestra.run.smithi088.stdout:3 2024-04-24T23:38:18.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.150+0000 7f6cdab75640 1 -- 172.21.15.88:0/3469805214 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6cd40bd0c0 msgr2=0x7f6cd4141620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:18.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.150+0000 7f6cdab75640 1 --2- 172.21.15.88:0/3469805214 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6cd40bd0c0 0x7f6cd4141620 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4150b80 tx=0x7f6cc001ad20 comp rx=0 tx=0).stop 2024-04-24T23:38:18.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.150+0000 7f6cdab75640 1 -- 172.21.15.88:0/3469805214 shutdown_connections 2024-04-24T23:38:18.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.150+0000 7f6cdab75640 1 --2- 172.21.15.88:0/3469805214 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6cd414aa90 0x7f6cd414ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.150+0000 7f6cdab75640 1 --2- 172.21.15.88:0/3469805214 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6cd40bd0c0 0x7f6cd4141620 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.150+0000 7f6cdab75640 1 --2- 172.21.15.88:0/3469805214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cd406b750 0x7f6cd41eca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.150+0000 7f6cdab75640 1 -- 172.21.15.88:0/3469805214 >> 172.21.15.88:0/3469805214 conn(0x7f6cd40c30c0 msgr2=0x7f6cd40c34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:18.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.150+0000 7f6cdab75640 1 -- 172.21.15.88:0/3469805214 shutdown_connections 2024-04-24T23:38:18.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.150+0000 7f6cdab75640 1 -- 172.21.15.88:0/3469805214 wait complete. 2024-04-24T23:38:18.167 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd new 454647d4-6ac2-46b4-8451-320eb951a87e 4 2024-04-24T23:38:18.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.278+0000 7efe37d3a640 1 Processor -- start 2024-04-24T23:38:18.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.278+0000 7efe37d3a640 1 -- start start 2024-04-24T23:38:18.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe37d3a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efe30151500 0x7efe3015c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:18.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe37d3a640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe3006fd80 con 0x7efe300c3b70 2024-04-24T23:38:18.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe37d3a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe301508f0 con 0x7efe300bd670 2024-04-24T23:38:18.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe37d3a640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7efe300712f0 con 0x7efe30151500 2024-04-24T23:38:18.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe35ad6640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7efe300bd670 0x7efe3014a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37368/0 (socket says 172.21.15.88:37368) 2024-04-24T23:38:18.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe35ad6640 1 -- 172.21.15.88:0/1064467658 learned_addr learned my addr 172.21.15.88:0/1064467658 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T23:38:18.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe362d7640 1 --2- 172.21.15.88:0/1064467658 >> v2:172.21.15.57:3300/0 conn(0x7efe30151500 0x7efe3015c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:18.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe34ad4640 1 -- 172.21.15.88:0/1064467658 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2116022008 0 0) 0x7efe301508f0 con 0x7efe300bd670 2024-04-24T23:38:18.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe34ad4640 1 -- 172.21.15.88:0/1064467658 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe1c003530 con 0x7efe300bd670 2024-04-24T23:38:18.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe34ad4640 1 -- 172.21.15.88:0/1064467658 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 240260876 0 0) 0x7efe1c003530 con 0x7efe300bd670 2024-04-24T23:38:18.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe34ad4640 1 -- 172.21.15.88:0/1064467658 >> v2:172.21.15.57:3300/0 conn(0x7efe30151500 msgr2=0x7efe3015c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:18.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe34ad4640 1 --2- 172.21.15.88:0/1064467658 >> v2:172.21.15.57:3300/0 conn(0x7efe30151500 0x7efe3015c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe34ad4640 1 -- 172.21.15.88:0/1064467658 >> v1:172.21.15.57:6789/0 conn(0x7efe300c3b70 legacy=0x7efe30150df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:18.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe34ad4640 1 -- 172.21.15.88:0/1064467658 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe300c1ee0 con 0x7efe300bd670 2024-04-24T23:38:18.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe34ad4640 1 -- 172.21.15.88:0/1064467658 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7efe2c001680 con 0x7efe300bd670 2024-04-24T23:38:18.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe34ad4640 1 -- 172.21.15.88:0/1064467658 >> v1:172.21.15.88:6789/0 conn(0x7efe300bd670 legacy=0x7efe3014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:18.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe34ad4640 1 --2- 172.21.15.88:0/1064467658 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efe1c0039c0 0x7efe1c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:18.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe34ad4640 1 --2- 172.21.15.88:0/1064467658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe1c004810 0x7efe1c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:18.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe34ad4640 1 --2- 172.21.15.88:0/1064467658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe1c005220 0x7efe1c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:18.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe34ad4640 1 -- 172.21.15.88:0/1064467658 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7efe300712f0 con 0x7efe1c005220 2024-04-24T23:38:18.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe34ad4640 1 -- 172.21.15.88:0/1064467658 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7efe1c00c150 con 0x7efe1c004810 2024-04-24T23:38:18.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe34ad4640 1 -- 172.21.15.88:0/1064467658 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7efe1c00c350 con 0x7efe1c0039c0 2024-04-24T23:38:18.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe352d5640 1 --2- 172.21.15.88:0/1064467658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe1c004810 0x7efe1c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:18.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe35ad6640 1 --2- 172.21.15.88:0/1064467658 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efe1c0039c0 0x7efe1c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:18.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe362d7640 1 --2- 172.21.15.88:0/1064467658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe1c005220 0x7efe1c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:18.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe352d5640 1 -- 172.21.15.88:0/1064467658 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efe1c0039c0 msgr2=0x7efe1c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:18.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe352d5640 1 --2- 172.21.15.88:0/1064467658 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efe1c0039c0 0x7efe1c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe352d5640 1 -- 172.21.15.88:0/1064467658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe1c005220 msgr2=0x7efe1c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:18.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe352d5640 1 --2- 172.21.15.88:0/1064467658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe1c005220 0x7efe1c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe362d7640 1 -- 172.21.15.88:0/1064467658 reap_dead start 2024-04-24T23:38:18.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe352d5640 1 -- 172.21.15.88:0/1064467658 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1c003530 con 0x7efe1c004810 2024-04-24T23:38:18.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe352d5640 1 --2- 172.21.15.88:0/1064467658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe1c004810 0x7efe1c004c90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efe24001780 tx=0x7efe2401c400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dadcde48499acb72 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:18.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe34ad4640 1 -- 172.21.15.88:0/1064467658 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe240013a0 con 0x7efe1c004810 2024-04-24T23:38:18.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe34ad4640 1 -- 172.21.15.88:0/1064467658 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe240052f0 con 0x7efe1c004810 2024-04-24T23:38:18.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.282+0000 7efe34ad4640 1 -- 172.21.15.88:0/1064467658 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe24003840 con 0x7efe1c004810 2024-04-24T23:38:18.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe37d3a640 1 -- 172.21.15.88:0/1064467658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe1c004810 msgr2=0x7efe1c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:18.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe37d3a640 1 --2- 172.21.15.88:0/1064467658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe1c004810 0x7efe1c004c90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efe24001780 tx=0x7efe2401c400 comp rx=0 tx=0).stop 2024-04-24T23:38:18.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe37d3a640 1 -- 172.21.15.88:0/1064467658 shutdown_connections 2024-04-24T23:38:18.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe37d3a640 1 --2- 172.21.15.88:0/1064467658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe1c004810 0x7efe1c004c90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe37d3a640 1 -- 172.21.15.88:0/1064467658 >> 172.21.15.88:0/1064467658 conn(0x7efe300a5d90 msgr2=0x7efe300a61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:18.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe37d3a640 1 -- 172.21.15.88:0/1064467658 shutdown_connections 2024-04-24T23:38:18.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe37d3a640 1 -- 172.21.15.88:0/1064467658 wait complete. 2024-04-24T23:38:18.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe37d3a640 1 Processor -- start 2024-04-24T23:38:18.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe37d3a640 1 -- start start 2024-04-24T23:38:18.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe37d3a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe1c004810 0x7efe30152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:18.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe37d3a640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efe30142e50 0x7efe30154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:18.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe37d3a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe30154890 0x7efe301e9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:18.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe37d3a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7efe300be500 con 0x7efe30154890 2024-04-24T23:38:18.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe37d3a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7efe30071820 con 0x7efe1c004810 2024-04-24T23:38:18.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe37d3a640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7efe300bda50 con 0x7efe30142e50 2024-04-24T23:38:18.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe35ad6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe1c004810 0x7efe30152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:18.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe352d5640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efe30142e50 0x7efe30154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:18.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe35ad6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe1c004810 0x7efe30152330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42580/0 (socket says 172.21.15.88:42580) 2024-04-24T23:38:18.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe35ad6640 1 -- 172.21.15.88:0/2958424792 learned_addr learned my addr 172.21.15.88:0/2958424792 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T23:38:18.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe362d7640 1 --2- 172.21.15.88:0/2958424792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe30154890 0x7efe301e9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:18.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe35ad6640 1 -- 172.21.15.88:0/2958424792 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efe30142e50 msgr2=0x7efe30154350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:18.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe35ad6640 1 --2- 172.21.15.88:0/2958424792 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efe30142e50 0x7efe30154350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe35ad6640 1 -- 172.21.15.88:0/2958424792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe30154890 msgr2=0x7efe301e9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:18.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe35ad6640 1 --2- 172.21.15.88:0/2958424792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe30154890 0x7efe301e9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe35ad6640 1 -- 172.21.15.88:0/2958424792 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe30152870 con 0x7efe1c004810 2024-04-24T23:38:18.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe362d7640 1 --2- 172.21.15.88:0/2958424792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe30154890 0x7efe301e9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:38:18.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe35ad6640 1 --2- 172.21.15.88:0/2958424792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe1c004810 0x7efe30152330 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7efe2c0122e0 tx=0x7efe2c0127a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:18.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe227fc640 1 -- 172.21.15.88:0/2958424792 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c01c070 con 0x7efe1c004810 2024-04-24T23:38:18.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe227fc640 1 -- 172.21.15.88:0/2958424792 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe2c014750 con 0x7efe1c004810 2024-04-24T23:38:18.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe37d3a640 1 -- 172.21.15.88:0/2958424792 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe30150210 con 0x7efe1c004810 2024-04-24T23:38:18.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe227fc640 1 -- 172.21.15.88:0/2958424792 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c014b40 con 0x7efe1c004810 2024-04-24T23:38:18.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe37d3a640 1 -- 172.21.15.88:0/2958424792 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe30149b80 con 0x7efe1c004810 2024-04-24T23:38:18.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe227fc640 1 -- 172.21.15.88:0/2958424792 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efe2c01f070 con 0x7efe1c004810 2024-04-24T23:38:18.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe227fc640 1 -- 172.21.15.88:0/2958424792 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7efe2c016950 con 0x7efe1c004810 2024-04-24T23:38:18.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.286+0000 7efe37d3a640 1 -- 172.21.15.88:0/2958424792 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe30068930 con 0x7efe1c004810 2024-04-24T23:38:18.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.290+0000 7efe227fc640 1 -- 172.21.15.88:0/2958424792 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7efe30152870 con 0x7efe1c004810 2024-04-24T23:38:18.326 INFO:tasks.ceph.mgr.x.smithi088.stderr:2024-04-24T23:38:18.326+0000 7ff7b7154180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-24T23:38:18.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.358+0000 7efe37d3a640 1 -- 172.21.15.88:0/2958424792 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd new", "uuid": "454647d4-6ac2-46b4-8451-320eb951a87e", "id": 4} v 0) -- 0x7efe301508a0 con 0x7efe1c004810 2024-04-24T23:38:18.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.366+0000 7efe227fc640 1 -- 172.21.15.88:0/2958424792 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "454647d4-6ac2-46b4-8451-320eb951a87e", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7efe2c016c00 con 0x7efe1c004810 2024-04-24T23:38:18.367 INFO:teuthology.orchestra.run.smithi088.stdout:4 2024-04-24T23:38:18.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.366+0000 7efe37d3a640 1 -- 172.21.15.88:0/2958424792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe1c004810 msgr2=0x7efe30152330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:18.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.366+0000 7efe37d3a640 1 --2- 172.21.15.88:0/2958424792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe1c004810 0x7efe30152330 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7efe2c0122e0 tx=0x7efe2c0127a0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.366+0000 7efe37d3a640 1 -- 172.21.15.88:0/2958424792 shutdown_connections 2024-04-24T23:38:18.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.366+0000 7efe37d3a640 1 --2- 172.21.15.88:0/2958424792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe30154890 0x7efe301e9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.366+0000 7efe37d3a640 1 --2- 172.21.15.88:0/2958424792 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efe30142e50 0x7efe30154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.366+0000 7efe37d3a640 1 --2- 172.21.15.88:0/2958424792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe1c004810 0x7efe30152330 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.366+0000 7efe37d3a640 1 -- 172.21.15.88:0/2958424792 >> 172.21.15.88:0/2958424792 conn(0x7efe300a5d90 msgr2=0x7efe300744f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:18.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.366+0000 7efe37d3a640 1 -- 172.21.15.88:0/2958424792 shutdown_connections 2024-04-24T23:38:18.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.366+0000 7efe37d3a640 1 -- 172.21.15.88:0/2958424792 wait complete. 2024-04-24T23:38:18.382 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd new f71c03a3-7ad8-46d3-89c9-d61de102586b 5 2024-04-24T23:38:18.383 INFO:tasks.ceph.mgr.x.smithi088.stderr:2024-04-24T23:38:18.382+0000 7ff7b7154180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-24T23:38:18.437 INFO:tasks.ceph.mgr.x.smithi088.stderr:2024-04-24T23:38:18.438+0000 7ff7b7154180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-24T23:38:18.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.486+0000 7fc4da4d8640 1 Processor -- start 2024-04-24T23:38:18.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.486+0000 7fc4da4d8640 1 -- start start 2024-04-24T23:38:18.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.486+0000 7fc4da4d8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc4d40bbe20 0x7fc4d40a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:18.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.486+0000 7fc4da4d8640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc4d414d5a0 0x7fc4d414da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:18.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.486+0000 7fc4da4d8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4d4154d40 con 0x7fc4d40bc630 2024-04-24T23:38:18.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.486+0000 7fc4da4d8640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fc4d41547c0 con 0x7fc4d414d5a0 2024-04-24T23:38:18.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.486+0000 7fc4da4d8640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fc4d40c2330 con 0x7fc4d40bbe20 2024-04-24T23:38:18.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.486+0000 7fc4d3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc4d40bbe20 0x7fc4d40a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:18.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.486+0000 7fc4d37fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc4d40bc630 0x7fc4d4150fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37382/0 (socket says 172.21.15.88:37382) 2024-04-24T23:38:18.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.486+0000 7fc4d37fe640 1 -- 172.21.15.88:0/4095747977 learned_addr learned my addr 172.21.15.88:0/4095747977 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T23:38:18.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.490+0000 7fc4d8a75640 1 --2- 172.21.15.88:0/4095747977 >> v2:172.21.15.57:3300/0 conn(0x7fc4d414d5a0 0x7fc4d414da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:18.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.490+0000 7fc4d3fff640 1 -- 172.21.15.88:0/4095747977 >> v2:172.21.15.57:3300/0 conn(0x7fc4d414d5a0 msgr2=0x7fc4d414da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:18.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.490+0000 7fc4d3fff640 1 --2- 172.21.15.88:0/4095747977 >> v2:172.21.15.57:3300/0 conn(0x7fc4d414d5a0 0x7fc4d414da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.490+0000 7fc4d3fff640 1 -- 172.21.15.88:0/4095747977 >> v1:172.21.15.88:6789/0 conn(0x7fc4d40bc630 legacy=0x7fc4d4150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:18.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.490+0000 7fc4d3fff640 1 -- 172.21.15.88:0/4095747977 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d4154a60 con 0x7fc4d40bbe20 2024-04-24T23:38:18.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.490+0000 7fc4d8a75640 1 --2- 172.21.15.88:0/4095747977 >> v2:172.21.15.57:3300/0 conn(0x7fc4d414d5a0 0x7fc4d414da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:38:18.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.490+0000 7fc4d3fff640 1 --2- 172.21.15.88:0/4095747977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d40bbe20 0x7fc4d40a1cc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40a5300 tx=0x7fc4bc01c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fe8e262a52ade79 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:18.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.490+0000 7fc4d2ffd640 1 -- 172.21.15.88:0/4095747977 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc0b0070 con 0x7fc4d40bbe20 2024-04-24T23:38:18.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.490+0000 7fc4d2ffd640 1 -- 172.21.15.88:0/4095747977 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4bc0ab600 con 0x7fc4d40bbe20 2024-04-24T23:38:18.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.490+0000 7fc4d2ffd640 1 -- 172.21.15.88:0/4095747977 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc0ab9d0 con 0x7fc4d40bbe20 2024-04-24T23:38:18.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.490+0000 7fc4da4d8640 1 -- 172.21.15.88:0/4095747977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d40bbe20 msgr2=0x7fc4d40a1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:18.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.490+0000 7fc4da4d8640 1 --2- 172.21.15.88:0/4095747977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d40bbe20 0x7fc4d40a1cc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40a5300 tx=0x7fc4bc01c360 comp rx=0 tx=0).stop 2024-04-24T23:38:18.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.490+0000 7fc4da4d8640 1 -- 172.21.15.88:0/4095747977 shutdown_connections 2024-04-24T23:38:18.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.490+0000 7fc4da4d8640 1 --2- 172.21.15.88:0/4095747977 >> v2:172.21.15.57:3300/0 conn(0x7fc4d414d5a0 0x7fc4d414da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.490+0000 7fc4da4d8640 1 --2- 172.21.15.88:0/4095747977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d40bbe20 0x7fc4d40a1cc0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.490+0000 7fc4da4d8640 1 -- 172.21.15.88:0/4095747977 >> 172.21.15.88:0/4095747977 conn(0x7fc4d40a4540 msgr2=0x7fc4d40a4950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:18.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.490+0000 7fc4da4d8640 1 -- 172.21.15.88:0/4095747977 shutdown_connections 2024-04-24T23:38:18.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.490+0000 7fc4da4d8640 1 -- 172.21.15.88:0/4095747977 wait complete. 2024-04-24T23:38:18.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.494+0000 7fc4da4d8640 1 Processor -- start 2024-04-24T23:38:18.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.494+0000 7fc4da4d8640 1 -- start start 2024-04-24T23:38:18.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.494+0000 7fc4da4d8640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc4d40bbe20 0x7fc4d415aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:18.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.494+0000 7fc4da4d8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d40bc630 0x7fc4d4149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:18.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.494+0000 7fc4da4d8640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4d414d5a0 0x7fc4d4149aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:18.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.494+0000 7fc4da4d8640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d4150990 con 0x7fc4d414d5a0 2024-04-24T23:38:18.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.494+0000 7fc4da4d8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d4150810 con 0x7fc4d40bc630 2024-04-24T23:38:18.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.494+0000 7fc4da4d8640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fc4d4073470 con 0x7fc4d40bbe20 2024-04-24T23:38:18.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.494+0000 7fc4d37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d40bc630 0x7fc4d4149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:18.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.494+0000 7fc4d37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d40bc630 0x7fc4d4149560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42594/0 (socket says 172.21.15.88:42594) 2024-04-24T23:38:18.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.494+0000 7fc4d37fe640 1 -- 172.21.15.88:0/1028820753 learned_addr learned my addr 172.21.15.88:0/1028820753 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T23:38:18.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.494+0000 7fc4d3fff640 1 --2- 172.21.15.88:0/1028820753 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc4d40bbe20 0x7fc4d415aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:18.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.494+0000 7fc4d8a75640 1 --2- 172.21.15.88:0/1028820753 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4d414d5a0 0x7fc4d4149aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:18.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.494+0000 7fc4d3fff640 1 -- 172.21.15.88:0/1028820753 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d40bc630 msgr2=0x7fc4d4149560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:18.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.494+0000 7fc4d3fff640 1 --2- 172.21.15.88:0/1028820753 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d40bc630 0x7fc4d4149560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.494+0000 7fc4d3fff640 1 -- 172.21.15.88:0/1028820753 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4d414d5a0 msgr2=0x7fc4d4149aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:18.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.494+0000 7fc4d3fff640 1 --2- 172.21.15.88:0/1028820753 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4d414d5a0 0x7fc4d4149aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.494+0000 7fc4d3fff640 1 -- 172.21.15.88:0/1028820753 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d414c620 con 0x7fc4d40bbe20 2024-04-24T23:38:18.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.494+0000 7fc4d37fe640 1 --2- 172.21.15.88:0/1028820753 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d40bc630 0x7fc4d4149560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:38:18.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.494+0000 7fc4d3fff640 1 --2- 172.21.15.88:0/1028820753 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc4d40bbe20 0x7fc4d415aa10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40c24b0 tx=0x7fc4bc019100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:18.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.494+0000 7fc4d0ff9640 1 -- 172.21.15.88:0/1028820753 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc0b8020 con 0x7fc4d40bbe20 2024-04-24T23:38:18.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.494+0000 7fc4d0ff9640 1 -- 172.21.15.88:0/1028820753 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4bc0b4630 con 0x7fc4d40bbe20 2024-04-24T23:38:18.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.494+0000 7fc4da4d8640 1 -- 172.21.15.88:0/1028820753 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4d414c8e0 con 0x7fc4d40bbe20 2024-04-24T23:38:18.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.494+0000 7fc4d0ff9640 1 -- 172.21.15.88:0/1028820753 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc0b0040 con 0x7fc4d40bbe20 2024-04-24T23:38:18.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.494+0000 7fc4da4d8640 1 -- 172.21.15.88:0/1028820753 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4d40a7c40 con 0x7fc4d40bbe20 2024-04-24T23:38:18.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.494+0000 7fc4d0ff9640 1 -- 172.21.15.88:0/1028820753 <== mon.2 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc4bc0bb020 con 0x7fc4d40bbe20 2024-04-24T23:38:18.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.494+0000 7fc4d0ff9640 1 -- 172.21.15.88:0/1028820753 <== mon.2 v2:172.21.15.88:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fc4bc0aa3a0 con 0x7fc4d40bbe20 2024-04-24T23:38:18.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.494+0000 7fc4da4d8640 1 -- 172.21.15.88:0/1028820753 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4d4068220 con 0x7fc4d40bbe20 2024-04-24T23:38:18.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.498+0000 7fc4d0ff9640 1 -- 172.21.15.88:0/1028820753 <== mon.2 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fc4bc0c2030 con 0x7fc4d40bbe20 2024-04-24T23:38:18.519 INFO:tasks.ceph.mgr.x.smithi088.stderr:2024-04-24T23:38:18.518+0000 7ff7b7154180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-24T23:38:18.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.562+0000 7fc4da4d8640 1 -- 172.21.15.88:0/1028820753 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f71c03a3-7ad8-46d3-89c9-d61de102586b", "id": 5} v 0) -- 0x7fc4d40749d0 con 0x7fc4d40bbe20 2024-04-24T23:38:18.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.570+0000 7fc4d0ff9640 1 -- 172.21.15.88:0/1028820753 <== mon.2 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f71c03a3-7ad8-46d3-89c9-d61de102586b", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fc4bc016070 con 0x7fc4d40bbe20 2024-04-24T23:38:18.571 INFO:teuthology.orchestra.run.smithi088.stdout:5 2024-04-24T23:38:18.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.570+0000 7fc4da4d8640 1 -- 172.21.15.88:0/1028820753 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc4d40bbe20 msgr2=0x7fc4d415aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:18.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.570+0000 7fc4da4d8640 1 --2- 172.21.15.88:0/1028820753 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc4d40bbe20 0x7fc4d415aa10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40c24b0 tx=0x7fc4bc019100 comp rx=0 tx=0).stop 2024-04-24T23:38:18.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.570+0000 7fc4da4d8640 1 -- 172.21.15.88:0/1028820753 shutdown_connections 2024-04-24T23:38:18.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.570+0000 7fc4da4d8640 1 --2- 172.21.15.88:0/1028820753 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4d414d5a0 0x7fc4d4149aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.570+0000 7fc4da4d8640 1 --2- 172.21.15.88:0/1028820753 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d40bc630 0x7fc4d4149560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.570+0000 7fc4da4d8640 1 --2- 172.21.15.88:0/1028820753 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc4d40bbe20 0x7fc4d415aa10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.570+0000 7fc4da4d8640 1 -- 172.21.15.88:0/1028820753 >> 172.21.15.88:0/1028820753 conn(0x7fc4d40a4540 msgr2=0x7fc4d40c16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:18.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.570+0000 7fc4da4d8640 1 -- 172.21.15.88:0/1028820753 shutdown_connections 2024-04-24T23:38:18.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.570+0000 7fc4da4d8640 1 -- 172.21.15.88:0/1028820753 wait complete. 2024-04-24T23:38:18.573 INFO:tasks.ceph.mgr.x.smithi088.stderr:2024-04-24T23:38:18.570+0000 7ff7b7154180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-24T23:38:18.587 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd new ec7ae2b7-9cb4-4059-8f98-0022c9763f13 6 2024-04-24T23:38:18.653 INFO:tasks.ceph.mgr.x.smithi088.stderr:2024-04-24T23:38:18.650+0000 7ff7b7154180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-24T23:38:18.655 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-24T23:38:18.653+0000 7fe04def4180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-24T23:38:18.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.690+0000 7f3ac271f640 1 Processor -- start 2024-04-24T23:38:18.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.690+0000 7f3ac271f640 1 -- start start 2024-04-24T23:38:18.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.694+0000 7f3ac271f640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3abc06b470 0x7f3abc06b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:18.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.694+0000 7f3ac271f640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3abc0a6c80 0x7f3abc151b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:18.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.694+0000 7f3ac271f640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3abc0be5e0 con 0x7f3abc0a6810 2024-04-24T23:38:18.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.694+0000 7f3ac271f640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f3abc0bdfe0 con 0x7f3abc0a6c80 2024-04-24T23:38:18.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.694+0000 7f3ac271f640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f3abc06bd90 con 0x7f3abc06b470 2024-04-24T23:38:18.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.694+0000 7f3abbfff640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3abc06b470 0x7f3abc06b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:18.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.694+0000 7f3abbfff640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3abc06b470 0x7f3abc06b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:42370/0 (socket says 172.21.15.88:42370) 2024-04-24T23:38:18.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.694+0000 7f3abbfff640 1 -- 172.21.15.88:0/1065046732 learned_addr learned my addr 172.21.15.88:0/1065046732 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T23:38:18.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.694+0000 7f3abb7fe640 1 --2- 172.21.15.88:0/1065046732 >> v2:172.21.15.57:3300/0 conn(0x7f3abc0a6c80 0x7f3abc151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:18.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.694+0000 7f3abbfff640 1 -- 172.21.15.88:0/1065046732 >> v2:172.21.15.57:3300/0 conn(0x7f3abc0a6c80 msgr2=0x7f3abc151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:18.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.694+0000 7f3abbfff640 1 --2- 172.21.15.88:0/1065046732 >> v2:172.21.15.57:3300/0 conn(0x7f3abc0a6c80 0x7f3abc151b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.694+0000 7f3abbfff640 1 -- 172.21.15.88:0/1065046732 >> v1:172.21.15.57:6789/0 conn(0x7f3abc0a6810 legacy=0x7f3abc14b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:18.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.694+0000 7f3abbfff640 1 -- 172.21.15.88:0/1065046732 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3abc0be230 con 0x7f3abc06b470 2024-04-24T23:38:18.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.694+0000 7f3abb7fe640 1 --2- 172.21.15.88:0/1065046732 >> v2:172.21.15.57:3300/0 conn(0x7f3abc0a6c80 0x7f3abc151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:38:18.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.694+0000 7f3abbfff640 1 --2- 172.21.15.88:0/1065046732 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3abc06b470 0x7f3abc06b850 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3aac009870 tx=0x7f3aac01c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46655a79b699a26d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:18.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.694+0000 7f3abaffd640 1 -- 172.21.15.88:0/1065046732 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aac0ab640 con 0x7f3abc06b470 2024-04-24T23:38:18.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.694+0000 7f3abaffd640 1 -- 172.21.15.88:0/1065046732 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aac0b0070 con 0x7f3abc06b470 2024-04-24T23:38:18.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.694+0000 7f3abaffd640 1 -- 172.21.15.88:0/1065046732 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aac0aba00 con 0x7f3abc06b470 2024-04-24T23:38:18.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3ac271f640 1 -- 172.21.15.88:0/1065046732 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3abc06b470 msgr2=0x7f3abc06b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:18.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3ac271f640 1 --2- 172.21.15.88:0/1065046732 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3abc06b470 0x7f3abc06b850 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3aac009870 tx=0x7f3aac01c460 comp rx=0 tx=0).stop 2024-04-24T23:38:18.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3ac271f640 1 -- 172.21.15.88:0/1065046732 shutdown_connections 2024-04-24T23:38:18.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3ac271f640 1 --2- 172.21.15.88:0/1065046732 >> v2:172.21.15.57:3300/0 conn(0x7f3abc0a6c80 0x7f3abc151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3ac271f640 1 --2- 172.21.15.88:0/1065046732 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3abc06b470 0x7f3abc06b850 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3ac271f640 1 -- 172.21.15.88:0/1065046732 >> 172.21.15.88:0/1065046732 conn(0x7f3abc0c30c0 msgr2=0x7f3abc0c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:18.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3ac271f640 1 -- 172.21.15.88:0/1065046732 shutdown_connections 2024-04-24T23:38:18.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3ac271f640 1 -- 172.21.15.88:0/1065046732 wait complete. 2024-04-24T23:38:18.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3ac271f640 1 Processor -- start 2024-04-24T23:38:18.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3ac271f640 1 -- start start 2024-04-24T23:38:18.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3ac271f640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3abc06b470 0x7f3abc1e78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:18.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3ac271f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3abc0a6810 0x7f3abc14c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:18.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3ac271f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3abc0a6c80 0x7f3abc14e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:18.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3ac271f640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3abc15ba90 con 0x7f3abc0a6c80 2024-04-24T23:38:18.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3ac271f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f3abc15b910 con 0x7f3abc0a6810 2024-04-24T23:38:18.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3ac271f640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f3abc15bc10 con 0x7f3abc06b470 2024-04-24T23:38:18.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3abb7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3abc0a6810 0x7f3abc14c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:18.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3abbfff640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3abc06b470 0x7f3abc1e78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:18.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3abb7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3abc0a6810 0x7f3abc14c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42606/0 (socket says 172.21.15.88:42606) 2024-04-24T23:38:18.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3abb7fe640 1 -- 172.21.15.88:0/2856200246 learned_addr learned my addr 172.21.15.88:0/2856200246 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T23:38:18.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3ac0cbc640 1 --2- 172.21.15.88:0/2856200246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3abc0a6c80 0x7f3abc14e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:18.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3abb7fe640 1 -- 172.21.15.88:0/2856200246 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3abc06b470 msgr2=0x7f3abc1e78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:18.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3abb7fe640 1 --2- 172.21.15.88:0/2856200246 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3abc06b470 0x7f3abc1e78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3abb7fe640 1 -- 172.21.15.88:0/2856200246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3abc0a6c80 msgr2=0x7f3abc14e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:18.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3abb7fe640 1 --2- 172.21.15.88:0/2856200246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3abc0a6c80 0x7f3abc14e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3abb7fe640 1 -- 172.21.15.88:0/2856200246 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3abc14cc30 con 0x7f3abc0a6810 2024-04-24T23:38:18.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3abbfff640 1 --2- 172.21.15.88:0/2856200246 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3abc06b470 0x7f3abc1e78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:38:18.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3abb7fe640 1 --2- 172.21.15.88:0/2856200246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3abc0a6810 0x7f3abc14c6f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3ab000c7f0 tx=0x7f3ab000ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:18.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3ab8ff9640 1 -- 172.21.15.88:0/2856200246 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab0015070 con 0x7f3abc0a6810 2024-04-24T23:38:18.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3ab8ff9640 1 -- 172.21.15.88:0/2856200246 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ab0007820 con 0x7f3abc0a6810 2024-04-24T23:38:18.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3ac271f640 1 -- 172.21.15.88:0/2856200246 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3abc151090 con 0x7f3abc0a6810 2024-04-24T23:38:18.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3ab8ff9640 1 -- 172.21.15.88:0/2856200246 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab0007c10 con 0x7f3abc0a6810 2024-04-24T23:38:18.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3ac271f640 1 -- 172.21.15.88:0/2856200246 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3abc151620 con 0x7f3abc0a6810 2024-04-24T23:38:18.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3ab8ff9640 1 -- 172.21.15.88:0/2856200246 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3ab0018070 con 0x7f3abc0a6810 2024-04-24T23:38:18.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.698+0000 7f3ab8ff9640 1 -- 172.21.15.88:0/2856200246 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f3ab0011ad0 con 0x7f3abc0a6810 2024-04-24T23:38:18.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.702+0000 7f3ac271f640 1 -- 172.21.15.88:0/2856200246 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3abc068930 con 0x7f3abc0a6810 2024-04-24T23:38:18.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.702+0000 7f3ab8ff9640 1 -- 172.21.15.88:0/2856200246 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f3abc14cc30 con 0x7f3abc0a6810 2024-04-24T23:38:18.708 INFO:tasks.ceph.mgr.x.smithi088.stderr:2024-04-24T23:38:18.706+0000 7ff7b7154180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-24T23:38:18.712 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-24T23:38:18.709+0000 7fe04def4180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-24T23:38:18.767 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-24T23:38:18.765+0000 7fe04def4180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-24T23:38:18.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.766+0000 7f3ac271f640 1 -- 172.21.15.88:0/2856200246 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ec7ae2b7-9cb4-4059-8f98-0022c9763f13", "id": 6} v 0) -- 0x7f3abc06dca0 con 0x7f3abc0a6810 2024-04-24T23:38:18.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.774+0000 7f3ab8ff9640 1 -- 172.21.15.88:0/2856200246 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ec7ae2b7-9cb4-4059-8f98-0022c9763f13", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f3ab0011da0 con 0x7f3abc0a6810 2024-04-24T23:38:18.774 INFO:teuthology.orchestra.run.smithi088.stdout:6 2024-04-24T23:38:18.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.774+0000 7f3ac271f640 1 -- 172.21.15.88:0/2856200246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3abc0a6810 msgr2=0x7f3abc14c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:18.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.774+0000 7f3ac271f640 1 --2- 172.21.15.88:0/2856200246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3abc0a6810 0x7f3abc14c6f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3ab000c7f0 tx=0x7f3ab000ccb0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.774+0000 7f3ac271f640 1 -- 172.21.15.88:0/2856200246 shutdown_connections 2024-04-24T23:38:18.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.774+0000 7f3ac271f640 1 --2- 172.21.15.88:0/2856200246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3abc0a6c80 0x7f3abc14e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.774+0000 7f3ac271f640 1 --2- 172.21.15.88:0/2856200246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3abc0a6810 0x7f3abc14c6f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.774+0000 7f3ac271f640 1 --2- 172.21.15.88:0/2856200246 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3abc06b470 0x7f3abc1e78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.774+0000 7f3ac271f640 1 -- 172.21.15.88:0/2856200246 >> 172.21.15.88:0/2856200246 conn(0x7f3abc0c30c0 msgr2=0x7f3abc149360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:18.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.774+0000 7f3ac271f640 1 -- 172.21.15.88:0/2856200246 shutdown_connections 2024-04-24T23:38:18.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.774+0000 7f3ac271f640 1 -- 172.21.15.88:0/2856200246 wait complete. 2024-04-24T23:38:18.791 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd new c0ee7505-60c1-40ba-9902-47313a04dafd 7 2024-04-24T23:38:18.849 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-24T23:38:18.849+0000 7fe04def4180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-24T23:38:18.865 INFO:tasks.ceph.mgr.x.smithi088.stderr:2024-04-24T23:38:18.862+0000 7ff7b7154180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-24T23:38:18.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.894+0000 7fd48fae7640 1 Processor -- start 2024-04-24T23:38:18.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.894+0000 7fd48fae7640 1 -- start start 2024-04-24T23:38:18.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.894+0000 7fd48fae7640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd4880723e0 0x7fd48814a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:18.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.894+0000 7fd48fae7640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd488070240 con 0x7fd4880a5d00 2024-04-24T23:38:18.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.894+0000 7fd48fae7640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4880bed70 con 0x7fd4880a7de0 2024-04-24T23:38:18.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.894+0000 7fd48fae7640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fd4880bf050 con 0x7fd4880723e0 2024-04-24T23:38:18.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.894+0000 7fd48d883640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd4880723e0 0x7fd48814a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:18.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.894+0000 7fd48e084640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd4880a7de0 0x7fd488151390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37392/0 (socket says 172.21.15.88:37392) 2024-04-24T23:38:18.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.894+0000 7fd48e084640 1 -- 172.21.15.88:0/1481437785 learned_addr learned my addr 172.21.15.88:0/1481437785 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-24T23:38:18.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.894+0000 7fd48d883640 1 -- 172.21.15.88:0/1481437785 >> v1:172.21.15.88:6789/0 conn(0x7fd4880a7de0 legacy=0x7fd488151390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:18.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.894+0000 7fd48c881640 1 -- 172.21.15.88:0/1481437785 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2208572851 0 0) 0x7fd4880bed70 con 0x7fd4880a7de0 2024-04-24T23:38:18.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.894+0000 7fd48d883640 1 -- 172.21.15.88:0/1481437785 >> v1:172.21.15.57:6789/0 conn(0x7fd4880a5d00 legacy=0x7fd488150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:18.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.894+0000 7fd48d883640 1 -- 172.21.15.88:0/1481437785 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4880bf330 con 0x7fd4880723e0 2024-04-24T23:38:18.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.898+0000 7fd48d883640 1 --2- 172.21.15.88:0/1481437785 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd4880723e0 0x7fd48814a830 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd4840097f0 tx=0x7fd48401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=354ae60d3b60225e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:18.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.898+0000 7fd48c881640 1 -- 172.21.15.88:0/1481437785 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4840b2070 con 0x7fd4880723e0 2024-04-24T23:38:18.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.898+0000 7fd48c881640 1 -- 172.21.15.88:0/1481437785 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4840a9070 con 0x7fd4880723e0 2024-04-24T23:38:18.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.898+0000 7fd48c881640 1 -- 172.21.15.88:0/1481437785 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4840ad880 con 0x7fd4880723e0 2024-04-24T23:38:18.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.898+0000 7fd48fae7640 1 -- 172.21.15.88:0/1481437785 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd4880723e0 msgr2=0x7fd48814a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:18.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.898+0000 7fd48fae7640 1 --2- 172.21.15.88:0/1481437785 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd4880723e0 0x7fd48814a830 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd4840097f0 tx=0x7fd48401c450 comp rx=0 tx=0).stop 2024-04-24T23:38:18.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.898+0000 7fd48fae7640 1 -- 172.21.15.88:0/1481437785 shutdown_connections 2024-04-24T23:38:18.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.898+0000 7fd48fae7640 1 --2- 172.21.15.88:0/1481437785 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd4880723e0 0x7fd48814a830 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.898+0000 7fd48fae7640 1 -- 172.21.15.88:0/1481437785 >> 172.21.15.88:0/1481437785 conn(0x7fd4880c30c0 msgr2=0x7fd4880c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:18.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.898+0000 7fd48fae7640 1 -- 172.21.15.88:0/1481437785 shutdown_connections 2024-04-24T23:38:18.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.898+0000 7fd48fae7640 1 -- 172.21.15.88:0/1481437785 wait complete. 2024-04-24T23:38:18.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.898+0000 7fd48fae7640 1 Processor -- start 2024-04-24T23:38:18.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.898+0000 7fd48fae7640 1 -- start start 2024-04-24T23:38:18.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.902+0000 7fd48fae7640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd4880723e0 0x7fd4881e9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:18.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.902+0000 7fd48fae7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4880a5d00 0x7fd48814fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:18.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.902+0000 7fd48fae7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4880a7de0 0x7fd4881ec6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:18.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.902+0000 7fd48fae7640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd48815b990 con 0x7fd4880a7de0 2024-04-24T23:38:18.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.902+0000 7fd48fae7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd48815b810 con 0x7fd4880a5d00 2024-04-24T23:38:18.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.902+0000 7fd48fae7640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fd48815bb10 con 0x7fd4880723e0 2024-04-24T23:38:18.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.902+0000 7fd48d883640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd4880723e0 0x7fd4881e9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:18.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.902+0000 7fd48d082640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4880a5d00 0x7fd48814fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:18.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.902+0000 7fd48d883640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd4880723e0 0x7fd4881e9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:42392/0 (socket says 172.21.15.88:42392) 2024-04-24T23:38:18.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.902+0000 7fd48d883640 1 -- 172.21.15.88:0/672569190 learned_addr learned my addr 172.21.15.88:0/672569190 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-24T23:38:18.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.902+0000 7fd48e084640 1 --2- 172.21.15.88:0/672569190 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4880a7de0 0x7fd4881ec6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:18.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.902+0000 7fd48d883640 1 -- 172.21.15.88:0/672569190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4880a5d00 msgr2=0x7fd48814fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:18.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.902+0000 7fd48d883640 1 --2- 172.21.15.88:0/672569190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4880a5d00 0x7fd48814fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.902+0000 7fd48d883640 1 -- 172.21.15.88:0/672569190 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4880a7de0 msgr2=0x7fd4881ec6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:18.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.902+0000 7fd48d883640 1 --2- 172.21.15.88:0/672569190 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4880a7de0 0x7fd4881ec6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.902+0000 7fd48d883640 1 -- 172.21.15.88:0/672569190 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4881502f0 con 0x7fd4880723e0 2024-04-24T23:38:18.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.902+0000 7fd48d082640 1 --2- 172.21.15.88:0/672569190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4880a5d00 0x7fd48814fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:38:18.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.902+0000 7fd48d883640 1 --2- 172.21.15.88:0/672569190 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd4880723e0 0x7fd4881e9d60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd4840097f0 tx=0x7fd48401ac90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:18.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.902+0000 7fd47e7fc640 1 -- 172.21.15.88:0/672569190 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4840b2050 con 0x7fd4880723e0 2024-04-24T23:38:18.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.902+0000 7fd47e7fc640 1 -- 172.21.15.88:0/672569190 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4840b3040 con 0x7fd4880723e0 2024-04-24T23:38:18.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.902+0000 7fd48fae7640 1 -- 172.21.15.88:0/672569190 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd48813bae0 con 0x7fd4880723e0 2024-04-24T23:38:18.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.902+0000 7fd47e7fc640 1 -- 172.21.15.88:0/672569190 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd484004240 con 0x7fd4880723e0 2024-04-24T23:38:18.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.902+0000 7fd48fae7640 1 -- 172.21.15.88:0/672569190 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4880c1dd0 con 0x7fd4880723e0 2024-04-24T23:38:18.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.902+0000 7fd47e7fc640 1 -- 172.21.15.88:0/672569190 <== mon.2 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd4840c0060 con 0x7fd4880723e0 2024-04-24T23:38:18.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.902+0000 7fd47e7fc640 1 -- 172.21.15.88:0/672569190 <== mon.2 v2:172.21.15.88:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fd4840b9ab0 con 0x7fd4880723e0 2024-04-24T23:38:18.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.902+0000 7fd48fae7640 1 -- 172.21.15.88:0/672569190 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd48813f4d0 con 0x7fd4880723e0 2024-04-24T23:38:18.905 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-24T23:38:18.901+0000 7fe04def4180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-24T23:38:18.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.902+0000 7fd47e7fc640 1 -- 172.21.15.88:0/672569190 <== mon.2 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fd4840160d0 con 0x7fd4880723e0 2024-04-24T23:38:18.930 INFO:tasks.ceph.mgr.x.smithi088.stderr:2024-04-24T23:38:18.930+0000 7ff7b7154180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-24T23:38:18.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.966+0000 7fd48fae7640 1 -- 172.21.15.88:0/672569190 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c0ee7505-60c1-40ba-9902-47313a04dafd", "id": 7} v 0) -- 0x7fd488068930 con 0x7fd4880723e0 2024-04-24T23:38:18.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.978+0000 7fd47e7fc640 1 -- 172.21.15.88:0/672569190 <== mon.2 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c0ee7505-60c1-40ba-9902-47313a04dafd", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fd484003e40 con 0x7fd4880723e0 2024-04-24T23:38:18.979 INFO:teuthology.orchestra.run.smithi088.stdout:7 2024-04-24T23:38:18.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.978+0000 7fd48fae7640 1 -- 172.21.15.88:0/672569190 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd4880723e0 msgr2=0x7fd4881e9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:18.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.978+0000 7fd48fae7640 1 --2- 172.21.15.88:0/672569190 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd4880723e0 0x7fd4881e9d60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd4840097f0 tx=0x7fd48401ac90 comp rx=0 tx=0).stop 2024-04-24T23:38:18.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.978+0000 7fd48fae7640 1 -- 172.21.15.88:0/672569190 shutdown_connections 2024-04-24T23:38:18.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.978+0000 7fd48fae7640 1 --2- 172.21.15.88:0/672569190 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4880a7de0 0x7fd4881ec6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.978+0000 7fd48fae7640 1 --2- 172.21.15.88:0/672569190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4880a5d00 0x7fd48814fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.978+0000 7fd48fae7640 1 --2- 172.21.15.88:0/672569190 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd4880723e0 0x7fd4881e9d60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:18.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.978+0000 7fd48fae7640 1 -- 172.21.15.88:0/672569190 >> 172.21.15.88:0/672569190 conn(0x7fd4880c30c0 msgr2=0x7fd488149a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:18.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.978+0000 7fd48fae7640 1 -- 172.21.15.88:0/672569190 shutdown_connections 2024-04-24T23:38:18.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-24T23:38:18.978+0000 7fd48fae7640 1 -- 172.21.15.88:0/672569190 wait complete. 2024-04-24T23:38:18.984 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-24T23:38:18.981+0000 7fe04def4180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-24T23:38:18.994 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-24T23:38:18.995 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-24T23:38:18.997 INFO:tasks.ceph.osd.0:Started 2024-04-24T23:38:18.997 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-24T23:38:18.998 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-24T23:38:19.000 INFO:tasks.ceph.osd.1:Started 2024-04-24T23:38:19.000 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-24T23:38:19.000 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-24T23:38:19.003 INFO:tasks.ceph.osd.2:Started 2024-04-24T23:38:19.003 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-24T23:38:19.003 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-24T23:38:19.005 INFO:tasks.ceph.osd.3:Started 2024-04-24T23:38:19.005 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-24T23:38:19.005 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-24T23:38:19.008 INFO:tasks.ceph.osd.4:Started 2024-04-24T23:38:19.008 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-24T23:38:19.008 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-24T23:38:19.010 INFO:tasks.ceph.osd.5:Started 2024-04-24T23:38:19.010 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-24T23:38:19.010 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-24T23:38:19.012 INFO:tasks.ceph.osd.6:Started 2024-04-24T23:38:19.013 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-24T23:38:19.013 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-24T23:38:19.015 INFO:tasks.ceph.osd.7:Started 2024-04-24T23:38:19.015 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:38:19.047 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-24T23:38:19.045+0000 7fe04def4180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-24T23:38:19.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.137+0000 7f8076654640 1 Processor -- start 2024-04-24T23:38:19.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.137+0000 7f8076654640 1 -- start start 2024-04-24T23:38:19.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.137+0000 7f8076654640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f80700c32d0 0x7f807014d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:19.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.137+0000 7f8076654640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f807014dea0 0x7f8070151300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:19.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.137+0000 7f8076654640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80700bd6c0 con 0x7f80700c1080 2024-04-24T23:38:19.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.137+0000 7f8076654640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f80700bf4a0 con 0x7f807014dea0 2024-04-24T23:38:19.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.137+0000 7f8076654640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f80700bd470 con 0x7f80700c32d0 2024-04-24T23:38:19.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.137+0000 7f8074bf1640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f807014dea0 0x7f8070151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:19.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.137+0000 7f8067fff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f80700c1080 0x7f8070150bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:47900/0 (socket says 172.21.15.57:47900) 2024-04-24T23:38:19.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.137+0000 7f8067fff640 1 -- 172.21.15.57:0/2773686477 learned_addr learned my addr 172.21.15.57:0/2773686477 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:38:19.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.137+0000 7f806ffff640 1 --2- 172.21.15.57:0/2773686477 >> v2:172.21.15.88:3300/0 conn(0x7f80700c32d0 0x7f807014d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:19.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.137+0000 7f8074bf1640 1 -- 172.21.15.57:0/2773686477 >> v2:172.21.15.88:3300/0 conn(0x7f80700c32d0 msgr2=0x7f807014d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:19.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.137+0000 7f8074bf1640 1 --2- 172.21.15.57:0/2773686477 >> v2:172.21.15.88:3300/0 conn(0x7f80700c32d0 0x7f807014d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:19.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.137+0000 7f8074bf1640 1 -- 172.21.15.57:0/2773686477 >> v1:172.21.15.57:6789/0 conn(0x7f80700c1080 legacy=0x7f8070150bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:19.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.137+0000 7f8074bf1640 1 -- 172.21.15.57:0/2773686477 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80700bd9a0 con 0x7f807014dea0 2024-04-24T23:38:19.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.137+0000 7f806f7fe640 1 -- 172.21.15.57:0/2773686477 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2690924141 0 0) 0x7f80700bd6c0 con 0x7f80700c1080 2024-04-24T23:38:19.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.141+0000 7f8074bf1640 1 --2- 172.21.15.57:0/2773686477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f807014dea0 0x7f8070151300 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f807008c660 tx=0x7f806801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50826541ff85718 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:19.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.141+0000 7f806f7fe640 1 -- 172.21.15.57:0/2773686477 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80680b2070 con 0x7f807014dea0 2024-04-24T23:38:19.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.141+0000 7f806f7fe640 1 -- 172.21.15.57:0/2773686477 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80680a57f0 con 0x7f807014dea0 2024-04-24T23:38:19.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.141+0000 7f806f7fe640 1 -- 172.21.15.57:0/2773686477 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80680a5bc0 con 0x7f807014dea0 2024-04-24T23:38:19.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.141+0000 7f8076654640 1 -- 172.21.15.57:0/2773686477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f807014dea0 msgr2=0x7f8070151300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:19.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.141+0000 7f8076654640 1 --2- 172.21.15.57:0/2773686477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f807014dea0 0x7f8070151300 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f807008c660 tx=0x7f806801c930 comp rx=0 tx=0).stop 2024-04-24T23:38:19.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.141+0000 7f8076654640 1 -- 172.21.15.57:0/2773686477 shutdown_connections 2024-04-24T23:38:19.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.141+0000 7f8076654640 1 --2- 172.21.15.57:0/2773686477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f807014dea0 0x7f8070151300 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:19.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.141+0000 7f8076654640 1 --2- 172.21.15.57:0/2773686477 >> v2:172.21.15.88:3300/0 conn(0x7f80700c32d0 0x7f807014d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:19.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.141+0000 7f8076654640 1 -- 172.21.15.57:0/2773686477 >> 172.21.15.57:0/2773686477 conn(0x7f8070067350 msgr2=0x7f8070067760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:19.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.141+0000 7f8076654640 1 -- 172.21.15.57:0/2773686477 shutdown_connections 2024-04-24T23:38:19.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.141+0000 7f8076654640 1 -- 172.21.15.57:0/2773686477 wait complete. 2024-04-24T23:38:19.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.141+0000 7f8076654640 1 Processor -- start 2024-04-24T23:38:19.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.141+0000 7f8076654640 1 -- start start 2024-04-24T23:38:19.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.141+0000 7f8076654640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80700c1080 0x7f80701e8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:19.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.141+0000 7f8076654640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f80700c32d0 0x7f8070143820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:19.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.141+0000 7f8076654640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f807014dea0 0x7f807013cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:19.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.141+0000 7f8076654640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f80700c1760 con 0x7f807014dea0 2024-04-24T23:38:19.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.141+0000 7f8076654640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f80700c15e0 con 0x7f80700c1080 2024-04-24T23:38:19.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.141+0000 7f8076654640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f807015d940 con 0x7f80700c32d0 2024-04-24T23:38:19.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.145+0000 7f8074bf1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f807014dea0 0x7f807013cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:19.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.145+0000 7f8074bf1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f807014dea0 0x7f807013cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60574/0 (socket says 172.21.15.57:60574) 2024-04-24T23:38:19.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.145+0000 7f8074bf1640 1 -- 172.21.15.57:0/3934951034 learned_addr learned my addr 172.21.15.57:0/3934951034 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:19.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.145+0000 7f806ffff640 1 --2- 172.21.15.57:0/3934951034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80700c1080 0x7f80701e8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:19.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.145+0000 7f8067fff640 1 --2- 172.21.15.57:0/3934951034 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f80700c32d0 0x7f8070143820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:19.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.145+0000 7f8074bf1640 1 -- 172.21.15.57:0/3934951034 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f80700c32d0 msgr2=0x7f8070143820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:19.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.145+0000 7f8074bf1640 1 --2- 172.21.15.57:0/3934951034 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f80700c32d0 0x7f8070143820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:19.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.145+0000 7f8074bf1640 1 -- 172.21.15.57:0/3934951034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80700c1080 msgr2=0x7f80701e8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:19.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.145+0000 7f8074bf1640 1 --2- 172.21.15.57:0/3934951034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80700c1080 0x7f80701e8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:19.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.145+0000 7f8074bf1640 1 -- 172.21.15.57:0/3934951034 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80701e8fb0 con 0x7f807014dea0 2024-04-24T23:38:19.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.145+0000 7f8074bf1640 1 --2- 172.21.15.57:0/3934951034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f807014dea0 0x7f807013cb10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f80680b0040 tx=0x7f80680196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:19.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.145+0000 7f806d7fa640 1 -- 172.21.15.57:0/3934951034 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80680b2050 con 0x7f807014dea0 2024-04-24T23:38:19.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.145+0000 7f806d7fa640 1 -- 172.21.15.57:0/3934951034 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80680be070 con 0x7f807014dea0 2024-04-24T23:38:19.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.145+0000 7f806d7fa640 1 -- 172.21.15.57:0/3934951034 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80680ad870 con 0x7f807014dea0 2024-04-24T23:38:19.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.145+0000 7f8076654640 1 -- 172.21.15.57:0/3934951034 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f807014f8b0 con 0x7f807014dea0 2024-04-24T23:38:19.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.145+0000 7f8076654640 1 -- 172.21.15.57:0/3934951034 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f807013c5f0 con 0x7f807014dea0 2024-04-24T23:38:19.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.145+0000 7f806d7fa640 1 -- 172.21.15.57:0/3934951034 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f80680ada10 con 0x7f807014dea0 2024-04-24T23:38:19.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.145+0000 7f806d7fa640 1 -- 172.21.15.57:0/3934951034 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f80680c3b90 con 0x7f807014dea0 2024-04-24T23:38:19.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.145+0000 7f8076654640 1 -- 172.21.15.57:0/3934951034 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8070068220 con 0x7f807014dea0 2024-04-24T23:38:19.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.145+0000 7f806d7fa640 1 -- 172.21.15.57:0/3934951034 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f8068016520 con 0x7f807014dea0 2024-04-24T23:38:19.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.205+0000 7f8076654640 1 -- 172.21.15.57:0/3934951034 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8070143d60 con 0x7f807014dea0 2024-04-24T23:38:19.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.205+0000 7f806d7fa640 1 -- 172.21.15.57:0/3934951034 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f80680addf0 con 0x7f807014dea0 2024-04-24T23:38:19.208 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:38:19.208 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":10,"fsid":"1ea31698-444a-4667-bcd9-b2608ad103c3","created":"2024-04-24T23:38:16.748774+0000","modified":"2024-04-24T23:38:18.972175+0000","last_up_change":"0.000000","last_in_change":"2024-04-24T23:38:18.972175+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"35ce67bc-9b25-416e-ab1e-774c717631f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"38f6f4ef-3bc2-4453-9946-7d1d17e735ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d77a0a49-b39a-464e-a1c9-49e19280c440","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f8ea9bfe-d839-44a6-a185-0f0985da314c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"454647d4-6ac2-46b4-8451-320eb951a87e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f71c03a3-7ad8-46d3-89c9-d61de102586b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ec7ae2b7-9cb4-4059-8f98-0022c9763f13","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c0ee7505-60c1-40ba-9902-47313a04dafd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:38:19.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.209+0000 7f8076654640 1 -- 172.21.15.57:0/3934951034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f807014dea0 msgr2=0x7f807013cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:19.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.209+0000 7f8076654640 1 --2- 172.21.15.57:0/3934951034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f807014dea0 0x7f807013cb10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f80680b0040 tx=0x7f80680196d0 comp rx=0 tx=0).stop 2024-04-24T23:38:19.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.209+0000 7f8076654640 1 -- 172.21.15.57:0/3934951034 shutdown_connections 2024-04-24T23:38:19.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.209+0000 7f8076654640 1 --2- 172.21.15.57:0/3934951034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f807014dea0 0x7f807013cb10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:19.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.209+0000 7f8076654640 1 --2- 172.21.15.57:0/3934951034 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f80700c32d0 0x7f8070143820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:19.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.209+0000 7f8076654640 1 --2- 172.21.15.57:0/3934951034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80700c1080 0x7f80701e8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:19.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.209+0000 7f8076654640 1 -- 172.21.15.57:0/3934951034 >> 172.21.15.57:0/3934951034 conn(0x7f8070067350 msgr2=0x7f807014b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:19.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.209+0000 7f8076654640 1 -- 172.21.15.57:0/3934951034 shutdown_connections 2024-04-24T23:38:19.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:19.209+0000 7f8076654640 1 -- 172.21.15.57:0/3934951034 wait complete. 2024-04-24T23:38:19.225 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-24T23:38:19.225 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-24T23:38:19.227 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-24T23:38:19.225+0000 7fe04def4180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-24T23:38:19.292 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-24T23:38:19.289+0000 7fe04def4180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-24T23:38:19.386 INFO:tasks.ceph.osd.4.smithi088.stderr:2024-04-24T23:38:19.386+0000 7f3a6043c7c0 -1 Falling back to public interface 2024-04-24T23:38:19.617 INFO:tasks.ceph.mgr.x.smithi088.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-24T23:38:19.617 INFO:tasks.ceph.mgr.x.smithi088.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-24T23:38:19.617 INFO:tasks.ceph.mgr.x.smithi088.stderr: from numpy import show_config as show_numpy_config 2024-04-24T23:38:19.637 INFO:tasks.ceph.osd.5.smithi088.stderr:2024-04-24T23:38:19.634+0000 7f6c30d047c0 -1 Falling back to public interface 2024-04-24T23:38:19.638 INFO:tasks.ceph.osd.7.smithi088.stderr:2024-04-24T23:38:19.634+0000 7f28639857c0 -1 Falling back to public interface 2024-04-24T23:38:19.654 INFO:tasks.ceph.osd.6.smithi088.stderr:2024-04-24T23:38:19.654+0000 7fd46f4e07c0 -1 Falling back to public interface 2024-04-24T23:38:19.666 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-04-24T23:38:19.665+0000 7f8afce077c0 -1 Falling back to public interface 2024-04-24T23:38:19.681 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-04-24T23:38:19.681+0000 7f285cb407c0 -1 Falling back to public interface 2024-04-24T23:38:19.683 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-04-24T23:38:19.681+0000 7f831322d7c0 -1 Falling back to public interface 2024-04-24T23:38:19.687 INFO:tasks.ceph.mgr.x.smithi088.stderr:2024-04-24T23:38:19.686+0000 7ff7b7154180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-24T23:38:19.693 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-24T23:38:19.693+0000 7f19c8a6f7c0 -1 Falling back to public interface 2024-04-24T23:38:19.842 INFO:tasks.ceph.mgr.x.smithi088.stderr:2024-04-24T23:38:19.838+0000 7ff7b7154180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-24T23:38:20.007 INFO:tasks.ceph.mgr.x.smithi088.stderr:2024-04-24T23:38:20.006+0000 7ff7b7154180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-24T23:38:20.030 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-24T23:38:20.071 INFO:tasks.ceph.mgr.x.smithi088.stderr:2024-04-24T23:38:20.070+0000 7ff7b7154180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-24T23:38:20.083 INFO:tasks.ceph.mgr.y.smithi057.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-24T23:38:20.084 INFO:tasks.ceph.mgr.y.smithi057.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-24T23:38:20.084 INFO:tasks.ceph.mgr.y.smithi057.stderr: from numpy import show_config as show_numpy_config 2024-04-24T23:38:20.118 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-24T23:38:20.117+0000 7fe04def4180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-24T23:38:20.152 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.149+0000 7f5f26264640 1 Processor -- start 2024-04-24T23:38:20.152 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.149+0000 7f5f26264640 1 -- start start 2024-04-24T23:38:20.154 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.153+0000 7f5f26264640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5f200a2da0 0x7f5f2006ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:20.154 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.153+0000 7f5f26264640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5f20071000 0x7f5f20071430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:20.154 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.153+0000 7f5f26264640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f200bf2a0 con 0x7f5f20151650 2024-04-24T23:38:20.154 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.153+0000 7f5f26264640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f5f200c37b0 con 0x7f5f200a2da0 2024-04-24T23:38:20.154 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.153+0000 7f5f26264640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f5f200c3a90 con 0x7f5f20071000 2024-04-24T23:38:20.154 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.153+0000 7f5f1f7fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5f200a2da0 0x7f5f2006ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:20.154 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.153+0000 7f5f1f7fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5f200a2da0 0x7f5f2006ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60582/0 (socket says 172.21.15.57:60582) 2024-04-24T23:38:20.154 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.153+0000 7f5f1f7fe640 1 -- 172.21.15.57:0/3840478841 learned_addr learned my addr 172.21.15.57:0/3840478841 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:20.154 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.153+0000 7f5f24801640 1 --2- 172.21.15.57:0/3840478841 >> v2:172.21.15.88:3300/0 conn(0x7f5f20071000 0x7f5f20071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:20.154 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.153+0000 7f5f1f7fe640 1 -- 172.21.15.57:0/3840478841 >> v2:172.21.15.88:3300/0 conn(0x7f5f20071000 msgr2=0x7f5f20071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:20.154 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.153+0000 7f5f1f7fe640 1 --2- 172.21.15.57:0/3840478841 >> v2:172.21.15.88:3300/0 conn(0x7f5f20071000 0x7f5f20071430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:20.155 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.153+0000 7f5f1f7fe640 1 -- 172.21.15.57:0/3840478841 >> v1:172.21.15.88:6789/0 conn(0x7f5f20151650 legacy=0x7f5f200beb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:20.155 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.153+0000 7f5f1f7fe640 1 -- 172.21.15.57:0/3840478841 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f200bf780 con 0x7f5f200a2da0 2024-04-24T23:38:20.155 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.153+0000 7f5f24801640 1 --2- 172.21.15.57:0/3840478841 >> v2:172.21.15.88:3300/0 conn(0x7f5f20071000 0x7f5f20071430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:38:20.156 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.153+0000 7f5f1f7fe640 1 --2- 172.21.15.57:0/3840478841 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f200a2da0 0x7f5f2006ff20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5f200c3e60 tx=0x7f5f1001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd8253b6f8af743 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:20.156 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.153+0000 7f5f1effd640 1 -- 172.21.15.57:0/3840478841 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f100b5070 con 0x7f5f200a2da0 2024-04-24T23:38:20.156 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.153+0000 7f5f1effd640 1 -- 172.21.15.57:0/3840478841 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f100a8a10 con 0x7f5f200a2da0 2024-04-24T23:38:20.156 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.153+0000 7f5f1effd640 1 -- 172.21.15.57:0/3840478841 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f100a8de0 con 0x7f5f200a2da0 2024-04-24T23:38:20.157 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f26264640 1 -- 172.21.15.57:0/3840478841 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f200a2da0 msgr2=0x7f5f2006ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:20.157 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f26264640 1 --2- 172.21.15.57:0/3840478841 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f200a2da0 0x7f5f2006ff20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5f200c3e60 tx=0x7f5f1001ed10 comp rx=0 tx=0).stop 2024-04-24T23:38:20.157 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f26264640 1 -- 172.21.15.57:0/3840478841 shutdown_connections 2024-04-24T23:38:20.157 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f26264640 1 --2- 172.21.15.57:0/3840478841 >> v2:172.21.15.88:3300/0 conn(0x7f5f20071000 0x7f5f20071430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:20.157 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f26264640 1 --2- 172.21.15.57:0/3840478841 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f200a2da0 0x7f5f2006ff20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:20.157 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f26264640 1 -- 172.21.15.57:0/3840478841 >> 172.21.15.57:0/3840478841 conn(0x7f5f200a5c60 msgr2=0x7f5f200a6070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:20.157 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f26264640 1 -- 172.21.15.57:0/3840478841 shutdown_connections 2024-04-24T23:38:20.158 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f26264640 1 -- 172.21.15.57:0/3840478841 wait complete. 2024-04-24T23:38:20.160 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f26264640 1 Processor -- start 2024-04-24T23:38:20.160 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f26264640 1 -- start start 2024-04-24T23:38:20.160 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f26264640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f20071000 0x7f5f2014a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:20.160 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f26264640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5f200a2da0 0x7f5f200a4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:20.160 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f26264640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f20151650 0x7f5f201e97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:20.160 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f26264640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5f200be410 con 0x7f5f20151650 2024-04-24T23:38:20.160 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f26264640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5f20151a30 con 0x7f5f20071000 2024-04-24T23:38:20.160 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f26264640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f5f200be590 con 0x7f5f200a2da0 2024-04-24T23:38:20.160 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f24801640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f20151650 0x7f5f201e97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:20.160 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f24801640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f20151650 0x7f5f201e97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60588/0 (socket says 172.21.15.57:60588) 2024-04-24T23:38:20.161 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f24801640 1 -- 172.21.15.57:0/3152400624 learned_addr learned my addr 172.21.15.57:0/3152400624 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:20.161 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f1ffff640 1 --2- 172.21.15.57:0/3152400624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f20071000 0x7f5f2014a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:20.161 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f1f7fe640 1 --2- 172.21.15.57:0/3152400624 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5f200a2da0 0x7f5f200a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:20.161 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f24801640 1 -- 172.21.15.57:0/3152400624 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5f200a2da0 msgr2=0x7f5f200a4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:20.161 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f24801640 1 --2- 172.21.15.57:0/3152400624 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5f200a2da0 0x7f5f200a4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:20.161 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f24801640 1 -- 172.21.15.57:0/3152400624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f20071000 msgr2=0x7f5f2014a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:20.161 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f24801640 1 --2- 172.21.15.57:0/3152400624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f20071000 0x7f5f2014a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:20.161 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f24801640 1 -- 172.21.15.57:0/3152400624 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f2014a630 con 0x7f5f20151650 2024-04-24T23:38:20.161 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f24801640 1 --2- 172.21.15.57:0/3152400624 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f20151650 0x7f5f201e97d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5f18007ef0 tx=0x7f5f1800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:20.161 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f1cff9640 1 -- 172.21.15.57:0/3152400624 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1801a070 con 0x7f5f20151650 2024-04-24T23:38:20.161 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f1cff9640 1 -- 172.21.15.57:0/3152400624 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f18003ba0 con 0x7f5f20151650 2024-04-24T23:38:20.161 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f26264640 1 -- 172.21.15.57:0/3152400624 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f20149e50 con 0x7f5f20151650 2024-04-24T23:38:20.161 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f1cff9640 1 -- 172.21.15.57:0/3152400624 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f18004030 con 0x7f5f20151650 2024-04-24T23:38:20.162 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f26264640 1 -- 172.21.15.57:0/3152400624 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f20153110 con 0x7f5f20151650 2024-04-24T23:38:20.162 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f1cff9640 1 -- 172.21.15.57:0/3152400624 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5f1801d070 con 0x7f5f20151650 2024-04-24T23:38:20.162 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.157+0000 7f5f1cff9640 1 -- 172.21.15.57:0/3152400624 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f5f18004720 con 0x7f5f20151650 2024-04-24T23:38:20.162 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.161+0000 7f5f26264640 1 -- 172.21.15.57:0/3152400624 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f20075380 con 0x7f5f20151650 2024-04-24T23:38:20.162 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.161+0000 7f5f1cff9640 1 -- 172.21.15.57:0/3152400624 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f5f2014a630 con 0x7f5f20151650 2024-04-24T23:38:20.205 INFO:tasks.ceph.mgr.x.smithi088.stderr:2024-04-24T23:38:20.202+0000 7ff7b7154180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-24T23:38:20.221 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.221+0000 7f5f26264640 1 -- 172.21.15.57:0/3152400624 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5f200bdea0 con 0x7f5f20151650 2024-04-24T23:38:20.221 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.221+0000 7f5f1cff9640 1 -- 172.21.15.57:0/3152400624 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f5f18010070 con 0x7f5f20151650 2024-04-24T23:38:20.222 INFO:teuthology.misc.health.smithi057.stdout: 2024-04-24T23:38:20.222 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":10,"fsid":"1ea31698-444a-4667-bcd9-b2608ad103c3","created":"2024-04-24T23:38:16.748774+0000","modified":"2024-04-24T23:38:18.972175+0000","last_up_change":"0.000000","last_in_change":"2024-04-24T23:38:18.972175+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"35ce67bc-9b25-416e-ab1e-774c717631f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"38f6f4ef-3bc2-4453-9946-7d1d17e735ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d77a0a49-b39a-464e-a1c9-49e19280c440","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f8ea9bfe-d839-44a6-a185-0f0985da314c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"454647d4-6ac2-46b4-8451-320eb951a87e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f71c03a3-7ad8-46d3-89c9-d61de102586b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ec7ae2b7-9cb4-4059-8f98-0022c9763f13","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c0ee7505-60c1-40ba-9902-47313a04dafd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:38:20.223 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.221+0000 7f5f26264640 1 -- 172.21.15.57:0/3152400624 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f20151650 msgr2=0x7f5f201e97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:20.223 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.221+0000 7f5f26264640 1 --2- 172.21.15.57:0/3152400624 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f20151650 0x7f5f201e97d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5f18007ef0 tx=0x7f5f1800d4a0 comp rx=0 tx=0).stop 2024-04-24T23:38:20.223 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.221+0000 7f5f26264640 1 -- 172.21.15.57:0/3152400624 shutdown_connections 2024-04-24T23:38:20.223 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.221+0000 7f5f26264640 1 --2- 172.21.15.57:0/3152400624 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f20151650 0x7f5f201e97d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:20.223 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.221+0000 7f5f26264640 1 --2- 172.21.15.57:0/3152400624 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5f200a2da0 0x7f5f200a4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:20.223 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.221+0000 7f5f26264640 1 --2- 172.21.15.57:0/3152400624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f20071000 0x7f5f2014a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:20.223 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.221+0000 7f5f26264640 1 -- 172.21.15.57:0/3152400624 >> 172.21.15.57:0/3152400624 conn(0x7f5f200a5c60 msgr2=0x7f5f200745a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:20.224 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.221+0000 7f5f26264640 1 -- 172.21.15.57:0/3152400624 shutdown_connections 2024-04-24T23:38:20.224 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:20.221+0000 7f5f26264640 1 -- 172.21.15.57:0/3152400624 wait complete. 2024-04-24T23:38:20.241 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-24T23:38:20.272 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-24T23:38:20.269+0000 7fe04def4180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-24T23:38:20.432 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-24T23:38:20.429+0000 7fe04def4180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-24T23:38:20.507 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-24T23:38:20.505+0000 7fe04def4180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-24T23:38:20.648 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-24T23:38:20.645+0000 7fe04def4180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-24T23:38:20.818 INFO:tasks.ceph.mgr.x.smithi088.stderr:2024-04-24T23:38:20.818+0000 7ff7b7154180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-24T23:38:20.894 INFO:tasks.ceph.mgr.x.smithi088.stderr:2024-04-24T23:38:20.894+0000 7ff7b7154180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-24T23:38:21.075 INFO:tasks.ceph.mgr.x.smithi088.stderr:2024-04-24T23:38:21.074+0000 7ff7b7154180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-24T23:38:21.149 INFO:tasks.ceph.mgr.x.smithi088.stderr:2024-04-24T23:38:21.146+0000 7ff7b7154180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-24T23:38:21.284 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-24T23:38:21.281+0000 7fe04def4180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-24T23:38:21.363 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-24T23:38:21.361+0000 7fe04def4180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-24T23:38:21.439 INFO:tasks.ceph.mgr.x.smithi088.stderr:2024-04-24T23:38:21.438+0000 7ff7b7154180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-24T23:38:21.501 INFO:tasks.ceph.mgr.x.smithi088.stderr:2024-04-24T23:38:21.498+0000 7ff7b7154180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-24T23:38:21.553 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-24T23:38:21.553+0000 7fe04def4180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-24T23:38:21.632 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-24T23:38:21.629+0000 7fe04def4180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-24T23:38:21.938 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-24T23:38:21.937+0000 7fe04def4180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-24T23:38:22.003 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-24T23:38:22.001+0000 7fe04def4180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-24T23:38:22.542 INFO:tasks.ceph.mgr.x.smithi088.stderr:2024-04-24T23:38:22.542+0000 7ff75e5a1640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-24T23:38:22.543 INFO:tasks.ceph.mgr.x.smithi088.stderr:2024-04-24T23:38:22.542+0000 7ff75e5a1640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-24T23:38:23.056 INFO:tasks.ceph.osd.4.smithi088.stderr:2024-04-24T23:38:23.054+0000 7f3a6043c7c0 -1 osd.4 0 log_to_monitors true 2024-04-24T23:38:23.317 INFO:tasks.ceph.osd.6.smithi088.stderr:2024-04-24T23:38:23.314+0000 7fd46f4e07c0 -1 osd.6 0 log_to_monitors true 2024-04-24T23:38:23.431 INFO:tasks.ceph.osd.7.smithi088.stderr:2024-04-24T23:38:23.430+0000 7f28639857c0 -1 osd.7 0 log_to_monitors true 2024-04-24T23:38:23.519 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-04-24T23:38:23.517+0000 7f285cb407c0 -1 osd.3 0 log_to_monitors true 2024-04-24T23:38:23.525 INFO:tasks.ceph.osd.5.smithi088.stderr:2024-04-24T23:38:23.526+0000 7f6c30d047c0 -1 osd.5 0 log_to_monitors true 2024-04-24T23:38:23.632 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-04-24T23:38:23.629+0000 7f8afce077c0 -1 osd.1 0 log_to_monitors true 2024-04-24T23:38:23.652 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-24T23:38:23.649+0000 7f19c8a6f7c0 -1 osd.0 0 log_to_monitors true 2024-04-24T23:38:23.659 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-04-24T23:38:23.657+0000 7f831322d7c0 -1 osd.2 0 log_to_monitors true 2024-04-24T23:38:25.930 INFO:tasks.ceph.osd.7.smithi088.stderr:2024-04-24T23:38:25.930+0000 7f285f92e640 -1 osd.7 0 waiting for initial osdmap 2024-04-24T23:38:25.951 INFO:tasks.ceph.osd.6.smithi088.stderr:2024-04-24T23:38:25.950+0000 7fd46b489640 -1 osd.6 0 waiting for initial osdmap 2024-04-24T23:38:25.954 INFO:tasks.ceph.osd.7.smithi088.stderr:2024-04-24T23:38:25.954+0000 7f2857763640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T23:38:25.959 INFO:tasks.ceph.osd.5.smithi088.stderr:2024-04-24T23:38:25.958+0000 7f6c2ccad640 -1 osd.5 0 waiting for initial osdmap 2024-04-24T23:38:25.974 INFO:tasks.ceph.osd.6.smithi088.stderr:2024-04-24T23:38:25.974+0000 7fd4632be640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T23:38:25.985 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-04-24T23:38:25.985+0000 7f8af8db0640 -1 osd.1 0 waiting for initial osdmap 2024-04-24T23:38:25.987 INFO:tasks.ceph.osd.4.smithi088.stderr:2024-04-24T23:38:25.986+0000 7f3a5c3e5640 -1 osd.4 0 waiting for initial osdmap 2024-04-24T23:38:25.993 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-24T23:38:25.993+0000 7f19c4a18640 -1 osd.0 0 waiting for initial osdmap 2024-04-24T23:38:25.994 INFO:tasks.ceph.osd.5.smithi088.stderr:2024-04-24T23:38:25.994+0000 7f6c24ae2640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T23:38:26.006 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-04-24T23:38:26.005+0000 7f830f1d6640 -1 osd.2 0 waiting for initial osdmap 2024-04-24T23:38:26.013 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-04-24T23:38:26.013+0000 7f8af0be5640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T23:38:26.018 INFO:tasks.ceph.osd.4.smithi088.stderr:2024-04-24T23:38:26.018+0000 7f3a5421a640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T23:38:26.025 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-24T23:38:26.025+0000 7f19bc84d640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T23:38:26.026 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-04-24T23:38:26.025+0000 7f2858ae9640 -1 osd.3 0 waiting for initial osdmap 2024-04-24T23:38:26.033 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-04-24T23:38:26.033+0000 7f830700b640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T23:38:26.049 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-04-24T23:38:26.049+0000 7f285091e640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T23:38:27.050 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-24T23:38:27.176 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.173+0000 7f3838758640 1 Processor -- start 2024-04-24T23:38:27.176 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.173+0000 7f3838758640 1 -- start start 2024-04-24T23:38:27.177 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.177+0000 7f3838758640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f383014bbc0 0x7f38300a7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:27.177 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.177+0000 7f3838758640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f383006f430 0x7f383014ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:27.178 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.177+0000 7f3838758640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f38300bc810 0x7f38300b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:27.178 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.177+0000 7f3838758640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f383014e9b0 con 0x7f38300bc810 2024-04-24T23:38:27.178 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.177+0000 7f3838758640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f383014f380 con 0x7f383014bbc0 2024-04-24T23:38:27.178 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.177+0000 7f3838758640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f383006e3c0 con 0x7f383006f430 2024-04-24T23:38:27.178 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.177+0000 7f3836cf5640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f38300bc810 0x7f38300b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:27.178 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.177+0000 7f3836cf5640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f38300bc810 0x7f38300b71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60628/0 (socket says 172.21.15.57:60628) 2024-04-24T23:38:27.178 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.177+0000 7f3836cf5640 1 -- 172.21.15.57:0/3319013743 learned_addr learned my addr 172.21.15.57:0/3319013743 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:27.178 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.177+0000 7f3835cf3640 1 --2- 172.21.15.57:0/3319013743 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f383006f430 0x7f383014ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:27.178 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.177+0000 7f38364f4640 1 --2- 172.21.15.57:0/3319013743 >> v2:172.21.15.88:3300/0 conn(0x7f383014bbc0 0x7f38300a7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:27.178 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.177+0000 7f3836cf5640 1 -- 172.21.15.57:0/3319013743 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f383006f430 msgr2=0x7f383014ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:27.178 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.177+0000 7f3836cf5640 1 --2- 172.21.15.57:0/3319013743 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f383006f430 0x7f383014ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:27.178 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.177+0000 7f3836cf5640 1 -- 172.21.15.57:0/3319013743 >> v2:172.21.15.88:3300/0 conn(0x7f383014bbc0 msgr2=0x7f38300a7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:27.179 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.177+0000 7f3836cf5640 1 --2- 172.21.15.57:0/3319013743 >> v2:172.21.15.88:3300/0 conn(0x7f383014bbc0 0x7f38300a7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:27.179 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.177+0000 7f3836cf5640 1 -- 172.21.15.57:0/3319013743 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f383006db10 con 0x7f38300bc810 2024-04-24T23:38:27.179 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.177+0000 7f3835cf3640 1 --2- 172.21.15.57:0/3319013743 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f383006f430 0x7f383014ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:38:27.179 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.177+0000 7f3836cf5640 1 --2- 172.21.15.57:0/3319013743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38300bc810 0x7f38300b71d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f38300c2e10 tx=0x7f382801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a1ef78c85c37f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:27.179 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.177+0000 7f38354f2640 1 -- 172.21.15.57:0/3319013743 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38280a5670 con 0x7f38300bc810 2024-04-24T23:38:27.180 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.177+0000 7f38354f2640 1 -- 172.21.15.57:0/3319013743 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38280a5810 con 0x7f38300bc810 2024-04-24T23:38:27.180 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.177+0000 7f38354f2640 1 -- 172.21.15.57:0/3319013743 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38280a5be0 con 0x7f38300bc810 2024-04-24T23:38:27.181 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.177+0000 7f3838758640 1 -- 172.21.15.57:0/3319013743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38300bc810 msgr2=0x7f38300b71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:27.181 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.177+0000 7f3838758640 1 --2- 172.21.15.57:0/3319013743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38300bc810 0x7f38300b71d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f38300c2e10 tx=0x7f382801c9f0 comp rx=0 tx=0).stop 2024-04-24T23:38:27.181 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.177+0000 7f3838758640 1 -- 172.21.15.57:0/3319013743 shutdown_connections 2024-04-24T23:38:27.181 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.177+0000 7f3838758640 1 --2- 172.21.15.57:0/3319013743 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f383006f430 0x7f383014ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:27.181 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.177+0000 7f3838758640 1 --2- 172.21.15.57:0/3319013743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38300bc810 0x7f38300b71d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:27.181 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.177+0000 7f3838758640 1 --2- 172.21.15.57:0/3319013743 >> v2:172.21.15.88:3300/0 conn(0x7f383014bbc0 0x7f38300a7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:27.181 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.177+0000 7f3838758640 1 -- 172.21.15.57:0/3319013743 >> 172.21.15.57:0/3319013743 conn(0x7f38300be910 msgr2=0x7f38300bed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:27.181 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.177+0000 7f3838758640 1 -- 172.21.15.57:0/3319013743 shutdown_connections 2024-04-24T23:38:27.181 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.177+0000 7f3838758640 1 -- 172.21.15.57:0/3319013743 wait complete. 2024-04-24T23:38:27.185 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.181+0000 7f3838758640 1 Processor -- start 2024-04-24T23:38:27.185 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.181+0000 7f3838758640 1 -- start start 2024-04-24T23:38:27.185 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.181+0000 7f3838758640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f383006f430 0x7f3830158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:27.185 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.181+0000 7f3838758640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38300bc810 0x7f38301573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:27.185 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.181+0000 7f3838758640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f383014bbc0 0x7f38300b98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:27.185 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.181+0000 7f3838758640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f38301523b0 con 0x7f38300bc810 2024-04-24T23:38:27.185 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.181+0000 7f3838758640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f3830152230 con 0x7f383014bbc0 2024-04-24T23:38:27.186 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.181+0000 7f3838758640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f3830152530 con 0x7f383006f430 2024-04-24T23:38:27.186 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.181+0000 7f3835cf3640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38300bc810 0x7f38301573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:27.186 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.181+0000 7f3835cf3640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38300bc810 0x7f38301573f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60636/0 (socket says 172.21.15.57:60636) 2024-04-24T23:38:27.186 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.181+0000 7f3835cf3640 1 -- 172.21.15.57:0/773139120 learned_addr learned my addr 172.21.15.57:0/773139120 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:27.186 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.181+0000 7f38364f4640 1 --2- 172.21.15.57:0/773139120 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f383006f430 0x7f3830158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:27.186 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.181+0000 7f3836cf5640 1 --2- 172.21.15.57:0/773139120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f383014bbc0 0x7f38300b98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:27.187 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.181+0000 7f3835cf3640 1 -- 172.21.15.57:0/773139120 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f383006f430 msgr2=0x7f3830158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:27.187 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.181+0000 7f3835cf3640 1 --2- 172.21.15.57:0/773139120 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f383006f430 0x7f3830158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:27.187 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.181+0000 7f3835cf3640 1 -- 172.21.15.57:0/773139120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f383014bbc0 msgr2=0x7f38300b98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:27.187 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.181+0000 7f3835cf3640 1 --2- 172.21.15.57:0/773139120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f383014bbc0 0x7f38300b98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:27.187 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.181+0000 7f3835cf3640 1 -- 172.21.15.57:0/773139120 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38300b9150 con 0x7f38300bc810 2024-04-24T23:38:27.187 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.181+0000 7f3836cf5640 1 --2- 172.21.15.57:0/773139120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f383014bbc0 0x7f38300b98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:38:27.188 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.181+0000 7f3835cf3640 1 --2- 172.21.15.57:0/773139120 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38300bc810 0x7f38301573f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f382000c7c0 tx=0x7f382000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:27.188 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.181+0000 7f3826ffd640 1 -- 172.21.15.57:0/773139120 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3820015070 con 0x7f38300bc810 2024-04-24T23:38:27.188 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.181+0000 7f3826ffd640 1 -- 172.21.15.57:0/773139120 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3820007a30 con 0x7f38300bc810 2024-04-24T23:38:27.188 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.181+0000 7f3838758640 1 -- 172.21.15.57:0/773139120 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38301eb1a0 con 0x7f38300bc810 2024-04-24T23:38:27.188 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.181+0000 7f3826ffd640 1 -- 172.21.15.57:0/773139120 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3820007e00 con 0x7f38300bc810 2024-04-24T23:38:27.188 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.181+0000 7f3838758640 1 -- 172.21.15.57:0/773139120 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38300c1a30 con 0x7f38300bc810 2024-04-24T23:38:27.188 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.181+0000 7f3838758640 1 -- 172.21.15.57:0/773139120 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38300b8f70 con 0x7f38300bc810 2024-04-24T23:38:27.189 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.181+0000 7f3826ffd640 1 -- 172.21.15.57:0/773139120 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 4) ==== 87389+0+0 (secure 0 0 0) 0x7f3820018070 con 0x7f38300bc810 2024-04-24T23:38:27.189 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.185+0000 7f3826ffd640 1 --2- 172.21.15.57:0/773139120 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f3814067830 0x7f3814069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:27.189 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.185+0000 7f3826ffd640 1 -- 172.21.15.57:0/773139120 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7f38200855a0 con 0x7f38300bc810 2024-04-24T23:38:27.189 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.185+0000 7f38364f4640 1 --2- 172.21.15.57:0/773139120 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f3814067830 0x7f3814069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:27.190 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.185+0000 7f38364f4640 1 --2- 172.21.15.57:0/773139120 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f3814067830 0x7f3814069cf0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f38301e4e50 tx=0x7f382c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:27.199 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.197+0000 7f3826ffd640 1 -- 172.21.15.57:0/773139120 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f38300b8f70 con 0x7f38300bc810 2024-04-24T23:38:27.354 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.353+0000 7f3838758640 1 -- 172.21.15.57:0/773139120 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f38301eaf90 con 0x7f38300bc810 2024-04-24T23:38:27.356 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.353+0000 7f3826ffd640 1 -- 172.21.15.57:0/773139120 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+10861 (secure 0 0 0) 0x7f3820056690 con 0x7f38300bc810 2024-04-24T23:38:27.356 INFO:teuthology.misc.health.smithi057.stdout: 2024-04-24T23:38:27.356 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":13,"fsid":"1ea31698-444a-4667-bcd9-b2608ad103c3","created":"2024-04-24T23:38:16.748774+0000","modified":"2024-04-24T23:38:26.956537+0000","last_up_change":"2024-04-24T23:38:26.956537+0000","last_in_change":"2024-04-24T23:38:18.972175+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"35ce67bc-9b25-416e-ab1e-774c717631f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6825","nonce":671364028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6827","nonce":671364028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6831","nonce":671364028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6829","nonce":671364028}]},"public_addr":"172.21.15.57:6825/671364028","cluster_addr":"172.21.15.57:6827/671364028","heartbeat_back_addr":"172.21.15.57:6831/671364028","heartbeat_front_addr":"172.21.15.57:6829/671364028","state":["exists","up"]},{"osd":1,"uuid":"38f6f4ef-3bc2-4453-9946-7d1d17e735ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6801","nonce":2653552037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6803","nonce":2653552037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6807","nonce":2653552037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6805","nonce":2653552037}]},"public_addr":"172.21.15.57:6801/2653552037","cluster_addr":"172.21.15.57:6803/2653552037","heartbeat_back_addr":"172.21.15.57:6807/2653552037","heartbeat_front_addr":"172.21.15.57:6805/2653552037","state":["exists","up"]},{"osd":2,"uuid":"d77a0a49-b39a-464e-a1c9-49e19280c440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6816","nonce":1565874109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6819","nonce":1565874109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6823","nonce":1565874109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6821","nonce":1565874109}]},"public_addr":"172.21.15.57:6816/1565874109","cluster_addr":"172.21.15.57:6819/1565874109","heartbeat_back_addr":"172.21.15.57:6823/1565874109","heartbeat_front_addr":"172.21.15.57:6821/1565874109","state":["exists","up"]},{"osd":3,"uuid":"f8ea9bfe-d839-44a6-a185-0f0985da314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6809","nonce":3474703186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6811","nonce":3474703186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6817","nonce":3474703186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6813","nonce":3474703186}]},"public_addr":"172.21.15.57:6809/3474703186","cluster_addr":"172.21.15.57:6811/3474703186","heartbeat_back_addr":"172.21.15.57:6817/3474703186","heartbeat_front_addr":"172.21.15.57:6813/3474703186","state":["exists","up"]},{"osd":4,"uuid":"454647d4-6ac2-46b4-8451-320eb951a87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6801","nonce":1271707713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6803","nonce":1271707713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6807","nonce":1271707713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6805","nonce":1271707713}]},"public_addr":"172.21.15.88:6801/1271707713","cluster_addr":"172.21.15.88:6803/1271707713","heartbeat_back_addr":"172.21.15.88:6807/1271707713","heartbeat_front_addr":"172.21.15.88:6805/1271707713","state":["exists","up"]},{"osd":5,"uuid":"f71c03a3-7ad8-46d3-89c9-d61de102586b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6809","nonce":2035054888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6813","nonce":2035054888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6820","nonce":2035054888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6816","nonce":2035054888}]},"public_addr":"172.21.15.88:6809/2035054888","cluster_addr":"172.21.15.88:6813/2035054888","heartbeat_back_addr":"172.21.15.88:6820/2035054888","heartbeat_front_addr":"172.21.15.88:6816/2035054888","state":["exists","up"]},{"osd":6,"uuid":"ec7ae2b7-9cb4-4059-8f98-0022c9763f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6825","nonce":1752291242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6827","nonce":1752291242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6831","nonce":1752291242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6829","nonce":1752291242}]},"public_addr":"172.21.15.88:6825/1752291242","cluster_addr":"172.21.15.88:6827/1752291242","heartbeat_back_addr":"172.21.15.88:6831/1752291242","heartbeat_front_addr":"172.21.15.88:6829/1752291242","state":["exists","up"]},{"osd":7,"uuid":"c0ee7505-60c1-40ba-9902-47313a04dafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6812","nonce":1782800372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6817","nonce":1782800372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6823","nonce":1782800372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6821","nonce":1782800372}]},"public_addr":"172.21.15.88:6812/1782800372","cluster_addr":"172.21.15.88:6817/1782800372","heartbeat_back_addr":"172.21.15.88:6823/1782800372","heartbeat_front_addr":"172.21.15.88:6821/1782800372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:38:27.359 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.357+0000 7f3838758640 1 -- 172.21.15.57:0/773139120 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f3814067830 msgr2=0x7f3814069cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:27.359 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.357+0000 7f3838758640 1 --2- 172.21.15.57:0/773139120 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f3814067830 0x7f3814069cf0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f38301e4e50 tx=0x7f382c008040 comp rx=0 tx=0).stop 2024-04-24T23:38:27.359 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.357+0000 7f3838758640 1 -- 172.21.15.57:0/773139120 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38300bc810 msgr2=0x7f38301573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:27.359 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.357+0000 7f3838758640 1 --2- 172.21.15.57:0/773139120 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38300bc810 0x7f38301573f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f382000c7c0 tx=0x7f382000cc80 comp rx=0 tx=0).stop 2024-04-24T23:38:27.359 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.357+0000 7f3838758640 1 -- 172.21.15.57:0/773139120 shutdown_connections 2024-04-24T23:38:27.359 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.357+0000 7f3838758640 1 --2- 172.21.15.57:0/773139120 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f3814067830 0x7f3814069cf0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:27.359 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.357+0000 7f3838758640 1 --2- 172.21.15.57:0/773139120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f383014bbc0 0x7f38300b98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:27.359 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.357+0000 7f3838758640 1 --2- 172.21.15.57:0/773139120 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38300bc810 0x7f38301573f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:27.359 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.357+0000 7f3838758640 1 --2- 172.21.15.57:0/773139120 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f383006f430 0x7f3830158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:27.359 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.357+0000 7f3838758640 1 -- 172.21.15.57:0/773139120 >> 172.21.15.57:0/773139120 conn(0x7f38300be910 msgr2=0x7f383014c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:27.359 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.357+0000 7f3838758640 1 -- 172.21.15.57:0/773139120 shutdown_connections 2024-04-24T23:38:27.359 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T23:38:27.357+0000 7f3838758640 1 -- 172.21.15.57:0/773139120 wait complete. 2024-04-24T23:38:27.373 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-24T23:38:27.373 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-24T23:38:27.373 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-24T23:38:27.373 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-24T23:38:27.375 INFO:tasks.ceph.mds.a:Started 2024-04-24T23:38:27.376 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-24T23:38:27.376 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-24T23:38:27.378 INFO:tasks.ceph.mds.c:Started 2024-04-24T23:38:27.378 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-24T23:38:27.378 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-24T23:38:27.381 INFO:tasks.ceph.mds.b:Started 2024-04-24T23:38:27.381 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-24T23:38:27.382 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:38:27.442 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2024-04-24T23:38:27.442 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2024-04-24T23:38:27.469 INFO:tasks.ceph.mds.b.smithi088.stdout:starting mds.b at 2024-04-24T23:38:27.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.497+0000 7f6d3c245640 1 Processor -- start 2024-04-24T23:38:27.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d3c245640 1 -- start start 2024-04-24T23:38:27.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d3c245640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6d3414f3c0 0x7f6d3415a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:27.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d3c245640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d3414e8e0 con 0x7f6d340bdbe0 2024-04-24T23:38:27.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d3c245640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d3414ebc0 con 0x7f6d3414bc60 2024-04-24T23:38:27.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d3c245640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f6d34152c20 con 0x7f6d3414f3c0 2024-04-24T23:38:27.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d397e0640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6d340bdbe0 0x7f6d340b6fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:47938/0 (socket says 172.21.15.57:47938) 2024-04-24T23:38:27.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d397e0640 1 -- 172.21.15.57:0/2744785297 learned_addr learned my addr 172.21.15.57:0/2744785297 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:38:27.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d3a7e2640 1 --2- 172.21.15.57:0/2744785297 >> v2:172.21.15.88:3300/0 conn(0x7f6d3414f3c0 0x7f6d3415a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:27.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d38fdf640 1 -- 172.21.15.57:0/2744785297 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 439611887 0 0) 0x7f6d3414e8e0 con 0x7f6d340bdbe0 2024-04-24T23:38:27.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d38fdf640 1 -- 172.21.15.57:0/2744785297 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d20003530 con 0x7f6d340bdbe0 2024-04-24T23:38:27.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d38fdf640 1 -- 172.21.15.57:0/2744785297 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2039446760 0 0) 0x7f6d20003530 con 0x7f6d340bdbe0 2024-04-24T23:38:27.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d38fdf640 1 -- 172.21.15.57:0/2744785297 >> v2:172.21.15.88:3300/0 conn(0x7f6d3414f3c0 msgr2=0x7f6d3415a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:27.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d38fdf640 1 --2- 172.21.15.57:0/2744785297 >> v2:172.21.15.88:3300/0 conn(0x7f6d3414f3c0 0x7f6d3415a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:27.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d38fdf640 1 -- 172.21.15.57:0/2744785297 >> v1:172.21.15.88:6789/0 conn(0x7f6d3414bc60 legacy=0x7f6d3406eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:27.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d38fdf640 1 -- 172.21.15.57:0/2744785297 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d3406f260 con 0x7f6d340bdbe0 2024-04-24T23:38:27.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d38fdf640 1 -- 172.21.15.57:0/2744785297 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7f6d24001680 con 0x7f6d340bdbe0 2024-04-24T23:38:27.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d38fdf640 1 -- 172.21.15.57:0/2744785297 >> v1:172.21.15.57:6789/0 conn(0x7f6d340bdbe0 legacy=0x7f6d340b6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:27.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d38fdf640 1 --2- 172.21.15.57:0/2744785297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d200039c0 0x7f6d20003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:27.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d38fdf640 1 --2- 172.21.15.57:0/2744785297 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d200043c0 0x7f6d20004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:27.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d38fdf640 1 --2- 172.21.15.57:0/2744785297 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d20005090 0x7f6d2000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:27.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d38fdf640 1 -- 172.21.15.57:0/2744785297 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6d34152c20 con 0x7f6d20005090 2024-04-24T23:38:27.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d38fdf640 1 -- 172.21.15.57:0/2744785297 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2000bff0 con 0x7f6d200039c0 2024-04-24T23:38:27.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d38fdf640 1 -- 172.21.15.57:0/2744785297 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f6d2000c1f0 con 0x7f6d200043c0 2024-04-24T23:38:27.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d3a7e2640 1 --2- 172.21.15.57:0/2744785297 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d20005090 0x7f6d2000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:27.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d39fe1640 1 --2- 172.21.15.57:0/2744785297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d200039c0 0x7f6d20003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:27.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d397e0640 1 --2- 172.21.15.57:0/2744785297 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d200043c0 0x7f6d20004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:27.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d3a7e2640 1 -- 172.21.15.57:0/2744785297 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d200043c0 msgr2=0x7f6d20004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:27.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d3a7e2640 1 --2- 172.21.15.57:0/2744785297 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d200043c0 0x7f6d20004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:27.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d3a7e2640 1 -- 172.21.15.57:0/2744785297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d200039c0 msgr2=0x7f6d20003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:27.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d3a7e2640 1 --2- 172.21.15.57:0/2744785297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d200039c0 0x7f6d20003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:27.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d3a7e2640 1 -- 172.21.15.57:0/2744785297 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d20003530 con 0x7f6d20005090 2024-04-24T23:38:27.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d3a7e2640 1 -- 172.21.15.57:0/2744785297 reap_dead start 2024-04-24T23:38:27.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.501+0000 7f6d3a7e2640 1 --2- 172.21.15.57:0/2744785297 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d20005090 0x7f6d2000b9d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6d30009fc0 tx=0x7f6d3001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ee8f427246c9c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:27.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d38fdf640 1 -- 172.21.15.57:0/2744785297 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d30009c10 con 0x7f6d20005090 2024-04-24T23:38:27.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d38fdf640 1 -- 172.21.15.57:0/2744785297 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d300a5cd0 con 0x7f6d20005090 2024-04-24T23:38:27.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d38fdf640 1 -- 172.21.15.57:0/2744785297 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d30003be0 con 0x7f6d20005090 2024-04-24T23:38:27.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d3c245640 1 -- 172.21.15.57:0/2744785297 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d20005090 msgr2=0x7f6d2000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:27.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d3c245640 1 --2- 172.21.15.57:0/2744785297 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d20005090 0x7f6d2000b9d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6d30009fc0 tx=0x7f6d3001ccc0 comp rx=0 tx=0).stop 2024-04-24T23:38:27.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d3c245640 1 -- 172.21.15.57:0/2744785297 shutdown_connections 2024-04-24T23:38:27.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d3c245640 1 --2- 172.21.15.57:0/2744785297 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d20005090 0x7f6d2000b9d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:27.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d3c245640 1 -- 172.21.15.57:0/2744785297 >> 172.21.15.57:0/2744785297 conn(0x7f6d340beab0 msgr2=0x7f6d340beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:27.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d3c245640 1 -- 172.21.15.57:0/2744785297 shutdown_connections 2024-04-24T23:38:27.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d3c245640 1 -- 172.21.15.57:0/2744785297 wait complete. 2024-04-24T23:38:27.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d3c245640 1 Processor -- start 2024-04-24T23:38:27.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d3c245640 1 -- start start 2024-04-24T23:38:27.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d3c245640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d20005090 0x7f6d34144000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:27.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d3c245640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d3414f9b0 0x7f6d341e43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:27.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d3c245640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d341e4910 0x7f6d34140240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:27.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d3c245640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6d340bc730 con 0x7f6d3414f9b0 2024-04-24T23:38:27.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d3c245640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6d340bc5b0 con 0x7f6d341e4910 2024-04-24T23:38:27.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d3c245640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f6d34151cc0 con 0x7f6d20005090 2024-04-24T23:38:27.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d397e0640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d3414f9b0 0x7f6d341e43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:27.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d397e0640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d3414f9b0 0x7f6d341e43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60676/0 (socket says 172.21.15.57:60676) 2024-04-24T23:38:27.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d397e0640 1 -- 172.21.15.57:0/1849534954 learned_addr learned my addr 172.21.15.57:0/1849534954 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:27.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d39fe1640 1 --2- 172.21.15.57:0/1849534954 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d20005090 0x7f6d34144000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:27.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d3a7e2640 1 --2- 172.21.15.57:0/1849534954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d341e4910 0x7f6d34140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:27.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d397e0640 1 -- 172.21.15.57:0/1849534954 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d20005090 msgr2=0x7f6d34144000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:27.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d397e0640 1 --2- 172.21.15.57:0/1849534954 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d20005090 0x7f6d34144000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:27.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d397e0640 1 -- 172.21.15.57:0/1849534954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d341e4910 msgr2=0x7f6d34140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:27.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d397e0640 1 --2- 172.21.15.57:0/1849534954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d341e4910 0x7f6d34140240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:27.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d397e0640 1 -- 172.21.15.57:0/1849534954 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d34144540 con 0x7f6d3414f9b0 2024-04-24T23:38:27.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d397e0640 1 --2- 172.21.15.57:0/1849534954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d3414f9b0 0x7f6d341e43d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6d240124c0 tx=0x7f6d24012980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:27.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d2a7fc640 1 -- 172.21.15.57:0/1849534954 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d24014810 con 0x7f6d3414f9b0 2024-04-24T23:38:27.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d2a7fc640 1 -- 172.21.15.57:0/1849534954 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d2401b070 con 0x7f6d3414f9b0 2024-04-24T23:38:27.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d3c245640 1 -- 172.21.15.57:0/1849534954 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d341514d0 con 0x7f6d3414f9b0 2024-04-24T23:38:27.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d2a7fc640 1 -- 172.21.15.57:0/1849534954 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d24014c30 con 0x7f6d3414f9b0 2024-04-24T23:38:27.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.505+0000 7f6d3c245640 1 -- 172.21.15.57:0/1849534954 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d3414c540 con 0x7f6d3414f9b0 2024-04-24T23:38:27.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.509+0000 7f6d3c245640 1 -- 172.21.15.57:0/1849534954 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d341e3d30 con 0x7f6d3414f9b0 2024-04-24T23:38:27.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.509+0000 7f6d2a7fc640 1 -- 172.21.15.57:0/1849534954 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 4) ==== 87389+0+0 (secure 0 0 0) 0x7f6d24016480 con 0x7f6d3414f9b0 2024-04-24T23:38:27.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.509+0000 7f6d2a7fc640 1 --2- 172.21.15.57:0/1849534954 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6d18067830 0x7f6d18069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:27.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.509+0000 7f6d2a7fc640 1 -- 172.21.15.57:0/1849534954 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7f6d24088870 con 0x7f6d3414f9b0 2024-04-24T23:38:27.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.509+0000 7f6d39fe1640 1 --2- 172.21.15.57:0/1849534954 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6d18067830 0x7f6d18069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:27.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.509+0000 7f6d39fe1640 1 --2- 172.21.15.57:0/1849534954 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6d18067830 0x7f6d18069cf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c007fd0 tx=0x7f6d2c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:27.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.513+0000 7f6d2a7fc640 1 -- 172.21.15.57:0/1849534954 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f6d34144540 con 0x7f6d3414f9b0 2024-04-24T23:38:27.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.669+0000 7f6d3c245640 1 -- 172.21.15.57:0/1849534954 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6d340be070 con 0x7f6d3414f9b0 2024-04-24T23:38:27.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.673+0000 7f6d2a7fc640 1 -- 172.21.15.57:0/1849534954 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+10861 (secure 0 0 0) 0x7f6d24059310 con 0x7f6d3414f9b0 2024-04-24T23:38:27.673 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:38:27.674 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":13,"fsid":"1ea31698-444a-4667-bcd9-b2608ad103c3","created":"2024-04-24T23:38:16.748774+0000","modified":"2024-04-24T23:38:26.956537+0000","last_up_change":"2024-04-24T23:38:26.956537+0000","last_in_change":"2024-04-24T23:38:18.972175+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"35ce67bc-9b25-416e-ab1e-774c717631f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6825","nonce":671364028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6827","nonce":671364028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6831","nonce":671364028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6829","nonce":671364028}]},"public_addr":"172.21.15.57:6825/671364028","cluster_addr":"172.21.15.57:6827/671364028","heartbeat_back_addr":"172.21.15.57:6831/671364028","heartbeat_front_addr":"172.21.15.57:6829/671364028","state":["exists","up"]},{"osd":1,"uuid":"38f6f4ef-3bc2-4453-9946-7d1d17e735ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6801","nonce":2653552037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6803","nonce":2653552037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6807","nonce":2653552037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6805","nonce":2653552037}]},"public_addr":"172.21.15.57:6801/2653552037","cluster_addr":"172.21.15.57:6803/2653552037","heartbeat_back_addr":"172.21.15.57:6807/2653552037","heartbeat_front_addr":"172.21.15.57:6805/2653552037","state":["exists","up"]},{"osd":2,"uuid":"d77a0a49-b39a-464e-a1c9-49e19280c440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6816","nonce":1565874109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6819","nonce":1565874109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6823","nonce":1565874109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6821","nonce":1565874109}]},"public_addr":"172.21.15.57:6816/1565874109","cluster_addr":"172.21.15.57:6819/1565874109","heartbeat_back_addr":"172.21.15.57:6823/1565874109","heartbeat_front_addr":"172.21.15.57:6821/1565874109","state":["exists","up"]},{"osd":3,"uuid":"f8ea9bfe-d839-44a6-a185-0f0985da314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6809","nonce":3474703186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6811","nonce":3474703186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6817","nonce":3474703186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6813","nonce":3474703186}]},"public_addr":"172.21.15.57:6809/3474703186","cluster_addr":"172.21.15.57:6811/3474703186","heartbeat_back_addr":"172.21.15.57:6817/3474703186","heartbeat_front_addr":"172.21.15.57:6813/3474703186","state":["exists","up"]},{"osd":4,"uuid":"454647d4-6ac2-46b4-8451-320eb951a87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6801","nonce":1271707713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6803","nonce":1271707713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6807","nonce":1271707713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6805","nonce":1271707713}]},"public_addr":"172.21.15.88:6801/1271707713","cluster_addr":"172.21.15.88:6803/1271707713","heartbeat_back_addr":"172.21.15.88:6807/1271707713","heartbeat_front_addr":"172.21.15.88:6805/1271707713","state":["exists","up"]},{"osd":5,"uuid":"f71c03a3-7ad8-46d3-89c9-d61de102586b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6809","nonce":2035054888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6813","nonce":2035054888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6820","nonce":2035054888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6816","nonce":2035054888}]},"public_addr":"172.21.15.88:6809/2035054888","cluster_addr":"172.21.15.88:6813/2035054888","heartbeat_back_addr":"172.21.15.88:6820/2035054888","heartbeat_front_addr":"172.21.15.88:6816/2035054888","state":["exists","up"]},{"osd":6,"uuid":"ec7ae2b7-9cb4-4059-8f98-0022c9763f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6825","nonce":1752291242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6827","nonce":1752291242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6831","nonce":1752291242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6829","nonce":1752291242}]},"public_addr":"172.21.15.88:6825/1752291242","cluster_addr":"172.21.15.88:6827/1752291242","heartbeat_back_addr":"172.21.15.88:6831/1752291242","heartbeat_front_addr":"172.21.15.88:6829/1752291242","state":["exists","up"]},{"osd":7,"uuid":"c0ee7505-60c1-40ba-9902-47313a04dafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6812","nonce":1782800372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6817","nonce":1782800372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6823","nonce":1782800372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6821","nonce":1782800372}]},"public_addr":"172.21.15.88:6812/1782800372","cluster_addr":"172.21.15.88:6817/1782800372","heartbeat_back_addr":"172.21.15.88:6823/1782800372","heartbeat_front_addr":"172.21.15.88:6821/1782800372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:38:27.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.673+0000 7f6d3c245640 1 -- 172.21.15.57:0/1849534954 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6d18067830 msgr2=0x7f6d18069cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:27.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.673+0000 7f6d3c245640 1 --2- 172.21.15.57:0/1849534954 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6d18067830 0x7f6d18069cf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c007fd0 tx=0x7f6d2c009040 comp rx=0 tx=0).stop 2024-04-24T23:38:27.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.673+0000 7f6d3c245640 1 -- 172.21.15.57:0/1849534954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d3414f9b0 msgr2=0x7f6d341e43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:27.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.673+0000 7f6d3c245640 1 --2- 172.21.15.57:0/1849534954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d3414f9b0 0x7f6d341e43d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6d240124c0 tx=0x7f6d24012980 comp rx=0 tx=0).stop 2024-04-24T23:38:27.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.673+0000 7f6d3c245640 1 -- 172.21.15.57:0/1849534954 shutdown_connections 2024-04-24T23:38:27.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.673+0000 7f6d3c245640 1 --2- 172.21.15.57:0/1849534954 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6d18067830 0x7f6d18069cf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:27.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.673+0000 7f6d3c245640 1 --2- 172.21.15.57:0/1849534954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d341e4910 0x7f6d34140240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:27.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.673+0000 7f6d3c245640 1 --2- 172.21.15.57:0/1849534954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d3414f9b0 0x7f6d341e43d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:27.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.673+0000 7f6d3c245640 1 --2- 172.21.15.57:0/1849534954 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d20005090 0x7f6d34144000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:27.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.673+0000 7f6d3c245640 1 -- 172.21.15.57:0/1849534954 >> 172.21.15.57:0/1849534954 conn(0x7f6d340beab0 msgr2=0x7f6d341497b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:27.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.673+0000 7f6d3c245640 1 -- 172.21.15.57:0/1849534954 shutdown_connections 2024-04-24T23:38:27.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.673+0000 7f6d3c245640 1 -- 172.21.15.57:0/1849534954 wait complete. 2024-04-24T23:38:27.690 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-04-24T23:38:27.691 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:38:27.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.809+0000 7fbb87a40640 1 Processor -- start 2024-04-24T23:38:27.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.809+0000 7fbb87a40640 1 -- start start 2024-04-24T23:38:27.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb87a40640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbb8014bc60 0x7fbb8006eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:27.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb87a40640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb8014e8e0 con 0x7fbb8006f090 2024-04-24T23:38:27.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb87a40640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb8014ebc0 con 0x7fbb800bdbe0 2024-04-24T23:38:27.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb87a40640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fbb80152c20 con 0x7fbb8014bc60 2024-04-24T23:38:27.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb84fdb640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbb8006f090 0x7fbb800b6fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46680/0 (socket says 172.21.15.57:46680) 2024-04-24T23:38:27.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb84fdb640 1 -- 172.21.15.57:0/684251915 learned_addr learned my addr 172.21.15.57:0/684251915 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:38:27.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb857dc640 1 --2- 172.21.15.57:0/684251915 >> v2:172.21.15.88:3300/0 conn(0x7fbb8014bc60 0x7fbb8006eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:27.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb77fff640 1 -- 172.21.15.57:0/684251915 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3599420912 0 0) 0x7fbb8014e8e0 con 0x7fbb8006f090 2024-04-24T23:38:27.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb77fff640 1 -- 172.21.15.57:0/684251915 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb6c003530 con 0x7fbb8006f090 2024-04-24T23:38:27.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb77fff640 1 -- 172.21.15.57:0/684251915 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2814277785 0 0) 0x7fbb6c003530 con 0x7fbb8006f090 2024-04-24T23:38:27.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb77fff640 1 -- 172.21.15.57:0/684251915 >> v2:172.21.15.88:3300/0 conn(0x7fbb8014bc60 msgr2=0x7fbb8006eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:27.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb77fff640 1 --2- 172.21.15.57:0/684251915 >> v2:172.21.15.88:3300/0 conn(0x7fbb8014bc60 0x7fbb8006eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:27.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb77fff640 1 -- 172.21.15.57:0/684251915 >> v1:172.21.15.88:6789/0 conn(0x7fbb800bdbe0 legacy=0x7fbb80159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:27.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb77fff640 1 -- 172.21.15.57:0/684251915 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb800b76e0 con 0x7fbb8006f090 2024-04-24T23:38:27.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb77fff640 1 -- 172.21.15.57:0/684251915 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7fbb70001680 con 0x7fbb8006f090 2024-04-24T23:38:27.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb77fff640 1 -- 172.21.15.57:0/684251915 >> v1:172.21.15.57:6789/0 conn(0x7fbb8006f090 legacy=0x7fbb800b6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:27.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb77fff640 1 --2- 172.21.15.57:0/684251915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb6c0039c0 0x7fbb6c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:27.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb77fff640 1 --2- 172.21.15.57:0/684251915 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbb6c004810 0x7fbb6c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:27.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb77fff640 1 --2- 172.21.15.57:0/684251915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb6c0051d0 0x7fbb6c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:27.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb77fff640 1 -- 172.21.15.57:0/684251915 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbb80152c20 con 0x7fbb6c0039c0 2024-04-24T23:38:27.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb77fff640 1 -- 172.21.15.57:0/684251915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6c00c070 con 0x7fbb6c0051d0 2024-04-24T23:38:27.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb77fff640 1 -- 172.21.15.57:0/684251915 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fbb6c00c270 con 0x7fbb6c004810 2024-04-24T23:38:27.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb857dc640 1 --2- 172.21.15.57:0/684251915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb6c0039c0 0x7fbb6c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:27.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb85fdd640 1 --2- 172.21.15.57:0/684251915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb6c0051d0 0x7fbb6c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:27.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb857dc640 1 -- 172.21.15.57:0/684251915 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbb6c004810 msgr2=0x7fbb6c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:27.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb857dc640 1 --2- 172.21.15.57:0/684251915 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbb6c004810 0x7fbb6c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:27.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb857dc640 1 -- 172.21.15.57:0/684251915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb6c0051d0 msgr2=0x7fbb6c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:27.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb857dc640 1 --2- 172.21.15.57:0/684251915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb6c0051d0 0x7fbb6c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:27.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb857dc640 1 -- 172.21.15.57:0/684251915 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6c003530 con 0x7fbb6c0039c0 2024-04-24T23:38:27.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb85fdd640 1 --2- 172.21.15.57:0/684251915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb6c0051d0 0x7fbb6c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:38:27.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb85fdd640 1 -- 172.21.15.57:0/684251915 reap_dead start 2024-04-24T23:38:27.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb857dc640 1 --2- 172.21.15.57:0/684251915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb6c0039c0 0x7fbb6c003de0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c009fc0 tx=0x7fbb7c01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb2e3f7ea5f356c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:27.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb77fff640 1 -- 172.21.15.57:0/684251915 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c0b2070 con 0x7fbb6c0039c0 2024-04-24T23:38:27.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb77fff640 1 -- 172.21.15.57:0/684251915 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb7c0a5a70 con 0x7fbb6c0039c0 2024-04-24T23:38:27.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.813+0000 7fbb77fff640 1 -- 172.21.15.57:0/684251915 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c009c10 con 0x7fbb6c0039c0 2024-04-24T23:38:27.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb87a40640 1 -- 172.21.15.57:0/684251915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb6c0039c0 msgr2=0x7fbb6c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:27.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb87a40640 1 --2- 172.21.15.57:0/684251915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb6c0039c0 0x7fbb6c003de0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c009fc0 tx=0x7fbb7c01cc80 comp rx=0 tx=0).stop 2024-04-24T23:38:27.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb87a40640 1 -- 172.21.15.57:0/684251915 shutdown_connections 2024-04-24T23:38:27.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb87a40640 1 --2- 172.21.15.57:0/684251915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb6c0039c0 0x7fbb6c003de0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:27.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb87a40640 1 -- 172.21.15.57:0/684251915 >> 172.21.15.57:0/684251915 conn(0x7fbb800beab0 msgr2=0x7fbb800beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:27.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb87a40640 1 -- 172.21.15.57:0/684251915 shutdown_connections 2024-04-24T23:38:27.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb87a40640 1 -- 172.21.15.57:0/684251915 wait complete. 2024-04-24T23:38:27.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb87a40640 1 Processor -- start 2024-04-24T23:38:27.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb87a40640 1 -- start start 2024-04-24T23:38:27.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb87a40640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb6c0039c0 0x7fbb801db7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:27.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb87a40640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb800bfba0 0x7fbb800bb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:27.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb87a40640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbb800bb940 0x7fbb801e8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:27.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb87a40640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbb800b6fd0 con 0x7fbb800bfba0 2024-04-24T23:38:27.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb87a40640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbb800730c0 con 0x7fbb6c0039c0 2024-04-24T23:38:27.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb87a40640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fbb800b7150 con 0x7fbb800bb940 2024-04-24T23:38:27.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb84fdb640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb800bfba0 0x7fbb800bb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:27.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb84fdb640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb800bfba0 0x7fbb800bb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38918/0 (socket says 172.21.15.57:38918) 2024-04-24T23:38:27.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb84fdb640 1 -- 172.21.15.57:0/252692209 learned_addr learned my addr 172.21.15.57:0/252692209 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:27.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb857dc640 1 --2- 172.21.15.57:0/252692209 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb6c0039c0 0x7fbb801db7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:27.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb85fdd640 1 --2- 172.21.15.57:0/252692209 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbb800bb940 0x7fbb801e8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:27.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb84fdb640 1 -- 172.21.15.57:0/252692209 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbb800bb940 msgr2=0x7fbb801e8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:27.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb84fdb640 1 --2- 172.21.15.57:0/252692209 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbb800bb940 0x7fbb801e8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:27.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb84fdb640 1 -- 172.21.15.57:0/252692209 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb6c0039c0 msgr2=0x7fbb801db7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:27.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb84fdb640 1 --2- 172.21.15.57:0/252692209 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb6c0039c0 0x7fbb801db7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:27.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb84fdb640 1 -- 172.21.15.57:0/252692209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb801dbd10 con 0x7fbb800bfba0 2024-04-24T23:38:27.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb84fdb640 1 --2- 172.21.15.57:0/252692209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb800bfba0 0x7fbb800bb400 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbb7000c720 tx=0x7fbb7000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:27.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb75ffb640 1 -- 172.21.15.57:0/252692209 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb70018070 con 0x7fbb800bfba0 2024-04-24T23:38:27.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb75ffb640 1 -- 172.21.15.57:0/252692209 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb700074e0 con 0x7fbb800bfba0 2024-04-24T23:38:27.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb87a40640 1 -- 172.21.15.57:0/252692209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb80144bd0 con 0x7fbb800bfba0 2024-04-24T23:38:27.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb75ffb640 1 -- 172.21.15.57:0/252692209 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb70004a30 con 0x7fbb800bfba0 2024-04-24T23:38:27.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb87a40640 1 -- 172.21.15.57:0/252692209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb800bbf70 con 0x7fbb800bfba0 2024-04-24T23:38:27.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.817+0000 7fbb87a40640 1 -- 172.21.15.57:0/252692209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb80068220 con 0x7fbb800bfba0 2024-04-24T23:38:27.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.821+0000 7fbb75ffb640 1 -- 172.21.15.57:0/252692209 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 4) ==== 87389+0+0 (secure 0 0 0) 0x7fbb7001b070 con 0x7fbb800bfba0 2024-04-24T23:38:27.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.821+0000 7fbb75ffb640 1 --2- 172.21.15.57:0/252692209 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fbb64067830 0x7fbb64069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:27.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.821+0000 7fbb75ffb640 1 -- 172.21.15.57:0/252692209 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7fbb70084c70 con 0x7fbb800bfba0 2024-04-24T23:38:27.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.821+0000 7fbb857dc640 1 --2- 172.21.15.57:0/252692209 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fbb64067830 0x7fbb64069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:27.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.821+0000 7fbb857dc640 1 --2- 172.21.15.57:0/252692209 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fbb64067830 0x7fbb64069cf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c0af000 tx=0x7fbb7c004ac0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:27.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:27.825+0000 7fbb75ffb640 1 -- 172.21.15.57:0/252692209 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fbb801dbd10 con 0x7fbb800bfba0 2024-04-24T23:38:28.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:28.017+0000 7fbb87a40640 1 -- 172.21.15.57:0/252692209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb800bd9c0 con 0x7fbb800bfba0 2024-04-24T23:38:28.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:28.017+0000 7fbb75ffb640 1 -- 172.21.15.57:0/252692209 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7fbb70055cc0 con 0x7fbb800bfba0 2024-04-24T23:38:28.018 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:38:28.018 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/1701414040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":1701414040},{"type":"v1","addr":"172.21.15.57:6835","nonce":1701414040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-24T23:38:28.018 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 2 2024-04-24T23:38:28.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:28.017+0000 7fbb87a40640 1 -- 172.21.15.57:0/252692209 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fbb64067830 msgr2=0x7fbb64069cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:28.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:28.017+0000 7fbb87a40640 1 --2- 172.21.15.57:0/252692209 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fbb64067830 0x7fbb64069cf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c0af000 tx=0x7fbb7c004ac0 comp rx=0 tx=0).stop 2024-04-24T23:38:28.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:28.017+0000 7fbb87a40640 1 -- 172.21.15.57:0/252692209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb800bfba0 msgr2=0x7fbb800bb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:28.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:28.017+0000 7fbb87a40640 1 --2- 172.21.15.57:0/252692209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb800bfba0 0x7fbb800bb400 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbb7000c720 tx=0x7fbb7000cbe0 comp rx=0 tx=0).stop 2024-04-24T23:38:28.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:28.017+0000 7fbb87a40640 1 -- 172.21.15.57:0/252692209 shutdown_connections 2024-04-24T23:38:28.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:28.017+0000 7fbb87a40640 1 --2- 172.21.15.57:0/252692209 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fbb64067830 0x7fbb64069cf0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:28.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:28.017+0000 7fbb87a40640 1 --2- 172.21.15.57:0/252692209 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbb800bb940 0x7fbb801e8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:28.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:28.017+0000 7fbb87a40640 1 --2- 172.21.15.57:0/252692209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb800bfba0 0x7fbb800bb400 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:28.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:28.017+0000 7fbb87a40640 1 --2- 172.21.15.57:0/252692209 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb6c0039c0 0x7fbb801db7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:28.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:28.017+0000 7fbb87a40640 1 -- 172.21.15.57:0/252692209 >> 172.21.15.57:0/252692209 conn(0x7fbb800beab0 msgr2=0x7fbb800b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:28.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:28.017+0000 7fbb87a40640 1 -- 172.21.15.57:0/252692209 shutdown_connections 2024-04-24T23:38:28.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:28.017+0000 7fbb87a40640 1 -- 172.21.15.57:0/252692209 wait complete. 2024-04-24T23:38:30.038 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:38:30.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.165+0000 7f4721009640 1 Processor -- start 2024-04-24T23:38:30.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.165+0000 7f4721009640 1 -- start start 2024-04-24T23:38:30.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.169+0000 7f4721009640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f471c0c32d0 0x7f471c14d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:30.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.169+0000 7f4721009640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f471c0c1080 0x7f471c150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:30.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.169+0000 7f4721009640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f471c0bd6c0 con 0x7f471c14dea0 2024-04-24T23:38:30.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.169+0000 7f4721009640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f471c0bf4a0 con 0x7f471c0c32d0 2024-04-24T23:38:30.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.169+0000 7f4721009640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f471c0bd470 con 0x7f471c0c1080 2024-04-24T23:38:30.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.169+0000 7f471ad9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f471c0c32d0 0x7f471c14d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:30.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.169+0000 7f471b59e640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f471c14dea0 0x7f471c151130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46686/0 (socket says 172.21.15.57:46686) 2024-04-24T23:38:30.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.169+0000 7f471b59e640 1 -- 172.21.15.57:0/1245418785 learned_addr learned my addr 172.21.15.57:0/1245418785 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:38:30.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.169+0000 7f471a59c640 1 --2- 172.21.15.57:0/1245418785 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f471c0c1080 0x7f471c150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:30.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.169+0000 7f471ad9d640 1 -- 172.21.15.57:0/1245418785 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f471c0c1080 msgr2=0x7f471c150bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:30.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.169+0000 7f471ad9d640 1 --2- 172.21.15.57:0/1245418785 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f471c0c1080 0x7f471c150bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:30.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.169+0000 7f471ad9d640 1 -- 172.21.15.57:0/1245418785 >> v1:172.21.15.57:6789/0 conn(0x7f471c14dea0 legacy=0x7f471c151130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:30.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.169+0000 7f471ad9d640 1 -- 172.21.15.57:0/1245418785 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f471c0bd9a0 con 0x7f471c0c32d0 2024-04-24T23:38:30.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.169+0000 7f4719d9b640 1 -- 172.21.15.57:0/1245418785 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4087305311 0 0) 0x7f471c0bd6c0 con 0x7f471c14dea0 2024-04-24T23:38:30.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.169+0000 7f471ad9d640 1 --2- 172.21.15.57:0/1245418785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f471c0c32d0 0x7f471c14d960 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f470c009d90 tx=0x7f470c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd593e10669131af server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:30.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.169+0000 7f4719d9b640 1 -- 172.21.15.57:0/1245418785 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c0b2070 con 0x7f471c0c32d0 2024-04-24T23:38:30.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.169+0000 7f4719d9b640 1 -- 172.21.15.57:0/1245418785 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f470c0a57a0 con 0x7f471c0c32d0 2024-04-24T23:38:30.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.169+0000 7f4719d9b640 1 -- 172.21.15.57:0/1245418785 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c0a5b70 con 0x7f471c0c32d0 2024-04-24T23:38:30.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.169+0000 7f4721009640 1 -- 172.21.15.57:0/1245418785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f471c0c32d0 msgr2=0x7f471c14d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:30.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.169+0000 7f4721009640 1 --2- 172.21.15.57:0/1245418785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f471c0c32d0 0x7f471c14d960 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f470c009d90 tx=0x7f470c01c8e0 comp rx=0 tx=0).stop 2024-04-24T23:38:30.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.169+0000 7f4721009640 1 -- 172.21.15.57:0/1245418785 shutdown_connections 2024-04-24T23:38:30.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.169+0000 7f4721009640 1 --2- 172.21.15.57:0/1245418785 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f471c0c1080 0x7f471c150bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:30.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.169+0000 7f4721009640 1 --2- 172.21.15.57:0/1245418785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f471c0c32d0 0x7f471c14d960 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:30.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.169+0000 7f4721009640 1 -- 172.21.15.57:0/1245418785 >> 172.21.15.57:0/1245418785 conn(0x7f471c067350 msgr2=0x7f471c067760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:30.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.169+0000 7f4721009640 1 -- 172.21.15.57:0/1245418785 shutdown_connections 2024-04-24T23:38:30.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.169+0000 7f4721009640 1 -- 172.21.15.57:0/1245418785 wait complete. 2024-04-24T23:38:30.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.173+0000 7f4721009640 1 Processor -- start 2024-04-24T23:38:30.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.173+0000 7f4721009640 1 -- start start 2024-04-24T23:38:30.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.173+0000 7f4721009640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f471c0c1080 0x7f471c140b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:30.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.173+0000 7f4721009640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f471c0c32d0 0x7f471c1e8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:30.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.173+0000 7f4721009640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f471c14dea0 0x7f471c1e9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:30.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.173+0000 7f4721009640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f471c0c1760 con 0x7f471c0c32d0 2024-04-24T23:38:30.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.173+0000 7f4721009640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f471c0c15e0 con 0x7f471c0c1080 2024-04-24T23:38:30.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.173+0000 7f4721009640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f471c15d940 con 0x7f471c14dea0 2024-04-24T23:38:30.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.173+0000 7f471a59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f471c0c32d0 0x7f471c1e8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:30.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.173+0000 7f471a59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f471c0c32d0 0x7f471c1e8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38932/0 (socket says 172.21.15.57:38932) 2024-04-24T23:38:30.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.173+0000 7f471a59c640 1 -- 172.21.15.57:0/3857870989 learned_addr learned my addr 172.21.15.57:0/3857870989 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:30.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.173+0000 7f471b59e640 1 --2- 172.21.15.57:0/3857870989 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f471c14dea0 0x7f471c1e9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:30.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.173+0000 7f471ad9d640 1 --2- 172.21.15.57:0/3857870989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f471c0c1080 0x7f471c140b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:30.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.173+0000 7f471a59c640 1 -- 172.21.15.57:0/3857870989 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f471c14dea0 msgr2=0x7f471c1e9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:30.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.173+0000 7f471a59c640 1 --2- 172.21.15.57:0/3857870989 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f471c14dea0 0x7f471c1e9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:30.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.173+0000 7f471a59c640 1 -- 172.21.15.57:0/3857870989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f471c0c1080 msgr2=0x7f471c140b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:30.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.173+0000 7f471a59c640 1 --2- 172.21.15.57:0/3857870989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f471c0c1080 0x7f471c140b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:30.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.173+0000 7f471a59c640 1 -- 172.21.15.57:0/3857870989 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f471c1438c0 con 0x7f471c0c32d0 2024-04-24T23:38:30.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.173+0000 7f471ad9d640 1 --2- 172.21.15.57:0/3857870989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f471c0c1080 0x7f471c140b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:38:30.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.173+0000 7f471a59c640 1 --2- 172.21.15.57:0/3857870989 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f471c0c32d0 0x7f471c1e8e30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f470400d5f0 tx=0x7f470400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:30.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.173+0000 7f47137fe640 1 -- 172.21.15.57:0/3857870989 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47040125f0 con 0x7f471c0c32d0 2024-04-24T23:38:30.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.173+0000 7f47137fe640 1 -- 172.21.15.57:0/3857870989 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4704019070 con 0x7f471c0c32d0 2024-04-24T23:38:30.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.173+0000 7f47137fe640 1 -- 172.21.15.57:0/3857870989 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47040129b0 con 0x7f471c0c32d0 2024-04-24T23:38:30.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.173+0000 7f4721009640 1 -- 172.21.15.57:0/3857870989 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f471c143ba0 con 0x7f471c0c32d0 2024-04-24T23:38:30.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.173+0000 7f4721009640 1 -- 172.21.15.57:0/3857870989 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f471c141060 con 0x7f471c0c32d0 2024-04-24T23:38:30.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.173+0000 7f4721009640 1 -- 172.21.15.57:0/3857870989 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f471c068220 con 0x7f471c0c32d0 2024-04-24T23:38:30.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.177+0000 7f47137fe640 1 -- 172.21.15.57:0/3857870989 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 4) ==== 87389+0+0 (secure 0 0 0) 0x7f4704012b50 con 0x7f471c0c32d0 2024-04-24T23:38:30.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.177+0000 7f47137fe640 1 --2- 172.21.15.57:0/3857870989 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f46fc067830 0x7f46fc069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:30.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.177+0000 7f47137fe640 1 -- 172.21.15.57:0/3857870989 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f4704085c80 con 0x7f471c0c32d0 2024-04-24T23:38:30.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.177+0000 7f471ad9d640 1 --2- 172.21.15.57:0/3857870989 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f46fc067830 0x7f46fc069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:30.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.177+0000 7f471ad9d640 1 --2- 172.21.15.57:0/3857870989 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f46fc067830 0x7f46fc069cf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f470c0af000 tx=0x7f470c0a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:30.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.181+0000 7f47137fe640 1 -- 172.21.15.57:0/3857870989 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f4704011340 con 0x7f471c0c32d0 2024-04-24T23:38:30.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.377+0000 7f4721009640 1 -- 172.21.15.57:0/3857870989 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f471c0c0980 con 0x7f471c0c32d0 2024-04-24T23:38:30.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.377+0000 7f47137fe640 1 -- 172.21.15.57:0/3857870989 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3037 (secure 0 0 0) 0x7f4704056b60 con 0x7f471c0c32d0 2024-04-24T23:38:30.380 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:38:30.380 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2925410225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2925410225},{"type":"v1","addr":"172.21.15.88:6835","nonce":2925410225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4227,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/173597347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":173597347},{"type":"v1","addr":"172.21.15.57:6834","nonce":173597347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/1701414040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":1701414040},{"type":"v1","addr":"172.21.15.57:6835","nonce":1701414040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-24T23:38:30.380 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 3 2024-04-24T23:38:30.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.381+0000 7f4721009640 1 -- 172.21.15.57:0/3857870989 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f46fc067830 msgr2=0x7f46fc069cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:30.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.381+0000 7f4721009640 1 --2- 172.21.15.57:0/3857870989 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f46fc067830 0x7f46fc069cf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f470c0af000 tx=0x7f470c0a7070 comp rx=0 tx=0).stop 2024-04-24T23:38:30.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.381+0000 7f4721009640 1 -- 172.21.15.57:0/3857870989 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f471c0c32d0 msgr2=0x7f471c1e8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:30.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.381+0000 7f4721009640 1 --2- 172.21.15.57:0/3857870989 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f471c0c32d0 0x7f471c1e8e30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f470400d5f0 tx=0x7f470400dab0 comp rx=0 tx=0).stop 2024-04-24T23:38:30.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.381+0000 7f4721009640 1 -- 172.21.15.57:0/3857870989 shutdown_connections 2024-04-24T23:38:30.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.381+0000 7f4721009640 1 --2- 172.21.15.57:0/3857870989 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f46fc067830 0x7f46fc069cf0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:30.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.381+0000 7f4721009640 1 --2- 172.21.15.57:0/3857870989 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f471c14dea0 0x7f471c1e9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:30.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.381+0000 7f4721009640 1 --2- 172.21.15.57:0/3857870989 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f471c0c32d0 0x7f471c1e8e30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:30.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.381+0000 7f4721009640 1 --2- 172.21.15.57:0/3857870989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f471c0c1080 0x7f471c140b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:30.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.381+0000 7f4721009640 1 -- 172.21.15.57:0/3857870989 >> 172.21.15.57:0/3857870989 conn(0x7f471c067350 msgr2=0x7f471c14a120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:30.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.381+0000 7f4721009640 1 -- 172.21.15.57:0/3857870989 shutdown_connections 2024-04-24T23:38:30.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.381+0000 7f4721009640 1 -- 172.21.15.57:0/3857870989 wait complete. 2024-04-24T23:38:30.400 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:38:30.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.513+0000 7f885406a640 1 Processor -- start 2024-04-24T23:38:30.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.513+0000 7f885406a640 1 -- start start 2024-04-24T23:38:30.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.517+0000 7f885406a640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f884c06c480 0x7f884c0c0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:30.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.517+0000 7f885406a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f884c14d320 0x7f884c0a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:30.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.517+0000 7f885406a640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f884c073010 con 0x7f884c072a20 2024-04-24T23:38:30.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.517+0000 7f885406a640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f884c14e610 con 0x7f884c14d320 2024-04-24T23:38:30.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.517+0000 7f885406a640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f884c06faa0 con 0x7f884c06c480 2024-04-24T23:38:30.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.517+0000 7f8851605640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f884c072a20 0x7f884c14cc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46696/0 (socket says 172.21.15.57:46696) 2024-04-24T23:38:30.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.517+0000 7f8851605640 1 -- 172.21.15.57:0/3373385016 learned_addr learned my addr 172.21.15.57:0/3373385016 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:38:30.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.517+0000 7f8852607640 1 --2- 172.21.15.57:0/3373385016 >> v2:172.21.15.57:3300/0 conn(0x7f884c14d320 0x7f884c0a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:30.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.517+0000 7f8851e06640 1 --2- 172.21.15.57:0/3373385016 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f884c06c480 0x7f884c0c0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:30.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.517+0000 7f8850e04640 1 -- 172.21.15.57:0/3373385016 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 55680447 0 0) 0x7f8840001120 con 0x7f884c072a20 2024-04-24T23:38:30.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.517+0000 7f8850e04640 1 -- 172.21.15.57:0/3373385016 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8834003530 con 0x7f884c072a20 2024-04-24T23:38:30.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.517+0000 7f8852607640 1 -- 172.21.15.57:0/3373385016 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f884c06c480 msgr2=0x7f884c0c0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:30.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.517+0000 7f8852607640 1 --2- 172.21.15.57:0/3373385016 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f884c06c480 0x7f884c0c0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:30.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.517+0000 7f8852607640 1 -- 172.21.15.57:0/3373385016 >> v1:172.21.15.57:6789/0 conn(0x7f884c072a20 legacy=0x7f884c14cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:30.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.517+0000 7f8852607640 1 -- 172.21.15.57:0/3373385016 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f884c067630 con 0x7f884c14d320 2024-04-24T23:38:30.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.517+0000 7f8852607640 1 --2- 172.21.15.57:0/3373385016 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f884c14d320 0x7f884c0a1d50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f88440097c0 tx=0x7f884401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f83699a9306df83d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:30.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.517+0000 7f8850e04640 1 -- 172.21.15.57:0/3373385016 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88440b0070 con 0x7f884c14d320 2024-04-24T23:38:30.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.517+0000 7f8850e04640 1 -- 172.21.15.57:0/3373385016 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88440ab600 con 0x7f884c14d320 2024-04-24T23:38:30.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.517+0000 7f8850e04640 1 -- 172.21.15.57:0/3373385016 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88440ab9d0 con 0x7f884c14d320 2024-04-24T23:38:30.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f885406a640 1 -- 172.21.15.57:0/3373385016 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f884c14d320 msgr2=0x7f884c0a1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:30.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f885406a640 1 --2- 172.21.15.57:0/3373385016 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f884c14d320 0x7f884c0a1d50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f88440097c0 tx=0x7f884401c4a0 comp rx=0 tx=0).stop 2024-04-24T23:38:30.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f885406a640 1 -- 172.21.15.57:0/3373385016 shutdown_connections 2024-04-24T23:38:30.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f885406a640 1 --2- 172.21.15.57:0/3373385016 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f884c14d320 0x7f884c0a1d50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:30.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f885406a640 1 --2- 172.21.15.57:0/3373385016 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f884c06c480 0x7f884c0c0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:30.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f885406a640 1 -- 172.21.15.57:0/3373385016 >> 172.21.15.57:0/3373385016 conn(0x7f884c0bf220 msgr2=0x7f884c0bf630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:30.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f885406a640 1 -- 172.21.15.57:0/3373385016 shutdown_connections 2024-04-24T23:38:30.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f885406a640 1 -- 172.21.15.57:0/3373385016 wait complete. 2024-04-24T23:38:30.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f885406a640 1 Processor -- start 2024-04-24T23:38:30.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f885406a640 1 -- start start 2024-04-24T23:38:30.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f885406a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f884c06c480 0x7f884c0a6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:30.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f885406a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f884c072a20 0x7f884c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:30.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f885406a640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f884c14d320 0x7f884c0a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:30.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f885406a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f884c0724b0 con 0x7f884c072a20 2024-04-24T23:38:30.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f885406a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f884c072330 con 0x7f884c06c480 2024-04-24T23:38:30.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f885406a640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f884c072630 con 0x7f884c14d320 2024-04-24T23:38:30.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f8851605640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f884c072a20 0x7f884c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:30.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f8851e06640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f884c06c480 0x7f884c0a6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:30.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f8852607640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f884c14d320 0x7f884c0a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:30.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f8851605640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f884c072a20 0x7f884c0a35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38946/0 (socket says 172.21.15.57:38946) 2024-04-24T23:38:30.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f8851e06640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f884c06c480 0x7f884c0a6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.57:46702/0 (socket says 172.21.15.57:46702) 2024-04-24T23:38:30.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f8851605640 1 -- 172.21.15.57:0/1220839058 learned_addr learned my addr 172.21.15.57:0/1220839058 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:30.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f8851605640 1 -- 172.21.15.57:0/1220839058 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f884c14d320 msgr2=0x7f884c0a3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:30.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f8851605640 1 --2- 172.21.15.57:0/1220839058 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f884c14d320 0x7f884c0a3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:30.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f8851605640 1 -- 172.21.15.57:0/1220839058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f884c06c480 msgr2=0x7f884c0a6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:30.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f8851605640 1 --2- 172.21.15.57:0/1220839058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f884c06c480 0x7f884c0a6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:30.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f8851605640 1 -- 172.21.15.57:0/1220839058 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f884c13de50 con 0x7f884c072a20 2024-04-24T23:38:30.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f8851605640 1 --2- 172.21.15.57:0/1220839058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f884c072a20 0x7f884c0a35e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f884000c730 tx=0x7f884000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:30.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f884a7fc640 1 -- 172.21.15.57:0/1220839058 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8840017070 con 0x7f884c072a20 2024-04-24T23:38:30.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f884a7fc640 1 -- 172.21.15.57:0/1220839058 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8840005ae0 con 0x7f884c072a20 2024-04-24T23:38:30.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f884a7fc640 1 -- 172.21.15.57:0/1220839058 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8840007e30 con 0x7f884c072a20 2024-04-24T23:38:30.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f885406a640 1 -- 172.21.15.57:0/1220839058 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f884c1e5b90 con 0x7f884c072a20 2024-04-24T23:38:30.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.521+0000 7f885406a640 1 -- 172.21.15.57:0/1220839058 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f884c0bcb30 con 0x7f884c072a20 2024-04-24T23:38:30.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.525+0000 7f885406a640 1 -- 172.21.15.57:0/1220839058 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f884c068930 con 0x7f884c072a20 2024-04-24T23:38:30.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.525+0000 7f884a7fc640 1 -- 172.21.15.57:0/1220839058 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 4) ==== 87389+0+0 (secure 0 0 0) 0x7f884001a070 con 0x7f884c072a20 2024-04-24T23:38:30.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.525+0000 7f884a7fc640 1 --2- 172.21.15.57:0/1220839058 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f8838067830 0x7f8838069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:30.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.525+0000 7f884a7fc640 1 -- 172.21.15.57:0/1220839058 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f8840084bb0 con 0x7f884c072a20 2024-04-24T23:38:30.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.525+0000 7f8851e06640 1 --2- 172.21.15.57:0/1220839058 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f8838067830 0x7f8838069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:30.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.525+0000 7f8851e06640 1 --2- 172.21.15.57:0/1220839058 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f8838067830 0x7f8838069cf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f884c146c70 tx=0x7f883c00d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:30.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.529+0000 7f884a7fc640 1 -- 172.21.15.57:0/1220839058 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f884c073010 con 0x7f884c072a20 2024-04-24T23:38:30.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.689+0000 7f885406a640 1 -- 172.21.15.57:0/1220839058 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f884c14dbf0 con 0x7f884c072a20 2024-04-24T23:38:30.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.693+0000 7f884a7fc640 1 -- 172.21.15.57:0/1220839058 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12836 (secure 0 0 0) 0x7f88400554c0 con 0x7f884c072a20 2024-04-24T23:38:30.693 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:38:30.693 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":16,"fsid":"1ea31698-444a-4667-bcd9-b2608ad103c3","created":"2024-04-24T23:38:16.748774+0000","modified":"2024-04-24T23:38:29.973276+0000","last_up_change":"2024-04-24T23:38:26.956537+0000","last_in_change":"2024-04-24T23:38:18.972175+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:38:27.611782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"35ce67bc-9b25-416e-ab1e-774c717631f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6825","nonce":671364028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6827","nonce":671364028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6831","nonce":671364028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6829","nonce":671364028}]},"public_addr":"172.21.15.57:6825/671364028","cluster_addr":"172.21.15.57:6827/671364028","heartbeat_back_addr":"172.21.15.57:6831/671364028","heartbeat_front_addr":"172.21.15.57:6829/671364028","state":["exists","up"]},{"osd":1,"uuid":"38f6f4ef-3bc2-4453-9946-7d1d17e735ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6801","nonce":2653552037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6803","nonce":2653552037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6807","nonce":2653552037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6805","nonce":2653552037}]},"public_addr":"172.21.15.57:6801/2653552037","cluster_addr":"172.21.15.57:6803/2653552037","heartbeat_back_addr":"172.21.15.57:6807/2653552037","heartbeat_front_addr":"172.21.15.57:6805/2653552037","state":["exists","up"]},{"osd":2,"uuid":"d77a0a49-b39a-464e-a1c9-49e19280c440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6816","nonce":1565874109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6819","nonce":1565874109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6823","nonce":1565874109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6821","nonce":1565874109}]},"public_addr":"172.21.15.57:6816/1565874109","cluster_addr":"172.21.15.57:6819/1565874109","heartbeat_back_addr":"172.21.15.57:6823/1565874109","heartbeat_front_addr":"172.21.15.57:6821/1565874109","state":["exists","up"]},{"osd":3,"uuid":"f8ea9bfe-d839-44a6-a185-0f0985da314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6809","nonce":3474703186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6811","nonce":3474703186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6817","nonce":3474703186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6813","nonce":3474703186}]},"public_addr":"172.21.15.57:6809/3474703186","cluster_addr":"172.21.15.57:6811/3474703186","heartbeat_back_addr":"172.21.15.57:6817/3474703186","heartbeat_front_addr":"172.21.15.57:6813/3474703186","state":["exists","up"]},{"osd":4,"uuid":"454647d4-6ac2-46b4-8451-320eb951a87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6801","nonce":1271707713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6803","nonce":1271707713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6807","nonce":1271707713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6805","nonce":1271707713}]},"public_addr":"172.21.15.88:6801/1271707713","cluster_addr":"172.21.15.88:6803/1271707713","heartbeat_back_addr":"172.21.15.88:6807/1271707713","heartbeat_front_addr":"172.21.15.88:6805/1271707713","state":["exists","up"]},{"osd":5,"uuid":"f71c03a3-7ad8-46d3-89c9-d61de102586b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6809","nonce":2035054888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6813","nonce":2035054888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6820","nonce":2035054888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6816","nonce":2035054888}]},"public_addr":"172.21.15.88:6809/2035054888","cluster_addr":"172.21.15.88:6813/2035054888","heartbeat_back_addr":"172.21.15.88:6820/2035054888","heartbeat_front_addr":"172.21.15.88:6816/2035054888","state":["exists","up"]},{"osd":6,"uuid":"ec7ae2b7-9cb4-4059-8f98-0022c9763f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6825","nonce":1752291242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6827","nonce":1752291242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6831","nonce":1752291242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6829","nonce":1752291242}]},"public_addr":"172.21.15.88:6825/1752291242","cluster_addr":"172.21.15.88:6827/1752291242","heartbeat_back_addr":"172.21.15.88:6831/1752291242","heartbeat_front_addr":"172.21.15.88:6829/1752291242","state":["exists","up"]},{"osd":7,"uuid":"c0ee7505-60c1-40ba-9902-47313a04dafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6812","nonce":1782800372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6817","nonce":1782800372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6823","nonce":1782800372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6821","nonce":1782800372}]},"public_addr":"172.21.15.88:6812/1782800372","cluster_addr":"172.21.15.88:6817/1782800372","heartbeat_back_addr":"172.21.15.88:6823/1782800372","heartbeat_front_addr":"172.21.15.88:6821/1782800372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.698562+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.682587+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.680197+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.561753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.011095+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.493320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.353451+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.423877+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:38:30.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.693+0000 7f885406a640 1 -- 172.21.15.57:0/1220839058 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f8838067830 msgr2=0x7f8838069cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:30.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.693+0000 7f885406a640 1 --2- 172.21.15.57:0/1220839058 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f8838067830 0x7f8838069cf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f884c146c70 tx=0x7f883c00d040 comp rx=0 tx=0).stop 2024-04-24T23:38:30.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.693+0000 7f885406a640 1 -- 172.21.15.57:0/1220839058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f884c072a20 msgr2=0x7f884c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:30.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.693+0000 7f885406a640 1 --2- 172.21.15.57:0/1220839058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f884c072a20 0x7f884c0a35e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f884000c730 tx=0x7f884000cbf0 comp rx=0 tx=0).stop 2024-04-24T23:38:30.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.693+0000 7f885406a640 1 -- 172.21.15.57:0/1220839058 shutdown_connections 2024-04-24T23:38:30.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.693+0000 7f885406a640 1 --2- 172.21.15.57:0/1220839058 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f8838067830 0x7f8838069cf0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:30.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.693+0000 7f885406a640 1 --2- 172.21.15.57:0/1220839058 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f884c14d320 0x7f884c0a3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:30.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.693+0000 7f885406a640 1 --2- 172.21.15.57:0/1220839058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f884c072a20 0x7f884c0a35e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:30.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.693+0000 7f885406a640 1 --2- 172.21.15.57:0/1220839058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f884c06c480 0x7f884c0a6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:30.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.693+0000 7f885406a640 1 -- 172.21.15.57:0/1220839058 >> 172.21.15.57:0/1220839058 conn(0x7f884c0bf220 msgr2=0x7f884c0bf600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:30.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.693+0000 7f885406a640 1 -- 172.21.15.57:0/1220839058 shutdown_connections 2024-04-24T23:38:30.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.693+0000 7f885406a640 1 -- 172.21.15.57:0/1220839058 wait complete. 2024-04-24T23:38:30.712 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:38:27.611782+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:38:30.713 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:38:30.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.833+0000 7fd05c1d3640 1 Processor -- start 2024-04-24T23:38:30.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.833+0000 7fd05c1d3640 1 -- start start 2024-04-24T23:38:30.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.833+0000 7fd05c1d3640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd05414aa90 0x7fd0541548a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:30.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.833+0000 7fd05c1d3640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0541509b0 con 0x7fd0540bd0c0 2024-04-24T23:38:30.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.833+0000 7fd05c1d3640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0540bc820 con 0x7fd054150e90 2024-04-24T23:38:30.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.833+0000 7fd05c1d3640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fd054154de0 con 0x7fd05414aa90 2024-04-24T23:38:30.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.833+0000 7fd05976e640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd0540bd0c0 0x7fd05406b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46698/0 (socket says 172.21.15.57:46698) 2024-04-24T23:38:30.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.833+0000 7fd05976e640 1 -- 172.21.15.57:0/3887373800 learned_addr learned my addr 172.21.15.57:0/3887373800 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:38:30.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.833+0000 7fd059f6f640 1 --2- 172.21.15.57:0/3887373800 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd05414aa90 0x7fd0541548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:30.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.833+0000 7fd059f6f640 1 -- 172.21.15.57:0/3887373800 >> v1:172.21.15.88:6789/0 conn(0x7fd054150e90 legacy=0x7fd0541512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:30.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.833+0000 7fd059f6f640 1 -- 172.21.15.57:0/3887373800 >> v1:172.21.15.57:6789/0 conn(0x7fd0540bd0c0 legacy=0x7fd05406b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:30.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.833+0000 7fd059f6f640 1 -- 172.21.15.57:0/3887373800 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0540bcb00 con 0x7fd05414aa90 2024-04-24T23:38:30.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.833+0000 7fd058f6d640 1 -- 172.21.15.57:0/3887373800 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3873501087 0 0) 0x7fd0540bc820 con 0x7fd054150e90 2024-04-24T23:38:30.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.837+0000 7fd059f6f640 1 --2- 172.21.15.57:0/3887373800 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd05414aa90 0x7fd0541548a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd048009dc0 tx=0x7fd04801c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9633287d188410be server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:30.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.837+0000 7fd058f6d640 1 -- 172.21.15.57:0/3887373800 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0480b2070 con 0x7fd05414aa90 2024-04-24T23:38:30.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.837+0000 7fd058f6d640 1 -- 172.21.15.57:0/3887373800 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0480a5a10 con 0x7fd05414aa90 2024-04-24T23:38:30.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.837+0000 7fd058f6d640 1 -- 172.21.15.57:0/3887373800 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0480a5de0 con 0x7fd05414aa90 2024-04-24T23:38:30.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.837+0000 7fd05c1d3640 1 -- 172.21.15.57:0/3887373800 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd05414aa90 msgr2=0x7fd0541548a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:30.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.837+0000 7fd05c1d3640 1 --2- 172.21.15.57:0/3887373800 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd05414aa90 0x7fd0541548a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd048009dc0 tx=0x7fd04801c990 comp rx=0 tx=0).stop 2024-04-24T23:38:30.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.837+0000 7fd05c1d3640 1 -- 172.21.15.57:0/3887373800 shutdown_connections 2024-04-24T23:38:30.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.837+0000 7fd05c1d3640 1 --2- 172.21.15.57:0/3887373800 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd05414aa90 0x7fd0541548a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:30.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.837+0000 7fd05c1d3640 1 -- 172.21.15.57:0/3887373800 >> 172.21.15.57:0/3887373800 conn(0x7fd0540c30c0 msgr2=0x7fd0540c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:30.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.837+0000 7fd05c1d3640 1 -- 172.21.15.57:0/3887373800 shutdown_connections 2024-04-24T23:38:30.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.837+0000 7fd05c1d3640 1 -- 172.21.15.57:0/3887373800 wait complete. 2024-04-24T23:38:30.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.841+0000 7fd05c1d3640 1 Processor -- start 2024-04-24T23:38:30.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.841+0000 7fd05c1d3640 1 -- start start 2024-04-24T23:38:30.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.841+0000 7fd05c1d3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0540bd0c0 0x7fd05414b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:30.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.841+0000 7fd05c1d3640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd05414aa90 0x7fd0540c1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:30.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.841+0000 7fd05c1d3640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd054150e90 0x7fd0541ec590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:30.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.841+0000 7fd05c1d3640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd05415ebd0 con 0x7fd05414aa90 2024-04-24T23:38:30.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.841+0000 7fd05c1d3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd05415ea50 con 0x7fd0540bd0c0 2024-04-24T23:38:30.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.841+0000 7fd05c1d3640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fd05415ed50 con 0x7fd054150e90 2024-04-24T23:38:30.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.841+0000 7fd05976e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd05414aa90 0x7fd0540c1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:30.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.841+0000 7fd05976e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd05414aa90 0x7fd0540c1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38952/0 (socket says 172.21.15.57:38952) 2024-04-24T23:38:30.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.841+0000 7fd05976e640 1 -- 172.21.15.57:0/1185079206 learned_addr learned my addr 172.21.15.57:0/1185079206 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:30.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.841+0000 7fd05a770640 1 --2- 172.21.15.57:0/1185079206 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd054150e90 0x7fd0541ec590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:30.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.841+0000 7fd059f6f640 1 --2- 172.21.15.57:0/1185079206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0540bd0c0 0x7fd05414b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:30.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.841+0000 7fd05976e640 1 -- 172.21.15.57:0/1185079206 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd054150e90 msgr2=0x7fd0541ec590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:30.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.841+0000 7fd05976e640 1 --2- 172.21.15.57:0/1185079206 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd054150e90 0x7fd0541ec590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:30.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.841+0000 7fd05976e640 1 -- 172.21.15.57:0/1185079206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0540bd0c0 msgr2=0x7fd05414b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:30.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.841+0000 7fd05976e640 1 --2- 172.21.15.57:0/1185079206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0540bd0c0 0x7fd05414b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:30.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.841+0000 7fd05976e640 1 -- 172.21.15.57:0/1185079206 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05414b6a0 con 0x7fd05414aa90 2024-04-24T23:38:30.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.841+0000 7fd05976e640 1 --2- 172.21.15.57:0/1185079206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd05414aa90 0x7fd0540c1e20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd05000c450 tx=0x7fd05000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:30.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.849+0000 7fd0467fc640 1 -- 172.21.15.57:0/1185079206 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd050017070 con 0x7fd05414aa90 2024-04-24T23:38:30.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.849+0000 7fd0467fc640 1 -- 172.21.15.57:0/1185079206 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd050005cf0 con 0x7fd05414aa90 2024-04-24T23:38:30.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.849+0000 7fd05c1d3640 1 -- 172.21.15.57:0/1185079206 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd05414e1f0 con 0x7fd05414aa90 2024-04-24T23:38:30.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.849+0000 7fd0467fc640 1 -- 172.21.15.57:0/1185079206 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd050007290 con 0x7fd05414aa90 2024-04-24T23:38:30.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.849+0000 7fd05c1d3640 1 -- 172.21.15.57:0/1185079206 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0540c2b30 con 0x7fd05414aa90 2024-04-24T23:38:30.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.849+0000 7fd05c1d3640 1 -- 172.21.15.57:0/1185079206 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd054068930 con 0x7fd05414aa90 2024-04-24T23:38:30.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.849+0000 7fd0467fc640 1 -- 172.21.15.57:0/1185079206 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 4) ==== 87389+0+0 (secure 0 0 0) 0x7fd05001a070 con 0x7fd05414aa90 2024-04-24T23:38:30.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.849+0000 7fd0467fc640 1 --2- 172.21.15.57:0/1185079206 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd0380678b0 0x7fd038069d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:30.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.849+0000 7fd0467fc640 1 -- 172.21.15.57:0/1185079206 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fd050084a70 con 0x7fd05414aa90 2024-04-24T23:38:30.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.849+0000 7fd059f6f640 1 --2- 172.21.15.57:0/1185079206 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd0380678b0 0x7fd038069d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:30.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.853+0000 7fd059f6f640 1 --2- 172.21.15.57:0/1185079206 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd0380678b0 0x7fd038069d70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd0480af000 tx=0x7fd0480a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:30.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:30.857+0000 7fd0467fc640 1 -- 172.21.15.57:0/1185079206 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fd05414b6a0 con 0x7fd05414aa90 2024-04-24T23:38:31.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.025+0000 7fd05c1d3640 1 -- 172.21.15.57:0/1185079206 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd0540a8650 con 0x7fd05414aa90 2024-04-24T23:38:31.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.025+0000 7fd0467fc640 1 -- 172.21.15.57:0/1185079206 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7fd050055400 con 0x7fd05414aa90 2024-04-24T23:38:31.026 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-04-24T23:38:31.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.025+0000 7fd05c1d3640 1 -- 172.21.15.57:0/1185079206 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd0380678b0 msgr2=0x7fd038069d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:31.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.025+0000 7fd05c1d3640 1 --2- 172.21.15.57:0/1185079206 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd0380678b0 0x7fd038069d70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd0480af000 tx=0x7fd0480a7070 comp rx=0 tx=0).stop 2024-04-24T23:38:31.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.025+0000 7fd05c1d3640 1 -- 172.21.15.57:0/1185079206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd05414aa90 msgr2=0x7fd0540c1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:31.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.025+0000 7fd05c1d3640 1 --2- 172.21.15.57:0/1185079206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd05414aa90 0x7fd0540c1e20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd05000c450 tx=0x7fd05000c910 comp rx=0 tx=0).stop 2024-04-24T23:38:31.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.025+0000 7fd05c1d3640 1 -- 172.21.15.57:0/1185079206 shutdown_connections 2024-04-24T23:38:31.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.025+0000 7fd05c1d3640 1 --2- 172.21.15.57:0/1185079206 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd0380678b0 0x7fd038069d70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:31.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.025+0000 7fd05c1d3640 1 --2- 172.21.15.57:0/1185079206 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd054150e90 0x7fd0541ec590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:31.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.025+0000 7fd05c1d3640 1 --2- 172.21.15.57:0/1185079206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd05414aa90 0x7fd0540c1e20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:31.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.025+0000 7fd05c1d3640 1 --2- 172.21.15.57:0/1185079206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0540bd0c0 0x7fd05414b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:31.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.029+0000 7fd05c1d3640 1 -- 172.21.15.57:0/1185079206 >> 172.21.15.57:0/1185079206 conn(0x7fd0540c30c0 msgr2=0x7fd0541512a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:31.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.029+0000 7fd05c1d3640 1 -- 172.21.15.57:0/1185079206 shutdown_connections 2024-04-24T23:38:31.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.029+0000 7fd05c1d3640 1 -- 172.21.15.57:0/1185079206 wait complete. 2024-04-24T23:38:31.047 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-24T23:38:31.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.169+0000 7f420c9f9640 1 Processor -- start 2024-04-24T23:38:31.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.169+0000 7f420c9f9640 1 -- start start 2024-04-24T23:38:31.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.169+0000 7f420c9f9640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f420806b470 0x7f42080a67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:31.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.169+0000 7f420c9f9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f42080be4d0 0x7f420814ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:31.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.169+0000 7f420c9f9640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42080be260 con 0x7f420814bf40 2024-04-24T23:38:31.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.169+0000 7f420c9f9640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f420814c390 con 0x7f420806b470 2024-04-24T23:38:31.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.169+0000 7f420c9f9640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f42080a6ce0 con 0x7f42080be4d0 2024-04-24T23:38:31.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.169+0000 7f420659c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f420806b470 0x7f42080a67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:31.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.169+0000 7f4206d9d640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f420814bf40 0x7f420814ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46710/0 (socket says 172.21.15.57:46710) 2024-04-24T23:38:31.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.169+0000 7f4206d9d640 1 -- 172.21.15.57:0/3627254270 learned_addr learned my addr 172.21.15.57:0/3627254270 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:38:31.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.169+0000 7f41fffff640 1 --2- 172.21.15.57:0/3627254270 >> v2:172.21.15.88:3300/0 conn(0x7f42080be4d0 0x7f420814ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:31.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.169+0000 7f4205d9b640 1 -- 172.21.15.57:0/3627254270 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1292820334 0 0) 0x7f42080be260 con 0x7f420814bf40 2024-04-24T23:38:31.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.169+0000 7f4205d9b640 1 -- 172.21.15.57:0/3627254270 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41f4003530 con 0x7f420814bf40 2024-04-24T23:38:31.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.169+0000 7f420659c640 1 -- 172.21.15.57:0/3627254270 >> v2:172.21.15.88:3300/0 conn(0x7f42080be4d0 msgr2=0x7f420814ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:31.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.169+0000 7f420659c640 1 --2- 172.21.15.57:0/3627254270 >> v2:172.21.15.88:3300/0 conn(0x7f42080be4d0 0x7f420814ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:31.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.169+0000 7f420659c640 1 -- 172.21.15.57:0/3627254270 >> v1:172.21.15.57:6789/0 conn(0x7f420814bf40 legacy=0x7f420814ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:31.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.169+0000 7f420659c640 1 -- 172.21.15.57:0/3627254270 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42080bdca0 con 0x7f420806b470 2024-04-24T23:38:31.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.169+0000 7f41fffff640 1 --2- 172.21.15.57:0/3627254270 >> v2:172.21.15.88:3300/0 conn(0x7f42080be4d0 0x7f420814ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:38:31.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f420659c640 1 --2- 172.21.15.57:0/3627254270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f420806b470 0x7f42080a67a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f420806d400 tx=0x7f41f801f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7a05355ff6394 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:31.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f4205d9b640 1 -- 172.21.15.57:0/3627254270 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f80b4070 con 0x7f420806b470 2024-04-24T23:38:31.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f4205d9b640 1 -- 172.21.15.57:0/3627254270 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41f80af600 con 0x7f420806b470 2024-04-24T23:38:31.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f4205d9b640 1 -- 172.21.15.57:0/3627254270 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f80af9d0 con 0x7f420806b470 2024-04-24T23:38:31.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f420c9f9640 1 -- 172.21.15.57:0/3627254270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f420806b470 msgr2=0x7f42080a67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:31.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f420c9f9640 1 --2- 172.21.15.57:0/3627254270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f420806b470 0x7f42080a67a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f420806d400 tx=0x7f41f801f110 comp rx=0 tx=0).stop 2024-04-24T23:38:31.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f420c9f9640 1 -- 172.21.15.57:0/3627254270 shutdown_connections 2024-04-24T23:38:31.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f420c9f9640 1 --2- 172.21.15.57:0/3627254270 >> v2:172.21.15.88:3300/0 conn(0x7f42080be4d0 0x7f420814ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:31.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f420c9f9640 1 --2- 172.21.15.57:0/3627254270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f420806b470 0x7f42080a67a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:31.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f420c9f9640 1 -- 172.21.15.57:0/3627254270 >> 172.21.15.57:0/3627254270 conn(0x7f42080c3050 msgr2=0x7f42080c3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:31.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f420c9f9640 1 -- 172.21.15.57:0/3627254270 shutdown_connections 2024-04-24T23:38:31.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f420c9f9640 1 -- 172.21.15.57:0/3627254270 wait complete. 2024-04-24T23:38:31.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f420c9f9640 1 Processor -- start 2024-04-24T23:38:31.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f420c9f9640 1 -- start start 2024-04-24T23:38:31.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f420c9f9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f420806b470 0x7f42080a4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:31.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f420c9f9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42080be4d0 0x7f4208146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:31.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f420c9f9640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f420814bf40 0x7f420809a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:31.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f420c9f9640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f420806b9d0 con 0x7f420806b470 2024-04-24T23:38:31.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f420c9f9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f420806b850 con 0x7f42080be4d0 2024-04-24T23:38:31.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f420c9f9640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f420814f160 con 0x7f420814bf40 2024-04-24T23:38:31.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f420659c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f420806b470 0x7f42080a4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:31.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f420659c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f420806b470 0x7f42080a4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38960/0 (socket says 172.21.15.57:38960) 2024-04-24T23:38:31.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f420659c640 1 -- 172.21.15.57:0/1692615550 learned_addr learned my addr 172.21.15.57:0/1692615550 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:31.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f41fffff640 1 --2- 172.21.15.57:0/1692615550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42080be4d0 0x7f4208146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:31.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f420659c640 1 -- 172.21.15.57:0/1692615550 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f420814bf40 msgr2=0x7f420809a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:31.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f420659c640 1 --2- 172.21.15.57:0/1692615550 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f420814bf40 0x7f420809a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:31.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f420659c640 1 -- 172.21.15.57:0/1692615550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42080be4d0 msgr2=0x7f4208146f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:31.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f420659c640 1 --2- 172.21.15.57:0/1692615550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42080be4d0 0x7f4208146f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:31.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f420659c640 1 -- 172.21.15.57:0/1692615550 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f420809a930 con 0x7f420806b470 2024-04-24T23:38:31.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f41fffff640 1 --2- 172.21.15.57:0/1692615550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42080be4d0 0x7f4208146f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:38:31.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f420659c640 1 --2- 172.21.15.57:0/1692615550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f420806b470 0x7f42080a4fc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f41f801cd40 tx=0x7f41f801beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:31.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f41feffd640 1 -- 172.21.15.57:0/1692615550 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f80b4040 con 0x7f420806b470 2024-04-24T23:38:31.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f41feffd640 1 -- 172.21.15.57:0/1692615550 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41f80c1070 con 0x7f420806b470 2024-04-24T23:38:31.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f41feffd640 1 -- 172.21.15.57:0/1692615550 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f8009450 con 0x7f420806b470 2024-04-24T23:38:31.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f420c9f9640 1 -- 172.21.15.57:0/1692615550 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42080bd040 con 0x7f420806b470 2024-04-24T23:38:31.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.173+0000 7f420c9f9640 1 -- 172.21.15.57:0/1692615550 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42080bc720 con 0x7f420806b470 2024-04-24T23:38:31.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.177+0000 7f420c9f9640 1 -- 172.21.15.57:0/1692615550 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42080bce30 con 0x7f420806b470 2024-04-24T23:38:31.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.177+0000 7f41feffd640 1 -- 172.21.15.57:0/1692615550 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 4) ==== 87389+0+0 (secure 0 0 0) 0x7f41f80ba690 con 0x7f420806b470 2024-04-24T23:38:31.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.177+0000 7f41feffd640 1 --2- 172.21.15.57:0/1692615550 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f41e8067860 0x7f41e8069d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:31.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.177+0000 7f41feffd640 1 -- 172.21.15.57:0/1692615550 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f41f81240e0 con 0x7f420806b470 2024-04-24T23:38:31.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.177+0000 7f41fffff640 1 --2- 172.21.15.57:0/1692615550 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f41e8067860 0x7f41e8069d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:31.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.177+0000 7f41fffff640 1 --2- 172.21.15.57:0/1692615550 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f41e8067860 0x7f41e8069d20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f42080a7e60 tx=0x7f41f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:31.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.181+0000 7f41feffd640 1 -- 172.21.15.57:0/1692615550 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f41f8018c70 con 0x7f420806b470 2024-04-24T23:38:31.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.345+0000 7f420c9f9640 1 -- 172.21.15.57:0/1692615550 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f4208068930 con 0x7f420806b470 2024-04-24T23:38:31.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.345+0000 7f41feffd640 1 -- 172.21.15.57:0/1692615550 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f41f80f51a0 con 0x7f420806b470 2024-04-24T23:38:31.348 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:38:31.349 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2024-04-24T23:38:31.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-24T23:38:31.349 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2024-04-24T23:38:31.349 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": ".mgr" 2024-04-24T23:38:31.349 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-24T23:38:31.349 INFO:teuthology.orchestra.run.smithi057.stdout:] 2024-04-24T23:38:31.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.349+0000 7f420c9f9640 1 -- 172.21.15.57:0/1692615550 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f41e8067860 msgr2=0x7f41e8069d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:31.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.349+0000 7f420c9f9640 1 --2- 172.21.15.57:0/1692615550 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f41e8067860 0x7f41e8069d20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f42080a7e60 tx=0x7f41f0008040 comp rx=0 tx=0).stop 2024-04-24T23:38:31.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.349+0000 7f420c9f9640 1 -- 172.21.15.57:0/1692615550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f420806b470 msgr2=0x7f42080a4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:31.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.349+0000 7f420c9f9640 1 --2- 172.21.15.57:0/1692615550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f420806b470 0x7f42080a4fc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f41f801cd40 tx=0x7f41f801beb0 comp rx=0 tx=0).stop 2024-04-24T23:38:31.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.349+0000 7f420c9f9640 1 -- 172.21.15.57:0/1692615550 shutdown_connections 2024-04-24T23:38:31.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.349+0000 7f420c9f9640 1 --2- 172.21.15.57:0/1692615550 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f41e8067860 0x7f41e8069d20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:31.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.349+0000 7f420c9f9640 1 --2- 172.21.15.57:0/1692615550 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f420814bf40 0x7f420809a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:31.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.349+0000 7f420c9f9640 1 --2- 172.21.15.57:0/1692615550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42080be4d0 0x7f4208146f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:31.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.349+0000 7f420c9f9640 1 --2- 172.21.15.57:0/1692615550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f420806b470 0x7f42080a4fc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:31.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.349+0000 7f420c9f9640 1 -- 172.21.15.57:0/1692615550 >> 172.21.15.57:0/1692615550 conn(0x7f42080c3050 msgr2=0x7f4208148ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:31.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.349+0000 7f420c9f9640 1 -- 172.21.15.57:0/1692615550 shutdown_connections 2024-04-24T23:38:31.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.349+0000 7f420c9f9640 1 -- 172.21.15.57:0/1692615550 wait complete. 2024-04-24T23:38:31.368 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-24T23:38:31.369 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-24T23:38:31.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.497+0000 7f27e0dd7640 1 Processor -- start 2024-04-24T23:38:31.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.497+0000 7f27e0dd7640 1 -- start start 2024-04-24T23:38:31.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27e0dd7640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f27dc06d6d0 0x7f27dc0bb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:31.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27e0dd7640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27dc072150 con 0x7f27dc0bba20 2024-04-24T23:38:31.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27e0dd7640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27dc06eb70 con 0x7f27dc06e000 2024-04-24T23:38:31.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27e0dd7640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f27dc06e920 con 0x7f27dc06d6d0 2024-04-24T23:38:31.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27dad9d640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f27dc0bba20 0x7f27dc0728e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46724/0 (socket says 172.21.15.57:46724) 2024-04-24T23:38:31.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27dad9d640 1 -- 172.21.15.57:0/1532410357 learned_addr learned my addr 172.21.15.57:0/1532410357 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:38:31.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27d959a640 1 -- 172.21.15.57:0/1532410357 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1286725485 0 0) 0x7f27dc072150 con 0x7f27dc0bba20 2024-04-24T23:38:31.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27d959a640 1 -- 172.21.15.57:0/1532410357 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27c8003530 con 0x7f27dc0bba20 2024-04-24T23:38:31.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27d9d9b640 1 --2- 172.21.15.57:0/1532410357 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f27dc06d6d0 0x7f27dc0bb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:31.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27d959a640 1 -- 172.21.15.57:0/1532410357 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1815108153 0 0) 0x7f27c8003530 con 0x7f27dc0bba20 2024-04-24T23:38:31.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27d959a640 1 -- 172.21.15.57:0/1532410357 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f27dc06d6d0 msgr2=0x7f27dc0bb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:31.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27d959a640 1 --2- 172.21.15.57:0/1532410357 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f27dc06d6d0 0x7f27dc0bb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:31.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27d959a640 1 -- 172.21.15.57:0/1532410357 >> v1:172.21.15.88:6789/0 conn(0x7f27dc06e000 legacy=0x7f27dc1513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:31.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27d959a640 1 -- 172.21.15.57:0/1532410357 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27dc06ee50 con 0x7f27dc0bba20 2024-04-24T23:38:31.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27d959a640 1 -- 172.21.15.57:0/1532410357 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7f27cc0016a0 con 0x7f27dc0bba20 2024-04-24T23:38:31.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27d959a640 1 -- 172.21.15.57:0/1532410357 >> v1:172.21.15.57:6789/0 conn(0x7f27dc0bba20 legacy=0x7f27dc0728e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:31.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27d959a640 1 --2- 172.21.15.57:0/1532410357 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f27dc06d6d0 0x7f27c80039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:31.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27d959a640 1 --2- 172.21.15.57:0/1532410357 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27c8004020 0x7f27c8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:31.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27d959a640 1 --2- 172.21.15.57:0/1532410357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27c8004d50 0x7f27c80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:31.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27d959a640 1 -- 172.21.15.57:0/1532410357 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f27dc06e920 con 0x7f27c8004020 2024-04-24T23:38:31.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27d959a640 1 -- 172.21.15.57:0/1532410357 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f27c800bb90 con 0x7f27c8004d50 2024-04-24T23:38:31.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27d959a640 1 -- 172.21.15.57:0/1532410357 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f27c800bd90 con 0x7f27dc06d6d0 2024-04-24T23:38:31.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27d9d9b640 1 --2- 172.21.15.57:0/1532410357 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27c8004020 0x7f27c8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:31.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27da59c640 1 --2- 172.21.15.57:0/1532410357 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f27dc06d6d0 0x7f27c80039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:31.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27dad9d640 1 --2- 172.21.15.57:0/1532410357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27c8004d50 0x7f27c80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:31.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27d9d9b640 1 -- 172.21.15.57:0/1532410357 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f27dc06d6d0 msgr2=0x7f27c80039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:31.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27d9d9b640 1 --2- 172.21.15.57:0/1532410357 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f27dc06d6d0 0x7f27c80039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:31.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27d9d9b640 1 -- 172.21.15.57:0/1532410357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27c8004d50 msgr2=0x7f27c80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:31.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27d9d9b640 1 --2- 172.21.15.57:0/1532410357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27c8004d50 0x7f27c80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:31.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27d9d9b640 1 -- 172.21.15.57:0/1532410357 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c8003530 con 0x7f27c8004020 2024-04-24T23:38:31.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27da59c640 1 --2- 172.21.15.57:0/1532410357 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f27dc06d6d0 0x7f27c80039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:38:31.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.501+0000 7f27dad9d640 1 --2- 172.21.15.57:0/1532410357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27c8004d50 0x7f27c80051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:38:31.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.505+0000 7f27d9d9b640 1 --2- 172.21.15.57:0/1532410357 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27c8004020 0x7f27c8004810 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f27c400ba00 tx=0x7f27c401c660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84344a36f94f015 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:31.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.505+0000 7f27d959a640 1 -- 172.21.15.57:0/1532410357 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c400b600 con 0x7f27c8004020 2024-04-24T23:38:31.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.505+0000 7f27d959a640 1 -- 172.21.15.57:0/1532410357 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27c40b0070 con 0x7f27c8004020 2024-04-24T23:38:31.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.505+0000 7f27d959a640 1 -- 172.21.15.57:0/1532410357 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c40ab8b0 con 0x7f27c8004020 2024-04-24T23:38:31.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.505+0000 7f27e0dd7640 1 -- 172.21.15.57:0/1532410357 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27c8004020 msgr2=0x7f27c8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:31.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.505+0000 7f27e0dd7640 1 --2- 172.21.15.57:0/1532410357 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27c8004020 0x7f27c8004810 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f27c400ba00 tx=0x7f27c401c660 comp rx=0 tx=0).stop 2024-04-24T23:38:31.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.505+0000 7f27dad9d640 1 -- 172.21.15.57:0/1532410357 reap_dead start 2024-04-24T23:38:31.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.505+0000 7f27e0dd7640 1 -- 172.21.15.57:0/1532410357 shutdown_connections 2024-04-24T23:38:31.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.505+0000 7f27e0dd7640 1 -- 172.21.15.57:0/1532410357 >> 172.21.15.57:0/1532410357 conn(0x7f27dc06b920 msgr2=0x7f27dc0c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:31.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.505+0000 7f27e0dd7640 1 -- 172.21.15.57:0/1532410357 shutdown_connections 2024-04-24T23:38:31.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.505+0000 7f27e0dd7640 1 -- 172.21.15.57:0/1532410357 wait complete. 2024-04-24T23:38:31.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.505+0000 7f27e0dd7640 1 Processor -- start 2024-04-24T23:38:31.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.505+0000 7f27e0dd7640 1 -- start start 2024-04-24T23:38:31.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.505+0000 7f27e0dd7640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f27c8004020 0x7f27dc145310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:31.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.505+0000 7f27e0dd7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27dc152300 0x7f27dc0c0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:31.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.505+0000 7f27e0dd7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27dc0c1040 0x7f27dc144180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:31.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.505+0000 7f27e0dd7640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f27dc072ff0 con 0x7f27dc152300 2024-04-24T23:38:31.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.505+0000 7f27e0dd7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f27dc072450 con 0x7f27dc0c1040 2024-04-24T23:38:31.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.505+0000 7f27e0dd7640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f27dc073170 con 0x7f27c8004020 2024-04-24T23:38:31.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.505+0000 7f27d9d9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27dc152300 0x7f27dc0c0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:31.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.505+0000 7f27d9d9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27dc152300 0x7f27dc0c0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38978/0 (socket says 172.21.15.57:38978) 2024-04-24T23:38:31.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.505+0000 7f27d9d9b640 1 -- 172.21.15.57:0/529899411 learned_addr learned my addr 172.21.15.57:0/529899411 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:31.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.509+0000 7f27dad9d640 1 --2- 172.21.15.57:0/529899411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27dc0c1040 0x7f27dc144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:31.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.509+0000 7f27da59c640 1 --2- 172.21.15.57:0/529899411 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f27c8004020 0x7f27dc145310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:31.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.509+0000 7f27d9d9b640 1 -- 172.21.15.57:0/529899411 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f27c8004020 msgr2=0x7f27dc145310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:31.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.509+0000 7f27d9d9b640 1 --2- 172.21.15.57:0/529899411 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f27c8004020 0x7f27dc145310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:31.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.509+0000 7f27d9d9b640 1 -- 172.21.15.57:0/529899411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27dc0c1040 msgr2=0x7f27dc144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:31.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.509+0000 7f27d9d9b640 1 --2- 172.21.15.57:0/529899411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27dc0c1040 0x7f27dc144180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:31.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.509+0000 7f27d9d9b640 1 -- 172.21.15.57:0/529899411 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27dc14ef20 con 0x7f27dc152300 2024-04-24T23:38:31.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.509+0000 7f27d9d9b640 1 --2- 172.21.15.57:0/529899411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27dc152300 0x7f27dc0c0b00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f27c401c490 tx=0x7f27c8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:31.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.509+0000 7f27d2ffd640 1 -- 172.21.15.57:0/529899411 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c40ba070 con 0x7f27dc152300 2024-04-24T23:38:31.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.509+0000 7f27d2ffd640 1 -- 172.21.15.57:0/529899411 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27c40abcb0 con 0x7f27dc152300 2024-04-24T23:38:31.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.509+0000 7f27d2ffd640 1 -- 172.21.15.57:0/529899411 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c40abe60 con 0x7f27dc152300 2024-04-24T23:38:31.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.509+0000 7f27e0dd7640 1 -- 172.21.15.57:0/529899411 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27dc146b90 con 0x7f27dc152300 2024-04-24T23:38:31.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.509+0000 7f27e0dd7640 1 -- 172.21.15.57:0/529899411 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27dc1546a0 con 0x7f27dc152300 2024-04-24T23:38:31.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.509+0000 7f27e0dd7640 1 -- 172.21.15.57:0/529899411 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27dc068290 con 0x7f27dc152300 2024-04-24T23:38:31.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.509+0000 7f27d2ffd640 1 -- 172.21.15.57:0/529899411 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 4) ==== 87389+0+0 (secure 0 0 0) 0x7f27c4004240 con 0x7f27dc152300 2024-04-24T23:38:31.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.509+0000 7f27d2ffd640 1 --2- 172.21.15.57:0/529899411 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f27bc067860 0x7f27bc069d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:31.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.509+0000 7f27d2ffd640 1 -- 172.21.15.57:0/529899411 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f27c4120350 con 0x7f27dc152300 2024-04-24T23:38:31.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.509+0000 7f27da59c640 1 --2- 172.21.15.57:0/529899411 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f27bc067860 0x7f27bc069d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:31.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.509+0000 7f27da59c640 1 --2- 172.21.15.57:0/529899411 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f27bc067860 0x7f27bc069d20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f27d4000f90 tx=0x7f27d4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:31.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.513+0000 7f27d2ffd640 1 -- 172.21.15.57:0/529899411 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f27c4016370 con 0x7f27dc152300 2024-04-24T23:38:31.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:31.673+0000 7f27e0dd7640 1 -- 172.21.15.57:0/529899411 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f27dc0bc720 con 0x7f27dc152300 2024-04-24T23:38:32.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.081+0000 7f27d2ffd640 1 -- 172.21.15.57:0/529899411 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f27c40f1350 con 0x7f27dc152300 2024-04-24T23:38:32.083 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2024-04-24T23:38:32.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.085+0000 7f27e0dd7640 1 -- 172.21.15.57:0/529899411 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f27bc067860 msgr2=0x7f27bc069d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:32.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.085+0000 7f27e0dd7640 1 --2- 172.21.15.57:0/529899411 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f27bc067860 0x7f27bc069d20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f27d4000f90 tx=0x7f27d4009040 comp rx=0 tx=0).stop 2024-04-24T23:38:32.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.085+0000 7f27e0dd7640 1 -- 172.21.15.57:0/529899411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27dc152300 msgr2=0x7f27dc0c0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:32.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.085+0000 7f27e0dd7640 1 --2- 172.21.15.57:0/529899411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27dc152300 0x7f27dc0c0b00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f27c401c490 tx=0x7f27c8005840 comp rx=0 tx=0).stop 2024-04-24T23:38:32.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.085+0000 7f27e0dd7640 1 -- 172.21.15.57:0/529899411 shutdown_connections 2024-04-24T23:38:32.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.085+0000 7f27e0dd7640 1 --2- 172.21.15.57:0/529899411 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f27bc067860 0x7f27bc069d20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:32.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.085+0000 7f27e0dd7640 1 --2- 172.21.15.57:0/529899411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27dc0c1040 0x7f27dc144180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:32.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.085+0000 7f27e0dd7640 1 --2- 172.21.15.57:0/529899411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27dc152300 0x7f27dc0c0b00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:32.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.085+0000 7f27e0dd7640 1 --2- 172.21.15.57:0/529899411 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f27c8004020 0x7f27dc145310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:32.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.085+0000 7f27e0dd7640 1 -- 172.21.15.57:0/529899411 >> 172.21.15.57:0/529899411 conn(0x7f27dc06b920 msgr2=0x7f27dc1513b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:32.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.085+0000 7f27e0dd7640 1 -- 172.21.15.57:0/529899411 shutdown_connections 2024-04-24T23:38:32.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.085+0000 7f27e0dd7640 1 -- 172.21.15.57:0/529899411 wait complete. 2024-04-24T23:38:32.117 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-24T23:38:32.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.249+0000 7f92c2b4e640 1 Processor -- start 2024-04-24T23:38:32.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.249+0000 7f92c2b4e640 1 -- start start 2024-04-24T23:38:32.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.249+0000 7f92c2b4e640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f92bc152330 0x7f92bc159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:32.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.249+0000 7f92c2b4e640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92bc0bd200 con 0x7f92bc14bc60 2024-04-24T23:38:32.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.249+0000 7f92c2b4e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92bc0be070 con 0x7f92bc0bd5f0 2024-04-24T23:38:32.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.249+0000 7f92c2b4e640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f92bc0bde20 con 0x7f92bc152330 2024-04-24T23:38:32.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.249+0000 7f92c10eb640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f92bc152330 0x7f92bc159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:32.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.249+0000 7f92c10eb640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f92bc152330 0x7f92bc159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38992/0 (socket says 172.21.15.57:38992) 2024-04-24T23:38:32.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.249+0000 7f92c10eb640 1 -- 172.21.15.57:0/1756734026 learned_addr learned my addr 172.21.15.57:0/1756734026 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:32.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.249+0000 7f92c08ea640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f92bc14bc60 0x7f92bc0c27c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46726/0 (socket says 172.21.15.57:46726) 2024-04-24T23:38:32.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.249+0000 7f92c10eb640 1 -- 172.21.15.57:0/1756734026 >> v1:172.21.15.88:6789/0 conn(0x7f92bc0bd5f0 legacy=0x7f92bc151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:32.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.249+0000 7f92c10eb640 1 -- 172.21.15.57:0/1756734026 >> v1:172.21.15.57:6789/0 conn(0x7f92bc14bc60 legacy=0x7f92bc0c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:32.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.249+0000 7f92c10eb640 1 -- 172.21.15.57:0/1756734026 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92bc0be350 con 0x7f92bc152330 2024-04-24T23:38:32.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.253+0000 7f92c10eb640 1 --2- 172.21.15.57:0/1756734026 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92bc152330 0x7f92bc159fa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f92b4009e50 tx=0x7f92b401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f3faafe9d19caa server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:32.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.253+0000 7f92bb7fe640 1 -- 172.21.15.57:0/1756734026 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b40a5610 con 0x7f92bc152330 2024-04-24T23:38:32.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.253+0000 7f92bb7fe640 1 -- 172.21.15.57:0/1756734026 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92b40a57b0 con 0x7f92bc152330 2024-04-24T23:38:32.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.253+0000 7f92bb7fe640 1 -- 172.21.15.57:0/1756734026 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b40a5b80 con 0x7f92bc152330 2024-04-24T23:38:32.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.253+0000 7f92c2b4e640 1 -- 172.21.15.57:0/1756734026 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92bc152330 msgr2=0x7f92bc159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:32.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.253+0000 7f92c2b4e640 1 --2- 172.21.15.57:0/1756734026 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92bc152330 0x7f92bc159fa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f92b4009e50 tx=0x7f92b401c8d0 comp rx=0 tx=0).stop 2024-04-24T23:38:32.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.253+0000 7f92c2b4e640 1 -- 172.21.15.57:0/1756734026 shutdown_connections 2024-04-24T23:38:32.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.253+0000 7f92c2b4e640 1 --2- 172.21.15.57:0/1756734026 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92bc152330 0x7f92bc159fa0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:32.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.253+0000 7f92c2b4e640 1 -- 172.21.15.57:0/1756734026 >> 172.21.15.57:0/1756734026 conn(0x7f92bc06b920 msgr2=0x7f92bc0c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:32.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.253+0000 7f92c2b4e640 1 -- 172.21.15.57:0/1756734026 shutdown_connections 2024-04-24T23:38:32.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.253+0000 7f92c2b4e640 1 -- 172.21.15.57:0/1756734026 wait complete. 2024-04-24T23:38:32.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.253+0000 7f92c2b4e640 1 Processor -- start 2024-04-24T23:38:32.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.253+0000 7f92c2b4e640 1 -- start start 2024-04-24T23:38:32.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.253+0000 7f92c2b4e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92bc0bd5f0 0x7f92bc1ed480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:32.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.253+0000 7f92c2b4e640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92bc14bc60 0x7f92bc0720e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:32.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.253+0000 7f92c2b4e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92bc152330 0x7f92bc0bb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:32.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.253+0000 7f92c2b4e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f92bc0bcfe0 con 0x7f92bc152330 2024-04-24T23:38:32.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.253+0000 7f92c2b4e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f92bc0bce60 con 0x7f92bc0bd5f0 2024-04-24T23:38:32.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.253+0000 7f92c2b4e640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f92bc15cd00 con 0x7f92bc14bc60 2024-04-24T23:38:32.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.253+0000 7f92c10eb640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92bc152330 0x7f92bc0bb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:32.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.257+0000 7f92c10eb640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92bc152330 0x7f92bc0bb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39000/0 (socket says 172.21.15.57:39000) 2024-04-24T23:38:32.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.257+0000 7f92c10eb640 1 -- 172.21.15.57:0/2513961738 learned_addr learned my addr 172.21.15.57:0/2513961738 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:32.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.257+0000 7f92c08ea640 1 --2- 172.21.15.57:0/2513961738 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92bc0bd5f0 0x7f92bc1ed480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:32.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.257+0000 7f92bbfff640 1 --2- 172.21.15.57:0/2513961738 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92bc14bc60 0x7f92bc0720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:32.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.257+0000 7f92c10eb640 1 -- 172.21.15.57:0/2513961738 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92bc14bc60 msgr2=0x7f92bc0720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:32.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.257+0000 7f92c10eb640 1 --2- 172.21.15.57:0/2513961738 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92bc14bc60 0x7f92bc0720e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:32.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.257+0000 7f92c10eb640 1 -- 172.21.15.57:0/2513961738 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92bc0bd5f0 msgr2=0x7f92bc1ed480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:32.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.257+0000 7f92c10eb640 1 --2- 172.21.15.57:0/2513961738 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92bc0bd5f0 0x7f92bc1ed480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:32.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.257+0000 7f92c10eb640 1 -- 172.21.15.57:0/2513961738 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92bc1ea2d0 con 0x7f92bc152330 2024-04-24T23:38:32.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.257+0000 7f92c08ea640 1 --2- 172.21.15.57:0/2513961738 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92bc0bd5f0 0x7f92bc1ed480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:38:32.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.257+0000 7f92c10eb640 1 --2- 172.21.15.57:0/2513961738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92bc152330 0x7f92bc0bb510 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f92b40194e0 tx=0x7f92b4019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:32.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.257+0000 7f92b97fa640 1 -- 172.21.15.57:0/2513961738 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b40bc030 con 0x7f92bc152330 2024-04-24T23:38:32.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.257+0000 7f92b97fa640 1 -- 172.21.15.57:0/2513961738 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92b40b8470 con 0x7f92bc152330 2024-04-24T23:38:32.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.257+0000 7f92b97fa640 1 -- 172.21.15.57:0/2513961738 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b40b8860 con 0x7f92bc152330 2024-04-24T23:38:32.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.257+0000 7f92c2b4e640 1 -- 172.21.15.57:0/2513961738 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92bc1e96a0 con 0x7f92bc152330 2024-04-24T23:38:32.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.257+0000 7f92c2b4e640 1 -- 172.21.15.57:0/2513961738 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92bc1ecc80 con 0x7f92bc152330 2024-04-24T23:38:32.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.257+0000 7f92c2b4e640 1 -- 172.21.15.57:0/2513961738 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92bc068290 con 0x7f92bc152330 2024-04-24T23:38:32.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.257+0000 7f92b97fa640 1 -- 172.21.15.57:0/2513961738 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f92b40bf070 con 0x7f92bc152330 2024-04-24T23:38:32.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.257+0000 7f92b97fa640 1 --2- 172.21.15.57:0/2513961738 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f929c0678c0 0x7f929c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:32.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.257+0000 7f92b97fa640 1 -- 172.21.15.57:0/2513961738 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f92b4120580 con 0x7f92bc152330 2024-04-24T23:38:32.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.257+0000 7f92c08ea640 1 --2- 172.21.15.57:0/2513961738 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f929c0678c0 0x7f929c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:32.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.257+0000 7f92c08ea640 1 --2- 172.21.15.57:0/2513961738 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f929c0678c0 0x7f929c069d80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f92a4007fd0 tx=0x7f92a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:32.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.261+0000 7f92b97fa640 1 -- 172.21.15.57:0/2513961738 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f92bc1ea2d0 con 0x7f92bc152330 2024-04-24T23:38:32.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:32.425+0000 7f92c2b4e640 1 -- 172.21.15.57:0/2513961738 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f92bc06ef70 con 0x7f92bc152330 2024-04-24T23:38:33.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.085+0000 7f92b97fa640 1 -- 172.21.15.57:0/2513961738 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7f92b40165e0 con 0x7f92bc152330 2024-04-24T23:38:33.088 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2024-04-24T23:38:33.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.089+0000 7f92c2b4e640 1 -- 172.21.15.57:0/2513961738 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f929c0678c0 msgr2=0x7f929c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:33.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.089+0000 7f92c2b4e640 1 --2- 172.21.15.57:0/2513961738 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f929c0678c0 0x7f929c069d80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f92a4007fd0 tx=0x7f92a4009040 comp rx=0 tx=0).stop 2024-04-24T23:38:33.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.089+0000 7f92c2b4e640 1 -- 172.21.15.57:0/2513961738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92bc152330 msgr2=0x7f92bc0bb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:33.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.089+0000 7f92c2b4e640 1 --2- 172.21.15.57:0/2513961738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92bc152330 0x7f92bc0bb510 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f92b40194e0 tx=0x7f92b4019670 comp rx=0 tx=0).stop 2024-04-24T23:38:33.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.089+0000 7f92c2b4e640 1 -- 172.21.15.57:0/2513961738 shutdown_connections 2024-04-24T23:38:33.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.089+0000 7f92c2b4e640 1 --2- 172.21.15.57:0/2513961738 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f929c0678c0 0x7f929c069d80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:33.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.089+0000 7f92c2b4e640 1 --2- 172.21.15.57:0/2513961738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92bc152330 0x7f92bc0bb510 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:33.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.089+0000 7f92c2b4e640 1 --2- 172.21.15.57:0/2513961738 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92bc14bc60 0x7f92bc0720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:33.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.089+0000 7f92c2b4e640 1 --2- 172.21.15.57:0/2513961738 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92bc0bd5f0 0x7f92bc1ed480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:33.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.089+0000 7f92c2b4e640 1 -- 172.21.15.57:0/2513961738 >> 172.21.15.57:0/2513961738 conn(0x7f92bc06b920 msgr2=0x7f92bc14d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:33.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.089+0000 7f92c2b4e640 1 -- 172.21.15.57:0/2513961738 shutdown_connections 2024-04-24T23:38:33.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.089+0000 7f92c2b4e640 1 -- 172.21.15.57:0/2513961738 wait complete. 2024-04-24T23:38:33.121 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-24T23:38:33.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.241+0000 7f6a39441640 1 Processor -- start 2024-04-24T23:38:33.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.241+0000 7f6a39441640 1 -- start start 2024-04-24T23:38:33.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.245+0000 7f6a39441640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6a3414a320 0x7f6a34150d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:33.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.245+0000 7f6a39441640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6a340bc330 0x7f6a3414d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:33.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.245+0000 7f6a39441640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a340722c0 con 0x7f6a3406d6d0 2024-04-24T23:38:33.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.245+0000 7f6a39441640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f6a340725a0 con 0x7f6a340bc330 2024-04-24T23:38:33.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.245+0000 7f6a39441640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f6a3414cfa0 con 0x7f6a3414a320 2024-04-24T23:38:33.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.245+0000 7f6a337fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6a340bc330 0x7f6a3414d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:33.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.245+0000 7f6a337fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6a340bc330 0x7f6a3414d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39004/0 (socket says 172.21.15.57:39004) 2024-04-24T23:38:33.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.245+0000 7f6a337fe640 1 -- 172.21.15.57:0/2587894922 learned_addr learned my addr 172.21.15.57:0/2587894922 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:33.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.245+0000 7f6a32ffd640 1 --2- 172.21.15.57:0/2587894922 >> v2:172.21.15.88:3300/0 conn(0x7f6a3414a320 0x7f6a34150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:33.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.245+0000 7f6a337fe640 1 -- 172.21.15.57:0/2587894922 >> v2:172.21.15.88:3300/0 conn(0x7f6a3414a320 msgr2=0x7f6a34150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:33.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.245+0000 7f6a337fe640 1 --2- 172.21.15.57:0/2587894922 >> v2:172.21.15.88:3300/0 conn(0x7f6a3414a320 0x7f6a34150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:33.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.245+0000 7f6a337fe640 1 -- 172.21.15.57:0/2587894922 >> v1:172.21.15.88:6789/0 conn(0x7f6a3406d6d0 legacy=0x7f6a340bd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:33.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.245+0000 7f6a337fe640 1 -- 172.21.15.57:0/2587894922 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a340be020 con 0x7f6a340bc330 2024-04-24T23:38:33.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.245+0000 7f6a337fe640 1 --2- 172.21.15.57:0/2587894922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a340bc330 0x7f6a3414d4c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6a3406f120 tx=0x7f6a2c01f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb8e5b3c0fdf088 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:33.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a31ffb640 1 -- 172.21.15.57:0/2587894922 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c0b4070 con 0x7f6a340bc330 2024-04-24T23:38:33.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a31ffb640 1 -- 172.21.15.57:0/2587894922 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a2c0af400 con 0x7f6a340bc330 2024-04-24T23:38:33.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a31ffb640 1 -- 172.21.15.57:0/2587894922 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c0af7d0 con 0x7f6a340bc330 2024-04-24T23:38:33.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a39441640 1 -- 172.21.15.57:0/2587894922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a340bc330 msgr2=0x7f6a3414d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:33.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a39441640 1 --2- 172.21.15.57:0/2587894922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a340bc330 0x7f6a3414d4c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6a3406f120 tx=0x7f6a2c01f1a0 comp rx=0 tx=0).stop 2024-04-24T23:38:33.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a39441640 1 -- 172.21.15.57:0/2587894922 shutdown_connections 2024-04-24T23:38:33.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a39441640 1 --2- 172.21.15.57:0/2587894922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a340bc330 0x7f6a3414d4c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:33.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a39441640 1 --2- 172.21.15.57:0/2587894922 >> v2:172.21.15.88:3300/0 conn(0x7f6a3414a320 0x7f6a34150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:33.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a39441640 1 -- 172.21.15.57:0/2587894922 >> 172.21.15.57:0/2587894922 conn(0x7f6a3406b920 msgr2=0x7f6a340c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:33.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a39441640 1 -- 172.21.15.57:0/2587894922 shutdown_connections 2024-04-24T23:38:33.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a39441640 1 -- 172.21.15.57:0/2587894922 wait complete. 2024-04-24T23:38:33.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a39441640 1 Processor -- start 2024-04-24T23:38:33.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a39441640 1 -- start start 2024-04-24T23:38:33.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a39441640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a3406d6d0 0x7f6a340c0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:33.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a39441640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a340bc330 0x7f6a34144b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a39441640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6a3414a320 0x7f6a341450d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a39441640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3414db80 con 0x7f6a340bc330 2024-04-24T23:38:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a39441640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3414da00 con 0x7f6a3406d6d0 2024-04-24T23:38:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a39441640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f6a3414dd00 con 0x7f6a3414a320 2024-04-24T23:38:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a327fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a340bc330 0x7f6a34144b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a327fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a340bc330 0x7f6a34144b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39018/0 (socket says 172.21.15.57:39018) 2024-04-24T23:38:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a327fc640 1 -- 172.21.15.57:0/2170291110 learned_addr learned my addr 172.21.15.57:0/2170291110 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a32ffd640 1 --2- 172.21.15.57:0/2170291110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a3406d6d0 0x7f6a340c0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a337fe640 1 --2- 172.21.15.57:0/2170291110 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6a3414a320 0x7f6a341450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a327fc640 1 -- 172.21.15.57:0/2170291110 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6a3414a320 msgr2=0x7f6a341450d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a327fc640 1 --2- 172.21.15.57:0/2170291110 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6a3414a320 0x7f6a341450d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a327fc640 1 -- 172.21.15.57:0/2170291110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a3406d6d0 msgr2=0x7f6a340c0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a327fc640 1 --2- 172.21.15.57:0/2170291110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a3406d6d0 0x7f6a340c0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:33.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a327fc640 1 -- 172.21.15.57:0/2170291110 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a340c08a0 con 0x7f6a340bc330 2024-04-24T23:38:33.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a327fc640 1 --2- 172.21.15.57:0/2170291110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a340bc330 0x7f6a34144b90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6a2800c440 tx=0x7f6a2800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:33.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a1b7fe640 1 -- 172.21.15.57:0/2170291110 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a28016020 con 0x7f6a340bc330 2024-04-24T23:38:33.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a1b7fe640 1 -- 172.21.15.57:0/2170291110 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a28012830 con 0x7f6a340bc330 2024-04-24T23:38:33.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a1b7fe640 1 -- 172.21.15.57:0/2170291110 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a28012c20 con 0x7f6a340bc330 2024-04-24T23:38:33.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a39441640 1 -- 172.21.15.57:0/2170291110 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a340b8700 con 0x7f6a340bc330 2024-04-24T23:38:33.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.249+0000 7f6a39441640 1 -- 172.21.15.57:0/2170291110 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a34145b70 con 0x7f6a340bc330 2024-04-24T23:38:33.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.253+0000 7f6a39441640 1 -- 172.21.15.57:0/2170291110 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a34068290 con 0x7f6a340bc330 2024-04-24T23:38:33.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.253+0000 7f6a1b7fe640 1 -- 172.21.15.57:0/2170291110 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6a28019020 con 0x7f6a340bc330 2024-04-24T23:38:33.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.253+0000 7f6a1b7fe640 1 --2- 172.21.15.57:0/2170291110 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6a200678f0 0x7f6a20069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:33.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.253+0000 7f6a1b7fe640 1 -- 172.21.15.57:0/2170291110 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f6a28085e50 con 0x7f6a340bc330 2024-04-24T23:38:33.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.253+0000 7f6a32ffd640 1 --2- 172.21.15.57:0/2170291110 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6a200678f0 0x7f6a20069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:33.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.253+0000 7f6a32ffd640 1 --2- 172.21.15.57:0/2170291110 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6a200678f0 0x7f6a20069db0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6a2400b930 tx=0x7f6a24008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:33.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.257+0000 7f6a1b7fe640 1 -- 172.21.15.57:0/2170291110 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f6a28020030 con 0x7f6a340bc330 2024-04-24T23:38:33.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:33.445+0000 7f6a39441640 1 -- 172.21.15.57:0/2170291110 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f6a340be8b0 con 0x7f6a340bc330 2024-04-24T23:38:34.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.153+0000 7f6a1b7fe640 1 -- 172.21.15.57:0/2170291110 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f6a340c08a0 con 0x7f6a340bc330 2024-04-24T23:38:34.160 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 2 and data pool 3 2024-04-24T23:38:34.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.165+0000 7f6a39441640 1 -- 172.21.15.57:0/2170291110 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6a200678f0 msgr2=0x7f6a20069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:34.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.165+0000 7f6a39441640 1 --2- 172.21.15.57:0/2170291110 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6a200678f0 0x7f6a20069db0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6a2400b930 tx=0x7f6a24008040 comp rx=0 tx=0).stop 2024-04-24T23:38:34.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.165+0000 7f6a39441640 1 -- 172.21.15.57:0/2170291110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a340bc330 msgr2=0x7f6a34144b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:34.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.165+0000 7f6a39441640 1 --2- 172.21.15.57:0/2170291110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a340bc330 0x7f6a34144b90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6a2800c440 tx=0x7f6a2800c900 comp rx=0 tx=0).stop 2024-04-24T23:38:34.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.165+0000 7f6a39441640 1 -- 172.21.15.57:0/2170291110 shutdown_connections 2024-04-24T23:38:34.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.165+0000 7f6a39441640 1 --2- 172.21.15.57:0/2170291110 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6a200678f0 0x7f6a20069db0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:34.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.165+0000 7f6a39441640 1 --2- 172.21.15.57:0/2170291110 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6a3414a320 0x7f6a341450d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:34.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.165+0000 7f6a39441640 1 --2- 172.21.15.57:0/2170291110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a340bc330 0x7f6a34144b90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:34.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.165+0000 7f6a39441640 1 --2- 172.21.15.57:0/2170291110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a3406d6d0 0x7f6a340c0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:34.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.165+0000 7f6a39441640 1 -- 172.21.15.57:0/2170291110 >> 172.21.15.57:0/2170291110 conn(0x7f6a3406b920 msgr2=0x7f6a340bead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:34.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.165+0000 7f6a39441640 1 -- 172.21.15.57:0/2170291110 shutdown_connections 2024-04-24T23:38:34.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.165+0000 7f6a39441640 1 -- 172.21.15.57:0/2170291110 wait complete. 2024-04-24T23:38:34.195 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-24T23:38:34.195 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-24T23:38:34.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.317+0000 7f6bd669b640 1 Processor -- start 2024-04-24T23:38:34.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.317+0000 7f6bd669b640 1 -- start start 2024-04-24T23:38:34.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.317+0000 7f6bd669b640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6bd014bc60 0x7f6bd00c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:34.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.317+0000 7f6bd669b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6bd00c2d00 0x7f6bd0151c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:34.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.317+0000 7f6bd669b640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bd00bd200 con 0x7f6bd00bd5f0 2024-04-24T23:38:34.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.317+0000 7f6bd669b640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f6bd00bde20 con 0x7f6bd00c2d00 2024-04-24T23:38:34.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.317+0000 7f6bd669b640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f6bd00be070 con 0x7f6bd014bc60 2024-04-24T23:38:34.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.317+0000 7f6bcf7fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6bd00c2d00 0x7f6bd0151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:34.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.317+0000 7f6bd4c38640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6bd00bd5f0 0x7f6bd006d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46738/0 (socket says 172.21.15.57:46738) 2024-04-24T23:38:34.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.317+0000 7f6bd4c38640 1 -- 172.21.15.57:0/2582632205 learned_addr learned my addr 172.21.15.57:0/2582632205 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:38:34.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.317+0000 7f6bcffff640 1 --2- 172.21.15.57:0/2582632205 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6bd014bc60 0x7f6bd00c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:34.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.317+0000 7f6bcf7fe640 1 -- 172.21.15.57:0/2582632205 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6bd014bc60 msgr2=0x7f6bd00c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:34.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.317+0000 7f6bcf7fe640 1 --2- 172.21.15.57:0/2582632205 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6bd014bc60 0x7f6bd00c27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:34.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.317+0000 7f6bcf7fe640 1 -- 172.21.15.57:0/2582632205 >> v1:172.21.15.57:6789/0 conn(0x7f6bd00bd5f0 legacy=0x7f6bd006d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:34.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.317+0000 7f6bcf7fe640 1 -- 172.21.15.57:0/2582632205 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd00be350 con 0x7f6bd00c2d00 2024-04-24T23:38:34.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.317+0000 7f6bcffff640 1 --2- 172.21.15.57:0/2582632205 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6bd014bc60 0x7f6bd00c27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:38:34.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.321+0000 7f6bcf7fe640 1 --2- 172.21.15.57:0/2582632205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bd00c2d00 0x7f6bd0151c20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40097c0 tx=0x7f6bc401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f431bb26092bad1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:34.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.321+0000 7f6bceffd640 1 -- 172.21.15.57:0/2582632205 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc40b0070 con 0x7f6bd00c2d00 2024-04-24T23:38:34.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.321+0000 7f6bceffd640 1 -- 172.21.15.57:0/2582632205 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bc40ab600 con 0x7f6bd00c2d00 2024-04-24T23:38:34.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.321+0000 7f6bceffd640 1 -- 172.21.15.57:0/2582632205 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc40a4e60 con 0x7f6bd00c2d00 2024-04-24T23:38:34.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.321+0000 7f6bd669b640 1 -- 172.21.15.57:0/2582632205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bd00c2d00 msgr2=0x7f6bd0151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:34.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.321+0000 7f6bd669b640 1 --2- 172.21.15.57:0/2582632205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bd00c2d00 0x7f6bd0151c20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40097c0 tx=0x7f6bc401c380 comp rx=0 tx=0).stop 2024-04-24T23:38:34.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.321+0000 7f6bd669b640 1 -- 172.21.15.57:0/2582632205 shutdown_connections 2024-04-24T23:38:34.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.321+0000 7f6bd669b640 1 --2- 172.21.15.57:0/2582632205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bd00c2d00 0x7f6bd0151c20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:34.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.321+0000 7f6bd669b640 1 --2- 172.21.15.57:0/2582632205 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6bd014bc60 0x7f6bd00c27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:34.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.321+0000 7f6bd669b640 1 -- 172.21.15.57:0/2582632205 >> 172.21.15.57:0/2582632205 conn(0x7f6bd006b920 msgr2=0x7f6bd00c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:34.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.321+0000 7f6bd669b640 1 -- 172.21.15.57:0/2582632205 shutdown_connections 2024-04-24T23:38:34.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.321+0000 7f6bd669b640 1 -- 172.21.15.57:0/2582632205 wait complete. 2024-04-24T23:38:34.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.325+0000 7f6bd669b640 1 Processor -- start 2024-04-24T23:38:34.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.325+0000 7f6bd669b640 1 -- start start 2024-04-24T23:38:34.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.325+0000 7f6bd669b640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6bd00bd5f0 0x7f6bd00bb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:34.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.325+0000 7f6bd669b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bd00c2d00 0x7f6bd01e9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:34.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.325+0000 7f6bd669b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bd014bc60 0x7f6bd00710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:34.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.325+0000 7f6bd669b640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd00bcfe0 con 0x7f6bd014bc60 2024-04-24T23:38:34.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.325+0000 7f6bd669b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd00bce60 con 0x7f6bd00c2d00 2024-04-24T23:38:34.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.325+0000 7f6bd669b640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f6bd015bfb0 con 0x7f6bd00bd5f0 2024-04-24T23:38:34.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.325+0000 7f6bd4c38640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bd014bc60 0x7f6bd00710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:34.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.325+0000 7f6bd4c38640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bd014bc60 0x7f6bd00710f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39048/0 (socket says 172.21.15.57:39048) 2024-04-24T23:38:34.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.325+0000 7f6bd4c38640 1 -- 172.21.15.57:0/2894534843 learned_addr learned my addr 172.21.15.57:0/2894534843 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:34.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.325+0000 7f6bcffff640 1 --2- 172.21.15.57:0/2894534843 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6bd00bd5f0 0x7f6bd00bb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:34.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.325+0000 7f6bcf7fe640 1 --2- 172.21.15.57:0/2894534843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bd00c2d00 0x7f6bd01e9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:34.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.325+0000 7f6bd4c38640 1 -- 172.21.15.57:0/2894534843 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6bd00bd5f0 msgr2=0x7f6bd00bb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:34.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.325+0000 7f6bd4c38640 1 --2- 172.21.15.57:0/2894534843 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6bd00bd5f0 0x7f6bd00bb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:34.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.325+0000 7f6bd4c38640 1 -- 172.21.15.57:0/2894534843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bd00c2d00 msgr2=0x7f6bd01e9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:34.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.325+0000 7f6bd4c38640 1 --2- 172.21.15.57:0/2894534843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bd00c2d00 0x7f6bd01e9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:34.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.325+0000 7f6bd4c38640 1 -- 172.21.15.57:0/2894534843 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd00bbc80 con 0x7f6bd014bc60 2024-04-24T23:38:34.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.325+0000 7f6bcffff640 1 --2- 172.21.15.57:0/2894534843 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6bd00bd5f0 0x7f6bd00bb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:38:34.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.325+0000 7f6bd4c38640 1 --2- 172.21.15.57:0/2894534843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bd014bc60 0x7f6bd00710f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800caf0 tx=0x7f6bc800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:34.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.325+0000 7f6bccff9640 1 -- 172.21.15.57:0/2894534843 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8017070 con 0x7f6bd014bc60 2024-04-24T23:38:34.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.325+0000 7f6bccff9640 1 -- 172.21.15.57:0/2894534843 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bc800aca0 con 0x7f6bd014bc60 2024-04-24T23:38:34.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.325+0000 7f6bd669b640 1 -- 172.21.15.57:0/2894534843 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bd0071a90 con 0x7f6bd014bc60 2024-04-24T23:38:34.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.325+0000 7f6bccff9640 1 -- 172.21.15.57:0/2894534843 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8012600 con 0x7f6bd014bc60 2024-04-24T23:38:34.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.325+0000 7f6bd669b640 1 -- 172.21.15.57:0/2894534843 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bd00722d0 con 0x7f6bd014bc60 2024-04-24T23:38:34.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.325+0000 7f6bd669b640 1 -- 172.21.15.57:0/2894534843 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bd0068290 con 0x7f6bd014bc60 2024-04-24T23:38:34.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.329+0000 7f6bccff9640 1 -- 172.21.15.57:0/2894534843 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6bc801a070 con 0x7f6bd014bc60 2024-04-24T23:38:34.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.329+0000 7f6bccff9640 1 --2- 172.21.15.57:0/2894534843 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6bbc0678f0 0x7f6bbc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:34.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.329+0000 7f6bccff9640 1 -- 172.21.15.57:0/2894534843 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f6bc8085900 con 0x7f6bd014bc60 2024-04-24T23:38:34.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.329+0000 7f6bcffff640 1 --2- 172.21.15.57:0/2894534843 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6bbc0678f0 0x7f6bbc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:34.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.329+0000 7f6bcffff640 1 --2- 172.21.15.57:0/2894534843 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6bbc0678f0 0x7f6bbc069db0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6bc000a9b0 tx=0x7f6bc0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:34.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.333+0000 7f6bccff9640 1 -- 172.21.15.57:0/2894534843 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f6bd00bbc80 con 0x7f6bd014bc60 2024-04-24T23:38:34.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:34.505+0000 7f6bd669b640 1 -- 172.21.15.57:0/2894534843 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f6bd006ef70 con 0x7f6bd014bc60 2024-04-24T23:38:35.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.161+0000 7f6bccff9640 1 -- 172.21.15.57:0/2894534843 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7f6bc8055df0 con 0x7f6bd014bc60 2024-04-24T23:38:35.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.165+0000 7f6bd669b640 1 -- 172.21.15.57:0/2894534843 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6bbc0678f0 msgr2=0x7f6bbc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:35.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.165+0000 7f6bd669b640 1 --2- 172.21.15.57:0/2894534843 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6bbc0678f0 0x7f6bbc069db0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6bc000a9b0 tx=0x7f6bc0008040 comp rx=0 tx=0).stop 2024-04-24T23:38:35.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.165+0000 7f6bd669b640 1 -- 172.21.15.57:0/2894534843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bd014bc60 msgr2=0x7f6bd00710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:35.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.165+0000 7f6bd669b640 1 --2- 172.21.15.57:0/2894534843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bd014bc60 0x7f6bd00710f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800caf0 tx=0x7f6bc800a060 comp rx=0 tx=0).stop 2024-04-24T23:38:35.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.165+0000 7f6bd669b640 1 -- 172.21.15.57:0/2894534843 shutdown_connections 2024-04-24T23:38:35.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.165+0000 7f6bd669b640 1 --2- 172.21.15.57:0/2894534843 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6bbc0678f0 0x7f6bbc069db0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:35.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.165+0000 7f6bd669b640 1 --2- 172.21.15.57:0/2894534843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bd014bc60 0x7f6bd00710f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:35.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.165+0000 7f6bd669b640 1 --2- 172.21.15.57:0/2894534843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bd00c2d00 0x7f6bd01e9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:35.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.165+0000 7f6bd669b640 1 --2- 172.21.15.57:0/2894534843 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6bd00bd5f0 0x7f6bd00bb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:35.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.165+0000 7f6bd669b640 1 -- 172.21.15.57:0/2894534843 >> 172.21.15.57:0/2894534843 conn(0x7f6bd006b920 msgr2=0x7f6bd006d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:35.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.165+0000 7f6bd669b640 1 -- 172.21.15.57:0/2894534843 shutdown_connections 2024-04-24T23:38:35.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.165+0000 7f6bd669b640 1 -- 172.21.15.57:0/2894534843 wait complete. 2024-04-24T23:38:35.189 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-24T23:38:35.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.321+0000 7ff38e5b9640 1 Processor -- start 2024-04-24T23:38:35.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.321+0000 7ff38e5b9640 1 -- start start 2024-04-24T23:38:35.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.321+0000 7ff38e5b9640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff38814de60 0x7ff388154a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:35.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.321+0000 7ff38e5b9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff3880bc6e0 0x7ff38806b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:35.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.321+0000 7ff38e5b9640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff38806fb20 con 0x7ff388151390 2024-04-24T23:38:35.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.321+0000 7ff38e5b9640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7ff3881545b0 con 0x7ff3880bc6e0 2024-04-24T23:38:35.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.321+0000 7ff38e5b9640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7ff388151820 con 0x7ff38814de60 2024-04-24T23:38:35.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.321+0000 7ff387fff640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff38814de60 0x7ff388154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:35.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.321+0000 7ff38cb56640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff3880bc6e0 0x7ff38806b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:35.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.321+0000 7ff38cb56640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff3880bc6e0 0x7ff38806b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.57:46788/0 (socket says 172.21.15.57:46788) 2024-04-24T23:38:35.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.321+0000 7ff37ffff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff388151390 0x7ff38806f410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.57:53368/0 (socket says 172.21.15.57:53368) 2024-04-24T23:38:35.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.321+0000 7ff38cb56640 1 -- 172.21.15.57:0/2969509611 learned_addr learned my addr 172.21.15.57:0/2969509611 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:35.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.321+0000 7ff387fff640 1 -- 172.21.15.57:0/2969509611 >> v2:172.21.15.88:3300/0 conn(0x7ff3880bc6e0 msgr2=0x7ff38806b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:35.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.321+0000 7ff387fff640 1 --2- 172.21.15.57:0/2969509611 >> v2:172.21.15.88:3300/0 conn(0x7ff3880bc6e0 0x7ff38806b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:35.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.321+0000 7ff387fff640 1 -- 172.21.15.57:0/2969509611 >> v1:172.21.15.88:6789/0 conn(0x7ff388151390 legacy=0x7ff38806f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:35.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.321+0000 7ff387fff640 1 -- 172.21.15.57:0/2969509611 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff388153f60 con 0x7ff38814de60 2024-04-24T23:38:35.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.321+0000 7ff38cb56640 1 --2- 172.21.15.57:0/2969509611 >> v2:172.21.15.88:3300/0 conn(0x7ff3880bc6e0 0x7ff38806b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:38:35.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.325+0000 7ff387fff640 1 --2- 172.21.15.57:0/2969509611 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff38814de60 0x7ff388154a40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff3780097c0 tx=0x7ff37801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32bdcacf49a585d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:35.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.325+0000 7ff3877fe640 1 -- 172.21.15.57:0/2969509611 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3780ab600 con 0x7ff38814de60 2024-04-24T23:38:35.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.325+0000 7ff3877fe640 1 -- 172.21.15.57:0/2969509611 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3780b0070 con 0x7ff38814de60 2024-04-24T23:38:35.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.325+0000 7ff3877fe640 1 -- 172.21.15.57:0/2969509611 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3780ab9c0 con 0x7ff38814de60 2024-04-24T23:38:35.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.325+0000 7ff38e5b9640 1 -- 172.21.15.57:0/2969509611 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff38814de60 msgr2=0x7ff388154a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:35.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.325+0000 7ff38e5b9640 1 --2- 172.21.15.57:0/2969509611 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff38814de60 0x7ff388154a40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff3780097c0 tx=0x7ff37801c3e0 comp rx=0 tx=0).stop 2024-04-24T23:38:35.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.325+0000 7ff38e5b9640 1 -- 172.21.15.57:0/2969509611 shutdown_connections 2024-04-24T23:38:35.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.325+0000 7ff38e5b9640 1 --2- 172.21.15.57:0/2969509611 >> v2:172.21.15.88:3300/0 conn(0x7ff3880bc6e0 0x7ff38806b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:35.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.325+0000 7ff38e5b9640 1 --2- 172.21.15.57:0/2969509611 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff38814de60 0x7ff388154a40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:35.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.325+0000 7ff38e5b9640 1 -- 172.21.15.57:0/2969509611 >> 172.21.15.57:0/2969509611 conn(0x7ff3880bfa50 msgr2=0x7ff3880bfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:35.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.325+0000 7ff38e5b9640 1 -- 172.21.15.57:0/2969509611 shutdown_connections 2024-04-24T23:38:35.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.325+0000 7ff38e5b9640 1 -- 172.21.15.57:0/2969509611 wait complete. 2024-04-24T23:38:35.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.325+0000 7ff38e5b9640 1 Processor -- start 2024-04-24T23:38:35.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.325+0000 7ff38e5b9640 1 -- start start 2024-04-24T23:38:35.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.329+0000 7ff38e5b9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3880bc6e0 0x7ff3881ecba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:35.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.329+0000 7ff38e5b9640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff38814de60 0x7ff388155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:35.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.329+0000 7ff38e5b9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3881503d0 0x7ff388156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:35.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.329+0000 7ff38e5b9640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff388139ab0 con 0x7ff3881503d0 2024-04-24T23:38:35.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.329+0000 7ff38e5b9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff388139c30 con 0x7ff3880bc6e0 2024-04-24T23:38:35.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.329+0000 7ff38e5b9640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7ff388139db0 con 0x7ff38814de60 2024-04-24T23:38:35.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.329+0000 7ff38cb56640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3881503d0 0x7ff388156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:35.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.329+0000 7ff38cb56640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3881503d0 0x7ff388156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39056/0 (socket says 172.21.15.57:39056) 2024-04-24T23:38:35.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.329+0000 7ff38cb56640 1 -- 172.21.15.57:0/3870685249 learned_addr learned my addr 172.21.15.57:0/3870685249 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:35.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.329+0000 7ff387fff640 1 --2- 172.21.15.57:0/3870685249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3880bc6e0 0x7ff3881ecba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:35.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.329+0000 7ff37ffff640 1 --2- 172.21.15.57:0/3870685249 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff38814de60 0x7ff388155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:35.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.329+0000 7ff38cb56640 1 -- 172.21.15.57:0/3870685249 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff38814de60 msgr2=0x7ff388155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:35.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.329+0000 7ff38cb56640 1 --2- 172.21.15.57:0/3870685249 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff38814de60 0x7ff388155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:35.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.329+0000 7ff38cb56640 1 -- 172.21.15.57:0/3870685249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3880bc6e0 msgr2=0x7ff3881ecba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:35.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.329+0000 7ff38cb56640 1 --2- 172.21.15.57:0/3870685249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3880bc6e0 0x7ff3881ecba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:35.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.329+0000 7ff38cb56640 1 -- 172.21.15.57:0/3870685249 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff388133eb0 con 0x7ff3881503d0 2024-04-24T23:38:35.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.329+0000 7ff38cb56640 1 --2- 172.21.15.57:0/3870685249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3881503d0 0x7ff388156170 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff38000efc0 tx=0x7ff38000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:35.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.329+0000 7ff3857fa640 1 -- 172.21.15.57:0/3870685249 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38000cbe0 con 0x7ff3881503d0 2024-04-24T23:38:35.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.329+0000 7ff3857fa640 1 -- 172.21.15.57:0/3870685249 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff38000cd80 con 0x7ff3881503d0 2024-04-24T23:38:35.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.329+0000 7ff3857fa640 1 -- 172.21.15.57:0/3870685249 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff380003bc0 con 0x7ff3881503d0 2024-04-24T23:38:35.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.329+0000 7ff38e5b9640 1 -- 172.21.15.57:0/3870685249 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff38814fa20 con 0x7ff3881503d0 2024-04-24T23:38:35.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.329+0000 7ff38e5b9640 1 -- 172.21.15.57:0/3870685249 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3881ed0e0 con 0x7ff3881503d0 2024-04-24T23:38:35.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.329+0000 7ff38e5b9640 1 -- 172.21.15.57:0/3870685249 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff388068220 con 0x7ff3881503d0 2024-04-24T23:38:35.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.329+0000 7ff3857fa640 1 -- 172.21.15.57:0/3870685249 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff38001b030 con 0x7ff3881503d0 2024-04-24T23:38:35.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.329+0000 7ff3857fa640 1 --2- 172.21.15.57:0/3870685249 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ff3680678c0 0x7ff368069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:35.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.329+0000 7ff3857fa640 1 -- 172.21.15.57:0/3870685249 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7ff3800861d0 con 0x7ff3881503d0 2024-04-24T23:38:35.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.329+0000 7ff387fff640 1 --2- 172.21.15.57:0/3870685249 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ff3680678c0 0x7ff368069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:35.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.333+0000 7ff387fff640 1 --2- 172.21.15.57:0/3870685249 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ff3680678c0 0x7ff368069d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff3780af000 tx=0x7ff3780a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:35.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.337+0000 7ff3857fa640 1 -- 172.21.15.57:0/3870685249 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7ff380022020 con 0x7ff3881503d0 2024-04-24T23:38:35.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:35.497+0000 7ff38e5b9640 1 -- 172.21.15.57:0/3870685249 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff3880bc4c0 con 0x7ff3881503d0 2024-04-24T23:38:37.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.169+0000 7ff3857fa640 1 -- 172.21.15.57:0/3870685249 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7ff380010040 con 0x7ff3881503d0 2024-04-24T23:38:37.171 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data_ec' created 2024-04-24T23:38:37.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.173+0000 7ff38e5b9640 1 -- 172.21.15.57:0/3870685249 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ff3680678c0 msgr2=0x7ff368069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:37.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.173+0000 7ff38e5b9640 1 --2- 172.21.15.57:0/3870685249 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ff3680678c0 0x7ff368069d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff3780af000 tx=0x7ff3780a7000 comp rx=0 tx=0).stop 2024-04-24T23:38:37.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.173+0000 7ff38e5b9640 1 -- 172.21.15.57:0/3870685249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3881503d0 msgr2=0x7ff388156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:37.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.173+0000 7ff38e5b9640 1 --2- 172.21.15.57:0/3870685249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3881503d0 0x7ff388156170 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff38000efc0 tx=0x7ff38000c490 comp rx=0 tx=0).stop 2024-04-24T23:38:37.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.173+0000 7ff38e5b9640 1 -- 172.21.15.57:0/3870685249 shutdown_connections 2024-04-24T23:38:37.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.173+0000 7ff38e5b9640 1 --2- 172.21.15.57:0/3870685249 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ff3680678c0 0x7ff368069d80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:37.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.173+0000 7ff38e5b9640 1 --2- 172.21.15.57:0/3870685249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3881503d0 0x7ff388156170 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:37.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.173+0000 7ff38e5b9640 1 --2- 172.21.15.57:0/3870685249 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff38814de60 0x7ff388155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:37.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.173+0000 7ff38e5b9640 1 --2- 172.21.15.57:0/3870685249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3880bc6e0 0x7ff3881ecba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:37.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.173+0000 7ff38e5b9640 1 -- 172.21.15.57:0/3870685249 >> 172.21.15.57:0/3870685249 conn(0x7ff3880bfa50 msgr2=0x7ff3880bfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:37.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.173+0000 7ff38e5b9640 1 -- 172.21.15.57:0/3870685249 shutdown_connections 2024-04-24T23:38:37.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.173+0000 7ff38e5b9640 1 -- 172.21.15.57:0/3870685249 wait complete. 2024-04-24T23:38:37.202 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-24T23:38:37.270 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:38:37.272 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:38:37.274 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:38:37.277 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:38:37.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.325+0000 7f5835de7640 1 Processor -- start 2024-04-24T23:38:37.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.325+0000 7f5835de7640 1 -- start start 2024-04-24T23:38:37.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.325+0000 7f5835de7640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f583006e000 0x7f58301513b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:37.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.325+0000 7f5835de7640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f583006d6d0 0x7f58300bb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:37.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.325+0000 7f5835de7640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f58300bba20 0x7f58300728e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:37.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.325+0000 7f5835de7640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f583006e920 con 0x7f583006d6d0 2024-04-24T23:38:37.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.325+0000 7f5835de7640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f5830072450 con 0x7f583006e000 2024-04-24T23:38:37.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.325+0000 7f5835de7640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f5830072150 con 0x7f58300bba20 2024-04-24T23:38:37.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.325+0000 7f582effd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f583006d6d0 0x7f58300bb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:37.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.325+0000 7f582effd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f583006d6d0 0x7f58300bb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39064/0 (socket says 172.21.15.57:39064) 2024-04-24T23:38:37.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.325+0000 7f582effd640 1 -- 172.21.15.57:0/3645759278 learned_addr learned my addr 172.21.15.57:0/3645759278 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:37.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.325+0000 7f582f7fe640 1 --2- 172.21.15.57:0/3645759278 >> v2:172.21.15.88:3300/0 conn(0x7f583006e000 0x7f58301513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:37.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.325+0000 7f582ffff640 1 --2- 172.21.15.57:0/3645759278 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f58300bba20 0x7f58300728e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:37.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.325+0000 7f582effd640 1 -- 172.21.15.57:0/3645759278 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f58300bba20 msgr2=0x7f58300728e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:37.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.325+0000 7f582effd640 1 --2- 172.21.15.57:0/3645759278 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f58300bba20 0x7f58300728e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:37.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.325+0000 7f582effd640 1 -- 172.21.15.57:0/3645759278 >> v2:172.21.15.88:3300/0 conn(0x7f583006e000 msgr2=0x7f58301513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:37.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.325+0000 7f582effd640 1 --2- 172.21.15.57:0/3645759278 >> v2:172.21.15.88:3300/0 conn(0x7f583006e000 0x7f58301513b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:37.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.325+0000 7f582effd640 1 -- 172.21.15.57:0/3645759278 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58301518f0 con 0x7f583006d6d0 2024-04-24T23:38:37.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.329+0000 7f582effd640 1 --2- 172.21.15.57:0/3645759278 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f583006d6d0 0x7f58300bb4e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f583006e8f0 tx=0x7f581801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec2332a4453f82d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:37.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.329+0000 7f582e7fc640 1 -- 172.21.15.57:0/3645759278 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58180aa610 con 0x7f583006d6d0 2024-04-24T23:38:37.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.329+0000 7f582e7fc640 1 -- 172.21.15.57:0/3645759278 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58180af070 con 0x7f583006d6d0 2024-04-24T23:38:37.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.329+0000 7f582e7fc640 1 -- 172.21.15.57:0/3645759278 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58180aa9d0 con 0x7f583006d6d0 2024-04-24T23:38:37.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.329+0000 7f5835de7640 1 -- 172.21.15.57:0/3645759278 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f583006d6d0 msgr2=0x7f58300bb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:37.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.329+0000 7f5835de7640 1 --2- 172.21.15.57:0/3645759278 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f583006d6d0 0x7f58300bb4e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f583006e8f0 tx=0x7f581801c4f0 comp rx=0 tx=0).stop 2024-04-24T23:38:37.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.329+0000 7f5835de7640 1 -- 172.21.15.57:0/3645759278 shutdown_connections 2024-04-24T23:38:37.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.329+0000 7f5835de7640 1 --2- 172.21.15.57:0/3645759278 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f58300bba20 0x7f58300728e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:37.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.329+0000 7f5835de7640 1 --2- 172.21.15.57:0/3645759278 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f583006d6d0 0x7f58300bb4e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:37.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.329+0000 7f5835de7640 1 --2- 172.21.15.57:0/3645759278 >> v2:172.21.15.88:3300/0 conn(0x7f583006e000 0x7f58301513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:37.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.329+0000 7f5835de7640 1 -- 172.21.15.57:0/3645759278 >> 172.21.15.57:0/3645759278 conn(0x7f583006b920 msgr2=0x7f58300c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:37.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.329+0000 7f5835de7640 1 -- 172.21.15.57:0/3645759278 shutdown_connections 2024-04-24T23:38:37.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.329+0000 7f5835de7640 1 -- 172.21.15.57:0/3645759278 wait complete. 2024-04-24T23:38:37.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.329+0000 7f5835de7640 1 Processor -- start 2024-04-24T23:38:37.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.329+0000 7f5835de7640 1 -- start start 2024-04-24T23:38:37.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.333+0000 7f5835de7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f583006d6d0 0x7f58301524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:37.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.333+0000 7f5835de7640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f583006e000 0x7f583014d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:37.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.333+0000 7f5835de7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58300bba20 0x7f5830140140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:37.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.333+0000 7f5835de7640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5830154730 con 0x7f583006d6d0 2024-04-24T23:38:37.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.333+0000 7f5835de7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5830073230 con 0x7f58300bba20 2024-04-24T23:38:37.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.333+0000 7f5835de7640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f58301548b0 con 0x7f583006e000 2024-04-24T23:38:37.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.333+0000 7f582f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f583006d6d0 0x7f58301524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:37.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.333+0000 7f582f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f583006d6d0 0x7f58301524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39066/0 (socket says 172.21.15.57:39066) 2024-04-24T23:38:37.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.333+0000 7f582f7fe640 1 -- 172.21.15.57:0/1833691496 learned_addr learned my addr 172.21.15.57:0/1833691496 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:37.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.333+0000 7f582ffff640 1 --2- 172.21.15.57:0/1833691496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58300bba20 0x7f5830140140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:37.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.333+0000 7f582f7fe640 1 -- 172.21.15.57:0/1833691496 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f583006e000 msgr2=0x7f583014d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:37.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.333+0000 7f582f7fe640 1 --2- 172.21.15.57:0/1833691496 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f583006e000 0x7f583014d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:37.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.333+0000 7f582f7fe640 1 -- 172.21.15.57:0/1833691496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58300bba20 msgr2=0x7f5830140140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:37.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.333+0000 7f582f7fe640 1 --2- 172.21.15.57:0/1833691496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58300bba20 0x7f5830140140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:37.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.333+0000 7f582f7fe640 1 -- 172.21.15.57:0/1833691496 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f583015b020 con 0x7f583006d6d0 2024-04-24T23:38:37.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.333+0000 7f582ffff640 1 --2- 172.21.15.57:0/1833691496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58300bba20 0x7f5830140140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:38:37.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.333+0000 7f582f7fe640 1 --2- 172.21.15.57:0/1833691496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f583006d6d0 0x7f58301524d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f582000ef00 tx=0x7f582000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:37.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.333+0000 7f5827fff640 1 -- 172.21.15.57:0/1833691496 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5820018020 con 0x7f583006d6d0 2024-04-24T23:38:37.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.333+0000 7f5827fff640 1 -- 172.21.15.57:0/1833691496 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5820014400 con 0x7f583006d6d0 2024-04-24T23:38:37.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.333+0000 7f5835de7640 1 -- 172.21.15.57:0/1833691496 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5830152a10 con 0x7f583006d6d0 2024-04-24T23:38:37.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.333+0000 7f5827fff640 1 -- 172.21.15.57:0/1833691496 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58200147d0 con 0x7f583006d6d0 2024-04-24T23:38:37.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.333+0000 7f5835de7640 1 -- 172.21.15.57:0/1833691496 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5830148f00 con 0x7f583006d6d0 2024-04-24T23:38:37.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.333+0000 7f5835de7640 1 -- 172.21.15.57:0/1833691496 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5830068290 con 0x7f583006d6d0 2024-04-24T23:38:37.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.333+0000 7f5827fff640 1 -- 172.21.15.57:0/1833691496 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f582001b020 con 0x7f583006d6d0 2024-04-24T23:38:37.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.333+0000 7f5827fff640 1 --2- 172.21.15.57:0/1833691496 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f58100678f0 0x7f5810069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:37.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.333+0000 7f5827fff640 1 -- 172.21.15.57:0/1833691496 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7f58200865f0 con 0x7f583006d6d0 2024-04-24T23:38:37.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.333+0000 7f582effd640 1 --2- 172.21.15.57:0/1833691496 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f58100678f0 0x7f5810069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:37.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.337+0000 7f582effd640 1 --2- 172.21.15.57:0/1833691496 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f58100678f0 0x7f5810069db0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f58180ae000 tx=0x7f5818004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:37.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.341+0000 7f5827fff640 1 -- 172.21.15.57:0/1833691496 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f5820022070 con 0x7f583006d6d0 2024-04-24T23:38:37.450 INFO:tasks.ceph.mds.a.smithi057.stderr:2024-04-24T23:38:37.449+0000 7fce1c645640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-24T23:38:37.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:37.501+0000 7f5835de7640 1 -- 172.21.15.57:0/1833691496 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f58300c2ed0 con 0x7f583006d6d0 2024-04-24T23:38:38.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.173+0000 7f5827fff640 1 -- 172.21.15.57:0/1833691496 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7f5830152a10 con 0x7f583006d6d0 2024-04-24T23:38:38.174 INFO:teuthology.orchestra.run.smithi057.stderr:set pool 4 allow_ec_overwrites to true 2024-04-24T23:38:38.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.177+0000 7f5835de7640 1 -- 172.21.15.57:0/1833691496 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f58100678f0 msgr2=0x7f5810069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:38.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.177+0000 7f5835de7640 1 --2- 172.21.15.57:0/1833691496 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f58100678f0 0x7f5810069db0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f58180ae000 tx=0x7f5818004740 comp rx=0 tx=0).stop 2024-04-24T23:38:38.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.177+0000 7f5835de7640 1 -- 172.21.15.57:0/1833691496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f583006d6d0 msgr2=0x7f58301524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:38.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.177+0000 7f5835de7640 1 --2- 172.21.15.57:0/1833691496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f583006d6d0 0x7f58301524d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f582000ef00 tx=0x7f582000b480 comp rx=0 tx=0).stop 2024-04-24T23:38:38.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.177+0000 7f5835de7640 1 -- 172.21.15.57:0/1833691496 shutdown_connections 2024-04-24T23:38:38.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.177+0000 7f5835de7640 1 --2- 172.21.15.57:0/1833691496 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f58100678f0 0x7f5810069db0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:38.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.177+0000 7f5835de7640 1 --2- 172.21.15.57:0/1833691496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58300bba20 0x7f5830140140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:38.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.177+0000 7f5835de7640 1 --2- 172.21.15.57:0/1833691496 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f583006e000 0x7f583014d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:38.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.177+0000 7f5835de7640 1 --2- 172.21.15.57:0/1833691496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f583006d6d0 0x7f58301524d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:38.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.177+0000 7f5835de7640 1 -- 172.21.15.57:0/1833691496 >> 172.21.15.57:0/1833691496 conn(0x7f583006b920 msgr2=0x7f5830144490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:38.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.177+0000 7f5835de7640 1 -- 172.21.15.57:0/1833691496 shutdown_connections 2024-04-24T23:38:38.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.177+0000 7f5835de7640 1 -- 172.21.15.57:0/1833691496 wait complete. 2024-04-24T23:38:38.223 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-24T23:38:38.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.385+0000 7fe34c5e8640 1 Processor -- start 2024-04-24T23:38:38.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.385+0000 7fe34c5e8640 1 -- start start 2024-04-24T23:38:38.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe34c5e8640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe34406d6d0 0x7fe3440bb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:38.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe34c5e8640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe344072150 con 0x7fe34406e000 2024-04-24T23:38:38.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe34c5e8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe34406eb70 con 0x7fe3440bba20 2024-04-24T23:38:38.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe34c5e8640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fe34406e920 con 0x7fe34406d6d0 2024-04-24T23:38:38.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe34a384640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe34406e000 0x7fe3441513b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52302/0 (socket says 172.21.15.57:52302) 2024-04-24T23:38:38.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe34a384640 1 -- 172.21.15.57:0/1488608145 learned_addr learned my addr 172.21.15.57:0/1488608145 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:38:38.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe349b83640 1 --2- 172.21.15.57:0/1488608145 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe34406d6d0 0x7fe3440bb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:38.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe349382640 1 -- 172.21.15.57:0/1488608145 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3713284493 0 0) 0x7fe344072150 con 0x7fe34406e000 2024-04-24T23:38:38.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe349382640 1 -- 172.21.15.57:0/1488608145 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe330003530 con 0x7fe34406e000 2024-04-24T23:38:38.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe349382640 1 -- 172.21.15.57:0/1488608145 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 156334696 0 0) 0x7fe330003530 con 0x7fe34406e000 2024-04-24T23:38:38.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe349382640 1 -- 172.21.15.57:0/1488608145 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe34406d6d0 msgr2=0x7fe3440bb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:38.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe349382640 1 --2- 172.21.15.57:0/1488608145 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe34406d6d0 0x7fe3440bb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:38.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe349382640 1 -- 172.21.15.57:0/1488608145 >> v1:172.21.15.88:6789/0 conn(0x7fe3440bba20 legacy=0x7fe3440728e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:38.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe349382640 1 -- 172.21.15.57:0/1488608145 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34406ee50 con 0x7fe34406e000 2024-04-24T23:38:38.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe349382640 1 -- 172.21.15.57:0/1488608145 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7fe3400016a0 con 0x7fe34406e000 2024-04-24T23:38:38.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe349382640 1 -- 172.21.15.57:0/1488608145 >> v1:172.21.15.57:6789/0 conn(0x7fe34406e000 legacy=0x7fe3441513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:38.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe349382640 1 --2- 172.21.15.57:0/1488608145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3300039f0 0x7fe330003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:38.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe349382640 1 --2- 172.21.15.57:0/1488608145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe330004810 0x7fe330004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:38.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe349382640 1 --2- 172.21.15.57:0/1488608145 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe34406d6d0 0x7fe3300051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:38.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe349382640 1 -- 172.21.15.57:0/1488608145 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe34406e920 con 0x7fe3300039f0 2024-04-24T23:38:38.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe349382640 1 -- 172.21.15.57:0/1488608145 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe33000ba80 con 0x7fe330004810 2024-04-24T23:38:38.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe349382640 1 -- 172.21.15.57:0/1488608145 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fe33000bc80 con 0x7fe34406d6d0 2024-04-24T23:38:38.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe34a384640 1 --2- 172.21.15.57:0/1488608145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3300039f0 0x7fe330003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:38.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe349b83640 1 --2- 172.21.15.57:0/1488608145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe330004810 0x7fe330004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:38.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe34ab85640 1 --2- 172.21.15.57:0/1488608145 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe34406d6d0 0x7fe3300051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:38.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe34a384640 1 -- 172.21.15.57:0/1488608145 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe34406d6d0 msgr2=0x7fe3300051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:38.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe34a384640 1 --2- 172.21.15.57:0/1488608145 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe34406d6d0 0x7fe3300051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:38.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe34a384640 1 -- 172.21.15.57:0/1488608145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe330004810 msgr2=0x7fe330004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:38.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe34a384640 1 --2- 172.21.15.57:0/1488608145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe330004810 0x7fe330004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:38.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe34a384640 1 -- 172.21.15.57:0/1488608145 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe330003530 con 0x7fe3300039f0 2024-04-24T23:38:38.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe349b83640 1 --2- 172.21.15.57:0/1488608145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe330004810 0x7fe330004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:38:38.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe34a384640 1 --2- 172.21.15.57:0/1488608145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3300039f0 0x7fe330003e10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe3440bc1e0 tx=0x7fe34001cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1de8450c827f3a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:38.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe349382640 1 -- 172.21.15.57:0/1488608145 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe340007d20 con 0x7fe3300039f0 2024-04-24T23:38:38.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe349382640 1 -- 172.21.15.57:0/1488608145 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3400a9020 con 0x7fe3300039f0 2024-04-24T23:38:38.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.389+0000 7fe349382640 1 -- 172.21.15.57:0/1488608145 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe340005ae0 con 0x7fe3300039f0 2024-04-24T23:38:38.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe34c5e8640 1 -- 172.21.15.57:0/1488608145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3300039f0 msgr2=0x7fe330003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:38.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe34c5e8640 1 --2- 172.21.15.57:0/1488608145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3300039f0 0x7fe330003e10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe3440bc1e0 tx=0x7fe34001cc00 comp rx=0 tx=0).stop 2024-04-24T23:38:38.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe34ab85640 1 -- 172.21.15.57:0/1488608145 reap_dead start 2024-04-24T23:38:38.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe34c5e8640 1 -- 172.21.15.57:0/1488608145 shutdown_connections 2024-04-24T23:38:38.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe34c5e8640 1 -- 172.21.15.57:0/1488608145 >> 172.21.15.57:0/1488608145 conn(0x7fe34406b920 msgr2=0x7fe3440c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:38.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe34c5e8640 1 -- 172.21.15.57:0/1488608145 shutdown_connections 2024-04-24T23:38:38.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe34c5e8640 1 -- 172.21.15.57:0/1488608145 wait complete. 2024-04-24T23:38:38.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe34c5e8640 1 Processor -- start 2024-04-24T23:38:38.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe34c5e8640 1 -- start start 2024-04-24T23:38:38.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe34c5e8640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3300039f0 0x7fe344154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:38.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe34c5e8640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe34414b300 0x7fe3440a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:38.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe34c5e8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3440a7280 0x7fe34415a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:38.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe34c5e8640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe34415ce60 con 0x7fe3300039f0 2024-04-24T23:38:38.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe34c5e8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe34415cce0 con 0x7fe3440a7280 2024-04-24T23:38:38.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe34c5e8640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fe34415cfe0 con 0x7fe34414b300 2024-04-24T23:38:38.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe34a384640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3300039f0 0x7fe344154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:38.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe34a384640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3300039f0 0x7fe344154a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42376/0 (socket says 172.21.15.57:42376) 2024-04-24T23:38:38.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe34a384640 1 -- 172.21.15.57:0/3727255279 learned_addr learned my addr 172.21.15.57:0/3727255279 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:38.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe349b83640 1 --2- 172.21.15.57:0/3727255279 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe34414b300 0x7fe3440a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:38.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe34ab85640 1 --2- 172.21.15.57:0/3727255279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3440a7280 0x7fe34415a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:38.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe34a384640 1 -- 172.21.15.57:0/3727255279 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe34414b300 msgr2=0x7fe3440a44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:38.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe34a384640 1 --2- 172.21.15.57:0/3727255279 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe34414b300 0x7fe3440a44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:38.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe34a384640 1 -- 172.21.15.57:0/3727255279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3440a7280 msgr2=0x7fe34415a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:38.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe34a384640 1 --2- 172.21.15.57:0/3727255279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3440a7280 0x7fe34415a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:38.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe34a384640 1 -- 172.21.15.57:0/3727255279 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34415aa90 con 0x7fe3300039f0 2024-04-24T23:38:38.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe34a384640 1 --2- 172.21.15.57:0/3727255279 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3300039f0 0x7fe344154a60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe340007040 tx=0x7fe330005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:38.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe33affd640 1 -- 172.21.15.57:0/3727255279 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3400a59f0 con 0x7fe3300039f0 2024-04-24T23:38:38.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe33affd640 1 -- 172.21.15.57:0/3727255279 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe344073200 con 0x7fe3300039f0 2024-04-24T23:38:38.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe33affd640 1 -- 172.21.15.57:0/3727255279 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3400a5db0 con 0x7fe3300039f0 2024-04-24T23:38:38.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe34c5e8640 1 -- 172.21.15.57:0/3727255279 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3440a6cf0 con 0x7fe3300039f0 2024-04-24T23:38:38.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.393+0000 7fe34c5e8640 1 -- 172.21.15.57:0/3727255279 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe34415af50 con 0x7fe3300039f0 2024-04-24T23:38:38.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.397+0000 7fe34c5e8640 1 -- 172.21.15.57:0/3727255279 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe344068290 con 0x7fe3300039f0 2024-04-24T23:38:38.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.397+0000 7fe33affd640 1 -- 172.21.15.57:0/3727255279 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe3400047f0 con 0x7fe3300039f0 2024-04-24T23:38:38.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.397+0000 7fe33affd640 1 --2- 172.21.15.57:0/3727255279 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fe3280678f0 0x7fe328069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:38.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.397+0000 7fe33affd640 1 -- 172.21.15.57:0/3727255279 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7fe34011f6b0 con 0x7fe3300039f0 2024-04-24T23:38:38.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.397+0000 7fe349b83640 1 --2- 172.21.15.57:0/3727255279 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fe3280678f0 0x7fe328069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:38.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.397+0000 7fe349b83640 1 --2- 172.21.15.57:0/3727255279 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fe3280678f0 0x7fe328069db0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe34414b6e0 tx=0x7fe334008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:38.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.401+0000 7fe33affd640 1 -- 172.21.15.57:0/3727255279 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fe34415aa90 con 0x7fe3300039f0 2024-04-24T23:38:38.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:38.601+0000 7fe34c5e8640 1 -- 172.21.15.57:0/3727255279 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fe3440bc720 con 0x7fe3300039f0 2024-04-24T23:38:39.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.237+0000 7fe33affd640 1 -- 172.21.15.57:0/3727255279 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7fe340016910 con 0x7fe3300039f0 2024-04-24T23:38:39.237 INFO:teuthology.orchestra.run.smithi057.stderr:added data pool 4 to fsmap 2024-04-24T23:38:39.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.237+0000 7fe34c5e8640 1 -- 172.21.15.57:0/3727255279 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fe3280678f0 msgr2=0x7fe328069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:39.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.237+0000 7fe34c5e8640 1 --2- 172.21.15.57:0/3727255279 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fe3280678f0 0x7fe328069db0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe34414b6e0 tx=0x7fe334008040 comp rx=0 tx=0).stop 2024-04-24T23:38:39.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.237+0000 7fe34c5e8640 1 -- 172.21.15.57:0/3727255279 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3300039f0 msgr2=0x7fe344154a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:39.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.237+0000 7fe34c5e8640 1 --2- 172.21.15.57:0/3727255279 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3300039f0 0x7fe344154a60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe340007040 tx=0x7fe330005840 comp rx=0 tx=0).stop 2024-04-24T23:38:39.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.237+0000 7fe34c5e8640 1 -- 172.21.15.57:0/3727255279 shutdown_connections 2024-04-24T23:38:39.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.237+0000 7fe34c5e8640 1 --2- 172.21.15.57:0/3727255279 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fe3280678f0 0x7fe328069db0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:39.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.237+0000 7fe34c5e8640 1 --2- 172.21.15.57:0/3727255279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3440a7280 0x7fe34415a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:39.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.237+0000 7fe34c5e8640 1 --2- 172.21.15.57:0/3727255279 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe34414b300 0x7fe3440a44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:39.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.237+0000 7fe34c5e8640 1 --2- 172.21.15.57:0/3727255279 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3300039f0 0x7fe344154a60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:39.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.237+0000 7fe34c5e8640 1 -- 172.21.15.57:0/3727255279 >> 172.21.15.57:0/3727255279 conn(0x7fe34406b920 msgr2=0x7fe3440c20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:39.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.237+0000 7fe34c5e8640 1 -- 172.21.15.57:0/3727255279 shutdown_connections 2024-04-24T23:38:39.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.237+0000 7fe34c5e8640 1 -- 172.21.15.57:0/3727255279 wait complete. 2024-04-24T23:38:39.260 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:38:39.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.393+0000 7f61b07c3640 1 Processor -- start 2024-04-24T23:38:39.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.393+0000 7f61b07c3640 1 -- start start 2024-04-24T23:38:39.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.393+0000 7f61b07c3640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f61a80c23b0 0x7f61a815c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:39.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.393+0000 7f61b07c3640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61a8151320 con 0x7f61a80c32a0 2024-04-24T23:38:39.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.393+0000 7f61b07c3640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61a8151590 con 0x7f61a80bd5a0 2024-04-24T23:38:39.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.393+0000 7f61b07c3640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f61a80c12e0 con 0x7f61a80c23b0 2024-04-24T23:38:39.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.393+0000 7f61aed60640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f61a80c23b0 0x7f61a815c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:39.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.393+0000 7f61aed60640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f61a80c23b0 0x7f61a815c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42384/0 (socket says 172.21.15.57:42384) 2024-04-24T23:38:39.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.393+0000 7f61aed60640 1 -- 172.21.15.57:0/2667225734 learned_addr learned my addr 172.21.15.57:0/2667225734 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:39.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.393+0000 7f61ae55f640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f61a80c32a0 0x7f61a80c0bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52310/0 (socket says 172.21.15.57:52310) 2024-04-24T23:38:39.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.397+0000 7f61aed60640 1 -- 172.21.15.57:0/2667225734 >> v1:172.21.15.88:6789/0 conn(0x7f61a80bd5a0 legacy=0x7f61a814da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:39.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.397+0000 7f61aed60640 1 -- 172.21.15.57:0/2667225734 >> v1:172.21.15.57:6789/0 conn(0x7f61a80c32a0 legacy=0x7f61a80c0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:39.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.397+0000 7f61aed60640 1 -- 172.21.15.57:0/2667225734 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a8153db0 con 0x7f61a80c23b0 2024-04-24T23:38:39.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.397+0000 7f61aed60640 1 --2- 172.21.15.57:0/2667225734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61a80c23b0 0x7f61a815c150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f61a00098a0 tx=0x7f61a001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7299bdf3cca68254 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:39.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.397+0000 7f61ad55d640 1 -- 172.21.15.57:0/2667225734 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a00b1070 con 0x7f61a80c23b0 2024-04-24T23:38:39.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.397+0000 7f61ad55d640 1 -- 172.21.15.57:0/2667225734 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a00ac640 con 0x7f61a80c23b0 2024-04-24T23:38:39.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.397+0000 7f61ad55d640 1 -- 172.21.15.57:0/2667225734 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a00aca10 con 0x7f61a80c23b0 2024-04-24T23:38:39.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.397+0000 7f61b07c3640 1 -- 172.21.15.57:0/2667225734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61a80c23b0 msgr2=0x7f61a815c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:39.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.397+0000 7f61b07c3640 1 --2- 172.21.15.57:0/2667225734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61a80c23b0 0x7f61a815c150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f61a00098a0 tx=0x7f61a001c500 comp rx=0 tx=0).stop 2024-04-24T23:38:39.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.397+0000 7f61b07c3640 1 -- 172.21.15.57:0/2667225734 shutdown_connections 2024-04-24T23:38:39.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.397+0000 7f61b07c3640 1 --2- 172.21.15.57:0/2667225734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61a80c23b0 0x7f61a815c150 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:39.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.397+0000 7f61b07c3640 1 -- 172.21.15.57:0/2667225734 >> 172.21.15.57:0/2667225734 conn(0x7f61a8072d40 msgr2=0x7f61a8073150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:39.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.397+0000 7f61b07c3640 1 -- 172.21.15.57:0/2667225734 shutdown_connections 2024-04-24T23:38:39.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.397+0000 7f61b07c3640 1 -- 172.21.15.57:0/2667225734 wait complete. 2024-04-24T23:38:39.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.401+0000 7f61b07c3640 1 Processor -- start 2024-04-24T23:38:39.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.401+0000 7f61b07c3640 1 -- start start 2024-04-24T23:38:39.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.401+0000 7f61b07c3640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f61a80bd5a0 0x7f61a80baf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:39.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.401+0000 7f61b07c3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61a80c23b0 0x7f61a80b9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:39.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.401+0000 7f61b07c3640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61a80c32a0 0x7f61a81e9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:39.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.401+0000 7f61b07c3640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f61a80bdf30 con 0x7f61a80c32a0 2024-04-24T23:38:39.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.401+0000 7f61b07c3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f61a80bddb0 con 0x7f61a80c23b0 2024-04-24T23:38:39.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.401+0000 7f61b07c3640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f61a815eeb0 con 0x7f61a80bd5a0 2024-04-24T23:38:39.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.401+0000 7f61aed60640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61a80c32a0 0x7f61a81e9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:39.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.401+0000 7f61aed60640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61a80c32a0 0x7f61a81e9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42392/0 (socket says 172.21.15.57:42392) 2024-04-24T23:38:39.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.401+0000 7f61aed60640 1 -- 172.21.15.57:0/1277201620 learned_addr learned my addr 172.21.15.57:0/1277201620 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:39.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.401+0000 7f61ae55f640 1 --2- 172.21.15.57:0/1277201620 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f61a80bd5a0 0x7f61a80baf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:39.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.401+0000 7f61add5e640 1 --2- 172.21.15.57:0/1277201620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61a80c23b0 0x7f61a80b9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:39.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.401+0000 7f61aed60640 1 -- 172.21.15.57:0/1277201620 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f61a80bd5a0 msgr2=0x7f61a80baf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:39.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.401+0000 7f61aed60640 1 --2- 172.21.15.57:0/1277201620 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f61a80bd5a0 0x7f61a80baf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:39.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.401+0000 7f61aed60640 1 -- 172.21.15.57:0/1277201620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61a80c23b0 msgr2=0x7f61a80b9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:39.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.401+0000 7f61aed60640 1 --2- 172.21.15.57:0/1277201620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61a80c23b0 0x7f61a80b9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:39.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.401+0000 7f61aed60640 1 -- 172.21.15.57:0/1277201620 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a80c5e50 con 0x7f61a80c32a0 2024-04-24T23:38:39.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.401+0000 7f61aed60640 1 --2- 172.21.15.57:0/1277201620 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61a80c32a0 0x7f61a81e9610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f61a00af040 tx=0x7f61a00192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:39.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.401+0000 7f619effd640 1 -- 172.21.15.57:0/1277201620 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a00b1040 con 0x7f61a80c32a0 2024-04-24T23:38:39.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.401+0000 7f619effd640 1 -- 172.21.15.57:0/1277201620 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a00ba070 con 0x7f61a80c32a0 2024-04-24T23:38:39.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.401+0000 7f61b07c3640 1 -- 172.21.15.57:0/1277201620 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61a81e9110 con 0x7f61a80c32a0 2024-04-24T23:38:39.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.401+0000 7f619effd640 1 -- 172.21.15.57:0/1277201620 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a00b5840 con 0x7f61a80c32a0 2024-04-24T23:38:39.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.401+0000 7f61b07c3640 1 -- 172.21.15.57:0/1277201620 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61a80c45d0 con 0x7f61a80c32a0 2024-04-24T23:38:39.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.401+0000 7f61b07c3640 1 -- 172.21.15.57:0/1277201620 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61a81e92e0 con 0x7f61a80c32a0 2024-04-24T23:38:39.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.401+0000 7f619effd640 1 -- 172.21.15.57:0/1277201620 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f61a00ac500 con 0x7f61a80c32a0 2024-04-24T23:38:39.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.405+0000 7f619effd640 1 --2- 172.21.15.57:0/1277201620 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f618c0678c0 0x7f618c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:39.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.405+0000 7f619effd640 1 -- 172.21.15.57:0/1277201620 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f61a011fd30 con 0x7f61a80c32a0 2024-04-24T23:38:39.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.405+0000 7f61ae55f640 1 --2- 172.21.15.57:0/1277201620 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f618c0678c0 0x7f618c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:39.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.405+0000 7f61ae55f640 1 --2- 172.21.15.57:0/1277201620 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f618c0678c0 0x7f618c069d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f61a4007fd0 tx=0x7f61a4005b80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:39.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.409+0000 7f619effd640 1 -- 172.21.15.57:0/1277201620 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f61a00160f0 con 0x7f61a80c32a0 2024-04-24T23:38:39.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.605+0000 7f61b07c3640 1 -- 172.21.15.57:0/1277201620 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61a8068930 con 0x7f61a80c32a0 2024-04-24T23:38:39.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.605+0000 7f619effd640 1 -- 172.21.15.57:0/1277201620 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+4350 (secure 0 0 0) 0x7f61a00f05c0 con 0x7f61a80c32a0 2024-04-24T23:38:39.606 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:38:39.606 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2925410225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2925410225},{"type":"v1","addr":"172.21.15.88:6835","nonce":2925410225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4227,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/173597347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":173597347},{"type":"v1","addr":"172.21.15.57:6834","nonce":173597347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:38:33.449139+0000","modified":"2024-04-24T23:38:38.604804+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4230":{"gid":4230,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/1701414040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":1701414040},{"type":"v1","addr":"172.21.15.57:6835","nonce":1701414040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4230,"qdb_cluster":[4230]},"id":1}]} 2024-04-24T23:38:39.606 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 7 2024-04-24T23:38:39.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.605+0000 7f61b07c3640 1 -- 172.21.15.57:0/1277201620 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f618c0678c0 msgr2=0x7f618c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:39.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.605+0000 7f61b07c3640 1 --2- 172.21.15.57:0/1277201620 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f618c0678c0 0x7f618c069d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f61a4007fd0 tx=0x7f61a4005b80 comp rx=0 tx=0).stop 2024-04-24T23:38:39.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.605+0000 7f61b07c3640 1 -- 172.21.15.57:0/1277201620 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61a80c32a0 msgr2=0x7f61a81e9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:39.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.605+0000 7f61b07c3640 1 --2- 172.21.15.57:0/1277201620 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61a80c32a0 0x7f61a81e9610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f61a00af040 tx=0x7f61a00192a0 comp rx=0 tx=0).stop 2024-04-24T23:38:39.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.605+0000 7f61b07c3640 1 -- 172.21.15.57:0/1277201620 shutdown_connections 2024-04-24T23:38:39.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.605+0000 7f61b07c3640 1 --2- 172.21.15.57:0/1277201620 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f618c0678c0 0x7f618c069d80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:39.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.605+0000 7f61b07c3640 1 --2- 172.21.15.57:0/1277201620 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61a80c32a0 0x7f61a81e9610 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:39.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.605+0000 7f61b07c3640 1 --2- 172.21.15.57:0/1277201620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61a80c23b0 0x7f61a80b9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:39.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.605+0000 7f61b07c3640 1 --2- 172.21.15.57:0/1277201620 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f61a80bd5a0 0x7f61a80baf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:39.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.605+0000 7f61b07c3640 1 -- 172.21.15.57:0/1277201620 >> 172.21.15.57:0/1277201620 conn(0x7f61a8072d40 msgr2=0x7f61a81453f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:39.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.605+0000 7f61b07c3640 1 -- 172.21.15.57:0/1277201620 shutdown_connections 2024-04-24T23:38:39.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.605+0000 7f61b07c3640 1 -- 172.21.15.57:0/1277201620 wait complete. 2024-04-24T23:38:39.625 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:38:39.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.741+0000 7f62447d6640 1 Processor -- start 2024-04-24T23:38:39.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.741+0000 7f62447d6640 1 -- start start 2024-04-24T23:38:39.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.745+0000 7f62447d6640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f623c14bc60 0x7f623c06eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:39.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.745+0000 7f62447d6640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f623c14e8e0 con 0x7f623c06f090 2024-04-24T23:38:39.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.745+0000 7f62447d6640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f623c14ebc0 con 0x7f623c0bdbe0 2024-04-24T23:38:39.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.745+0000 7f62447d6640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f623c152c20 con 0x7f623c14bc60 2024-04-24T23:38:39.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.745+0000 7f6242572640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f623c14bc60 0x7f623c06eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:39.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.745+0000 7f6241d71640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f623c06f090 0x7f623c0b6fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52326/0 (socket says 172.21.15.57:52326) 2024-04-24T23:38:39.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.745+0000 7f6241d71640 1 -- 172.21.15.57:0/3911458208 learned_addr learned my addr 172.21.15.57:0/3911458208 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:38:39.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.745+0000 7f6242572640 1 -- 172.21.15.57:0/3911458208 >> v1:172.21.15.88:6789/0 conn(0x7f623c0bdbe0 legacy=0x7f623c159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:39.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.745+0000 7f6241570640 1 -- 172.21.15.57:0/3911458208 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1089318148 0 0) 0x7f623c14e8e0 con 0x7f623c06f090 2024-04-24T23:38:39.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.745+0000 7f6242572640 1 -- 172.21.15.57:0/3911458208 >> v1:172.21.15.57:6789/0 conn(0x7f623c06f090 legacy=0x7f623c0b6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:39.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.745+0000 7f6242572640 1 -- 172.21.15.57:0/3911458208 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f623c0b76e0 con 0x7f623c14bc60 2024-04-24T23:38:39.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.745+0000 7f6242572640 1 --2- 172.21.15.57:0/3911458208 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f623c14bc60 0x7f623c06eb50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f62380097c0 tx=0x7f623801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce5c8b5982127889 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:39.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.749+0000 7f6241570640 1 -- 172.21.15.57:0/3911458208 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62380b0070 con 0x7f623c14bc60 2024-04-24T23:38:39.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.749+0000 7f6241570640 1 -- 172.21.15.57:0/3911458208 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62380ab600 con 0x7f623c14bc60 2024-04-24T23:38:39.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.749+0000 7f6241570640 1 -- 172.21.15.57:0/3911458208 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62380ab9d0 con 0x7f623c14bc60 2024-04-24T23:38:39.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.749+0000 7f62447d6640 1 -- 172.21.15.57:0/3911458208 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f623c14bc60 msgr2=0x7f623c06eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:39.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.749+0000 7f62447d6640 1 --2- 172.21.15.57:0/3911458208 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f623c14bc60 0x7f623c06eb50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f62380097c0 tx=0x7f623801c460 comp rx=0 tx=0).stop 2024-04-24T23:38:39.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.749+0000 7f62447d6640 1 -- 172.21.15.57:0/3911458208 shutdown_connections 2024-04-24T23:38:39.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.749+0000 7f62447d6640 1 --2- 172.21.15.57:0/3911458208 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f623c14bc60 0x7f623c06eb50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:39.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.749+0000 7f62447d6640 1 -- 172.21.15.57:0/3911458208 >> 172.21.15.57:0/3911458208 conn(0x7f623c0beab0 msgr2=0x7f623c0beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:39.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.749+0000 7f62447d6640 1 -- 172.21.15.57:0/3911458208 shutdown_connections 2024-04-24T23:38:39.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.749+0000 7f62447d6640 1 -- 172.21.15.57:0/3911458208 wait complete. 2024-04-24T23:38:39.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.749+0000 7f62447d6640 1 Processor -- start 2024-04-24T23:38:39.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.749+0000 7f62447d6640 1 -- start start 2024-04-24T23:38:39.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.749+0000 7f62447d6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f623c06f090 0x7f623c14e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:39.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.749+0000 7f62447d6640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f623c0bdbe0 0x7f623c141320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:39.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.749+0000 7f62447d6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f623c14bc60 0x7f623c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:39.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.749+0000 7f62447d6640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f623c15d110 con 0x7f623c06f090 2024-04-24T23:38:39.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.749+0000 7f62447d6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f623c15cf90 con 0x7f623c14bc60 2024-04-24T23:38:39.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.749+0000 7f62447d6640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f623c15d290 con 0x7f623c0bdbe0 2024-04-24T23:38:39.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.749+0000 7f6242572640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f623c06f090 0x7f623c14e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:39.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.749+0000 7f6242572640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f623c06f090 0x7f623c14e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42408/0 (socket says 172.21.15.57:42408) 2024-04-24T23:38:39.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.749+0000 7f6242572640 1 -- 172.21.15.57:0/2569654786 learned_addr learned my addr 172.21.15.57:0/2569654786 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:39.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.749+0000 7f6241d71640 1 --2- 172.21.15.57:0/2569654786 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f623c0bdbe0 0x7f623c141320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:39.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.749+0000 7f6242d73640 1 --2- 172.21.15.57:0/2569654786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f623c14bc60 0x7f623c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:39.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.749+0000 7f6242572640 1 -- 172.21.15.57:0/2569654786 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f623c0bdbe0 msgr2=0x7f623c141320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:39.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.749+0000 7f6242572640 1 --2- 172.21.15.57:0/2569654786 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f623c0bdbe0 0x7f623c141320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:39.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.749+0000 7f6242572640 1 -- 172.21.15.57:0/2569654786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f623c14bc60 msgr2=0x7f623c0710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:39.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.749+0000 7f6242572640 1 --2- 172.21.15.57:0/2569654786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f623c14bc60 0x7f623c0710b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:39.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.749+0000 7f6242572640 1 -- 172.21.15.57:0/2569654786 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f623c14d820 con 0x7f623c06f090 2024-04-24T23:38:39.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.749+0000 7f6241d71640 1 --2- 172.21.15.57:0/2569654786 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f623c0bdbe0 0x7f623c141320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:38:39.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.749+0000 7f6242572640 1 --2- 172.21.15.57:0/2569654786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f623c06f090 0x7f623c14e2d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f62380ae040 tx=0x7f623801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:39.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.753+0000 7f6232ffd640 1 -- 172.21.15.57:0/2569654786 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62380bd070 con 0x7f623c06f090 2024-04-24T23:38:39.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.753+0000 7f6232ffd640 1 -- 172.21.15.57:0/2569654786 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6238004230 con 0x7f623c06f090 2024-04-24T23:38:39.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.753+0000 7f62447d6640 1 -- 172.21.15.57:0/2569654786 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f623c14db00 con 0x7f623c06f090 2024-04-24T23:38:39.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.753+0000 7f6232ffd640 1 -- 172.21.15.57:0/2569654786 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62380b0040 con 0x7f623c06f090 2024-04-24T23:38:39.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.753+0000 7f62447d6640 1 -- 172.21.15.57:0/2569654786 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f623c14c950 con 0x7f623c06f090 2024-04-24T23:38:39.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.753+0000 7f62447d6640 1 -- 172.21.15.57:0/2569654786 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f623c14cb90 con 0x7f623c06f090 2024-04-24T23:38:39.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.753+0000 7f6232ffd640 1 -- 172.21.15.57:0/2569654786 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f62380c0070 con 0x7f623c06f090 2024-04-24T23:38:39.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.753+0000 7f6232ffd640 1 --2- 172.21.15.57:0/2569654786 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f62200678c0 0x7f6220069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:39.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.753+0000 7f6232ffd640 1 -- 172.21.15.57:0/2569654786 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f623811fb10 con 0x7f623c06f090 2024-04-24T23:38:39.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.753+0000 7f6241d71640 1 --2- 172.21.15.57:0/2569654786 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f62200678c0 0x7f6220069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:39.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.753+0000 7f6241d71640 1 --2- 172.21.15.57:0/2569654786 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f62200678c0 0x7f6220069d80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f623c144010 tx=0x7f622c007cd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:39.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.757+0000 7f6232ffd640 1 -- 172.21.15.57:0/2569654786 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f623c14cb90 con 0x7f623c06f090 2024-04-24T23:38:39.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.921+0000 7f62447d6640 1 -- 172.21.15.57:0/2569654786 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f623c0bd9c0 con 0x7f623c06f090 2024-04-24T23:38:39.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.925+0000 7f6232ffd640 1 -- 172.21.15.57:0/2569654786 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7f6238016050 con 0x7f623c06f090 2024-04-24T23:38:39.925 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:38:39.925 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":24,"fsid":"1ea31698-444a-4667-bcd9-b2608ad103c3","created":"2024-04-24T23:38:16.748774+0000","modified":"2024-04-24T23:38:38.604475+0000","last_up_change":"2024-04-24T23:38:26.956537+0000","last_in_change":"2024-04-24T23:38:18.972175+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:38:27.611782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:38:31.718061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:38:32.469413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:38:36.215724+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"35ce67bc-9b25-416e-ab1e-774c717631f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6825","nonce":671364028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6827","nonce":671364028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6831","nonce":671364028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6829","nonce":671364028}]},"public_addr":"172.21.15.57:6825/671364028","cluster_addr":"172.21.15.57:6827/671364028","heartbeat_back_addr":"172.21.15.57:6831/671364028","heartbeat_front_addr":"172.21.15.57:6829/671364028","state":["exists","up"]},{"osd":1,"uuid":"38f6f4ef-3bc2-4453-9946-7d1d17e735ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6801","nonce":2653552037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6803","nonce":2653552037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6807","nonce":2653552037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6805","nonce":2653552037}]},"public_addr":"172.21.15.57:6801/2653552037","cluster_addr":"172.21.15.57:6803/2653552037","heartbeat_back_addr":"172.21.15.57:6807/2653552037","heartbeat_front_addr":"172.21.15.57:6805/2653552037","state":["exists","up"]},{"osd":2,"uuid":"d77a0a49-b39a-464e-a1c9-49e19280c440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6816","nonce":1565874109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6819","nonce":1565874109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6823","nonce":1565874109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6821","nonce":1565874109}]},"public_addr":"172.21.15.57:6816/1565874109","cluster_addr":"172.21.15.57:6819/1565874109","heartbeat_back_addr":"172.21.15.57:6823/1565874109","heartbeat_front_addr":"172.21.15.57:6821/1565874109","state":["exists","up"]},{"osd":3,"uuid":"f8ea9bfe-d839-44a6-a185-0f0985da314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6809","nonce":3474703186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6811","nonce":3474703186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6817","nonce":3474703186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6813","nonce":3474703186}]},"public_addr":"172.21.15.57:6809/3474703186","cluster_addr":"172.21.15.57:6811/3474703186","heartbeat_back_addr":"172.21.15.57:6817/3474703186","heartbeat_front_addr":"172.21.15.57:6813/3474703186","state":["exists","up"]},{"osd":4,"uuid":"454647d4-6ac2-46b4-8451-320eb951a87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6801","nonce":1271707713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6803","nonce":1271707713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6807","nonce":1271707713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6805","nonce":1271707713}]},"public_addr":"172.21.15.88:6801/1271707713","cluster_addr":"172.21.15.88:6803/1271707713","heartbeat_back_addr":"172.21.15.88:6807/1271707713","heartbeat_front_addr":"172.21.15.88:6805/1271707713","state":["exists","up"]},{"osd":5,"uuid":"f71c03a3-7ad8-46d3-89c9-d61de102586b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6809","nonce":2035054888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6813","nonce":2035054888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6820","nonce":2035054888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6816","nonce":2035054888}]},"public_addr":"172.21.15.88:6809/2035054888","cluster_addr":"172.21.15.88:6813/2035054888","heartbeat_back_addr":"172.21.15.88:6820/2035054888","heartbeat_front_addr":"172.21.15.88:6816/2035054888","state":["exists","up"]},{"osd":6,"uuid":"ec7ae2b7-9cb4-4059-8f98-0022c9763f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6825","nonce":1752291242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6827","nonce":1752291242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6831","nonce":1752291242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6829","nonce":1752291242}]},"public_addr":"172.21.15.88:6825/1752291242","cluster_addr":"172.21.15.88:6827/1752291242","heartbeat_back_addr":"172.21.15.88:6831/1752291242","heartbeat_front_addr":"172.21.15.88:6829/1752291242","state":["exists","up"]},{"osd":7,"uuid":"c0ee7505-60c1-40ba-9902-47313a04dafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6812","nonce":1782800372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6817","nonce":1782800372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6823","nonce":1782800372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6821","nonce":1782800372}]},"public_addr":"172.21.15.88:6812/1782800372","cluster_addr":"172.21.15.88:6817/1782800372","heartbeat_back_addr":"172.21.15.88:6823/1782800372","heartbeat_front_addr":"172.21.15.88:6821/1782800372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.698562+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.682587+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.680197+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.561753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.011095+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.493320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.353451+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.423877+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:38:39.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.925+0000 7f62447d6640 1 -- 172.21.15.57:0/2569654786 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f62200678c0 msgr2=0x7f6220069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:39.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.925+0000 7f62447d6640 1 --2- 172.21.15.57:0/2569654786 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f62200678c0 0x7f6220069d80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f623c144010 tx=0x7f622c007cd0 comp rx=0 tx=0).stop 2024-04-24T23:38:39.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.925+0000 7f62447d6640 1 -- 172.21.15.57:0/2569654786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f623c06f090 msgr2=0x7f623c14e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:39.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.925+0000 7f62447d6640 1 --2- 172.21.15.57:0/2569654786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f623c06f090 0x7f623c14e2d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f62380ae040 tx=0x7f623801aca0 comp rx=0 tx=0).stop 2024-04-24T23:38:39.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.925+0000 7f62447d6640 1 -- 172.21.15.57:0/2569654786 shutdown_connections 2024-04-24T23:38:39.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.925+0000 7f62447d6640 1 --2- 172.21.15.57:0/2569654786 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f62200678c0 0x7f6220069d80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:39.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.925+0000 7f62447d6640 1 --2- 172.21.15.57:0/2569654786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f623c14bc60 0x7f623c0710b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:39.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.925+0000 7f62447d6640 1 --2- 172.21.15.57:0/2569654786 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f623c0bdbe0 0x7f623c141320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:39.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.925+0000 7f62447d6640 1 --2- 172.21.15.57:0/2569654786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f623c06f090 0x7f623c14e2d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:39.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.925+0000 7f62447d6640 1 -- 172.21.15.57:0/2569654786 >> 172.21.15.57:0/2569654786 conn(0x7f623c0beab0 msgr2=0x7f623c06db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:39.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.925+0000 7f62447d6640 1 -- 172.21.15.57:0/2569654786 shutdown_connections 2024-04-24T23:38:39.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:39.925+0000 7f62447d6640 1 -- 172.21.15.57:0/2569654786 wait complete. 2024-04-24T23:38:39.944 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:38:40.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.065+0000 7f2d084f1640 1 Processor -- start 2024-04-24T23:38:40.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.069+0000 7f2d084f1640 1 -- start start 2024-04-24T23:38:40.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.069+0000 7f2d084f1640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2d000bdbe0 0x7f2d000b6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:40.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.069+0000 7f2d084f1640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2d000b7510 0x7f2d00159050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:40.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.069+0000 7f2d084f1640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d0014e8e0 con 0x7f2d0014bc60 2024-04-24T23:38:40.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.069+0000 7f2d084f1640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f2d00152c20 con 0x7f2d000bdbe0 2024-04-24T23:38:40.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.069+0000 7f2d084f1640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f2d0014ebc0 con 0x7f2d000b7510 2024-04-24T23:38:40.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.069+0000 7f2d0628d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2d0014bc60 0x7f2d0006eb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.57:43718/0 (socket says 172.21.15.57:43718) 2024-04-24T23:38:40.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.069+0000 7f2d0628d640 1 -- 172.21.15.57:0/3062100312 learned_addr learned my addr 172.21.15.57:0/3062100312 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:38:40.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.069+0000 7f2d06a8e640 1 --2- 172.21.15.57:0/3062100312 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2d000b7510 0x7f2d00159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:40.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.069+0000 7f2d05a8c640 1 --2- 172.21.15.57:0/3062100312 >> v2:172.21.15.88:3300/0 conn(0x7f2d000bdbe0 0x7f2d000b6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:40.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.069+0000 7f2d05a8c640 1 -- 172.21.15.57:0/3062100312 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2d000b7510 msgr2=0x7f2d00159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:40.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.069+0000 7f2d05a8c640 1 --2- 172.21.15.57:0/3062100312 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2d000b7510 0x7f2d00159050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:40.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.069+0000 7f2d05a8c640 1 -- 172.21.15.57:0/3062100312 >> v1:172.21.15.88:6789/0 conn(0x7f2d0014bc60 legacy=0x7f2d0006eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:40.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.069+0000 7f2d05a8c640 1 -- 172.21.15.57:0/3062100312 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d0006f260 con 0x7f2d000bdbe0 2024-04-24T23:38:40.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d05a8c640 1 --2- 172.21.15.57:0/3062100312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d000bdbe0 0x7f2d000b6fd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4009d90 tx=0x7f2cf401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42cb0e94b7297f89 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:40.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d0528b640 1 -- 172.21.15.57:0/3062100312 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf40b2070 con 0x7f2d000bdbe0 2024-04-24T23:38:40.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d0528b640 1 -- 172.21.15.57:0/3062100312 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cf40a5830 con 0x7f2d000bdbe0 2024-04-24T23:38:40.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d0528b640 1 -- 172.21.15.57:0/3062100312 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf40a5c00 con 0x7f2d000bdbe0 2024-04-24T23:38:40.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d084f1640 1 -- 172.21.15.57:0/3062100312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d000bdbe0 msgr2=0x7f2d000b6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:40.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d084f1640 1 --2- 172.21.15.57:0/3062100312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d000bdbe0 0x7f2d000b6fd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4009d90 tx=0x7f2cf401c970 comp rx=0 tx=0).stop 2024-04-24T23:38:40.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d084f1640 1 -- 172.21.15.57:0/3062100312 shutdown_connections 2024-04-24T23:38:40.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d084f1640 1 --2- 172.21.15.57:0/3062100312 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2d000b7510 0x7f2d00159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:40.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d084f1640 1 --2- 172.21.15.57:0/3062100312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d000bdbe0 0x7f2d000b6fd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:40.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d084f1640 1 -- 172.21.15.57:0/3062100312 >> 172.21.15.57:0/3062100312 conn(0x7f2d000beab0 msgr2=0x7f2d000beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:40.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d084f1640 1 -- 172.21.15.57:0/3062100312 shutdown_connections 2024-04-24T23:38:40.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d084f1640 1 -- 172.21.15.57:0/3062100312 wait complete. 2024-04-24T23:38:40.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d084f1640 1 Processor -- start 2024-04-24T23:38:40.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d084f1640 1 -- start start 2024-04-24T23:38:40.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d084f1640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2d000b7510 0x7f2d000b7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:40.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d084f1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d000bdbe0 0x7f2d001ea720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:40.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d084f1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d0014bc60 0x7f2d001eac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:40.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d084f1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0015bf30 con 0x7f2d0014bc60 2024-04-24T23:38:40.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d084f1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0015bdb0 con 0x7f2d000bdbe0 2024-04-24T23:38:40.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d084f1640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f2d0015c0b0 con 0x7f2d000b7510 2024-04-24T23:38:40.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d06a8e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d0014bc60 0x7f2d001eac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:40.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d06a8e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d0014bc60 0x7f2d001eac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42412/0 (socket says 172.21.15.57:42412) 2024-04-24T23:38:40.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d06a8e640 1 -- 172.21.15.57:0/1091333885 learned_addr learned my addr 172.21.15.57:0/1091333885 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:40.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d05a8c640 1 --2- 172.21.15.57:0/1091333885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d000bdbe0 0x7f2d001ea720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:40.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d0628d640 1 --2- 172.21.15.57:0/1091333885 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2d000b7510 0x7f2d000b7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:40.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d06a8e640 1 -- 172.21.15.57:0/1091333885 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2d000b7510 msgr2=0x7f2d000b7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:40.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d06a8e640 1 --2- 172.21.15.57:0/1091333885 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2d000b7510 0x7f2d000b7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:40.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d06a8e640 1 -- 172.21.15.57:0/1091333885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d000bdbe0 msgr2=0x7f2d001ea720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:40.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d06a8e640 1 --2- 172.21.15.57:0/1091333885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d000bdbe0 0x7f2d001ea720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:40.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d06a8e640 1 -- 172.21.15.57:0/1091333885 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d000b8150 con 0x7f2d0014bc60 2024-04-24T23:38:40.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.073+0000 7f2d06a8e640 1 --2- 172.21.15.57:0/1091333885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d0014bc60 0x7f2d001eac60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000e820 tx=0x7f2cf000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.077+0000 7f2cfeffd640 1 -- 172.21.15.57:0/1091333885 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0017070 con 0x7f2d0014bc60 2024-04-24T23:38:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.077+0000 7f2cfeffd640 1 -- 172.21.15.57:0/1091333885 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cf000c940 con 0x7f2d0014bc60 2024-04-24T23:38:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.077+0000 7f2d084f1640 1 -- 172.21.15.57:0/1091333885 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d00142fa0 con 0x7f2d0014bc60 2024-04-24T23:38:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.077+0000 7f2cfeffd640 1 -- 172.21.15.57:0/1091333885 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf000cd10 con 0x7f2d0014bc60 2024-04-24T23:38:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.077+0000 7f2d084f1640 1 -- 172.21.15.57:0/1091333885 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d001436a0 con 0x7f2d0014bc60 2024-04-24T23:38:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.077+0000 7f2d084f1640 1 -- 172.21.15.57:0/1091333885 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d00068220 con 0x7f2d0014bc60 2024-04-24T23:38:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.077+0000 7f2cfeffd640 1 -- 172.21.15.57:0/1091333885 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2cf001a070 con 0x7f2d0014bc60 2024-04-24T23:38:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.077+0000 7f2cfeffd640 1 --2- 172.21.15.57:0/1091333885 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f2cec0678f0 0x7f2cec069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.077+0000 7f2cfeffd640 1 -- 172.21.15.57:0/1091333885 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2cf0085d20 con 0x7f2d0014bc60 2024-04-24T23:38:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.077+0000 7f2d0628d640 1 --2- 172.21.15.57:0/1091333885 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f2cec0678f0 0x7f2cec069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:40.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.077+0000 7f2d0628d640 1 --2- 172.21.15.57:0/1091333885 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f2cec0678f0 0x7f2cec069db0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8000f70 tx=0x7f2cf8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:40.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.081+0000 7f2cfeffd640 1 -- 172.21.15.57:0/1091333885 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f2d000b8150 con 0x7f2d0014bc60 2024-04-24T23:38:40.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.245+0000 7f2d084f1640 1 -- 172.21.15.57:0/1091333885 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2d001592b0 con 0x7f2d0014bc60 2024-04-24T23:38:40.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.249+0000 7f2cfeffd640 1 -- 172.21.15.57:0/1091333885 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7f2cf0055ed0 con 0x7f2d0014bc60 2024-04-24T23:38:40.251 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:38:40.251 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":24,"fsid":"1ea31698-444a-4667-bcd9-b2608ad103c3","created":"2024-04-24T23:38:16.748774+0000","modified":"2024-04-24T23:38:38.604475+0000","last_up_change":"2024-04-24T23:38:26.956537+0000","last_in_change":"2024-04-24T23:38:18.972175+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:38:27.611782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:38:31.718061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:38:32.469413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:38:36.215724+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"35ce67bc-9b25-416e-ab1e-774c717631f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6825","nonce":671364028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6827","nonce":671364028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6831","nonce":671364028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6829","nonce":671364028}]},"public_addr":"172.21.15.57:6825/671364028","cluster_addr":"172.21.15.57:6827/671364028","heartbeat_back_addr":"172.21.15.57:6831/671364028","heartbeat_front_addr":"172.21.15.57:6829/671364028","state":["exists","up"]},{"osd":1,"uuid":"38f6f4ef-3bc2-4453-9946-7d1d17e735ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6801","nonce":2653552037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6803","nonce":2653552037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6807","nonce":2653552037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6805","nonce":2653552037}]},"public_addr":"172.21.15.57:6801/2653552037","cluster_addr":"172.21.15.57:6803/2653552037","heartbeat_back_addr":"172.21.15.57:6807/2653552037","heartbeat_front_addr":"172.21.15.57:6805/2653552037","state":["exists","up"]},{"osd":2,"uuid":"d77a0a49-b39a-464e-a1c9-49e19280c440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6816","nonce":1565874109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6819","nonce":1565874109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6823","nonce":1565874109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6821","nonce":1565874109}]},"public_addr":"172.21.15.57:6816/1565874109","cluster_addr":"172.21.15.57:6819/1565874109","heartbeat_back_addr":"172.21.15.57:6823/1565874109","heartbeat_front_addr":"172.21.15.57:6821/1565874109","state":["exists","up"]},{"osd":3,"uuid":"f8ea9bfe-d839-44a6-a185-0f0985da314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6809","nonce":3474703186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6811","nonce":3474703186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6817","nonce":3474703186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6813","nonce":3474703186}]},"public_addr":"172.21.15.57:6809/3474703186","cluster_addr":"172.21.15.57:6811/3474703186","heartbeat_back_addr":"172.21.15.57:6817/3474703186","heartbeat_front_addr":"172.21.15.57:6813/3474703186","state":["exists","up"]},{"osd":4,"uuid":"454647d4-6ac2-46b4-8451-320eb951a87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6801","nonce":1271707713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6803","nonce":1271707713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6807","nonce":1271707713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6805","nonce":1271707713}]},"public_addr":"172.21.15.88:6801/1271707713","cluster_addr":"172.21.15.88:6803/1271707713","heartbeat_back_addr":"172.21.15.88:6807/1271707713","heartbeat_front_addr":"172.21.15.88:6805/1271707713","state":["exists","up"]},{"osd":5,"uuid":"f71c03a3-7ad8-46d3-89c9-d61de102586b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6809","nonce":2035054888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6813","nonce":2035054888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6820","nonce":2035054888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6816","nonce":2035054888}]},"public_addr":"172.21.15.88:6809/2035054888","cluster_addr":"172.21.15.88:6813/2035054888","heartbeat_back_addr":"172.21.15.88:6820/2035054888","heartbeat_front_addr":"172.21.15.88:6816/2035054888","state":["exists","up"]},{"osd":6,"uuid":"ec7ae2b7-9cb4-4059-8f98-0022c9763f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6825","nonce":1752291242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6827","nonce":1752291242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6831","nonce":1752291242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6829","nonce":1752291242}]},"public_addr":"172.21.15.88:6825/1752291242","cluster_addr":"172.21.15.88:6827/1752291242","heartbeat_back_addr":"172.21.15.88:6831/1752291242","heartbeat_front_addr":"172.21.15.88:6829/1752291242","state":["exists","up"]},{"osd":7,"uuid":"c0ee7505-60c1-40ba-9902-47313a04dafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6812","nonce":1782800372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6817","nonce":1782800372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6823","nonce":1782800372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6821","nonce":1782800372}]},"public_addr":"172.21.15.88:6812/1782800372","cluster_addr":"172.21.15.88:6817/1782800372","heartbeat_back_addr":"172.21.15.88:6823/1782800372","heartbeat_front_addr":"172.21.15.88:6821/1782800372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.698562+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.682587+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.680197+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.561753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.011095+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.493320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.353451+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.423877+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:38:40.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.253+0000 7f2d084f1640 1 -- 172.21.15.57:0/1091333885 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f2cec0678f0 msgr2=0x7f2cec069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:40.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.253+0000 7f2d084f1640 1 --2- 172.21.15.57:0/1091333885 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f2cec0678f0 0x7f2cec069db0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8000f70 tx=0x7f2cf8009040 comp rx=0 tx=0).stop 2024-04-24T23:38:40.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.253+0000 7f2d084f1640 1 -- 172.21.15.57:0/1091333885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d0014bc60 msgr2=0x7f2d001eac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:40.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.253+0000 7f2d084f1640 1 --2- 172.21.15.57:0/1091333885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d0014bc60 0x7f2d001eac60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000e820 tx=0x7f2cf000ece0 comp rx=0 tx=0).stop 2024-04-24T23:38:40.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.253+0000 7f2d084f1640 1 -- 172.21.15.57:0/1091333885 shutdown_connections 2024-04-24T23:38:40.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.253+0000 7f2d084f1640 1 --2- 172.21.15.57:0/1091333885 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f2cec0678f0 0x7f2cec069db0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:40.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.253+0000 7f2d084f1640 1 --2- 172.21.15.57:0/1091333885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d0014bc60 0x7f2d001eac60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:40.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.253+0000 7f2d084f1640 1 --2- 172.21.15.57:0/1091333885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d000bdbe0 0x7f2d001ea720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:40.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.253+0000 7f2d084f1640 1 --2- 172.21.15.57:0/1091333885 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2d000b7510 0x7f2d000b7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:40.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.253+0000 7f2d084f1640 1 -- 172.21.15.57:0/1091333885 >> 172.21.15.57:0/1091333885 conn(0x7f2d000beab0 msgr2=0x7f2d0006e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:40.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.253+0000 7f2d084f1640 1 -- 172.21.15.57:0/1091333885 shutdown_connections 2024-04-24T23:38:40.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.253+0000 7f2d084f1640 1 -- 172.21.15.57:0/1091333885 wait complete. 2024-04-24T23:38:40.285 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:38:40.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.401+0000 7ff178a81640 1 Processor -- start 2024-04-24T23:38:40.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.405+0000 7ff178a81640 1 -- start start 2024-04-24T23:38:40.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.405+0000 7ff178a81640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff1740b8800 0x7ff1740b8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:40.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.405+0000 7ff178a81640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1740bdbf0 0x7ff1740be010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:40.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.405+0000 7ff178a81640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1740730b0 con 0x7ff174071650 2024-04-24T23:38:40.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.405+0000 7ff178a81640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7ff17414d7b0 con 0x7ff1740b8800 2024-04-24T23:38:40.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.405+0000 7ff178a81640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7ff17414da90 con 0x7ff1740bdbf0 2024-04-24T23:38:40.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.405+0000 7ff17259c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff1740b8800 0x7ff1740b8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:40.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.405+0000 7ff17259c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff1740b8800 0x7ff1740b8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42418/0 (socket says 172.21.15.57:42418) 2024-04-24T23:38:40.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.405+0000 7ff17259c640 1 -- 172.21.15.57:0/147183200 learned_addr learned my addr 172.21.15.57:0/147183200 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:40.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.405+0000 7ff171d9b640 1 --2- 172.21.15.57:0/147183200 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1740bdbf0 0x7ff1740be010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:40.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.405+0000 7ff17259c640 1 -- 172.21.15.57:0/147183200 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1740bdbf0 msgr2=0x7ff1740be010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:40.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.405+0000 7ff17259c640 1 --2- 172.21.15.57:0/147183200 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1740bdbf0 0x7ff1740be010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:40.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.405+0000 7ff17259c640 1 -- 172.21.15.57:0/147183200 >> v1:172.21.15.88:6789/0 conn(0x7ff174071650 legacy=0x7ff174071ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:40.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.405+0000 7ff17259c640 1 -- 172.21.15.57:0/147183200 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1740b9120 con 0x7ff1740b8800 2024-04-24T23:38:40.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.405+0000 7ff17259c640 1 --2- 172.21.15.57:0/147183200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1740b8800 0x7ff1740b8be0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff16400aa40 tx=0x7ff16401d910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab437ad3895e7880 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:40.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.405+0000 7ff17159a640 1 -- 172.21.15.57:0/147183200 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1640b3070 con 0x7ff1740b8800 2024-04-24T23:38:40.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff17159a640 1 -- 172.21.15.57:0/147183200 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1640a6880 con 0x7ff1740b8800 2024-04-24T23:38:40.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff17159a640 1 -- 172.21.15.57:0/147183200 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16400b040 con 0x7ff1740b8800 2024-04-24T23:38:40.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff178a81640 1 -- 172.21.15.57:0/147183200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1740b8800 msgr2=0x7ff1740b8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:40.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff178a81640 1 --2- 172.21.15.57:0/147183200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1740b8800 0x7ff1740b8be0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff16400aa40 tx=0x7ff16401d910 comp rx=0 tx=0).stop 2024-04-24T23:38:40.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff178a81640 1 -- 172.21.15.57:0/147183200 shutdown_connections 2024-04-24T23:38:40.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff178a81640 1 --2- 172.21.15.57:0/147183200 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1740bdbf0 0x7ff1740be010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:40.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff178a81640 1 --2- 172.21.15.57:0/147183200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1740b8800 0x7ff1740b8be0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:40.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff178a81640 1 -- 172.21.15.57:0/147183200 >> 172.21.15.57:0/147183200 conn(0x7ff1740beab0 msgr2=0x7ff1740beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:40.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff178a81640 1 -- 172.21.15.57:0/147183200 shutdown_connections 2024-04-24T23:38:40.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff178a81640 1 -- 172.21.15.57:0/147183200 wait complete. 2024-04-24T23:38:40.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff178a81640 1 Processor -- start 2024-04-24T23:38:40.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff178a81640 1 -- start start 2024-04-24T23:38:40.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff178a81640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff174071650 0x7ff1741480d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:40.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff178a81640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1740b8800 0x7ff174146230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:40.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff178a81640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1740bdbf0 0x7ff174138480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:40.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff178a81640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff1740b8110 con 0x7ff174071650 2024-04-24T23:38:40.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff178a81640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff1740a81a0 con 0x7ff1740b8800 2024-04-24T23:38:40.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff178a81640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7ff1740be550 con 0x7ff1740bdbf0 2024-04-24T23:38:40.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff17259c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff174071650 0x7ff1741480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:40.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff17259c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff174071650 0x7ff1741480d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42426/0 (socket says 172.21.15.57:42426) 2024-04-24T23:38:40.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff17259c640 1 -- 172.21.15.57:0/933783507 learned_addr learned my addr 172.21.15.57:0/933783507 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:40.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff171d9b640 1 --2- 172.21.15.57:0/933783507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1740b8800 0x7ff174146230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:40.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff172d9d640 1 --2- 172.21.15.57:0/933783507 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1740bdbf0 0x7ff174138480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:40.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff17259c640 1 -- 172.21.15.57:0/933783507 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1740bdbf0 msgr2=0x7ff174138480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:40.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff17259c640 1 --2- 172.21.15.57:0/933783507 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1740bdbf0 0x7ff174138480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:40.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff17259c640 1 -- 172.21.15.57:0/933783507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1740b8800 msgr2=0x7ff174146230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:40.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff17259c640 1 --2- 172.21.15.57:0/933783507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1740b8800 0x7ff174146230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:40.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff17259c640 1 -- 172.21.15.57:0/933783507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff17414c6d0 con 0x7ff174071650 2024-04-24T23:38:40.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff172d9d640 1 --2- 172.21.15.57:0/933783507 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1740bdbf0 0x7ff174138480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:38:40.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff17259c640 1 --2- 172.21.15.57:0/933783507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff174071650 0x7ff1741480d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff16401b540 tx=0x7ff16401c150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:40.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff162ffd640 1 -- 172.21.15.57:0/933783507 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1640be070 con 0x7ff174071650 2024-04-24T23:38:40.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff162ffd640 1 -- 172.21.15.57:0/933783507 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1640b5050 con 0x7ff174071650 2024-04-24T23:38:40.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff178a81640 1 -- 172.21.15.57:0/933783507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff174146770 con 0x7ff174071650 2024-04-24T23:38:40.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff162ffd640 1 -- 172.21.15.57:0/933783507 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1640b3030 con 0x7ff174071650 2024-04-24T23:38:40.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.409+0000 7ff178a81640 1 -- 172.21.15.57:0/933783507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff174147920 con 0x7ff174071650 2024-04-24T23:38:40.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.413+0000 7ff178a81640 1 -- 172.21.15.57:0/933783507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff174068220 con 0x7ff174071650 2024-04-24T23:38:40.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.413+0000 7ff162ffd640 1 -- 172.21.15.57:0/933783507 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff1640c1070 con 0x7ff174071650 2024-04-24T23:38:40.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.413+0000 7ff162ffd640 1 --2- 172.21.15.57:0/933783507 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ff1540678c0 0x7ff154069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:40.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.413+0000 7ff162ffd640 1 -- 172.21.15.57:0/933783507 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff16411f910 con 0x7ff174071650 2024-04-24T23:38:40.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.413+0000 7ff171d9b640 1 --2- 172.21.15.57:0/933783507 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ff1540678c0 0x7ff154069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:40.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.413+0000 7ff171d9b640 1 --2- 172.21.15.57:0/933783507 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ff1540678c0 0x7ff154069d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff17414a560 tx=0x7ff168008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:40.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.417+0000 7ff162ffd640 1 -- 172.21.15.57:0/933783507 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7ff174146770 con 0x7ff174071650 2024-04-24T23:38:40.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.613+0000 7ff178a81640 1 -- 172.21.15.57:0/933783507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1740c1d90 con 0x7ff174071650 2024-04-24T23:38:40.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.617+0000 7ff162ffd640 1 -- 172.21.15.57:0/933783507 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+4350 (secure 0 0 0) 0x7ff164017500 con 0x7ff174071650 2024-04-24T23:38:40.617 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:38:40.617 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2925410225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2925410225},{"type":"v1","addr":"172.21.15.88:6835","nonce":2925410225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4227,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/173597347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":173597347},{"type":"v1","addr":"172.21.15.57:6834","nonce":173597347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:38:33.449139+0000","modified":"2024-04-24T23:38:38.604804+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4230":{"gid":4230,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/1701414040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":1701414040},{"type":"v1","addr":"172.21.15.57:6835","nonce":1701414040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4230,"qdb_cluster":[4230]},"id":1}]} 2024-04-24T23:38:40.617 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 7 2024-04-24T23:38:40.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.617+0000 7ff178a81640 1 -- 172.21.15.57:0/933783507 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ff1540678c0 msgr2=0x7ff154069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:40.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.617+0000 7ff178a81640 1 --2- 172.21.15.57:0/933783507 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ff1540678c0 0x7ff154069d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff17414a560 tx=0x7ff168008040 comp rx=0 tx=0).stop 2024-04-24T23:38:40.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.617+0000 7ff178a81640 1 -- 172.21.15.57:0/933783507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff174071650 msgr2=0x7ff1741480d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:40.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.617+0000 7ff178a81640 1 --2- 172.21.15.57:0/933783507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff174071650 0x7ff1741480d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff16401b540 tx=0x7ff16401c150 comp rx=0 tx=0).stop 2024-04-24T23:38:40.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.617+0000 7ff178a81640 1 -- 172.21.15.57:0/933783507 shutdown_connections 2024-04-24T23:38:40.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.617+0000 7ff178a81640 1 --2- 172.21.15.57:0/933783507 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ff1540678c0 0x7ff154069d80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:40.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.617+0000 7ff178a81640 1 --2- 172.21.15.57:0/933783507 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1740bdbf0 0x7ff174138480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:40.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.617+0000 7ff178a81640 1 --2- 172.21.15.57:0/933783507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1740b8800 0x7ff174146230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:40.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.617+0000 7ff178a81640 1 --2- 172.21.15.57:0/933783507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff174071650 0x7ff1741480d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:40.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.617+0000 7ff178a81640 1 -- 172.21.15.57:0/933783507 >> 172.21.15.57:0/933783507 conn(0x7ff1740beab0 msgr2=0x7ff17414bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:40.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.617+0000 7ff178a81640 1 -- 172.21.15.57:0/933783507 shutdown_connections 2024-04-24T23:38:40.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.617+0000 7ff178a81640 1 -- 172.21.15.57:0/933783507 wait complete. 2024-04-24T23:38:40.635 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:38:40.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.761+0000 7f1280f68640 1 Processor -- start 2024-04-24T23:38:40.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.761+0000 7f1280f68640 1 -- start start 2024-04-24T23:38:40.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.761+0000 7f1280f68640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f127c0a6350 0x7f127c0a6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:40.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.761+0000 7f1280f68640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f127c0a3230 0x7f127c0bf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:40.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.761+0000 7f1280f68640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f127c0a39c0 con 0x7f127c0c3240 2024-04-24T23:38:40.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.761+0000 7f1280f68640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f127c0c0ca0 con 0x7f127c0a6350 2024-04-24T23:38:40.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.761+0000 7f1280f68640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f127c1528c0 con 0x7f127c0a3230 2024-04-24T23:38:40.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.761+0000 7f127a59c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f127c0a6350 0x7f127c0a6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:40.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.761+0000 7f127a59c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f127c0a6350 0x7f127c0a6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42428/0 (socket says 172.21.15.57:42428) 2024-04-24T23:38:40.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.761+0000 7f127a59c640 1 -- 172.21.15.57:0/718331723 learned_addr learned my addr 172.21.15.57:0/718331723 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:40.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.761+0000 7f127ad9d640 1 --2- 172.21.15.57:0/718331723 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f127c0a3230 0x7f127c0bf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:40.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.761+0000 7f127a59c640 1 -- 172.21.15.57:0/718331723 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f127c0a3230 msgr2=0x7f127c0bf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:40.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.761+0000 7f127a59c640 1 --2- 172.21.15.57:0/718331723 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f127c0a3230 0x7f127c0bf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:40.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.761+0000 7f127a59c640 1 -- 172.21.15.57:0/718331723 >> v1:172.21.15.88:6789/0 conn(0x7f127c0c3240 legacy=0x7f127c0c1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:40.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.761+0000 7f127a59c640 1 -- 172.21.15.57:0/718331723 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f127c0c0930 con 0x7f127c0a6350 2024-04-24T23:38:40.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.761+0000 7f127a59c640 1 --2- 172.21.15.57:0/718331723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f127c0a6350 0x7f127c0a6730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f126c009870 tx=0x7f126c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2877fd7899649b24 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:40.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f127959a640 1 -- 172.21.15.57:0/718331723 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126c0b0070 con 0x7f127c0a6350 2024-04-24T23:38:40.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f127959a640 1 -- 172.21.15.57:0/718331723 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f126c0ab600 con 0x7f127c0a6350 2024-04-24T23:38:40.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f127959a640 1 -- 172.21.15.57:0/718331723 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126c0ab9d0 con 0x7f127c0a6350 2024-04-24T23:38:40.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f1280f68640 1 -- 172.21.15.57:0/718331723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f127c0a6350 msgr2=0x7f127c0a6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:40.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f1280f68640 1 --2- 172.21.15.57:0/718331723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f127c0a6350 0x7f127c0a6730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f126c009870 tx=0x7f126c01c4d0 comp rx=0 tx=0).stop 2024-04-24T23:38:40.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f1280f68640 1 -- 172.21.15.57:0/718331723 shutdown_connections 2024-04-24T23:38:40.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f1280f68640 1 --2- 172.21.15.57:0/718331723 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f127c0a3230 0x7f127c0bf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:40.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f1280f68640 1 --2- 172.21.15.57:0/718331723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f127c0a6350 0x7f127c0a6730 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:40.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f1280f68640 1 -- 172.21.15.57:0/718331723 >> 172.21.15.57:0/718331723 conn(0x7f127c06b8a0 msgr2=0x7f127c0a5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:40.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f1280f68640 1 -- 172.21.15.57:0/718331723 shutdown_connections 2024-04-24T23:38:40.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f1280f68640 1 -- 172.21.15.57:0/718331723 wait complete. 2024-04-24T23:38:40.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f1280f68640 1 Processor -- start 2024-04-24T23:38:40.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f1280f68640 1 -- start start 2024-04-24T23:38:40.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f1280f68640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f127c0a3230 0x7f127c159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:40.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f1280f68640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f127c0a6350 0x7f127c0a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:40.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f1280f68640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f127c0c3240 0x7f127c14ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:40.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f1280f68640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f127c0713b0 con 0x7f127c0c3240 2024-04-24T23:38:40.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f1280f68640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f127c071230 con 0x7f127c0a6350 2024-04-24T23:38:40.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f1280f68640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f127c071530 con 0x7f127c0a3230 2024-04-24T23:38:40.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f127ad9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f127c0c3240 0x7f127c14ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:40.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f127ad9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f127c0c3240 0x7f127c14ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42430/0 (socket says 172.21.15.57:42430) 2024-04-24T23:38:40.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f127ad9d640 1 -- 172.21.15.57:0/3197855950 learned_addr learned my addr 172.21.15.57:0/3197855950 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:40.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f1279d9b640 1 --2- 172.21.15.57:0/3197855950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f127c0a6350 0x7f127c0a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:40.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f127a59c640 1 --2- 172.21.15.57:0/3197855950 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f127c0a3230 0x7f127c159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:40.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f127ad9d640 1 -- 172.21.15.57:0/3197855950 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f127c0a3230 msgr2=0x7f127c159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:40.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f127ad9d640 1 --2- 172.21.15.57:0/3197855950 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f127c0a3230 0x7f127c159850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:40.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f127ad9d640 1 -- 172.21.15.57:0/3197855950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f127c0a6350 msgr2=0x7f127c0a4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:40.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f127ad9d640 1 --2- 172.21.15.57:0/3197855950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f127c0a6350 0x7f127c0a4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:40.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f127ad9d640 1 -- 172.21.15.57:0/3197855950 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f127c151a60 con 0x7f127c0c3240 2024-04-24T23:38:40.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f1279d9b640 1 --2- 172.21.15.57:0/3197855950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f127c0a6350 0x7f127c0a4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:38:40.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.765+0000 7f127ad9d640 1 --2- 172.21.15.57:0/3197855950 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f127c0c3240 0x7f127c14ed30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1274007e70 tx=0x7f127400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:40.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.769+0000 7f126affd640 1 -- 172.21.15.57:0/3197855950 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1274014420 con 0x7f127c0c3240 2024-04-24T23:38:40.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.769+0000 7f126affd640 1 -- 172.21.15.57:0/3197855950 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1274019070 con 0x7f127c0c3240 2024-04-24T23:38:40.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.769+0000 7f1280f68640 1 -- 172.21.15.57:0/3197855950 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f127c0a53a0 con 0x7f127c0c3240 2024-04-24T23:38:40.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.769+0000 7f126affd640 1 -- 172.21.15.57:0/3197855950 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1274014820 con 0x7f127c0c3240 2024-04-24T23:38:40.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.769+0000 7f1280f68640 1 -- 172.21.15.57:0/3197855950 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f127c151780 con 0x7f127c0c3240 2024-04-24T23:38:40.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.769+0000 7f1280f68640 1 -- 172.21.15.57:0/3197855950 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f127c1eb860 con 0x7f127c0c3240 2024-04-24T23:38:40.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.769+0000 7f126affd640 1 -- 172.21.15.57:0/3197855950 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f12740149c0 con 0x7f127c0c3240 2024-04-24T23:38:40.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.769+0000 7f126affd640 1 --2- 172.21.15.57:0/3197855950 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f125c0678c0 0x7f125c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:40.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.769+0000 7f126affd640 1 -- 172.21.15.57:0/3197855950 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1274086950 con 0x7f127c0c3240 2024-04-24T23:38:40.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.769+0000 7f127a59c640 1 --2- 172.21.15.57:0/3197855950 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f125c0678c0 0x7f125c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:40.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.769+0000 7f127a59c640 1 --2- 172.21.15.57:0/3197855950 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f125c0678c0 0x7f125c069d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f126c0ad000 tx=0x7f126c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:40.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.773+0000 7f126affd640 1 -- 172.21.15.57:0/3197855950 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f127c0a53a0 con 0x7f127c0c3240 2024-04-24T23:38:40.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.933+0000 7f1280f68640 1 -- 172.21.15.57:0/3197855950 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f127c0c2da0 con 0x7f127c0c3240 2024-04-24T23:38:40.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.937+0000 7f126affd640 1 -- 172.21.15.57:0/3197855950 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7f1274057020 con 0x7f127c0c3240 2024-04-24T23:38:40.939 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:38:40.939 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":24,"fsid":"1ea31698-444a-4667-bcd9-b2608ad103c3","created":"2024-04-24T23:38:16.748774+0000","modified":"2024-04-24T23:38:38.604475+0000","last_up_change":"2024-04-24T23:38:26.956537+0000","last_in_change":"2024-04-24T23:38:18.972175+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:38:27.611782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:38:31.718061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:38:32.469413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:38:36.215724+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"35ce67bc-9b25-416e-ab1e-774c717631f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6825","nonce":671364028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6827","nonce":671364028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6831","nonce":671364028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6829","nonce":671364028}]},"public_addr":"172.21.15.57:6825/671364028","cluster_addr":"172.21.15.57:6827/671364028","heartbeat_back_addr":"172.21.15.57:6831/671364028","heartbeat_front_addr":"172.21.15.57:6829/671364028","state":["exists","up"]},{"osd":1,"uuid":"38f6f4ef-3bc2-4453-9946-7d1d17e735ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6801","nonce":2653552037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6803","nonce":2653552037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6807","nonce":2653552037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6805","nonce":2653552037}]},"public_addr":"172.21.15.57:6801/2653552037","cluster_addr":"172.21.15.57:6803/2653552037","heartbeat_back_addr":"172.21.15.57:6807/2653552037","heartbeat_front_addr":"172.21.15.57:6805/2653552037","state":["exists","up"]},{"osd":2,"uuid":"d77a0a49-b39a-464e-a1c9-49e19280c440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6816","nonce":1565874109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6819","nonce":1565874109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6823","nonce":1565874109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6821","nonce":1565874109}]},"public_addr":"172.21.15.57:6816/1565874109","cluster_addr":"172.21.15.57:6819/1565874109","heartbeat_back_addr":"172.21.15.57:6823/1565874109","heartbeat_front_addr":"172.21.15.57:6821/1565874109","state":["exists","up"]},{"osd":3,"uuid":"f8ea9bfe-d839-44a6-a185-0f0985da314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6809","nonce":3474703186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6811","nonce":3474703186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6817","nonce":3474703186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6813","nonce":3474703186}]},"public_addr":"172.21.15.57:6809/3474703186","cluster_addr":"172.21.15.57:6811/3474703186","heartbeat_back_addr":"172.21.15.57:6817/3474703186","heartbeat_front_addr":"172.21.15.57:6813/3474703186","state":["exists","up"]},{"osd":4,"uuid":"454647d4-6ac2-46b4-8451-320eb951a87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6801","nonce":1271707713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6803","nonce":1271707713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6807","nonce":1271707713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6805","nonce":1271707713}]},"public_addr":"172.21.15.88:6801/1271707713","cluster_addr":"172.21.15.88:6803/1271707713","heartbeat_back_addr":"172.21.15.88:6807/1271707713","heartbeat_front_addr":"172.21.15.88:6805/1271707713","state":["exists","up"]},{"osd":5,"uuid":"f71c03a3-7ad8-46d3-89c9-d61de102586b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6809","nonce":2035054888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6813","nonce":2035054888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6820","nonce":2035054888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6816","nonce":2035054888}]},"public_addr":"172.21.15.88:6809/2035054888","cluster_addr":"172.21.15.88:6813/2035054888","heartbeat_back_addr":"172.21.15.88:6820/2035054888","heartbeat_front_addr":"172.21.15.88:6816/2035054888","state":["exists","up"]},{"osd":6,"uuid":"ec7ae2b7-9cb4-4059-8f98-0022c9763f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6825","nonce":1752291242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6827","nonce":1752291242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6831","nonce":1752291242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6829","nonce":1752291242}]},"public_addr":"172.21.15.88:6825/1752291242","cluster_addr":"172.21.15.88:6827/1752291242","heartbeat_back_addr":"172.21.15.88:6831/1752291242","heartbeat_front_addr":"172.21.15.88:6829/1752291242","state":["exists","up"]},{"osd":7,"uuid":"c0ee7505-60c1-40ba-9902-47313a04dafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6812","nonce":1782800372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6817","nonce":1782800372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6823","nonce":1782800372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6821","nonce":1782800372}]},"public_addr":"172.21.15.88:6812/1782800372","cluster_addr":"172.21.15.88:6817/1782800372","heartbeat_back_addr":"172.21.15.88:6823/1782800372","heartbeat_front_addr":"172.21.15.88:6821/1782800372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.698562+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.682587+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.680197+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.561753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.011095+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.493320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.353451+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.423877+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:38:40.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.941+0000 7f1280f68640 1 -- 172.21.15.57:0/3197855950 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f125c0678c0 msgr2=0x7f125c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:40.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.941+0000 7f1280f68640 1 --2- 172.21.15.57:0/3197855950 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f125c0678c0 0x7f125c069d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f126c0ad000 tx=0x7f126c0a6000 comp rx=0 tx=0).stop 2024-04-24T23:38:40.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.941+0000 7f1280f68640 1 -- 172.21.15.57:0/3197855950 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f127c0c3240 msgr2=0x7f127c14ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:40.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.941+0000 7f1280f68640 1 --2- 172.21.15.57:0/3197855950 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f127c0c3240 0x7f127c14ed30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1274007e70 tx=0x7f127400e4b0 comp rx=0 tx=0).stop 2024-04-24T23:38:40.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.941+0000 7f1280f68640 1 -- 172.21.15.57:0/3197855950 shutdown_connections 2024-04-24T23:38:40.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.941+0000 7f1280f68640 1 --2- 172.21.15.57:0/3197855950 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f125c0678c0 0x7f125c069d80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:40.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.941+0000 7f1280f68640 1 --2- 172.21.15.57:0/3197855950 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f127c0c3240 0x7f127c14ed30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:40.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.941+0000 7f1280f68640 1 --2- 172.21.15.57:0/3197855950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f127c0a6350 0x7f127c0a4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:40.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.941+0000 7f1280f68640 1 --2- 172.21.15.57:0/3197855950 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f127c0a3230 0x7f127c159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:40.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.941+0000 7f1280f68640 1 -- 172.21.15.57:0/3197855950 >> 172.21.15.57:0/3197855950 conn(0x7f127c06b8a0 msgr2=0x7f127c0a84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:40.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.941+0000 7f1280f68640 1 -- 172.21.15.57:0/3197855950 shutdown_connections 2024-04-24T23:38:40.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:40.941+0000 7f1280f68640 1 -- 172.21.15.57:0/3197855950 wait complete. 2024-04-24T23:38:41.260 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-24T23:38:33.449139+0000', 'modified': '2024-04-24T23:38:38.604804+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4230}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4230': {'gid': 4230, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/1701414040', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 1701414040}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 1701414040}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4230, 'qdb_cluster': [4230]} 2024-04-24T23:38:41.260 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-24T23:38:41.261 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-24T23:38:41.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.397+0000 7f1777d6d640 1 Processor -- start 2024-04-24T23:38:41.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.397+0000 7f1777d6d640 1 -- start start 2024-04-24T23:38:41.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.397+0000 7f1777d6d640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f177006e520 0x7f177014d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:41.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.397+0000 7f1777d6d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f17700bf3a0 0x7f177014a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:41.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.397+0000 7f1777d6d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17700bd870 con 0x7f1770072200 2024-04-24T23:38:41.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.397+0000 7f1777d6d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f177014e350 con 0x7f17700bf3a0 2024-04-24T23:38:41.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.397+0000 7f1777d6d640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f17700be440 con 0x7f177006e520 2024-04-24T23:38:41.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.397+0000 7f177630a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f17700bf3a0 0x7f177014a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:41.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.397+0000 7f177630a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f17700bf3a0 0x7f177014a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42432/0 (socket says 172.21.15.57:42432) 2024-04-24T23:38:41.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.397+0000 7f177630a640 1 -- 172.21.15.57:0/146594645 learned_addr learned my addr 172.21.15.57:0/146594645 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:41.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.397+0000 7f1775308640 1 --2- 172.21.15.57:0/146594645 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f177006e520 0x7f177014d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:41.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.397+0000 7f177630a640 1 -- 172.21.15.57:0/146594645 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f177006e520 msgr2=0x7f177014d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:41.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.397+0000 7f177630a640 1 --2- 172.21.15.57:0/146594645 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f177006e520 0x7f177014d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.397+0000 7f177630a640 1 -- 172.21.15.57:0/146594645 >> v1:172.21.15.88:6789/0 conn(0x7f1770072200 legacy=0x7f17700be8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:41.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.397+0000 7f177630a640 1 -- 172.21.15.57:0/146594645 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17700bdb10 con 0x7f17700bf3a0 2024-04-24T23:38:41.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.397+0000 7f1775308640 1 --2- 172.21.15.57:0/146594645 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f177006e520 0x7f177014d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:38:41.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.401+0000 7f177630a640 1 --2- 172.21.15.57:0/146594645 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17700bf3a0 0x7f177014a500 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f17680098a0 tx=0x7f176801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4352783e295fc793 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:41.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.401+0000 7f1774b07640 1 -- 172.21.15.57:0/146594645 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17680b5070 con 0x7f17700bf3a0 2024-04-24T23:38:41.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.401+0000 7f1774b07640 1 -- 172.21.15.57:0/146594645 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17680a8a30 con 0x7f17700bf3a0 2024-04-24T23:38:41.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.401+0000 7f1774b07640 1 -- 172.21.15.57:0/146594645 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17680a8e00 con 0x7f17700bf3a0 2024-04-24T23:38:41.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.401+0000 7f1777d6d640 1 -- 172.21.15.57:0/146594645 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17700bf3a0 msgr2=0x7f177014a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:41.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.401+0000 7f1777d6d640 1 --2- 172.21.15.57:0/146594645 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17700bf3a0 0x7f177014a500 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f17680098a0 tx=0x7f176801ed30 comp rx=0 tx=0).stop 2024-04-24T23:38:41.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.401+0000 7f1777d6d640 1 -- 172.21.15.57:0/146594645 shutdown_connections 2024-04-24T23:38:41.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.401+0000 7f1777d6d640 1 --2- 172.21.15.57:0/146594645 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17700bf3a0 0x7f177014a500 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.401+0000 7f1777d6d640 1 --2- 172.21.15.57:0/146594645 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f177006e520 0x7f177014d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.401+0000 7f1777d6d640 1 -- 172.21.15.57:0/146594645 >> 172.21.15.57:0/146594645 conn(0x7f17700c2e70 msgr2=0x7f17700c3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:41.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.401+0000 7f1777d6d640 1 -- 172.21.15.57:0/146594645 shutdown_connections 2024-04-24T23:38:41.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.401+0000 7f1777d6d640 1 -- 172.21.15.57:0/146594645 wait complete. 2024-04-24T23:38:41.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.401+0000 7f1777d6d640 1 Processor -- start 2024-04-24T23:38:41.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.401+0000 7f1777d6d640 1 -- start start 2024-04-24T23:38:41.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.401+0000 7f1777d6d640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f177006e520 0x7f177014e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:41.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.401+0000 7f1777d6d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1770072200 0x7f17700bab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:41.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.401+0000 7f1777d6d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17700bf3a0 0x7f1770120a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:41.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.401+0000 7f1777d6d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f17700725e0 con 0x7f17700bf3a0 2024-04-24T23:38:41.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.401+0000 7f1777d6d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f17700be0d0 con 0x7f1770072200 2024-04-24T23:38:41.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.401+0000 7f1777d6d640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f1770072760 con 0x7f177006e520 2024-04-24T23:38:41.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.401+0000 7f177630a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17700bf3a0 0x7f1770120a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:41.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.401+0000 7f177630a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17700bf3a0 0x7f1770120a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42442/0 (socket says 172.21.15.57:42442) 2024-04-24T23:38:41.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.401+0000 7f177630a640 1 -- 172.21.15.57:0/883127514 learned_addr learned my addr 172.21.15.57:0/883127514 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:41.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.401+0000 7f1775308640 1 --2- 172.21.15.57:0/883127514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1770072200 0x7f17700bab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:41.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.401+0000 7f1775b09640 1 --2- 172.21.15.57:0/883127514 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f177006e520 0x7f177014e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:41.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.401+0000 7f177630a640 1 -- 172.21.15.57:0/883127514 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f177006e520 msgr2=0x7f177014e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:41.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.401+0000 7f177630a640 1 --2- 172.21.15.57:0/883127514 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f177006e520 0x7f177014e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.401+0000 7f177630a640 1 -- 172.21.15.57:0/883127514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1770072200 msgr2=0x7f17700bab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:41.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.405+0000 7f177630a640 1 --2- 172.21.15.57:0/883127514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1770072200 0x7f17700bab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.405+0000 7f177630a640 1 -- 172.21.15.57:0/883127514 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17700bb0a0 con 0x7f17700bf3a0 2024-04-24T23:38:41.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.405+0000 7f1775b09640 1 --2- 172.21.15.57:0/883127514 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f177006e520 0x7f177014e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:38:41.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.405+0000 7f177630a640 1 --2- 172.21.15.57:0/883127514 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17700bf3a0 0x7f1770120a50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f176801d3e0 tx=0x7f176801bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:41.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.405+0000 7f17667fc640 1 -- 172.21.15.57:0/883127514 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17680b5070 con 0x7f17700bf3a0 2024-04-24T23:38:41.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.405+0000 7f17667fc640 1 -- 172.21.15.57:0/883127514 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17680b0ba0 con 0x7f17700bf3a0 2024-04-24T23:38:41.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.405+0000 7f1777d6d640 1 -- 172.21.15.57:0/883127514 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17701ea150 con 0x7f17700bf3a0 2024-04-24T23:38:41.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.405+0000 7f17667fc640 1 -- 172.21.15.57:0/883127514 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17680bb420 con 0x7f17700bf3a0 2024-04-24T23:38:41.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.405+0000 7f1777d6d640 1 -- 172.21.15.57:0/883127514 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17701e9e70 con 0x7f17700bf3a0 2024-04-24T23:38:41.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.405+0000 7f17667fc640 1 -- 172.21.15.57:0/883127514 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f17680b9030 con 0x7f17700bf3a0 2024-04-24T23:38:41.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.405+0000 7f17667fc640 1 --2- 172.21.15.57:0/883127514 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f17540678c0 0x7f1754069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:41.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.405+0000 7f17667fc640 1 -- 172.21.15.57:0/883127514 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f17681230a0 con 0x7f17700bf3a0 2024-04-24T23:38:41.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.405+0000 7f1775b09640 1 --2- 172.21.15.57:0/883127514 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f17540678c0 0x7f1754069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:41.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.405+0000 7f177aee6000 1 Processor -- start 2024-04-24T23:38:41.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.405+0000 7f177aee6000 1 -- start start 2024-04-24T23:38:41.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.405+0000 7f1775b09640 1 --2- 172.21.15.57:0/883127514 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f17540678c0 0x7f1754069d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f176c001e10 tx=0x7f176c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:41.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.405+0000 7f177aee6000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586fc147b80 0x5586fc147f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:41.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.405+0000 7f177aee6000 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5586fc1484a0 0x5586fc148880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:41.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.405+0000 7f177aee6000 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586fc148dc0 0x5586fc18da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:41.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177aee6000 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5586fbf985e0 con 0x5586fc148dc0 2024-04-24T23:38:41.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177aee6000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x5586fbf1fc50 con 0x5586fc147b80 2024-04-24T23:38:41.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177aee6000 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x5586fbf945a0 con 0x5586fc1484a0 2024-04-24T23:38:41.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177630a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586fc148dc0 0x5586fc18da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:41.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177630a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586fc148dc0 0x5586fc18da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42456/0 (socket says 172.21.15.57:42456) 2024-04-24T23:38:41.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177630a640 1 -- 172.21.15.57:0/878145299 learned_addr learned my addr 172.21.15.57:0/878145299 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:41.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f1775b09640 1 --2- 172.21.15.57:0/878145299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586fc147b80 0x5586fc147f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:41.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f1775308640 1 --2- 172.21.15.57:0/878145299 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5586fc1484a0 0x5586fc148880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:41.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177630a640 1 -- 172.21.15.57:0/878145299 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5586fc1484a0 msgr2=0x5586fc148880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:41.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177630a640 1 --2- 172.21.15.57:0/878145299 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5586fc1484a0 0x5586fc148880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177630a640 1 -- 172.21.15.57:0/878145299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586fc147b80 msgr2=0x5586fc147f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:41.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177630a640 1 --2- 172.21.15.57:0/878145299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586fc147b80 0x5586fc147f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177630a640 1 -- 172.21.15.57:0/878145299 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586fbf1dd10 con 0x5586fc148dc0 2024-04-24T23:38:41.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177630a640 1 --2- 172.21.15.57:0/878145299 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586fc148dc0 0x5586fc18da40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f17680f31c0 tx=0x7f17680f2e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d52488f04ea61224 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:41.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f17537fe640 1 -- 172.21.15.57:0/878145299 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17680f3230 con 0x5586fc148dc0 2024-04-24T23:38:41.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f17537fe640 1 -- 172.21.15.57:0/878145299 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17680f75e0 con 0x5586fc148dc0 2024-04-24T23:38:41.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f17537fe640 1 -- 172.21.15.57:0/878145299 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17680fbe10 con 0x5586fc148dc0 2024-04-24T23:38:41.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177aee6000 1 -- 172.21.15.57:0/878145299 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586fc148dc0 msgr2=0x5586fc18da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:41.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177aee6000 1 --2- 172.21.15.57:0/878145299 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586fc148dc0 0x5586fc18da40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f17680f31c0 tx=0x7f17680f2e30 comp rx=0 tx=0).stop 2024-04-24T23:38:41.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177aee6000 1 -- 172.21.15.57:0/878145299 shutdown_connections 2024-04-24T23:38:41.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177aee6000 1 --2- 172.21.15.57:0/878145299 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586fc148dc0 0x5586fc18da40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177aee6000 1 --2- 172.21.15.57:0/878145299 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5586fc1484a0 0x5586fc148880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177aee6000 1 --2- 172.21.15.57:0/878145299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586fc147b80 0x5586fc147f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177aee6000 1 -- 172.21.15.57:0/878145299 >> 172.21.15.57:0/878145299 conn(0x5586fc1817a0 msgr2=0x5586fc183bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:41.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177aee6000 1 -- 172.21.15.57:0/878145299 shutdown_connections 2024-04-24T23:38:41.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177aee6000 1 -- 172.21.15.57:0/878145299 wait complete. 2024-04-24T23:38:41.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177aee6000 1 -- start start 2024-04-24T23:38:41.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177aee6000 1 Processor -- start 2024-04-24T23:38:41.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177aee6000 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586fc147b80 0x5586fc14fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:41.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177aee6000 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5586fc1484a0 0x5586fc14df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:41.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177aee6000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586fc148dc0 0x5586fc14e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:41.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177aee6000 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5586fbf9cc10 con 0x5586fc147b80 2024-04-24T23:38:41.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177aee6000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x5586fbf52520 con 0x5586fc148dc0 2024-04-24T23:38:41.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177aee6000 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x5586fbf65340 con 0x5586fc1484a0 2024-04-24T23:38:41.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177aee6000 10 client.0 _ll_register_callbacks cb 0x5586fc1355c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:38:41.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f1775b09640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586fc147b80 0x5586fc14fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:41.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f1775b09640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586fc147b80 0x5586fc14fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42458/0 (socket says 172.21.15.57:42458) 2024-04-24T23:38:41.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f1775b09640 1 -- 172.21.15.57:0/3784037132 learned_addr learned my addr 172.21.15.57:0/3784037132 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:41.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f1775308640 1 --2- 172.21.15.57:0/3784037132 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5586fc1484a0 0x5586fc14df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:41.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177630a640 1 --2- 172.21.15.57:0/3784037132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586fc148dc0 0x5586fc14e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:41.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f1775b09640 1 -- 172.21.15.57:0/3784037132 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5586fc1484a0 msgr2=0x5586fc14df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:41.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f1775b09640 1 --2- 172.21.15.57:0/3784037132 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5586fc1484a0 0x5586fc14df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f1775b09640 1 -- 172.21.15.57:0/3784037132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586fc148dc0 msgr2=0x5586fc14e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:41.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f1775b09640 1 --2- 172.21.15.57:0/3784037132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586fc148dc0 0x5586fc14e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f1775b09640 1 -- 172.21.15.57:0/3784037132 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586fbf307b0 con 0x5586fc147b80 2024-04-24T23:38:41.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f1775b09640 1 --2- 172.21.15.57:0/3784037132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586fc147b80 0x5586fc14fab0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f176c00ec10 tx=0x7f176c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ae740581cf0d20 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:41.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f1750ff9640 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2024-04-24T23:38:41.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f1750ff9640 1 -- 172.21.15.57:0/3784037132 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c027060 con 0x5586fc147b80 2024-04-24T23:38:41.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f1750ff9640 1 -- 172.21.15.57:0/3784037132 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f176c010040 con 0x5586fc147b80 2024-04-24T23:38:41.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f177aee6000 1 -- 172.21.15.57:0/3784037132 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17680f75e0 con 0x5586fc147b80 2024-04-24T23:38:41.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.409+0000 7f1750ff9640 1 -- 172.21.15.57:0/3784037132 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f176c013420 con 0x5586fc147b80 2024-04-24T23:38:41.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.413+0000 7f177aee6000 10 client.4377 fetch_fsmap learned FSMap version 7 2024-04-24T23:38:41.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.413+0000 7f177aee6000 1 -- 172.21.15.57:0/3784037132 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x5586fbf1fea0 con 0x5586fc147b80 2024-04-24T23:38:41.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.413+0000 7f1750ff9640 1 -- 172.21.15.57:0/3784037132 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17680f75e0 con 0x5586fc147b80 2024-04-24T23:38:41.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.413+0000 7f1750ff9640 1 -- 172.21.15.57:0/3784037132 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 7) ==== 2897+0+0 (secure 0 0 0) 0x7f176c0135c0 con 0x5586fc147b80 2024-04-24T23:38:41.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.413+0000 7f177aee6000 10 client.4377 fetch_fsmap finished waiting for FSMap version 7 2024-04-24T23:38:41.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.413+0000 7f177aee6000 10 client.4377 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-24T23:38:41.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.413+0000 7f177aee6000 20 client.4377 populate_metadata read hostname 'smithi057' 2024-04-24T23:38:41.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.413+0000 7f177aee6000 1 --2- 172.21.15.57:0/3784037132 >> [v2:172.21.15.57:6833/1701414040,v1:172.21.15.57:6835/1701414040] conn(0x5586fc14ee60 0x5586fc14f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:41.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.413+0000 7f177aee6000 4 client.4377 mds_command: new command op to 4230 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-24T23:38:41.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.413+0000 7f177aee6000 1 -- 172.21.15.57:0/3784037132 --> [v2:172.21.15.57:6833/1701414040,v1:172.21.15.57:6835/1701414040] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586fbf33ab0 con 0x5586fc14ee60 2024-04-24T23:38:41.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.413+0000 7f1775308640 1 --2- 172.21.15.57:0/3784037132 >> [v2:172.21.15.57:6833/1701414040,v1:172.21.15.57:6835/1701414040] conn(0x5586fc14ee60 0x5586fc14f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:41.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.413+0000 7f1775308640 1 --2- 172.21.15.57:0/3784037132 >> [v2:172.21.15.57:6833/1701414040,v1:172.21.15.57:6835/1701414040] conn(0x5586fc14ee60 0x5586fc14f240 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7dd73ce58489cec server_cookie=cb781998c5d3d0c7 in_seq=0 out_seq=0 2024-04-24T23:38:41.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.413+0000 7f1750ff9640 10 client.4377 ms_handle_connect on v2:172.21.15.57:6833/1701414040 2024-04-24T23:38:41.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.413+0000 7f1750ff9640 1 -- 172.21.15.57:0/3784037132 <== mds.0 v2:172.21.15.57:6833/1701414040 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5586fbf33ab0 con 0x5586fc14ee60 2024-04-24T23:38:41.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.413+0000 7f1750ff9640 10 client.4377 handle_command_reply: tid=0 2024-04-24T23:38:41.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.413+0000 7f177aee6000 1 client.4377 shutdown 2024-04-24T23:38:41.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.413+0000 7f177aee6000 1 -- 172.21.15.57:0/3784037132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586fc147b80 msgr2=0x5586fc14fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:41.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.413+0000 7f177aee6000 1 --2- 172.21.15.57:0/3784037132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586fc147b80 0x5586fc14fab0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f176c00ec10 tx=0x7f176c000f50 comp rx=0 tx=0).stop 2024-04-24T23:38:41.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.413+0000 7f177aee6000 1 -- 172.21.15.57:0/3784037132 shutdown_connections 2024-04-24T23:38:41.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.413+0000 7f177aee6000 1 --2- 172.21.15.57:0/3784037132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586fc148dc0 0x5586fc14e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.413+0000 7f177aee6000 1 --2- 172.21.15.57:0/3784037132 >> [v2:172.21.15.57:6833/1701414040,v1:172.21.15.57:6835/1701414040] conn(0x5586fc14ee60 0x5586fc14f240 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.413+0000 7f177aee6000 1 --2- 172.21.15.57:0/3784037132 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5586fc1484a0 0x5586fc14df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.413+0000 7f177aee6000 1 --2- 172.21.15.57:0/3784037132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586fc147b80 0x5586fc14fab0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.413+0000 7f1750ff9640 0 client.4377 ms_handle_reset on v2:172.21.15.57:6833/1701414040 2024-04-24T23:38:41.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.413+0000 7f177aee6000 1 -- 172.21.15.57:0/3784037132 >> 172.21.15.57:0/3784037132 conn(0x5586fc1817a0 msgr2=0x5586fc147280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:41.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.413+0000 7f177aee6000 1 -- 172.21.15.57:0/3784037132 shutdown_connections 2024-04-24T23:38:41.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.413+0000 7f177aee6000 1 -- 172.21.15.57:0/3784037132 wait complete. 2024-04-24T23:38:41.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.413+0000 7f177aee6000 20 client.4377 trim_cache size 0 max 16384 2024-04-24T23:38:41.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.429+0000 7f177aee6000 1 Processor -- start 2024-04-24T23:38:41.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.429+0000 7f177aee6000 1 -- start start 2024-04-24T23:38:41.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177aee6000 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586fc1817a0 0x5586fc198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:41.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177aee6000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586fc147b80 0x5586fc199300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:41.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177aee6000 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5586fc1484a0 0x5586fc199840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:41.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177aee6000 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f17701f3fe0 con 0x5586fc1817a0 2024-04-24T23:38:41.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177aee6000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f17701f2ac0 con 0x5586fc147b80 2024-04-24T23:38:41.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177aee6000 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f17701f30e0 con 0x5586fc1484a0 2024-04-24T23:38:41.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f1775b09640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586fc1817a0 0x5586fc198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:41.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f1775b09640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586fc1817a0 0x5586fc198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42474/0 (socket says 172.21.15.57:42474) 2024-04-24T23:38:41.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f1775b09640 1 -- 172.21.15.57:0/2792605335 learned_addr learned my addr 172.21.15.57:0/2792605335 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:41.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f1775b09640 1 -- 172.21.15.57:0/2792605335 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5586fc1484a0 msgr2=0x5586fc199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:41.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f1775b09640 1 --2- 172.21.15.57:0/2792605335 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5586fc1484a0 0x5586fc199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f1775b09640 1 -- 172.21.15.57:0/2792605335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586fc147b80 msgr2=0x5586fc199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:41.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f1775308640 1 --2- 172.21.15.57:0/2792605335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586fc147b80 0x5586fc199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:41.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f1775b09640 1 --2- 172.21.15.57:0/2792605335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586fc147b80 0x5586fc199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f1775b09640 1 -- 172.21.15.57:0/2792605335 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586fbf20e80 con 0x5586fc1817a0 2024-04-24T23:38:41.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f1775b09640 1 --2- 172.21.15.57:0/2792605335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586fc1817a0 0x5586fc198dc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f176c003fd0 tx=0x7f176c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ba905155c97e1a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:41.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f1752ffd640 1 -- 172.21.15.57:0/2792605335 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c0135c0 con 0x5586fc1817a0 2024-04-24T23:38:41.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f1752ffd640 1 -- 172.21.15.57:0/2792605335 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f176c013b10 con 0x5586fc1817a0 2024-04-24T23:38:41.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f1752ffd640 1 -- 172.21.15.57:0/2792605335 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c022480 con 0x5586fc1817a0 2024-04-24T23:38:41.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177aee6000 1 -- 172.21.15.57:0/2792605335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586fc1817a0 msgr2=0x5586fc198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:41.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177aee6000 1 --2- 172.21.15.57:0/2792605335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586fc1817a0 0x5586fc198dc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f176c003fd0 tx=0x7f176c01f000 comp rx=0 tx=0).stop 2024-04-24T23:38:41.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177aee6000 1 -- 172.21.15.57:0/2792605335 shutdown_connections 2024-04-24T23:38:41.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177aee6000 1 --2- 172.21.15.57:0/2792605335 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5586fc1484a0 0x5586fc199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177aee6000 1 --2- 172.21.15.57:0/2792605335 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586fc147b80 0x5586fc199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177aee6000 1 --2- 172.21.15.57:0/2792605335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586fc1817a0 0x5586fc198dc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177aee6000 1 -- 172.21.15.57:0/2792605335 >> 172.21.15.57:0/2792605335 conn(0x5586fc1946d0 msgr2=0x5586fc14ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:41.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177aee6000 1 -- 172.21.15.57:0/2792605335 shutdown_connections 2024-04-24T23:38:41.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177aee6000 1 -- 172.21.15.57:0/2792605335 wait complete. 2024-04-24T23:38:41.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177aee6000 1 -- start start 2024-04-24T23:38:41.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177aee6000 1 Processor -- start 2024-04-24T23:38:41.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177aee6000 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5586fc147b80 0x5586fc19cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:41.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177aee6000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586fc1484a0 0x5586fc19d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:41.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177aee6000 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586fc1817a0 0x5586fc19d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:41.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177aee6000 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5586fc153250 con 0x5586fc1817a0 2024-04-24T23:38:41.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177aee6000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x5586fbf978f0 con 0x5586fc1484a0 2024-04-24T23:38:41.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177aee6000 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x5586fbf9cc10 con 0x5586fc147b80 2024-04-24T23:38:41.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177aee6000 10 client.0 _ll_register_callbacks cb 0x7f176c001b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:38:41.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177630a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586fc1817a0 0x5586fc19d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:41.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177630a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586fc1817a0 0x5586fc19d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42488/0 (socket says 172.21.15.57:42488) 2024-04-24T23:38:41.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177630a640 1 -- 172.21.15.57:0/3397671036 learned_addr learned my addr 172.21.15.57:0/3397671036 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:41.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f1775308640 1 --2- 172.21.15.57:0/3397671036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586fc1484a0 0x5586fc19d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:41.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f1775b09640 1 --2- 172.21.15.57:0/3397671036 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5586fc147b80 0x5586fc19cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:41.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177630a640 1 -- 172.21.15.57:0/3397671036 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5586fc147b80 msgr2=0x5586fc19cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:41.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177630a640 1 --2- 172.21.15.57:0/3397671036 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5586fc147b80 0x5586fc19cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177630a640 1 -- 172.21.15.57:0/3397671036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586fc1484a0 msgr2=0x5586fc19d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:41.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177630a640 1 --2- 172.21.15.57:0/3397671036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586fc1484a0 0x5586fc19d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177630a640 1 -- 172.21.15.57:0/3397671036 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586fbf65760 con 0x5586fc1817a0 2024-04-24T23:38:41.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177630a640 1 --2- 172.21.15.57:0/3397671036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586fc1817a0 0x5586fc19d960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1768020410 tx=0x7f17681211f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505df518cf95fd43 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:41.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f1750ff9640 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2024-04-24T23:38:41.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f1750ff9640 1 -- 172.21.15.57:0/3397671036 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17680f75e0 con 0x5586fc1817a0 2024-04-24T23:38:41.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f1750ff9640 1 -- 172.21.15.57:0/3397671036 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f17680fb980 con 0x5586fc1817a0 2024-04-24T23:38:41.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177aee6000 1 -- 172.21.15.57:0/3397671036 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f176c013b10 con 0x5586fc1817a0 2024-04-24T23:38:41.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f1750ff9640 1 -- 172.21.15.57:0/3397671036 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f17680fbbe0 con 0x5586fc1817a0 2024-04-24T23:38:41.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177aee6000 10 client.4383 fetch_fsmap learned FSMap version 7 2024-04-24T23:38:41.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.433+0000 7f177aee6000 1 -- 172.21.15.57:0/3397671036 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x5586fbff19e0 con 0x5586fc1817a0 2024-04-24T23:38:41.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f1750ff9640 1 -- 172.21.15.57:0/3397671036 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f176c013b10 con 0x5586fc1817a0 2024-04-24T23:38:41.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f1750ff9640 1 -- 172.21.15.57:0/3397671036 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 7) ==== 2897+0+0 (secure 0 0 0) 0x7f17680f7120 con 0x5586fc1817a0 2024-04-24T23:38:41.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f177aee6000 10 client.4383 fetch_fsmap finished waiting for FSMap version 7 2024-04-24T23:38:41.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f177aee6000 10 client.4383 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-24T23:38:41.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f177aee6000 20 client.4383 populate_metadata read hostname 'smithi057' 2024-04-24T23:38:41.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f177aee6000 1 --2- 172.21.15.57:0/3397671036 >> [v2:172.21.15.57:6833/1701414040,v1:172.21.15.57:6835/1701414040] conn(0x5586fc148dc0 0x5586fc19e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:41.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f177aee6000 4 client.4383 mds_command: new command op to 4230 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-24T23:38:41.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f177aee6000 1 -- 172.21.15.57:0/3397671036 --> [v2:172.21.15.57:6833/1701414040,v1:172.21.15.57:6835/1701414040] -- command(tid 0: {"prefix": "status"}) -- 0x5586fbfa5b20 con 0x5586fc148dc0 2024-04-24T23:38:41.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f1775b09640 1 --2- 172.21.15.57:0/3397671036 >> [v2:172.21.15.57:6833/1701414040,v1:172.21.15.57:6835/1701414040] conn(0x5586fc148dc0 0x5586fc19e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:41.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f1775b09640 1 --2- 172.21.15.57:0/3397671036 >> [v2:172.21.15.57:6833/1701414040,v1:172.21.15.57:6835/1701414040] conn(0x5586fc148dc0 0x5586fc19e230 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcccdcc42833d147 server_cookie=a358142ac9ca4886 in_seq=0 out_seq=0 2024-04-24T23:38:41.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f1750ff9640 10 client.4383 ms_handle_connect on v2:172.21.15.57:6833/1701414040 2024-04-24T23:38:41.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f1750ff9640 1 -- 172.21.15.57:0/3397671036 <== mds.0 v2:172.21.15.57:6833/1701414040 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x5586fbfa5b20 con 0x5586fc148dc0 2024-04-24T23:38:41.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f1750ff9640 10 client.4383 handle_command_reply: tid=0 2024-04-24T23:38:41.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f177aee6000 1 client.4383 shutdown 2024-04-24T23:38:41.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f177aee6000 1 -- 172.21.15.57:0/3397671036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586fc1817a0 msgr2=0x5586fc19d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:41.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f177aee6000 1 --2- 172.21.15.57:0/3397671036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586fc1817a0 0x5586fc19d960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1768020410 tx=0x7f17681211f0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f177aee6000 1 -- 172.21.15.57:0/3397671036 shutdown_connections 2024-04-24T23:38:41.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f177aee6000 1 --2- 172.21.15.57:0/3397671036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586fc1817a0 0x5586fc19d960 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f177aee6000 1 --2- 172.21.15.57:0/3397671036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586fc1484a0 0x5586fc19d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f177aee6000 1 --2- 172.21.15.57:0/3397671036 >> [v2:172.21.15.57:6833/1701414040,v1:172.21.15.57:6835/1701414040] conn(0x5586fc148dc0 0x5586fc19e230 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f177aee6000 1 --2- 172.21.15.57:0/3397671036 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5586fc147b80 0x5586fc19cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f1750ff9640 0 client.4383 ms_handle_reset on v2:172.21.15.57:6833/1701414040 2024-04-24T23:38:41.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f177aee6000 1 -- 172.21.15.57:0/3397671036 >> 172.21.15.57:0/3397671036 conn(0x5586fc1946d0 msgr2=0x5586fc14d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:41.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f177aee6000 1 -- 172.21.15.57:0/3397671036 shutdown_connections 2024-04-24T23:38:41.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f177aee6000 1 -- 172.21.15.57:0/3397671036 wait complete. 2024-04-24T23:38:41.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f177aee6000 20 client.4383 trim_cache size 0 max 16384 2024-04-24T23:38:41.444 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-24T23:38:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "1ea31698-444a-4667-bcd9-b2608ad103c3", 2024-04-24T23:38:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 0, 2024-04-24T23:38:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 4230, 2024-04-24T23:38:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2024-04-24T23:38:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2024-04-24T23:38:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2024-04-24T23:38:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 7.2824029860000001, 2024-04-24T23:38:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 7, 2024-04-24T23:38:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 24, 2024-04-24T23:38:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 24, 2024-04-24T23:38:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 13.995121151999999 2024-04-24T23:38:41.445 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-24T23:38:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f1777d6d640 1 -- 172.21.15.57:0/883127514 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f17540678c0 msgr2=0x7f1754069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f1777d6d640 1 --2- 172.21.15.57:0/883127514 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f17540678c0 0x7f1754069d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f176c001e10 tx=0x7f176c009040 comp rx=0 tx=0).stop 2024-04-24T23:38:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f1777d6d640 1 -- 172.21.15.57:0/883127514 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17700bf3a0 msgr2=0x7f1770120a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f1777d6d640 1 --2- 172.21.15.57:0/883127514 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17700bf3a0 0x7f1770120a50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f176801d3e0 tx=0x7f176801bad0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f1777d6d640 1 -- 172.21.15.57:0/883127514 shutdown_connections 2024-04-24T23:38:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f1777d6d640 1 --2- 172.21.15.57:0/883127514 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f17540678c0 0x7f1754069d80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f1777d6d640 1 --2- 172.21.15.57:0/883127514 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17700bf3a0 0x7f1770120a50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f1777d6d640 1 --2- 172.21.15.57:0/883127514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1770072200 0x7f17700bab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f1777d6d640 1 --2- 172.21.15.57:0/883127514 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f177006e520 0x7f177014e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f1777d6d640 1 -- 172.21.15.57:0/883127514 >> 172.21.15.57:0/883127514 conn(0x7f17700c2e70 msgr2=0x7f17700c3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f1777d6d640 1 -- 172.21.15.57:0/883127514 shutdown_connections 2024-04-24T23:38:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.437+0000 7f1777d6d640 1 -- 172.21.15.57:0/883127514 wait complete. 2024-04-24T23:38:41.454 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-24T23:38:41.454 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-24T23:38:41.454 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-24T23:38:41.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.565+0000 7f5b643cd640 1 Processor -- start 2024-04-24T23:38:41.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.565+0000 7f5b643cd640 1 -- start start 2024-04-24T23:38:41.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.565+0000 7f5b643cd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5b5c0b8800 0x7f5b5c0b8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:41.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.569+0000 7f5b643cd640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b5c0be040 0x7f5b5c071d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:41.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.569+0000 7f5b643cd640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b5c0730b0 con 0x7f5b5c0bdbf0 2024-04-24T23:38:41.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.569+0000 7f5b643cd640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f5b5c14d7b0 con 0x7f5b5c0b8800 2024-04-24T23:38:41.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.569+0000 7f5b643cd640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f5b5c14da90 con 0x7f5b5c0be040 2024-04-24T23:38:41.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.569+0000 7f5b62169640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5b5c0b8800 0x7f5b5c0b8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:41.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.569+0000 7f5b62169640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5b5c0b8800 0x7f5b5c0b8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42492/0 (socket says 172.21.15.57:42492) 2024-04-24T23:38:41.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.569+0000 7f5b62169640 1 -- 172.21.15.57:0/2526999067 learned_addr learned my addr 172.21.15.57:0/2526999067 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:41.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.569+0000 7f5b6296a640 1 --2- 172.21.15.57:0/2526999067 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b5c0be040 0x7f5b5c071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:41.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.569+0000 7f5b62169640 1 -- 172.21.15.57:0/2526999067 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b5c0be040 msgr2=0x7f5b5c071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:41.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.569+0000 7f5b62169640 1 --2- 172.21.15.57:0/2526999067 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b5c0be040 0x7f5b5c071d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.569+0000 7f5b62169640 1 -- 172.21.15.57:0/2526999067 >> v1:172.21.15.88:6789/0 conn(0x7f5b5c0bdbf0 legacy=0x7f5b5c071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:41.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.569+0000 7f5b62169640 1 -- 172.21.15.57:0/2526999067 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b5c0722a0 con 0x7f5b5c0b8800 2024-04-24T23:38:41.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.569+0000 7f5b62169640 1 --2- 172.21.15.57:0/2526999067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b5c0b8800 0x7f5b5c0b8be0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5b5400bb20 tx=0x7f5b5401e9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220e9931d09d430a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:41.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.569+0000 7f5b61167640 1 -- 172.21.15.57:0/2526999067 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b540ad070 con 0x7f5b5c0b8800 2024-04-24T23:38:41.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.569+0000 7f5b61167640 1 -- 172.21.15.57:0/2526999067 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b54004230 con 0x7f5b5c0b8800 2024-04-24T23:38:41.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.569+0000 7f5b61167640 1 -- 172.21.15.57:0/2526999067 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b540a7750 con 0x7f5b5c0b8800 2024-04-24T23:38:41.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.569+0000 7f5b643cd640 1 -- 172.21.15.57:0/2526999067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b5c0b8800 msgr2=0x7f5b5c0b8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:41.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.569+0000 7f5b643cd640 1 --2- 172.21.15.57:0/2526999067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b5c0b8800 0x7f5b5c0b8be0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5b5400bb20 tx=0x7f5b5401e9f0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.569+0000 7f5b643cd640 1 -- 172.21.15.57:0/2526999067 shutdown_connections 2024-04-24T23:38:41.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.569+0000 7f5b643cd640 1 --2- 172.21.15.57:0/2526999067 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b5c0be040 0x7f5b5c071d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.569+0000 7f5b643cd640 1 --2- 172.21.15.57:0/2526999067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b5c0b8800 0x7f5b5c0b8be0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.569+0000 7f5b643cd640 1 -- 172.21.15.57:0/2526999067 >> 172.21.15.57:0/2526999067 conn(0x7f5b5c0beab0 msgr2=0x7f5b5c0beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:41.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.569+0000 7f5b643cd640 1 -- 172.21.15.57:0/2526999067 shutdown_connections 2024-04-24T23:38:41.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.569+0000 7f5b643cd640 1 -- 172.21.15.57:0/2526999067 wait complete. 2024-04-24T23:38:41.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.573+0000 7f5b643cd640 1 Processor -- start 2024-04-24T23:38:41.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.573+0000 7f5b643cd640 1 -- start start 2024-04-24T23:38:41.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.573+0000 7f5b643cd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b5c0b8800 0x7f5b5c152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:41.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.573+0000 7f5b643cd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b5c0bdbf0 0x7f5b5c1545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:41.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.573+0000 7f5b643cd640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b5c0be040 0x7f5b5c154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:41.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.573+0000 7f5b643cd640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5b5c0a7f90 con 0x7f5b5c0bdbf0 2024-04-24T23:38:41.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.573+0000 7f5b643cd640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5b5c0b8110 con 0x7f5b5c0b8800 2024-04-24T23:38:41.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.573+0000 7f5b643cd640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f5b5c0a8110 con 0x7f5b5c0be040 2024-04-24T23:38:41.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.573+0000 7f5b61968640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b5c0bdbf0 0x7f5b5c1545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:41.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.573+0000 7f5b61968640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b5c0bdbf0 0x7f5b5c1545a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42494/0 (socket says 172.21.15.57:42494) 2024-04-24T23:38:41.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.573+0000 7f5b61968640 1 -- 172.21.15.57:0/1971059501 learned_addr learned my addr 172.21.15.57:0/1971059501 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:41.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.573+0000 7f5b6296a640 1 --2- 172.21.15.57:0/1971059501 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b5c0be040 0x7f5b5c154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:41.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.573+0000 7f5b62169640 1 --2- 172.21.15.57:0/1971059501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b5c0b8800 0x7f5b5c152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:41.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.573+0000 7f5b61968640 1 -- 172.21.15.57:0/1971059501 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b5c0be040 msgr2=0x7f5b5c154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:41.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.573+0000 7f5b61968640 1 --2- 172.21.15.57:0/1971059501 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b5c0be040 0x7f5b5c154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.573+0000 7f5b61968640 1 -- 172.21.15.57:0/1971059501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b5c0b8800 msgr2=0x7f5b5c152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:41.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.573+0000 7f5b61968640 1 --2- 172.21.15.57:0/1971059501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b5c0b8800 0x7f5b5c152640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.573+0000 7f5b61968640 1 -- 172.21.15.57:0/1971059501 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b5c152b80 con 0x7f5b5c0bdbf0 2024-04-24T23:38:41.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.573+0000 7f5b61968640 1 --2- 172.21.15.57:0/1971059501 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b5c0bdbf0 0x7f5b5c1545a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000c7f0 tx=0x7f5b5000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:41.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.573+0000 7f5b5affd640 1 -- 172.21.15.57:0/1971059501 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b50003b80 con 0x7f5b5c0bdbf0 2024-04-24T23:38:41.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.573+0000 7f5b5affd640 1 -- 172.21.15.57:0/1971059501 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b50003d20 con 0x7f5b5c0bdbf0 2024-04-24T23:38:41.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.573+0000 7f5b643cd640 1 -- 172.21.15.57:0/1971059501 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b5c150590 con 0x7f5b5c0bdbf0 2024-04-24T23:38:41.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.573+0000 7f5b5affd640 1 -- 172.21.15.57:0/1971059501 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5000aa90 con 0x7f5b5c0bdbf0 2024-04-24T23:38:41.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.573+0000 7f5b643cd640 1 -- 172.21.15.57:0/1971059501 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b5c150b50 con 0x7f5b5c0bdbf0 2024-04-24T23:38:41.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.573+0000 7f5b643cd640 1 -- 172.21.15.57:0/1971059501 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b5c068220 con 0x7f5b5c0bdbf0 2024-04-24T23:38:41.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.573+0000 7f5b5affd640 1 -- 172.21.15.57:0/1971059501 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5b5000ac30 con 0x7f5b5c0bdbf0 2024-04-24T23:38:41.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.577+0000 7f5b5affd640 1 --2- 172.21.15.57:0/1971059501 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f5b480678f0 0x7f5b48069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:41.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.577+0000 7f5b5affd640 1 -- 172.21.15.57:0/1971059501 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5b50085ec0 con 0x7f5b5c0bdbf0 2024-04-24T23:38:41.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.577+0000 7f5b62169640 1 --2- 172.21.15.57:0/1971059501 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f5b480678f0 0x7f5b48069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:41.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.577+0000 7f5b62169640 1 --2- 172.21.15.57:0/1971059501 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f5b480678f0 0x7f5b48069db0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5b540b1000 tx=0x7f5b540a9070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:41.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.581+0000 7f5b5affd640 1 -- 172.21.15.57:0/1971059501 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f5b5c152b80 con 0x7f5b5c0bdbf0 2024-04-24T23:38:41.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.769+0000 7f5b643cd640 1 -- 172.21.15.57:0/1971059501 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5b5c0b7da0 con 0x7f5b5c0bdbf0 2024-04-24T23:38:41.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.773+0000 7f5b5affd640 1 -- 172.21.15.57:0/1971059501 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f5b50056750 con 0x7f5b5c0bdbf0 2024-04-24T23:38:41.773 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-24T23:38:41.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.773+0000 7f5b643cd640 1 -- 172.21.15.57:0/1971059501 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f5b480678f0 msgr2=0x7f5b48069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:41.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.773+0000 7f5b643cd640 1 --2- 172.21.15.57:0/1971059501 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f5b480678f0 0x7f5b48069db0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5b540b1000 tx=0x7f5b540a9070 comp rx=0 tx=0).stop 2024-04-24T23:38:41.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.773+0000 7f5b643cd640 1 -- 172.21.15.57:0/1971059501 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b5c0bdbf0 msgr2=0x7f5b5c1545a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:41.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.773+0000 7f5b643cd640 1 --2- 172.21.15.57:0/1971059501 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b5c0bdbf0 0x7f5b5c1545a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000c7f0 tx=0x7f5b5000ccb0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.773+0000 7f5b643cd640 1 -- 172.21.15.57:0/1971059501 shutdown_connections 2024-04-24T23:38:41.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.773+0000 7f5b643cd640 1 --2- 172.21.15.57:0/1971059501 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f5b480678f0 0x7f5b48069db0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.773+0000 7f5b643cd640 1 --2- 172.21.15.57:0/1971059501 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b5c0be040 0x7f5b5c154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.773+0000 7f5b643cd640 1 --2- 172.21.15.57:0/1971059501 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b5c0bdbf0 0x7f5b5c1545a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.773+0000 7f5b643cd640 1 --2- 172.21.15.57:0/1971059501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b5c0b8800 0x7f5b5c152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:41.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.773+0000 7f5b643cd640 1 -- 172.21.15.57:0/1971059501 >> 172.21.15.57:0/1971059501 conn(0x7f5b5c0beab0 msgr2=0x7f5b5c0744f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:41.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.773+0000 7f5b643cd640 1 -- 172.21.15.57:0/1971059501 shutdown_connections 2024-04-24T23:38:41.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:41.773+0000 7f5b643cd640 1 -- 172.21.15.57:0/1971059501 wait complete. 2024-04-24T23:38:41.790 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-24T23:38:41.790 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-24T23:38:41.790 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi116.front.sepia.ceph.com 2024-04-24T23:38:41.790 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-24T23:38:41.790 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-24T23:38:41.791 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-24T23:38:41.791 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-24T23:38:41.791 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-24T23:38:41.791 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-24T23:38:41.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:38:41.791 DEBUG:teuthology.orchestra.run.smithi116:> ip addr 2024-04-24T23:38:41.798 INFO:teuthology.orchestra.run.smithi116.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:38:41.798 INFO:teuthology.orchestra.run.smithi116.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:38:41.798 INFO:teuthology.orchestra.run.smithi116.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:38:41.798 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:38:41.798 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 ::1/128 scope host 2024-04-24T23:38:41.798 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:38:41.799 INFO:teuthology.orchestra.run.smithi116.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-24T23:38:41.799 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:90 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:38:41.799 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f0 2024-04-24T23:38:41.799 INFO:teuthology.orchestra.run.smithi116.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-24T23:38:41.799 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:91 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:38:41.799 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f1 2024-04-24T23:38:41.799 INFO:teuthology.orchestra.run.smithi116.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-24T23:38:41.799 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:66 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:38:41.799 INFO:teuthology.orchestra.run.smithi116.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-24T23:38:41.799 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:67 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:38:41.799 INFO:teuthology.orchestra.run.smithi116.stdout: inet 172.21.15.116/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-24T23:38:41.799 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft 42448sec preferred_lft 42448sec 2024-04-24T23:38:41.799 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::ec4:7aff:fe8f:3f67/64 scope link 2024-04-24T23:38:41.799 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:38:41.799 INFO:teuthology.orchestra.run.smithi116.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-24T23:38:41.800 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 02:42:65:c2:38:a7 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:38:41.800 INFO:teuthology.orchestra.run.smithi116.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-24T23:38:41.800 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:38:41.800 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-24T23:38:41.800 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:38:41.801 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-04-24T23:38:41.801 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link add name ceph-brx type bridge 2024-04-24T23:38:41.801 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip addr flush dev ceph-brx 2024-04-24T23:38:41.801 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set ceph-brx up 2024-04-24T23:38:41.801 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-24T23:38:41.801 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-04-24T23:38:41.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-24T23:38:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:38:41.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-24T23:38:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:38:41.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:38:41.930 DEBUG:teuthology.orchestra.run.smithi116:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-24T23:38:41.940 INFO:teuthology.orchestra.run.smithi116.stdout:1 2024-04-24T23:38:41.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:38:41.941 DEBUG:teuthology.orchestra.run.smithi116:> route 2024-04-24T23:38:42.006 INFO:teuthology.orchestra.run.smithi116.stdout:Kernel IP routing table 2024-04-24T23:38:42.006 INFO:teuthology.orchestra.run.smithi116.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-24T23:38:42.006 INFO:teuthology.orchestra.run.smithi116.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-24T23:38:42.006 INFO:teuthology.orchestra.run.smithi116.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-24T23:38:42.006 INFO:teuthology.orchestra.run.smithi116.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-24T23:38:42.006 INFO:teuthology.orchestra.run.smithi116.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-24T23:38:42.007 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-24T23:38:42.007 INFO:teuthology.orchestra.run.smithi116.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-24T23:38:42.007 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-24T23:38:42.007 INFO:teuthology.orchestra.run.smithi116.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-24T23:38:42.007 INFO:teuthology.orchestra.run.smithi116.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-24T23:38:42.007 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:38:42.007 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-04-24T23:38:42.007 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-24T23:38:42.007 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-24T23:38:42.008 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-24T23:38:42.008 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-04-24T23:38:42.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-24T23:38:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:38:42.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-24T23:38:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:38:42.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:38:42.122 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2024-04-24T23:38:42.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:38:42.167 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list-id 2024-04-24T23:38:42.215 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:38:42.215 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-04-24T23:38:42.215 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-24T23:38:42.215 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-24T23:38:42.215 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-04-24T23:38:42.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-24T23:38:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:38:42.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-24T23:38:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:38:42.330 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-24T23:38:42.330 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:38:42.330 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-04-24T23:38:42.330 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-24T23:38:42.330 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-24T23:38:42.330 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-24T23:38:42.330 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-24T23:38:42.330 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-24T23:38:42.330 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-04-24T23:38:42.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-24T23:38:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:38:42.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-24T23:38:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:38:42.472 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:38:42.472 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-04-24T23:38:42.472 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set brx.0 up 2024-04-24T23:38:42.472 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set dev brx.0 master ceph-brx 2024-04-24T23:38:42.472 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-04-24T23:38:42.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-24T23:38:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:38:42.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-24T23:38:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:38:42.575 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-24T23:38:42.575 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:38:42.575 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-24T23:38:42.627 INFO:teuthology.orchestra.run.smithi116.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-24T23:38:42.627 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:38:42.628 DEBUG:teuthology.orchestra.run.smithi116:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-24T23:38:42.675 DEBUG:teuthology.orchestra.run.smithi116:> sudo modprobe fuse 2024-04-24T23:38:42.732 DEBUG:teuthology.orchestra.run.smithi116:> cat /proc/self/mounts | awk '{print $2}' 2024-04-24T23:38:42.781 INFO:teuthology.orchestra.run.smithi116.stdout:/sys 2024-04-24T23:38:42.781 INFO:teuthology.orchestra.run.smithi116.stdout:/proc 2024-04-24T23:38:42.782 INFO:teuthology.orchestra.run.smithi116.stdout:/dev 2024-04-24T23:38:42.782 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/pts 2024-04-24T23:38:42.782 INFO:teuthology.orchestra.run.smithi116.stdout:/run 2024-04-24T23:38:42.782 INFO:teuthology.orchestra.run.smithi116.stdout:/ 2024-04-24T23:38:42.782 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/security 2024-04-24T23:38:42.782 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/shm 2024-04-24T23:38:42.782 INFO:teuthology.orchestra.run.smithi116.stdout:/run/lock 2024-04-24T23:38:42.782 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/cgroup 2024-04-24T23:38:42.782 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/pstore 2024-04-24T23:38:42.782 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/bpf 2024-04-24T23:38:42.782 INFO:teuthology.orchestra.run.smithi116.stdout:/proc/sys/fs/binfmt_misc 2024-04-24T23:38:42.782 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/hugepages 2024-04-24T23:38:42.783 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/mqueue 2024-04-24T23:38:42.783 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/debug 2024-04-24T23:38:42.783 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/tracing 2024-04-24T23:38:42.783 INFO:teuthology.orchestra.run.smithi116.stdout:/proc/fs/nfsd 2024-04-24T23:38:42.783 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/fuse/connections 2024-04-24T23:38:42.783 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/config 2024-04-24T23:38:42.783 INFO:teuthology.orchestra.run.smithi116.stdout:/run/credentials/systemd-sysusers.service 2024-04-24T23:38:42.783 INFO:teuthology.orchestra.run.smithi116.stdout:/run/rpc_pipefs 2024-04-24T23:38:42.783 INFO:teuthology.orchestra.run.smithi116.stdout:/run/user/1000 2024-04-24T23:38:42.783 INFO:teuthology.orchestra.run.smithi116.stdout:/var/lib/ceph 2024-04-24T23:38:42.783 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns 2024-04-24T23:38:42.783 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-24T23:38:42.783 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-24T23:38:42.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:38:42.784 DEBUG:teuthology.orchestra.run.smithi116:> ls /sys/fs/fuse/connections 2024-04-24T23:38:42.831 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-24T23:38:42.831 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-24T23:38:42.876 DEBUG:teuthology.orchestra.run.smithi116:> sudo modprobe fuse 2024-04-24T23:38:42.890 DEBUG:teuthology.orchestra.run.smithi116:> cat /proc/self/mounts | awk '{print $2}' 2024-04-24T23:38:42.936 INFO:teuthology.orchestra.run.smithi116.stdout:/sys 2024-04-24T23:38:42.936 INFO:teuthology.orchestra.run.smithi116.stdout:/proc 2024-04-24T23:38:42.936 INFO:teuthology.orchestra.run.smithi116.stdout:/dev 2024-04-24T23:38:42.936 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/pts 2024-04-24T23:38:42.936 INFO:teuthology.orchestra.run.smithi116.stdout:/run 2024-04-24T23:38:42.936 INFO:teuthology.orchestra.run.smithi116.stdout:/ 2024-04-24T23:38:42.936 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/security 2024-04-24T23:38:42.936 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/shm 2024-04-24T23:38:42.936 INFO:teuthology.orchestra.run.smithi116.stdout:/run/lock 2024-04-24T23:38:42.936 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/cgroup 2024-04-24T23:38:42.937 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/pstore 2024-04-24T23:38:42.937 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/bpf 2024-04-24T23:38:42.937 INFO:teuthology.orchestra.run.smithi116.stdout:/proc/sys/fs/binfmt_misc 2024-04-24T23:38:42.937 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/hugepages 2024-04-24T23:38:42.937 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/mqueue 2024-04-24T23:38:42.937 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/debug 2024-04-24T23:38:42.937 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/tracing 2024-04-24T23:38:42.937 INFO:teuthology.orchestra.run.smithi116.stdout:/proc/fs/nfsd 2024-04-24T23:38:42.937 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/fuse/connections 2024-04-24T23:38:42.937 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/config 2024-04-24T23:38:42.937 INFO:teuthology.orchestra.run.smithi116.stdout:/run/credentials/systemd-sysusers.service 2024-04-24T23:38:42.937 INFO:teuthology.orchestra.run.smithi116.stdout:/run/rpc_pipefs 2024-04-24T23:38:42.937 INFO:teuthology.orchestra.run.smithi116.stdout:/run/user/1000 2024-04-24T23:38:42.938 INFO:teuthology.orchestra.run.smithi116.stdout:/var/lib/ceph 2024-04-24T23:38:42.938 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns 2024-04-24T23:38:42.938 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-24T23:38:42.938 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-24T23:38:42.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:38:42.939 DEBUG:teuthology.orchestra.run.smithi116:> ls /sys/fs/fuse/connections 2024-04-24T23:38:42.966 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi116.stderr:2024-04-24T23:38:42.962+0000 7f7372542580 -1 init, newargv = 0x563aa7216cb0 newargc=15 2024-04-24T23:38:42.966 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi116.stderr:ceph-fuse[22849]: starting ceph client 2024-04-24T23:38:42.976 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi116.stderr:ceph-fuse[22849]: starting fuse 2024-04-24T23:38:44.071 DEBUG:teuthology.orchestra.run.smithi116:> sudo modprobe fuse 2024-04-24T23:38:44.088 DEBUG:teuthology.orchestra.run.smithi116:> cat /proc/self/mounts | awk '{print $2}' 2024-04-24T23:38:44.137 INFO:teuthology.orchestra.run.smithi116.stdout:/sys 2024-04-24T23:38:44.137 INFO:teuthology.orchestra.run.smithi116.stdout:/proc 2024-04-24T23:38:44.137 INFO:teuthology.orchestra.run.smithi116.stdout:/dev 2024-04-24T23:38:44.137 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/pts 2024-04-24T23:38:44.137 INFO:teuthology.orchestra.run.smithi116.stdout:/run 2024-04-24T23:38:44.137 INFO:teuthology.orchestra.run.smithi116.stdout:/ 2024-04-24T23:38:44.137 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/security 2024-04-24T23:38:44.137 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/shm 2024-04-24T23:38:44.137 INFO:teuthology.orchestra.run.smithi116.stdout:/run/lock 2024-04-24T23:38:44.137 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/cgroup 2024-04-24T23:38:44.137 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/pstore 2024-04-24T23:38:44.138 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/bpf 2024-04-24T23:38:44.138 INFO:teuthology.orchestra.run.smithi116.stdout:/proc/sys/fs/binfmt_misc 2024-04-24T23:38:44.138 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/hugepages 2024-04-24T23:38:44.138 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/mqueue 2024-04-24T23:38:44.138 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/debug 2024-04-24T23:38:44.138 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/tracing 2024-04-24T23:38:44.138 INFO:teuthology.orchestra.run.smithi116.stdout:/proc/fs/nfsd 2024-04-24T23:38:44.138 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/fuse/connections 2024-04-24T23:38:44.138 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/config 2024-04-24T23:38:44.138 INFO:teuthology.orchestra.run.smithi116.stdout:/run/credentials/systemd-sysusers.service 2024-04-24T23:38:44.138 INFO:teuthology.orchestra.run.smithi116.stdout:/run/rpc_pipefs 2024-04-24T23:38:44.138 INFO:teuthology.orchestra.run.smithi116.stdout:/run/user/1000 2024-04-24T23:38:44.139 INFO:teuthology.orchestra.run.smithi116.stdout:/var/lib/ceph 2024-04-24T23:38:44.139 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns 2024-04-24T23:38:44.139 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-24T23:38:44.139 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-24T23:38:44.139 INFO:teuthology.orchestra.run.smithi116.stdout:/home/ubuntu/cephtest/mnt.admin 2024-04-24T23:38:44.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:38:44.140 DEBUG:teuthology.orchestra.run.smithi116:> ls /sys/fs/fuse/connections 2024-04-24T23:38:44.188 INFO:teuthology.orchestra.run.smithi116.stdout:45 2024-04-24T23:38:44.188 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-24T23:38:44.188 DEBUG:teuthology.orchestra.run.smithi116:> sudo stdin-killer -- python3 -c ' 2024-04-24T23:38:44.188 DEBUG:teuthology.orchestra.run.smithi116:> import glob 2024-04-24T23:38:44.188 DEBUG:teuthology.orchestra.run.smithi116:> import re 2024-04-24T23:38:44.189 DEBUG:teuthology.orchestra.run.smithi116:> import os 2024-04-24T23:38:44.189 DEBUG:teuthology.orchestra.run.smithi116:> import subprocess 2024-04-24T23:38:44.189 DEBUG:teuthology.orchestra.run.smithi116:> 2024-04-24T23:38:44.189 DEBUG:teuthology.orchestra.run.smithi116:> def _find_admin_socket(client_name): 2024-04-24T23:38:44.189 DEBUG:teuthology.orchestra.run.smithi116:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-24T23:38:44.189 DEBUG:teuthology.orchestra.run.smithi116:> files = glob.glob(asok_path) 2024-04-24T23:38:44.189 DEBUG:teuthology.orchestra.run.smithi116:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-24T23:38:44.189 DEBUG:teuthology.orchestra.run.smithi116:> 2024-04-24T23:38:44.189 DEBUG:teuthology.orchestra.run.smithi116:> # Given a non-glob path, it better be there 2024-04-24T23:38:44.189 DEBUG:teuthology.orchestra.run.smithi116:> if "*" not in asok_path: 2024-04-24T23:38:44.189 DEBUG:teuthology.orchestra.run.smithi116:> assert(len(files) == 1) 2024-04-24T23:38:44.189 DEBUG:teuthology.orchestra.run.smithi116:> return files[0] 2024-04-24T23:38:44.189 DEBUG:teuthology.orchestra.run.smithi116:> 2024-04-24T23:38:44.189 DEBUG:teuthology.orchestra.run.smithi116:> for f in files: 2024-04-24T23:38:44.189 DEBUG:teuthology.orchestra.run.smithi116:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-24T23:38:44.189 DEBUG:teuthology.orchestra.run.smithi116:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-24T23:38:44.190 DEBUG:teuthology.orchestra.run.smithi116:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-24T23:38:44.190 DEBUG:teuthology.orchestra.run.smithi116:> contents = proc_f.read() 2024-04-24T23:38:44.190 DEBUG:teuthology.orchestra.run.smithi116:> if mountpoint in contents: 2024-04-24T23:38:44.190 DEBUG:teuthology.orchestra.run.smithi116:> return f 2024-04-24T23:38:44.190 DEBUG:teuthology.orchestra.run.smithi116:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-24T23:38:44.190 DEBUG:teuthology.orchestra.run.smithi116:> 2024-04-24T23:38:44.190 DEBUG:teuthology.orchestra.run.smithi116:> print(_find_admin_socket("client.admin")) 2024-04-24T23:38:44.190 DEBUG:teuthology.orchestra.run.smithi116:> ' 2024-04-24T23:38:44.312 INFO:teuthology.orchestra.run.smithi116.stdout:/var/run/ceph/ceph-client.admin.22849.asok 2024-04-24T23:38:44.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-24T23:38:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:38:44.325 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.22849.asok 2024-04-24T23:38:44.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:38:44.325 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.22849.asok status 2024-04-24T23:38:44.480 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-24T23:38:44.481 INFO:teuthology.orchestra.run.smithi116.stdout: "metadata": { 2024-04-24T23:38:44.481 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_sha1": "d2c45d977142e024a59b68a8f1dce8f0b9840551", 2024-04-24T23:38:44.481 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_version": "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)", 2024-04-24T23:38:44.481 INFO:teuthology.orchestra.run.smithi116.stdout: "entity_id": "admin", 2024-04-24T23:38:44.481 INFO:teuthology.orchestra.run.smithi116.stdout: "hostname": "smithi116", 2024-04-24T23:38:44.481 INFO:teuthology.orchestra.run.smithi116.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-24T23:38:44.481 INFO:teuthology.orchestra.run.smithi116.stdout: "pid": "22849", 2024-04-24T23:38:44.481 INFO:teuthology.orchestra.run.smithi116.stdout: "root": "/" 2024-04-24T23:38:44.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-24T23:38:44.481 INFO:teuthology.orchestra.run.smithi116.stdout: "dentry_count": 0, 2024-04-24T23:38:44.481 INFO:teuthology.orchestra.run.smithi116.stdout: "dentry_pinned_count": 0, 2024-04-24T23:38:44.482 INFO:teuthology.orchestra.run.smithi116.stdout: "id": 4313, 2024-04-24T23:38:44.482 INFO:teuthology.orchestra.run.smithi116.stdout: "inst": { 2024-04-24T23:38:44.482 INFO:teuthology.orchestra.run.smithi116.stdout: "name": { 2024-04-24T23:38:44.482 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "client", 2024-04-24T23:38:44.482 INFO:teuthology.orchestra.run.smithi116.stdout: "num": 4313 2024-04-24T23:38:44.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-24T23:38:44.482 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": { 2024-04-24T23:38:44.482 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-04-24T23:38:44.482 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:0", 2024-04-24T23:38:44.482 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2477216554 2024-04-24T23:38:44.482 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-24T23:38:44.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-24T23:38:44.483 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": { 2024-04-24T23:38:44.483 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-04-24T23:38:44.483 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:0", 2024-04-24T23:38:44.483 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2477216554 2024-04-24T23:38:44.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-24T23:38:44.483 INFO:teuthology.orchestra.run.smithi116.stdout: "inst_str": "client.4313 172.21.15.116:0/2477216554", 2024-04-24T23:38:44.483 INFO:teuthology.orchestra.run.smithi116.stdout: "addr_str": "172.21.15.116:0/2477216554", 2024-04-24T23:38:44.483 INFO:teuthology.orchestra.run.smithi116.stdout: "inode_count": 1, 2024-04-24T23:38:44.483 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_epoch": 7, 2024-04-24T23:38:44.483 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_epoch": 24, 2024-04-24T23:38:44.483 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_epoch_barrier": 0, 2024-04-24T23:38:44.483 INFO:teuthology.orchestra.run.smithi116.stdout: "blocklisted": false, 2024-04-24T23:38:44.484 INFO:teuthology.orchestra.run.smithi116.stdout: "fs_name": "cephfs" 2024-04-24T23:38:44.484 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-24T23:38:44.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:38:44.494 DEBUG:teuthology.orchestra.run.smithi116:> stat --file-system '--printf=%T 2024-04-24T23:38:44.495 DEBUG:teuthology.orchestra.run.smithi116:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-24T23:38:44.501 INFO:teuthology.orchestra.run.smithi116.stdout:fuseblk 2024-04-24T23:38:44.501 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-24T23:38:44.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:38:44.501 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-24T23:38:44.556 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-24T23:38:44.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-24T23:38:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:38:44.762 INFO:teuthology.orchestra.run.smithi116.stdout:# file: . 2024-04-24T23:38:44.762 INFO:teuthology.orchestra.run.smithi116.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-24T23:38:44.762 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:38:44.763 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-24T23:38:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:38:44.770 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-24T23:38:44.770 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:38:44.776 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:38:44.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf03b6b640 1 Processor -- start 2024-04-24T23:38:44.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf03b6b640 1 -- start start 2024-04-24T23:38:44.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf03b6b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faefc14de40 0x7faefc0bd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:44.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf03b6b640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faefc0711d0 0x7faefc15b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:44.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf03b6b640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faefc0a6940 con 0x7faefc0bd8e0 2024-04-24T23:38:44.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf03b6b640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7faefc0c37e0 con 0x7faefc14de40 2024-04-24T23:38:44.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf03b6b640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7faefc070e10 con 0x7faefc0711d0 2024-04-24T23:38:44.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf01106640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7faefc0bd8e0 0x7faefc150e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52334/0 (socket says 172.21.15.57:52334) 2024-04-24T23:38:44.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf01106640 1 -- 172.21.15.57:0/1138261232 learned_addr learned my addr 172.21.15.57:0/1138261232 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:38:44.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf01907640 1 --2- 172.21.15.57:0/1138261232 >> v2:172.21.15.88:3300/0 conn(0x7faefc14de40 0x7faefc0bd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:44.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf02108640 1 --2- 172.21.15.57:0/1138261232 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faefc0711d0 0x7faefc15b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:44.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf00905640 1 -- 172.21.15.57:0/1138261232 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 340019247 0 0) 0x7faefc0a6940 con 0x7faefc0bd8e0 2024-04-24T23:38:44.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf00905640 1 -- 172.21.15.57:0/1138261232 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faee4003530 con 0x7faefc0bd8e0 2024-04-24T23:38:44.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf00905640 1 -- 172.21.15.57:0/1138261232 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 854596928 0 0) 0x7faee4003530 con 0x7faefc0bd8e0 2024-04-24T23:38:44.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf00905640 1 -- 172.21.15.57:0/1138261232 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faefc0711d0 msgr2=0x7faefc15b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:44.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf00905640 1 --2- 172.21.15.57:0/1138261232 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faefc0711d0 0x7faefc15b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:44.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf00905640 1 -- 172.21.15.57:0/1138261232 >> v2:172.21.15.88:3300/0 conn(0x7faefc14de40 msgr2=0x7faefc0bd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:44.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf00905640 1 --2- 172.21.15.57:0/1138261232 >> v2:172.21.15.88:3300/0 conn(0x7faefc14de40 0x7faefc0bd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:44.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf00905640 1 -- 172.21.15.57:0/1138261232 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faefc14e220 con 0x7faefc0bd8e0 2024-04-24T23:38:44.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf00905640 1 -- 172.21.15.57:0/1138261232 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7faef0001a00 con 0x7faefc0bd8e0 2024-04-24T23:38:44.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf00905640 1 -- 172.21.15.57:0/1138261232 >> v1:172.21.15.57:6789/0 conn(0x7faefc0bd8e0 legacy=0x7faefc150e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:44.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf00905640 1 --2- 172.21.15.57:0/1138261232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faee40039c0 0x7faee4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:44.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf00905640 1 --2- 172.21.15.57:0/1138261232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faee4004810 0x7faee4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:44.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf00905640 1 --2- 172.21.15.57:0/1138261232 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faefc0711d0 0x7faee40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:44.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf00905640 1 -- 172.21.15.57:0/1138261232 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7faefc0c37e0 con 0x7faee4004810 2024-04-24T23:38:44.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf00905640 1 -- 172.21.15.57:0/1138261232 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7faefc070e10 con 0x7faee40039c0 2024-04-24T23:38:44.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf00905640 1 -- 172.21.15.57:0/1138261232 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7faee400b9d0 con 0x7faefc0711d0 2024-04-24T23:38:44.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf01106640 1 --2- 172.21.15.57:0/1138261232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faee4004810 0x7faee4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:44.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf01907640 1 --2- 172.21.15.57:0/1138261232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faee40039c0 0x7faee4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:44.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf02108640 1 --2- 172.21.15.57:0/1138261232 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faefc0711d0 0x7faee40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:44.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf01106640 1 -- 172.21.15.57:0/1138261232 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faefc0711d0 msgr2=0x7faee40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:44.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf01106640 1 --2- 172.21.15.57:0/1138261232 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faefc0711d0 0x7faee40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:44.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf01106640 1 -- 172.21.15.57:0/1138261232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faee40039c0 msgr2=0x7faee4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:44.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf01106640 1 --2- 172.21.15.57:0/1138261232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faee40039c0 0x7faee4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:44.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.909+0000 7faf01106640 1 -- 172.21.15.57:0/1138261232 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee4003530 con 0x7faee4004810 2024-04-24T23:38:44.918 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.913+0000 7faf01106640 1 --2- 172.21.15.57:0/1138261232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faee4004810 0x7faee4004c90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faefc0bdcf0 tx=0x7faef001d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3b979ac7d0a004 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:44.918 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.913+0000 7faf00905640 1 -- 172.21.15.57:0/1138261232 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef000a4c0 con 0x7faee4004810 2024-04-24T23:38:44.918 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.913+0000 7faf00905640 1 -- 172.21.15.57:0/1138261232 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef00ad630 con 0x7faee4004810 2024-04-24T23:38:44.918 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.913+0000 7faf00905640 1 -- 172.21.15.57:0/1138261232 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef00a5e60 con 0x7faee4004810 2024-04-24T23:38:44.918 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.913+0000 7faf03b6b640 1 -- 172.21.15.57:0/1138261232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faee4004810 msgr2=0x7faee4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:44.918 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.913+0000 7faf03b6b640 1 --2- 172.21.15.57:0/1138261232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faee4004810 0x7faee4004c90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faefc0bdcf0 tx=0x7faef001d360 comp rx=0 tx=0).stop 2024-04-24T23:38:44.918 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.913+0000 7faf02108640 1 -- 172.21.15.57:0/1138261232 reap_dead start 2024-04-24T23:38:44.918 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.913+0000 7faf03b6b640 1 -- 172.21.15.57:0/1138261232 shutdown_connections 2024-04-24T23:38:44.918 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.913+0000 7faf03b6b640 1 -- 172.21.15.57:0/1138261232 >> 172.21.15.57:0/1138261232 conn(0x7faefc0a5d20 msgr2=0x7faefc0a6130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:44.918 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.913+0000 7faf03b6b640 1 -- 172.21.15.57:0/1138261232 shutdown_connections 2024-04-24T23:38:44.918 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.913+0000 7faf03b6b640 1 -- 172.21.15.57:0/1138261232 wait complete. 2024-04-24T23:38:44.918 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.913+0000 7faf03b6b640 1 Processor -- start 2024-04-24T23:38:44.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.913+0000 7faf03b6b640 1 -- start start 2024-04-24T23:38:44.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.917+0000 7faf03b6b640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faee4004810 0x7faefc14b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:44.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.917+0000 7faf03b6b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faefc1430b0 0x7faefc1e6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:44.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.917+0000 7faf03b6b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc145050 0x7faefc1e9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:44.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.917+0000 7faf03b6b640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7faefc0c3a30 con 0x7faefc1430b0 2024-04-24T23:38:44.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.917+0000 7faf03b6b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7faefc150910 con 0x7faefc145050 2024-04-24T23:38:44.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.917+0000 7faf03b6b640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7faefc0c1e70 con 0x7faee4004810 2024-04-24T23:38:44.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.917+0000 7faf01106640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faefc1430b0 0x7faefc1e6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:44.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.917+0000 7faf01907640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faee4004810 0x7faefc14b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:44.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.917+0000 7faf02108640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc145050 0x7faefc1e9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:44.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.917+0000 7faf01106640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faefc1430b0 0x7faefc1e6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42500/0 (socket says 172.21.15.57:42500) 2024-04-24T23:38:44.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.917+0000 7faf01907640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faee4004810 0x7faefc14b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.57:60080/0 (socket says 172.21.15.57:60080) 2024-04-24T23:38:44.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.917+0000 7faf01106640 1 -- 172.21.15.57:0/428827027 learned_addr learned my addr 172.21.15.57:0/428827027 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:44.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.917+0000 7faf01106640 1 -- 172.21.15.57:0/428827027 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faee4004810 msgr2=0x7faefc14b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:44.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.917+0000 7faf01106640 1 --2- 172.21.15.57:0/428827027 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faee4004810 0x7faefc14b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:44.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.917+0000 7faf01106640 1 -- 172.21.15.57:0/428827027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc145050 msgr2=0x7faefc1e9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:44.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.917+0000 7faf01106640 1 --2- 172.21.15.57:0/428827027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc145050 0x7faefc1e9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:44.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.917+0000 7faf01106640 1 -- 172.21.15.57:0/428827027 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faefc141b40 con 0x7faefc1430b0 2024-04-24T23:38:44.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.917+0000 7faf01106640 1 --2- 172.21.15.57:0/428827027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faefc1430b0 0x7faefc1e6510 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faef0098ca0 tx=0x7faee4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:44.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.917+0000 7faefa7fc640 1 -- 172.21.15.57:0/428827027 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef00bb070 con 0x7faefc1430b0 2024-04-24T23:38:44.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.917+0000 7faefa7fc640 1 -- 172.21.15.57:0/428827027 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef00ad430 con 0x7faefc1430b0 2024-04-24T23:38:44.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.917+0000 7faefa7fc640 1 -- 172.21.15.57:0/428827027 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef00019e0 con 0x7faefc1430b0 2024-04-24T23:38:44.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.917+0000 7faf03b6b640 1 -- 172.21.15.57:0/428827027 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faefc141540 con 0x7faefc1430b0 2024-04-24T23:38:44.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.917+0000 7faf03b6b640 1 -- 172.21.15.57:0/428827027 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faefc1e5bf0 con 0x7faefc1430b0 2024-04-24T23:38:44.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.917+0000 7faf03b6b640 1 -- 172.21.15.57:0/428827027 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faefc068930 con 0x7faefc1430b0 2024-04-24T23:38:44.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.917+0000 7faefa7fc640 1 -- 172.21.15.57:0/428827027 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faef00be070 con 0x7faefc1430b0 2024-04-24T23:38:44.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.917+0000 7faefa7fc640 1 --2- 172.21.15.57:0/428827027 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7faee80678f0 0x7faee8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:44.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.917+0000 7faefa7fc640 1 -- 172.21.15.57:0/428827027 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7faef011fd60 con 0x7faefc1430b0 2024-04-24T23:38:44.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.917+0000 7faf01907640 1 --2- 172.21.15.57:0/428827027 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7faee80678f0 0x7faee8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:44.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.921+0000 7faf01907640 1 --2- 172.21.15.57:0/428827027 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7faee80678f0 0x7faee8069db0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faef4009be0 tx=0x7faef4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:44.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:44.921+0000 7faefa7fc640 1 -- 172.21.15.57:0/428827027 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7faef0017070 con 0x7faefc1430b0 2024-04-24T23:38:45.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.085+0000 7faf03b6b640 1 -- 172.21.15.57:0/428827027 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faefc0be150 con 0x7faefc1430b0 2024-04-24T23:38:45.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.089+0000 7faefa7fc640 1 -- 172.21.15.57:0/428827027 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7faef00f0580 con 0x7faefc1430b0 2024-04-24T23:38:45.091 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:38:45.091 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":24,"fsid":"1ea31698-444a-4667-bcd9-b2608ad103c3","created":"2024-04-24T23:38:16.748774+0000","modified":"2024-04-24T23:38:38.604475+0000","last_up_change":"2024-04-24T23:38:26.956537+0000","last_in_change":"2024-04-24T23:38:18.972175+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:38:27.611782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:38:31.718061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:38:32.469413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:38:36.215724+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"35ce67bc-9b25-416e-ab1e-774c717631f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6825","nonce":671364028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6827","nonce":671364028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6831","nonce":671364028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6829","nonce":671364028}]},"public_addr":"172.21.15.57:6825/671364028","cluster_addr":"172.21.15.57:6827/671364028","heartbeat_back_addr":"172.21.15.57:6831/671364028","heartbeat_front_addr":"172.21.15.57:6829/671364028","state":["exists","up"]},{"osd":1,"uuid":"38f6f4ef-3bc2-4453-9946-7d1d17e735ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6801","nonce":2653552037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6803","nonce":2653552037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6807","nonce":2653552037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6805","nonce":2653552037}]},"public_addr":"172.21.15.57:6801/2653552037","cluster_addr":"172.21.15.57:6803/2653552037","heartbeat_back_addr":"172.21.15.57:6807/2653552037","heartbeat_front_addr":"172.21.15.57:6805/2653552037","state":["exists","up"]},{"osd":2,"uuid":"d77a0a49-b39a-464e-a1c9-49e19280c440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6816","nonce":1565874109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6819","nonce":1565874109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6823","nonce":1565874109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6821","nonce":1565874109}]},"public_addr":"172.21.15.57:6816/1565874109","cluster_addr":"172.21.15.57:6819/1565874109","heartbeat_back_addr":"172.21.15.57:6823/1565874109","heartbeat_front_addr":"172.21.15.57:6821/1565874109","state":["exists","up"]},{"osd":3,"uuid":"f8ea9bfe-d839-44a6-a185-0f0985da314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6809","nonce":3474703186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6811","nonce":3474703186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6817","nonce":3474703186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6813","nonce":3474703186}]},"public_addr":"172.21.15.57:6809/3474703186","cluster_addr":"172.21.15.57:6811/3474703186","heartbeat_back_addr":"172.21.15.57:6817/3474703186","heartbeat_front_addr":"172.21.15.57:6813/3474703186","state":["exists","up"]},{"osd":4,"uuid":"454647d4-6ac2-46b4-8451-320eb951a87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6801","nonce":1271707713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6803","nonce":1271707713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6807","nonce":1271707713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6805","nonce":1271707713}]},"public_addr":"172.21.15.88:6801/1271707713","cluster_addr":"172.21.15.88:6803/1271707713","heartbeat_back_addr":"172.21.15.88:6807/1271707713","heartbeat_front_addr":"172.21.15.88:6805/1271707713","state":["exists","up"]},{"osd":5,"uuid":"f71c03a3-7ad8-46d3-89c9-d61de102586b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6809","nonce":2035054888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6813","nonce":2035054888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6820","nonce":2035054888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6816","nonce":2035054888}]},"public_addr":"172.21.15.88:6809/2035054888","cluster_addr":"172.21.15.88:6813/2035054888","heartbeat_back_addr":"172.21.15.88:6820/2035054888","heartbeat_front_addr":"172.21.15.88:6816/2035054888","state":["exists","up"]},{"osd":6,"uuid":"ec7ae2b7-9cb4-4059-8f98-0022c9763f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6825","nonce":1752291242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6827","nonce":1752291242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6831","nonce":1752291242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6829","nonce":1752291242}]},"public_addr":"172.21.15.88:6825/1752291242","cluster_addr":"172.21.15.88:6827/1752291242","heartbeat_back_addr":"172.21.15.88:6831/1752291242","heartbeat_front_addr":"172.21.15.88:6829/1752291242","state":["exists","up"]},{"osd":7,"uuid":"c0ee7505-60c1-40ba-9902-47313a04dafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6812","nonce":1782800372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6817","nonce":1782800372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6823","nonce":1782800372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6821","nonce":1782800372}]},"public_addr":"172.21.15.88:6812/1782800372","cluster_addr":"172.21.15.88:6817/1782800372","heartbeat_back_addr":"172.21.15.88:6823/1782800372","heartbeat_front_addr":"172.21.15.88:6821/1782800372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.698562+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.682587+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.680197+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.561753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.011095+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.493320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.353451+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.423877+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:38:45.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.093+0000 7faf03b6b640 1 -- 172.21.15.57:0/428827027 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7faee80678f0 msgr2=0x7faee8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:45.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.093+0000 7faf03b6b640 1 --2- 172.21.15.57:0/428827027 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7faee80678f0 0x7faee8069db0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faef4009be0 tx=0x7faef4009190 comp rx=0 tx=0).stop 2024-04-24T23:38:45.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.093+0000 7faf03b6b640 1 -- 172.21.15.57:0/428827027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faefc1430b0 msgr2=0x7faefc1e6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:45.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.093+0000 7faf03b6b640 1 --2- 172.21.15.57:0/428827027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faefc1430b0 0x7faefc1e6510 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faef0098ca0 tx=0x7faee4005840 comp rx=0 tx=0).stop 2024-04-24T23:38:45.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.093+0000 7faf03b6b640 1 -- 172.21.15.57:0/428827027 shutdown_connections 2024-04-24T23:38:45.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.093+0000 7faf03b6b640 1 --2- 172.21.15.57:0/428827027 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7faee80678f0 0x7faee8069db0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.093+0000 7faf03b6b640 1 --2- 172.21.15.57:0/428827027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc145050 0x7faefc1e9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.093+0000 7faf03b6b640 1 --2- 172.21.15.57:0/428827027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faefc1430b0 0x7faefc1e6510 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.093+0000 7faf03b6b640 1 --2- 172.21.15.57:0/428827027 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faee4004810 0x7faefc14b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.093+0000 7faf03b6b640 1 -- 172.21.15.57:0/428827027 >> 172.21.15.57:0/428827027 conn(0x7faefc0a5d20 msgr2=0x7faefc147920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:45.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.093+0000 7faf03b6b640 1 -- 172.21.15.57:0/428827027 shutdown_connections 2024-04-24T23:38:45.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.093+0000 7faf03b6b640 1 -- 172.21.15.57:0/428827027 wait complete. 2024-04-24T23:38:45.111 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:38:27.611782+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:38:31.718061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:38:32.469413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-24T23:38:36.215724+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-24T23:38:45.112 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:38:45.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.241+0000 7f63f97c7640 1 Processor -- start 2024-04-24T23:38:45.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.241+0000 7f63f97c7640 1 -- start start 2024-04-24T23:38:45.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.241+0000 7f63f97c7640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f63f406e000 0x7f63f41513b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:45.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.241+0000 7f63f97c7640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f63f406d6d0 0x7f63f40bb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:45.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.241+0000 7f63f97c7640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63f4072150 con 0x7f63f40bba20 2024-04-24T23:38:45.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.241+0000 7f63f97c7640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f63f406e920 con 0x7f63f406e000 2024-04-24T23:38:45.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.241+0000 7f63f97c7640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f63f4072450 con 0x7f63f406d6d0 2024-04-24T23:38:45.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.241+0000 7f63f2ffd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f63f406e000 0x7f63f41513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:45.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.241+0000 7f63f2ffd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f63f406e000 0x7f63f41513b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42504/0 (socket says 172.21.15.57:42504) 2024-04-24T23:38:45.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.241+0000 7f63f2ffd640 1 -- 172.21.15.57:0/3032248410 learned_addr learned my addr 172.21.15.57:0/3032248410 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:45.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.241+0000 7f63f27fc640 1 --2- 172.21.15.57:0/3032248410 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f63f406d6d0 0x7f63f40bb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:45.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.241+0000 7f63f2ffd640 1 -- 172.21.15.57:0/3032248410 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f63f406d6d0 msgr2=0x7f63f40bb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:45.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.241+0000 7f63f2ffd640 1 --2- 172.21.15.57:0/3032248410 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f63f406d6d0 0x7f63f40bb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.241+0000 7f63f2ffd640 1 -- 172.21.15.57:0/3032248410 >> v1:172.21.15.88:6789/0 conn(0x7f63f40bba20 legacy=0x7f63f40728e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:45.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.241+0000 7f63f2ffd640 1 -- 172.21.15.57:0/3032248410 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f41518f0 con 0x7f63f406e000 2024-04-24T23:38:45.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.245+0000 7f63f2ffd640 1 --2- 172.21.15.57:0/3032248410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63f406e000 0x7f63f41513b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f63e4009870 tx=0x7f63e401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a76b7d0066140fb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:45.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.245+0000 7f63f1ffb640 1 -- 172.21.15.57:0/3032248410 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e40a95f0 con 0x7f63f406e000 2024-04-24T23:38:45.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.245+0000 7f63f1ffb640 1 -- 172.21.15.57:0/3032248410 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63e40a9790 con 0x7f63f406e000 2024-04-24T23:38:45.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.245+0000 7f63f1ffb640 1 -- 172.21.15.57:0/3032248410 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e40a9b60 con 0x7f63f406e000 2024-04-24T23:38:45.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.245+0000 7f63f97c7640 1 -- 172.21.15.57:0/3032248410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63f406e000 msgr2=0x7f63f41513b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:45.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.245+0000 7f63f97c7640 1 --2- 172.21.15.57:0/3032248410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63f406e000 0x7f63f41513b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f63e4009870 tx=0x7f63e401c530 comp rx=0 tx=0).stop 2024-04-24T23:38:45.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.245+0000 7f63f97c7640 1 -- 172.21.15.57:0/3032248410 shutdown_connections 2024-04-24T23:38:45.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.245+0000 7f63f97c7640 1 --2- 172.21.15.57:0/3032248410 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f63f406d6d0 0x7f63f40bb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.245+0000 7f63f97c7640 1 --2- 172.21.15.57:0/3032248410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63f406e000 0x7f63f41513b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.245+0000 7f63f97c7640 1 -- 172.21.15.57:0/3032248410 >> 172.21.15.57:0/3032248410 conn(0x7f63f406b920 msgr2=0x7f63f40c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:45.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.245+0000 7f63f97c7640 1 -- 172.21.15.57:0/3032248410 shutdown_connections 2024-04-24T23:38:45.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.245+0000 7f63f97c7640 1 -- 172.21.15.57:0/3032248410 wait complete. 2024-04-24T23:38:45.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.245+0000 7f63f97c7640 1 Processor -- start 2024-04-24T23:38:45.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.245+0000 7f63f97c7640 1 -- start start 2024-04-24T23:38:45.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.245+0000 7f63f97c7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63f406d6d0 0x7f63f4146c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:45.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.245+0000 7f63f97c7640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f63f406e000 0x7f63f4145200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:45.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.245+0000 7f63f97c7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63f40bba20 0x7f63f4145740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:45.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.245+0000 7f63f97c7640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f63f4073170 con 0x7f63f40bba20 2024-04-24T23:38:45.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.245+0000 7f63f97c7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f63f4072ff0 con 0x7f63f406d6d0 2024-04-24T23:38:45.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.245+0000 7f63f97c7640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f63f415dad0 con 0x7f63f406e000 2024-04-24T23:38:45.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.245+0000 7f63f37fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63f40bba20 0x7f63f4145740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:45.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.245+0000 7f63f37fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63f40bba20 0x7f63f4145740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42510/0 (socket says 172.21.15.57:42510) 2024-04-24T23:38:45.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.245+0000 7f63f37fe640 1 -- 172.21.15.57:0/1125689373 learned_addr learned my addr 172.21.15.57:0/1125689373 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:45.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.249+0000 7f63f2ffd640 1 --2- 172.21.15.57:0/1125689373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63f406d6d0 0x7f63f4146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:45.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.249+0000 7f63f27fc640 1 --2- 172.21.15.57:0/1125689373 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f63f406e000 0x7f63f4145200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:45.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.249+0000 7f63f37fe640 1 -- 172.21.15.57:0/1125689373 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f63f406e000 msgr2=0x7f63f4145200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:45.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.249+0000 7f63f37fe640 1 --2- 172.21.15.57:0/1125689373 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f63f406e000 0x7f63f4145200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.249+0000 7f63f37fe640 1 -- 172.21.15.57:0/1125689373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63f406d6d0 msgr2=0x7f63f4146c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:45.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.249+0000 7f63f37fe640 1 --2- 172.21.15.57:0/1125689373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63f406d6d0 0x7f63f4146c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.249+0000 7f63f37fe640 1 -- 172.21.15.57:0/1125689373 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f4145c80 con 0x7f63f40bba20 2024-04-24T23:38:45.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.249+0000 7f63f2ffd640 1 --2- 172.21.15.57:0/1125689373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63f406d6d0 0x7f63f4146c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:38:45.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.249+0000 7f63f37fe640 1 --2- 172.21.15.57:0/1125689373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63f40bba20 0x7f63f4145740 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f63ec00c760 tx=0x7f63ec00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:45.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.249+0000 7f63db7fe640 1 -- 172.21.15.57:0/1125689373 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec003ba0 con 0x7f63f40bba20 2024-04-24T23:38:45.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.249+0000 7f63db7fe640 1 -- 172.21.15.57:0/1125689373 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63ec003d40 con 0x7f63f40bba20 2024-04-24T23:38:45.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.249+0000 7f63f97c7640 1 -- 172.21.15.57:0/1125689373 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63f4147150 con 0x7f63f40bba20 2024-04-24T23:38:45.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.249+0000 7f63db7fe640 1 -- 172.21.15.57:0/1125689373 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec005310 con 0x7f63f40bba20 2024-04-24T23:38:45.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.249+0000 7f63f97c7640 1 -- 172.21.15.57:0/1125689373 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63f41e9f10 con 0x7f63f40bba20 2024-04-24T23:38:45.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.249+0000 7f63f97c7640 1 -- 172.21.15.57:0/1125689373 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63f4068290 con 0x7f63f40bba20 2024-04-24T23:38:45.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.249+0000 7f63db7fe640 1 -- 172.21.15.57:0/1125689373 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f63ec0054b0 con 0x7f63f40bba20 2024-04-24T23:38:45.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.249+0000 7f63db7fe640 1 --2- 172.21.15.57:0/1125689373 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f63e00678f0 0x7f63e0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:45.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.249+0000 7f63db7fe640 1 -- 172.21.15.57:0/1125689373 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f63ec085b90 con 0x7f63f40bba20 2024-04-24T23:38:45.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.249+0000 7f63f2ffd640 1 --2- 172.21.15.57:0/1125689373 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f63e00678f0 0x7f63e0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:45.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.249+0000 7f63f2ffd640 1 --2- 172.21.15.57:0/1125689373 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f63e00678f0 0x7f63e0069db0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f63e40ae000 tx=0x7f63e40b3040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:45.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.253+0000 7f63db7fe640 1 -- 172.21.15.57:0/1125689373 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f63ec020020 con 0x7f63f40bba20 2024-04-24T23:38:45.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.413+0000 7f63f97c7640 1 -- 172.21.15.57:0/1125689373 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f63f40be340 con 0x7f63f40bba20 2024-04-24T23:38:45.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.417+0000 7f63db7fe640 1 -- 172.21.15.57:0/1125689373 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f63f4147150 con 0x7f63f40bba20 2024-04-24T23:38:45.417 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-04-24T23:38:45.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.417+0000 7f63f97c7640 1 -- 172.21.15.57:0/1125689373 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f63e00678f0 msgr2=0x7f63e0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:45.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.417+0000 7f63f97c7640 1 --2- 172.21.15.57:0/1125689373 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f63e00678f0 0x7f63e0069db0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f63e40ae000 tx=0x7f63e40b3040 comp rx=0 tx=0).stop 2024-04-24T23:38:45.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.417+0000 7f63f97c7640 1 -- 172.21.15.57:0/1125689373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63f40bba20 msgr2=0x7f63f4145740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:45.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.417+0000 7f63f97c7640 1 --2- 172.21.15.57:0/1125689373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63f40bba20 0x7f63f4145740 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f63ec00c760 tx=0x7f63ec00cc20 comp rx=0 tx=0).stop 2024-04-24T23:38:45.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.417+0000 7f63f97c7640 1 -- 172.21.15.57:0/1125689373 shutdown_connections 2024-04-24T23:38:45.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.417+0000 7f63f97c7640 1 --2- 172.21.15.57:0/1125689373 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f63e00678f0 0x7f63e0069db0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.417+0000 7f63f97c7640 1 --2- 172.21.15.57:0/1125689373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63f40bba20 0x7f63f4145740 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.417+0000 7f63f97c7640 1 --2- 172.21.15.57:0/1125689373 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f63f406e000 0x7f63f4145200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.417+0000 7f63f97c7640 1 --2- 172.21.15.57:0/1125689373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63f406d6d0 0x7f63f4146c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.417+0000 7f63f97c7640 1 -- 172.21.15.57:0/1125689373 >> 172.21.15.57:0/1125689373 conn(0x7f63f406b920 msgr2=0x7f63f414fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:45.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.417+0000 7f63f97c7640 1 -- 172.21.15.57:0/1125689373 shutdown_connections 2024-04-24T23:38:45.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.417+0000 7f63f97c7640 1 -- 172.21.15.57:0/1125689373 wait complete. 2024-04-24T23:38:45.435 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:38:45.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57fcd22640 1 Processor -- start 2024-04-24T23:38:45.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57fcd22640 1 -- start start 2024-04-24T23:38:45.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57fcd22640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f57f80bd5f0 0x7f57f8151c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:45.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57fcd22640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57f80bd200 con 0x7f57f80bc3b0 2024-04-24T23:38:45.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57fcd22640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57f80be070 con 0x7f57f814bc60 2024-04-24T23:38:45.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57fcd22640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f57f80bde20 con 0x7f57f80bd5f0 2024-04-24T23:38:45.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57f6d9d640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f57f80bc3b0 0x7f57f8158f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52344/0 (socket says 172.21.15.57:52344) 2024-04-24T23:38:45.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57f6d9d640 1 -- 172.21.15.57:0/2241069880 learned_addr learned my addr 172.21.15.57:0/2241069880 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:38:45.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57f5d9b640 1 --2- 172.21.15.57:0/2241069880 >> v2:172.21.15.88:3300/0 conn(0x7f57f80bd5f0 0x7f57f8151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:45.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57f559a640 1 -- 172.21.15.57:0/2241069880 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3884533205 0 0) 0x7f57f80bd200 con 0x7f57f80bc3b0 2024-04-24T23:38:45.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57f559a640 1 -- 172.21.15.57:0/2241069880 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57e0003530 con 0x7f57f80bc3b0 2024-04-24T23:38:45.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57f559a640 1 -- 172.21.15.57:0/2241069880 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 662130451 0 0) 0x7f57e0003530 con 0x7f57f80bc3b0 2024-04-24T23:38:45.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57f559a640 1 -- 172.21.15.57:0/2241069880 >> v2:172.21.15.88:3300/0 conn(0x7f57f80bd5f0 msgr2=0x7f57f8151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:45.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57f559a640 1 --2- 172.21.15.57:0/2241069880 >> v2:172.21.15.88:3300/0 conn(0x7f57f80bd5f0 0x7f57f8151c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57f559a640 1 -- 172.21.15.57:0/2241069880 >> v1:172.21.15.88:6789/0 conn(0x7f57f814bc60 legacy=0x7f57f80c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:45.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57f559a640 1 -- 172.21.15.57:0/2241069880 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f80be350 con 0x7f57f80bc3b0 2024-04-24T23:38:45.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57f559a640 1 -- 172.21.15.57:0/2241069880 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7f57f0001a00 con 0x7f57f80bc3b0 2024-04-24T23:38:45.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57f559a640 1 -- 172.21.15.57:0/2241069880 >> v1:172.21.15.57:6789/0 conn(0x7f57f80bc3b0 legacy=0x7f57f8158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:45.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57f559a640 1 --2- 172.21.15.57:0/2241069880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57e00039c0 0x7f57e0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:45.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57f559a640 1 --2- 172.21.15.57:0/2241069880 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f57e0004810 0x7f57e0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:45.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57f559a640 1 --2- 172.21.15.57:0/2241069880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57e00052f0 0x7f57e000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:45.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57f559a640 1 -- 172.21.15.57:0/2241069880 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f57f80bde20 con 0x7f57e00039c0 2024-04-24T23:38:45.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57f559a640 1 -- 172.21.15.57:0/2241069880 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f57e000c1c0 con 0x7f57e00052f0 2024-04-24T23:38:45.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57f559a640 1 -- 172.21.15.57:0/2241069880 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f57e000c3c0 con 0x7f57e0004810 2024-04-24T23:38:45.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57f659c640 1 --2- 172.21.15.57:0/2241069880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57e00039c0 0x7f57e0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:45.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57f5d9b640 1 --2- 172.21.15.57:0/2241069880 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f57e0004810 0x7f57e0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:45.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57f6d9d640 1 --2- 172.21.15.57:0/2241069880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57e00052f0 0x7f57e000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:45.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57f659c640 1 -- 172.21.15.57:0/2241069880 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f57e0004810 msgr2=0x7f57e0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:45.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57f659c640 1 --2- 172.21.15.57:0/2241069880 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f57e0004810 0x7f57e0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57f659c640 1 -- 172.21.15.57:0/2241069880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57e00052f0 msgr2=0x7f57e000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:45.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57f659c640 1 --2- 172.21.15.57:0/2241069880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57e00052f0 0x7f57e000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57f659c640 1 -- 172.21.15.57:0/2241069880 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e0003530 con 0x7f57e00039c0 2024-04-24T23:38:45.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.553+0000 7f57f6d9d640 1 -- 172.21.15.57:0/2241069880 reap_dead start 2024-04-24T23:38:45.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.557+0000 7f57f659c640 1 --2- 172.21.15.57:0/2241069880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57e00039c0 0x7f57e0003de0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f57e8001750 tx=0x7f57e801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ffe983f878687a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:45.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.557+0000 7f57f559a640 1 -- 172.21.15.57:0/2241069880 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e80013a0 con 0x7f57e00039c0 2024-04-24T23:38:45.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.557+0000 7f57f559a640 1 -- 172.21.15.57:0/2241069880 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57e80052f0 con 0x7f57e00039c0 2024-04-24T23:38:45.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.557+0000 7f57f559a640 1 -- 172.21.15.57:0/2241069880 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e8003840 con 0x7f57e00039c0 2024-04-24T23:38:45.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.557+0000 7f57fcd22640 1 -- 172.21.15.57:0/2241069880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57e00039c0 msgr2=0x7f57e0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:45.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.557+0000 7f57fcd22640 1 --2- 172.21.15.57:0/2241069880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57e00039c0 0x7f57e0003de0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f57e8001750 tx=0x7f57e801c3c0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.557+0000 7f57fcd22640 1 -- 172.21.15.57:0/2241069880 shutdown_connections 2024-04-24T23:38:45.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.557+0000 7f57fcd22640 1 --2- 172.21.15.57:0/2241069880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57e00039c0 0x7f57e0003de0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.557+0000 7f57fcd22640 1 -- 172.21.15.57:0/2241069880 >> 172.21.15.57:0/2241069880 conn(0x7f57f806b920 msgr2=0x7f57f80c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:45.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.557+0000 7f57fcd22640 1 -- 172.21.15.57:0/2241069880 shutdown_connections 2024-04-24T23:38:45.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.557+0000 7f57fcd22640 1 -- 172.21.15.57:0/2241069880 wait complete. 2024-04-24T23:38:45.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.557+0000 7f57fcd22640 1 Processor -- start 2024-04-24T23:38:45.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.557+0000 7f57fcd22640 1 -- start start 2024-04-24T23:38:45.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.561+0000 7f57fcd22640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f57e00039c0 0x7f57f80c16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:45.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.561+0000 7f57fcd22640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f80a4cf0 0x7f57f8150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:45.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.561+0000 7f57fcd22640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57f8144380 0x7f57f8144800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:45.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.561+0000 7f57fcd22640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f57f8151da0 con 0x7f57f8144380 2024-04-24T23:38:45.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.561+0000 7f57fcd22640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f57f8151c20 con 0x7f57f80a4cf0 2024-04-24T23:38:45.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.561+0000 7f57fcd22640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f57f8151f20 con 0x7f57e00039c0 2024-04-24T23:38:45.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.561+0000 7f57f6d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57f8144380 0x7f57f8144800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:45.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.561+0000 7f57f6d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57f8144380 0x7f57f8144800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42526/0 (socket says 172.21.15.57:42526) 2024-04-24T23:38:45.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.561+0000 7f57f6d9d640 1 -- 172.21.15.57:0/3161457761 learned_addr learned my addr 172.21.15.57:0/3161457761 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:45.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.561+0000 7f57f659c640 1 --2- 172.21.15.57:0/3161457761 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f57e00039c0 0x7f57f80c16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:45.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.561+0000 7f57f5d9b640 1 --2- 172.21.15.57:0/3161457761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f80a4cf0 0x7f57f8150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:45.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.561+0000 7f57f6d9d640 1 -- 172.21.15.57:0/3161457761 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f57e00039c0 msgr2=0x7f57f80c16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:45.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.561+0000 7f57f6d9d640 1 --2- 172.21.15.57:0/3161457761 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f57e00039c0 0x7f57f80c16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.561+0000 7f57f6d9d640 1 -- 172.21.15.57:0/3161457761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f80a4cf0 msgr2=0x7f57f8150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:45.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.561+0000 7f57f6d9d640 1 --2- 172.21.15.57:0/3161457761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f80a4cf0 0x7f57f8150da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.561+0000 7f57f6d9d640 1 -- 172.21.15.57:0/3161457761 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f81512e0 con 0x7f57f8144380 2024-04-24T23:38:45.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.561+0000 7f57f5d9b640 1 --2- 172.21.15.57:0/3161457761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f80a4cf0 0x7f57f8150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:38:45.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.561+0000 7f57f6d9d640 1 --2- 172.21.15.57:0/3161457761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57f8144380 0x7f57f8144800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f57f80bcbd0 tx=0x7f57f0007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:45.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.561+0000 7f57e6ffd640 1 -- 172.21.15.57:0/3161457761 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f000ea80 con 0x7f57f8144380 2024-04-24T23:38:45.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.561+0000 7f57e6ffd640 1 -- 172.21.15.57:0/3161457761 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57f0018070 con 0x7f57f8144380 2024-04-24T23:38:45.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.561+0000 7f57fcd22640 1 -- 172.21.15.57:0/3161457761 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57f81ea300 con 0x7f57f8144380 2024-04-24T23:38:45.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.561+0000 7f57e6ffd640 1 -- 172.21.15.57:0/3161457761 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f000ee60 con 0x7f57f8144380 2024-04-24T23:38:45.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.561+0000 7f57fcd22640 1 -- 172.21.15.57:0/3161457761 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57f8144d40 con 0x7f57f8144380 2024-04-24T23:38:45.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.561+0000 7f57fcd22640 1 -- 172.21.15.57:0/3161457761 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57f80730f0 con 0x7f57f8144380 2024-04-24T23:38:45.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.561+0000 7f57e6ffd640 1 -- 172.21.15.57:0/3161457761 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f57f001d460 con 0x7f57f8144380 2024-04-24T23:38:45.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.561+0000 7f57e6ffd640 1 --2- 172.21.15.57:0/3161457761 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f57d80678f0 0x7f57d8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:45.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.561+0000 7f57e6ffd640 1 -- 172.21.15.57:0/3161457761 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f57f00861d0 con 0x7f57f8144380 2024-04-24T23:38:45.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.561+0000 7f57f659c640 1 --2- 172.21.15.57:0/3161457761 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f57d80678f0 0x7f57d8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:45.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.565+0000 7f57f659c640 1 --2- 172.21.15.57:0/3161457761 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f57d80678f0 0x7f57d8069db0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f57e00057f0 tx=0x7f57e80011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:45.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.565+0000 7f57e6ffd640 1 -- 172.21.15.57:0/3161457761 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f57f81512e0 con 0x7f57f8144380 2024-04-24T23:38:45.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.733+0000 7f57fcd22640 1 -- 172.21.15.57:0/3161457761 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f57f8068290 con 0x7f57f8144380 2024-04-24T23:38:45.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.733+0000 7f57e6ffd640 1 -- 172.21.15.57:0/3161457761 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f57f0056940 con 0x7f57f8144380 2024-04-24T23:38:45.735 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-04-24T23:38:45.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.737+0000 7f57fcd22640 1 -- 172.21.15.57:0/3161457761 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f57d80678f0 msgr2=0x7f57d8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:45.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.737+0000 7f57fcd22640 1 --2- 172.21.15.57:0/3161457761 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f57d80678f0 0x7f57d8069db0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f57e00057f0 tx=0x7f57e80011a0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.737+0000 7f57fcd22640 1 -- 172.21.15.57:0/3161457761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57f8144380 msgr2=0x7f57f8144800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:45.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.737+0000 7f57fcd22640 1 --2- 172.21.15.57:0/3161457761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57f8144380 0x7f57f8144800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f57f80bcbd0 tx=0x7f57f0007bc0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.737+0000 7f57fcd22640 1 -- 172.21.15.57:0/3161457761 shutdown_connections 2024-04-24T23:38:45.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.737+0000 7f57fcd22640 1 --2- 172.21.15.57:0/3161457761 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f57d80678f0 0x7f57d8069db0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.737+0000 7f57fcd22640 1 --2- 172.21.15.57:0/3161457761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57f8144380 0x7f57f8144800 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.737+0000 7f57fcd22640 1 --2- 172.21.15.57:0/3161457761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f80a4cf0 0x7f57f8150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.737+0000 7f57fcd22640 1 --2- 172.21.15.57:0/3161457761 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f57e00039c0 0x7f57f80c16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.737+0000 7f57fcd22640 1 -- 172.21.15.57:0/3161457761 >> 172.21.15.57:0/3161457761 conn(0x7f57f806b920 msgr2=0x7f57f814e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:45.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.737+0000 7f57fcd22640 1 -- 172.21.15.57:0/3161457761 shutdown_connections 2024-04-24T23:38:45.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.737+0000 7f57fcd22640 1 -- 172.21.15.57:0/3161457761 wait complete. 2024-04-24T23:38:45.754 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:38:45.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.869+0000 7f0fa0535640 1 Processor -- start 2024-04-24T23:38:45.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.869+0000 7f0fa0535640 1 -- start start 2024-04-24T23:38:45.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.873+0000 7f0fa0535640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0f980bd5f0 0x7f0f98151c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:45.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.873+0000 7f0fa0535640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0f980bc3b0 0x7f0f98152160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:45.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.873+0000 7f0fa0535640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f980bd200 con 0x7f0f9814bc60 2024-04-24T23:38:45.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.873+0000 7f0fa0535640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f0f981526a0 con 0x7f0f980bd5f0 2024-04-24T23:38:45.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.873+0000 7f0fa0535640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f0f980bde20 con 0x7f0f980bc3b0 2024-04-24T23:38:45.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.873+0000 7f0f9dad0640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0f980bd5f0 0x7f0f98151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:45.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.873+0000 7f0f9dad0640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0f980bd5f0 0x7f0f98151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42536/0 (socket says 172.21.15.57:42536) 2024-04-24T23:38:45.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.873+0000 7f0f9dad0640 1 -- 172.21.15.57:0/2477691015 learned_addr learned my addr 172.21.15.57:0/2477691015 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:45.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.873+0000 7f0f9e2d1640 1 --1- 172.21.15.57:0/2477691015 >> v1:172.21.15.57:6789/0 conn(0x7f0f9814bc60 0x7f0f980c27c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52354/0 (socket says 172.21.15.57:52354) 2024-04-24T23:38:45.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.873+0000 7f0f9ead2640 1 --2- 172.21.15.57:0/2477691015 >> v2:172.21.15.88:3300/0 conn(0x7f0f980bc3b0 0x7f0f98152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:45.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.873+0000 7f0f9dad0640 1 -- 172.21.15.57:0/2477691015 >> v2:172.21.15.88:3300/0 conn(0x7f0f980bc3b0 msgr2=0x7f0f98152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:45.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.873+0000 7f0f9dad0640 1 --2- 172.21.15.57:0/2477691015 >> v2:172.21.15.88:3300/0 conn(0x7f0f980bc3b0 0x7f0f98152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.873+0000 7f0f9dad0640 1 -- 172.21.15.57:0/2477691015 >> v1:172.21.15.57:6789/0 conn(0x7f0f9814bc60 legacy=0x7f0f980c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:45.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.873+0000 7f0f9dad0640 1 -- 172.21.15.57:0/2477691015 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f980be070 con 0x7f0f980bd5f0 2024-04-24T23:38:45.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.873+0000 7f0f9dad0640 1 --2- 172.21.15.57:0/2477691015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f980bd5f0 0x7f0f98151c20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0f98152c50 tx=0x7f0f8801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575c84ed98c5555c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:45.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.873+0000 7f0f9d2cf640 1 -- 172.21.15.57:0/2477691015 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f880b0070 con 0x7f0f980bd5f0 2024-04-24T23:38:45.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.873+0000 7f0f9d2cf640 1 -- 172.21.15.57:0/2477691015 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f880ab600 con 0x7f0f980bd5f0 2024-04-24T23:38:45.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.873+0000 7f0f9d2cf640 1 -- 172.21.15.57:0/2477691015 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f880ab9d0 con 0x7f0f980bd5f0 2024-04-24T23:38:45.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.873+0000 7f0fa0535640 1 -- 172.21.15.57:0/2477691015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f980bd5f0 msgr2=0x7f0f98151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:45.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.873+0000 7f0fa0535640 1 --2- 172.21.15.57:0/2477691015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f980bd5f0 0x7f0f98151c20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0f98152c50 tx=0x7f0f8801c400 comp rx=0 tx=0).stop 2024-04-24T23:38:45.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.873+0000 7f0fa0535640 1 -- 172.21.15.57:0/2477691015 shutdown_connections 2024-04-24T23:38:45.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.873+0000 7f0fa0535640 1 --2- 172.21.15.57:0/2477691015 >> v2:172.21.15.88:3300/0 conn(0x7f0f980bc3b0 0x7f0f98152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.873+0000 7f0fa0535640 1 --2- 172.21.15.57:0/2477691015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f980bd5f0 0x7f0f98151c20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.873+0000 7f0fa0535640 1 -- 172.21.15.57:0/2477691015 >> 172.21.15.57:0/2477691015 conn(0x7f0f9806b920 msgr2=0x7f0f980c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:45.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.873+0000 7f0fa0535640 1 -- 172.21.15.57:0/2477691015 shutdown_connections 2024-04-24T23:38:45.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.873+0000 7f0fa0535640 1 -- 172.21.15.57:0/2477691015 wait complete. 2024-04-24T23:38:45.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.877+0000 7f0fa0535640 1 Processor -- start 2024-04-24T23:38:45.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.877+0000 7f0fa0535640 1 -- start start 2024-04-24T23:38:45.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.877+0000 7f0fa0535640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f980bc3b0 0x7f0f98145c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:45.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.877+0000 7f0fa0535640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f980bd5f0 0x7f0f981ece70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:45.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.877+0000 7f0fa0535640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0f9814bc60 0x7f0f98144410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:45.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.877+0000 7f0fa0535640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0f980bce60 con 0x7f0f980bd5f0 2024-04-24T23:38:45.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.877+0000 7f0fa0535640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9814c040 con 0x7f0f980bc3b0 2024-04-24T23:38:45.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.877+0000 7f0fa0535640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f0f980bcfe0 con 0x7f0f9814bc60 2024-04-24T23:38:45.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.877+0000 7f0f9dad0640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f980bd5f0 0x7f0f981ece70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:45.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.877+0000 7f0f9dad0640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f980bd5f0 0x7f0f981ece70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42544/0 (socket says 172.21.15.57:42544) 2024-04-24T23:38:45.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.877+0000 7f0f9dad0640 1 -- 172.21.15.57:0/333250755 learned_addr learned my addr 172.21.15.57:0/333250755 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:45.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.877+0000 7f0f9dad0640 1 -- 172.21.15.57:0/333250755 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0f9814bc60 msgr2=0x7f0f98144410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:45.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.877+0000 7f0f9dad0640 1 --2- 172.21.15.57:0/333250755 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0f9814bc60 0x7f0f98144410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.877+0000 7f0f9dad0640 1 -- 172.21.15.57:0/333250755 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f980bc3b0 msgr2=0x7f0f98145c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:45.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.877+0000 7f0f9e2d1640 1 --2- 172.21.15.57:0/333250755 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f980bc3b0 0x7f0f98145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:45.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.877+0000 7f0f9dad0640 1 --2- 172.21.15.57:0/333250755 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f980bc3b0 0x7f0f98145c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:45.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.877+0000 7f0f9dad0640 1 -- 172.21.15.57:0/333250755 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f981ec390 con 0x7f0f980bd5f0 2024-04-24T23:38:45.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.877+0000 7f0f9dad0640 1 --2- 172.21.15.57:0/333250755 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f980bd5f0 0x7f0f981ece70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0f88019010 tx=0x7f0f880191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:45.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.877+0000 7f0f8effd640 1 -- 172.21.15.57:0/333250755 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f880b9070 con 0x7f0f980bd5f0 2024-04-24T23:38:45.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.877+0000 7f0f8effd640 1 -- 172.21.15.57:0/333250755 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f880b4400 con 0x7f0f980bd5f0 2024-04-24T23:38:45.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.877+0000 7f0fa0535640 1 -- 172.21.15.57:0/333250755 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f981ec670 con 0x7f0f980bd5f0 2024-04-24T23:38:45.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.877+0000 7f0f8effd640 1 -- 172.21.15.57:0/333250755 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f880b0040 con 0x7f0f980bd5f0 2024-04-24T23:38:45.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.877+0000 7f0fa0535640 1 -- 172.21.15.57:0/333250755 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f98146270 con 0x7f0f980bd5f0 2024-04-24T23:38:45.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.877+0000 7f0fa0535640 1 -- 172.21.15.57:0/333250755 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f98068290 con 0x7f0f980bd5f0 2024-04-24T23:38:45.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.877+0000 7f0f8effd640 1 -- 172.21.15.57:0/333250755 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0f880bc070 con 0x7f0f980bd5f0 2024-04-24T23:38:45.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.881+0000 7f0f8effd640 1 --2- 172.21.15.57:0/333250755 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f0f7c0678c0 0x7f0f7c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:45.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.881+0000 7f0f8effd640 1 -- 172.21.15.57:0/333250755 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0f8811f070 con 0x7f0f980bd5f0 2024-04-24T23:38:45.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.881+0000 7f0f9e2d1640 1 --2- 172.21.15.57:0/333250755 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f0f7c0678c0 0x7f0f7c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:45.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.881+0000 7f0f9e2d1640 1 --2- 172.21.15.57:0/333250755 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f0f7c0678c0 0x7f0f7c069d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0f94000f70 tx=0x7f0f94009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:45.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:45.885+0000 7f0f8effd640 1 -- 172.21.15.57:0/333250755 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f0f88016110 con 0x7f0f980bd5f0 2024-04-24T23:38:46.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.037+0000 7f0fa0535640 1 -- 172.21.15.57:0/333250755 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0f980bcc40 con 0x7f0f980bd5f0 2024-04-24T23:38:46.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.037+0000 7f0f8effd640 1 -- 172.21.15.57:0/333250755 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f0f880ef7e0 con 0x7f0f980bd5f0 2024-04-24T23:38:46.039 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-24T23:38:46.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.041+0000 7f0fa0535640 1 -- 172.21.15.57:0/333250755 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f0f7c0678c0 msgr2=0x7f0f7c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:46.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.041+0000 7f0fa0535640 1 --2- 172.21.15.57:0/333250755 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f0f7c0678c0 0x7f0f7c069d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0f94000f70 tx=0x7f0f94009040 comp rx=0 tx=0).stop 2024-04-24T23:38:46.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.041+0000 7f0fa0535640 1 -- 172.21.15.57:0/333250755 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f980bd5f0 msgr2=0x7f0f981ece70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:46.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.041+0000 7f0fa0535640 1 --2- 172.21.15.57:0/333250755 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f980bd5f0 0x7f0f981ece70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0f88019010 tx=0x7f0f880191a0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.041+0000 7f0fa0535640 1 -- 172.21.15.57:0/333250755 shutdown_connections 2024-04-24T23:38:46.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.041+0000 7f0fa0535640 1 --2- 172.21.15.57:0/333250755 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f0f7c0678c0 0x7f0f7c069d80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.041+0000 7f0fa0535640 1 --2- 172.21.15.57:0/333250755 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0f9814bc60 0x7f0f98144410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.041+0000 7f0fa0535640 1 --2- 172.21.15.57:0/333250755 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f980bd5f0 0x7f0f981ece70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.041+0000 7f0fa0535640 1 --2- 172.21.15.57:0/333250755 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f980bc3b0 0x7f0f98145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.041+0000 7f0fa0535640 1 -- 172.21.15.57:0/333250755 >> 172.21.15.57:0/333250755 conn(0x7f0f9806b920 msgr2=0x7f0f9814e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:46.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.041+0000 7f0fa0535640 1 -- 172.21.15.57:0/333250755 shutdown_connections 2024-04-24T23:38:46.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.041+0000 7f0fa0535640 1 -- 172.21.15.57:0/333250755 wait complete. 2024-04-24T23:38:46.056 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-24T23:38:46.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.177+0000 7f3f6d960640 1 Processor -- start 2024-04-24T23:38:46.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.177+0000 7f3f6d960640 1 -- start start 2024-04-24T23:38:46.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.177+0000 7f3f6d960640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3f6814bd80 0x7f3f6814e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:46.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.177+0000 7f3f6d960640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3f6806b210 0x7f3f68158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:46.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.177+0000 7f3f6d960640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f681529c0 con 0x7f3f680b7fe0 2024-04-24T23:38:46.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.177+0000 7f3f6d960640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f3f68151b40 con 0x7f3f6806b210 2024-04-24T23:38:46.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.177+0000 7f3f6d960640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f3f680be330 con 0x7f3f6814bd80 2024-04-24T23:38:46.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.177+0000 7f3f66ffd640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3f6814bd80 0x7f3f6814e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:46.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.177+0000 7f3f677fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3f6806b210 0x7f3f68158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:46.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.177+0000 7f3f66ffd640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3f6814bd80 0x7f3f6814e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.57:60116/0 (socket says 172.21.15.57:60116) 2024-04-24T23:38:46.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.177+0000 7f3f66ffd640 1 -- 172.21.15.57:0/163957218 learned_addr learned my addr 172.21.15.57:0/163957218 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:46.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.181+0000 7f3f677fe640 1 -- 172.21.15.57:0/163957218 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3f6814bd80 msgr2=0x7f3f6814e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:46.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.181+0000 7f3f677fe640 1 --2- 172.21.15.57:0/163957218 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3f6814bd80 0x7f3f6814e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.181+0000 7f3f677fe640 1 -- 172.21.15.57:0/163957218 >> v1:172.21.15.88:6789/0 conn(0x7f3f680b7fe0 legacy=0x7f3f681522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:46.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.181+0000 7f3f65ffb640 1 -- 172.21.15.57:0/163957218 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3322272057 0 0) 0x7f3f681529c0 con 0x7f3f680b7fe0 2024-04-24T23:38:46.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.181+0000 7f3f677fe640 1 -- 172.21.15.57:0/163957218 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f68151d90 con 0x7f3f6806b210 2024-04-24T23:38:46.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.181+0000 7f3f66ffd640 1 --2- 172.21.15.57:0/163957218 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3f6814bd80 0x7f3f6814e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:38:46.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.181+0000 7f3f677fe640 1 --2- 172.21.15.57:0/163957218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f6806b210 0x7f3f68158e90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3f60009d90 tx=0x7f3f6001c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cc08bea9742748c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:46.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.181+0000 7f3f65ffb640 1 -- 172.21.15.57:0/163957218 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f600b2070 con 0x7f3f6806b210 2024-04-24T23:38:46.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.181+0000 7f3f65ffb640 1 -- 172.21.15.57:0/163957218 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f600a57a0 con 0x7f3f6806b210 2024-04-24T23:38:46.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.181+0000 7f3f65ffb640 1 -- 172.21.15.57:0/163957218 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f600a5b70 con 0x7f3f6806b210 2024-04-24T23:38:46.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.181+0000 7f3f6d960640 1 -- 172.21.15.57:0/163957218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f6806b210 msgr2=0x7f3f68158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:46.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.181+0000 7f3f6d960640 1 --2- 172.21.15.57:0/163957218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f6806b210 0x7f3f68158e90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3f60009d90 tx=0x7f3f6001c8e0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.181+0000 7f3f6d960640 1 -- 172.21.15.57:0/163957218 shutdown_connections 2024-04-24T23:38:46.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.181+0000 7f3f6d960640 1 --2- 172.21.15.57:0/163957218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f6806b210 0x7f3f68158e90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.181+0000 7f3f6d960640 1 --2- 172.21.15.57:0/163957218 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3f6814bd80 0x7f3f6814e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.181+0000 7f3f6d960640 1 -- 172.21.15.57:0/163957218 >> 172.21.15.57:0/163957218 conn(0x7f3f680c2fc0 msgr2=0x7f3f680c33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:46.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.181+0000 7f3f6d960640 1 -- 172.21.15.57:0/163957218 shutdown_connections 2024-04-24T23:38:46.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.181+0000 7f3f6d960640 1 -- 172.21.15.57:0/163957218 wait complete. 2024-04-24T23:38:46.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.185+0000 7f3f6d960640 1 Processor -- start 2024-04-24T23:38:46.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.185+0000 7f3f6d960640 1 -- start start 2024-04-24T23:38:46.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.185+0000 7f3f6d960640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f6806b210 0x7f3f681ed0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:46.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.185+0000 7f3f6d960640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f680b7fe0 0x7f3f680c1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:46.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.185+0000 7f3f6d960640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3f6814bd80 0x7f3f6813e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:46.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.185+0000 7f3f6d960640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3f680bf8f0 con 0x7f3f6806b210 2024-04-24T23:38:46.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.185+0000 7f3f6d960640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f3f680bf770 con 0x7f3f680b7fe0 2024-04-24T23:38:46.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.185+0000 7f3f6d960640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f3f6815bbf0 con 0x7f3f6814bd80 2024-04-24T23:38:46.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.185+0000 7f3f66ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f6806b210 0x7f3f681ed0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:46.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.185+0000 7f3f66ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f6806b210 0x7f3f681ed0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42552/0 (socket says 172.21.15.57:42552) 2024-04-24T23:38:46.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.185+0000 7f3f66ffd640 1 -- 172.21.15.57:0/4197507606 learned_addr learned my addr 172.21.15.57:0/4197507606 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:46.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.185+0000 7f3f667fc640 1 --2- 172.21.15.57:0/4197507606 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f680b7fe0 0x7f3f680c1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:46.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.185+0000 7f3f677fe640 1 --2- 172.21.15.57:0/4197507606 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3f6814bd80 0x7f3f6813e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:46.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.185+0000 7f3f66ffd640 1 -- 172.21.15.57:0/4197507606 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3f6814bd80 msgr2=0x7f3f6813e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:46.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.185+0000 7f3f66ffd640 1 --2- 172.21.15.57:0/4197507606 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3f6814bd80 0x7f3f6813e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.185+0000 7f3f66ffd640 1 -- 172.21.15.57:0/4197507606 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f680b7fe0 msgr2=0x7f3f680c1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:46.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.185+0000 7f3f66ffd640 1 --2- 172.21.15.57:0/4197507606 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f680b7fe0 0x7f3f680c1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.185+0000 7f3f66ffd640 1 -- 172.21.15.57:0/4197507606 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f68142010 con 0x7f3f6806b210 2024-04-24T23:38:46.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.185+0000 7f3f66ffd640 1 --2- 172.21.15.57:0/4197507606 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f6806b210 0x7f3f681ed0c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3f5800e930 tx=0x7f3f5800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:46.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.185+0000 7f3f4ffff640 1 -- 172.21.15.57:0/4197507606 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f58017070 con 0x7f3f6806b210 2024-04-24T23:38:46.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.185+0000 7f3f4ffff640 1 -- 172.21.15.57:0/4197507606 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f5800ca00 con 0x7f3f6806b210 2024-04-24T23:38:46.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.185+0000 7f3f4ffff640 1 -- 172.21.15.57:0/4197507606 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f5800cdd0 con 0x7f3f6806b210 2024-04-24T23:38:46.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.185+0000 7f3f6d960640 1 -- 172.21.15.57:0/4197507606 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f68158fd0 con 0x7f3f6806b210 2024-04-24T23:38:46.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.185+0000 7f3f6d960640 1 -- 172.21.15.57:0/4197507606 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f68070530 con 0x7f3f6806b210 2024-04-24T23:38:46.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.189+0000 7f3f6d960640 1 -- 172.21.15.57:0/4197507606 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f68068930 con 0x7f3f6806b210 2024-04-24T23:38:46.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.189+0000 7f3f4ffff640 1 -- 172.21.15.57:0/4197507606 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3f5801a070 con 0x7f3f6806b210 2024-04-24T23:38:46.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.189+0000 7f3f4ffff640 1 --2- 172.21.15.57:0/4197507606 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f3f540678f0 0x7f3f54069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:46.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.189+0000 7f3f4ffff640 1 -- 172.21.15.57:0/4197507606 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3f58085ea0 con 0x7f3f6806b210 2024-04-24T23:38:46.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.189+0000 7f3f667fc640 1 --2- 172.21.15.57:0/4197507606 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f3f540678f0 0x7f3f54069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:46.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.189+0000 7f3f667fc640 1 --2- 172.21.15.57:0/4197507606 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f3f540678f0 0x7f3f54069db0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3f6806f7e0 tx=0x7f3f5c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:46.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.193+0000 7f3f4ffff640 1 -- 172.21.15.57:0/4197507606 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f3f58056690 con 0x7f3f6806b210 2024-04-24T23:38:46.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.353+0000 7f3f6d960640 1 -- 172.21.15.57:0/4197507606 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f3f6813f1c0 con 0x7f3f6806b210 2024-04-24T23:38:46.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.353+0000 7f3f4ffff640 1 -- 172.21.15.57:0/4197507606 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f3f58055f90 con 0x7f3f6806b210 2024-04-24T23:38:46.354 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-04-24T23:38:46.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.353+0000 7f3f6d960640 1 -- 172.21.15.57:0/4197507606 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f3f540678f0 msgr2=0x7f3f54069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:46.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.353+0000 7f3f6d960640 1 --2- 172.21.15.57:0/4197507606 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f3f540678f0 0x7f3f54069db0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3f6806f7e0 tx=0x7f3f5c009040 comp rx=0 tx=0).stop 2024-04-24T23:38:46.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.353+0000 7f3f6d960640 1 -- 172.21.15.57:0/4197507606 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f6806b210 msgr2=0x7f3f681ed0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:46.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.353+0000 7f3f6d960640 1 --2- 172.21.15.57:0/4197507606 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f6806b210 0x7f3f681ed0c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3f5800e930 tx=0x7f3f5800edf0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.353+0000 7f3f6d960640 1 -- 172.21.15.57:0/4197507606 shutdown_connections 2024-04-24T23:38:46.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.353+0000 7f3f6d960640 1 --2- 172.21.15.57:0/4197507606 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f3f540678f0 0x7f3f54069db0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.353+0000 7f3f6d960640 1 --2- 172.21.15.57:0/4197507606 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3f6814bd80 0x7f3f6813e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.353+0000 7f3f6d960640 1 --2- 172.21.15.57:0/4197507606 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f680b7fe0 0x7f3f680c1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.353+0000 7f3f6d960640 1 --2- 172.21.15.57:0/4197507606 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f6806b210 0x7f3f681ed0c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.353+0000 7f3f6d960640 1 -- 172.21.15.57:0/4197507606 >> 172.21.15.57:0/4197507606 conn(0x7f3f680c2fc0 msgr2=0x7f3f6814e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:46.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.353+0000 7f3f6d960640 1 -- 172.21.15.57:0/4197507606 shutdown_connections 2024-04-24T23:38:46.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.353+0000 7f3f6d960640 1 -- 172.21.15.57:0/4197507606 wait complete. 2024-04-24T23:38:46.372 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:38:46.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.493+0000 7f2aca671640 1 Processor -- start 2024-04-24T23:38:46.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2aca671640 1 -- start start 2024-04-24T23:38:46.499 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2aca671640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ac4072200 0x7f2ac414d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:46.499 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2aca671640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2ac406e520 0x7f2ac40be8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:46.499 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2aca671640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ac40bd870 con 0x7f2ac40bf3a0 2024-04-24T23:38:46.499 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2aca671640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f2ac414e350 con 0x7f2ac406e520 2024-04-24T23:38:46.499 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2aca671640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f2ac40be440 con 0x7f2ac4072200 2024-04-24T23:38:46.499 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2ac8c0e640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2ac40bf3a0 0x7f2ac414a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52362/0 (socket says 172.21.15.57:52362) 2024-04-24T23:38:46.499 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2ac8c0e640 1 -- 172.21.15.57:0/3487725430 learned_addr learned my addr 172.21.15.57:0/3487725430 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:38:46.499 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2ac37fe640 1 --2- 172.21.15.57:0/3487725430 >> v2:172.21.15.88:3300/0 conn(0x7f2ac406e520 0x7f2ac40be8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:46.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2ac3fff640 1 --2- 172.21.15.57:0/3487725430 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ac4072200 0x7f2ac414d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:46.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2ac2ffd640 1 -- 172.21.15.57:0/3487725430 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 734395281 0 0) 0x7f2ac40bd870 con 0x7f2ac40bf3a0 2024-04-24T23:38:46.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2ac2ffd640 1 -- 172.21.15.57:0/3487725430 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2aac003530 con 0x7f2ac40bf3a0 2024-04-24T23:38:46.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2ac2ffd640 1 -- 172.21.15.57:0/3487725430 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3285457580 0 0) 0x7f2aac003530 con 0x7f2ac40bf3a0 2024-04-24T23:38:46.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2ac2ffd640 1 -- 172.21.15.57:0/3487725430 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ac4072200 msgr2=0x7f2ac414d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:46.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2ac2ffd640 1 --2- 172.21.15.57:0/3487725430 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ac4072200 0x7f2ac414d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2ac2ffd640 1 -- 172.21.15.57:0/3487725430 >> v2:172.21.15.88:3300/0 conn(0x7f2ac406e520 msgr2=0x7f2ac40be8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:46.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2ac2ffd640 1 --2- 172.21.15.57:0/3487725430 >> v2:172.21.15.88:3300/0 conn(0x7f2ac406e520 0x7f2ac40be8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2ac2ffd640 1 -- 172.21.15.57:0/3487725430 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ac40bdb10 con 0x7f2ac40bf3a0 2024-04-24T23:38:46.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2ac2ffd640 1 -- 172.21.15.57:0/3487725430 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7f2abc001680 con 0x7f2ac40bf3a0 2024-04-24T23:38:46.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2ac2ffd640 1 -- 172.21.15.57:0/3487725430 >> v1:172.21.15.57:6789/0 conn(0x7f2ac40bf3a0 legacy=0x7f2ac414a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:46.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2ac2ffd640 1 --2- 172.21.15.57:0/3487725430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2aac0039c0 0x7f2aac003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:46.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2ac2ffd640 1 --2- 172.21.15.57:0/3487725430 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ac4072200 0x7f2aac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:46.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2ac2ffd640 1 --2- 172.21.15.57:0/3487725430 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aac004d50 0x7f2aac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:46.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2ac2ffd640 1 -- 172.21.15.57:0/3487725430 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac414e350 con 0x7f2aac004d50 2024-04-24T23:38:46.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2ac2ffd640 1 -- 172.21.15.57:0/3487725430 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac40be440 con 0x7f2aac0039c0 2024-04-24T23:38:46.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2ac2ffd640 1 -- 172.21.15.57:0/3487725430 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f2aac00ba00 con 0x7f2ac4072200 2024-04-24T23:38:46.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2ac8c0e640 1 --2- 172.21.15.57:0/3487725430 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aac004d50 0x7f2aac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:46.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2ac3fff640 1 --2- 172.21.15.57:0/3487725430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2aac0039c0 0x7f2aac003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:46.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2ac37fe640 1 --2- 172.21.15.57:0/3487725430 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ac4072200 0x7f2aac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:46.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2ac8c0e640 1 -- 172.21.15.57:0/3487725430 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ac4072200 msgr2=0x7f2aac004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:46.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2ac8c0e640 1 --2- 172.21.15.57:0/3487725430 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ac4072200 0x7f2aac004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2ac8c0e640 1 -- 172.21.15.57:0/3487725430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2aac0039c0 msgr2=0x7f2aac003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:46.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2ac8c0e640 1 --2- 172.21.15.57:0/3487725430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2aac0039c0 0x7f2aac003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.497+0000 7f2ac8c0e640 1 -- 172.21.15.57:0/3487725430 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aac003530 con 0x7f2aac004d50 2024-04-24T23:38:46.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2ac8c0e640 1 --2- 172.21.15.57:0/3487725430 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aac004d50 0x7f2aac0051d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2abc00c110 tx=0x7f2abc01cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba2c01845586e95 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:46.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2ac2ffd640 1 -- 172.21.15.57:0/3487725430 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2abc007c50 con 0x7f2aac004d50 2024-04-24T23:38:46.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2ac2ffd640 1 -- 172.21.15.57:0/3487725430 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2abc0a9070 con 0x7f2aac004d50 2024-04-24T23:38:46.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2ac2ffd640 1 -- 172.21.15.57:0/3487725430 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2abc005d40 con 0x7f2aac004d50 2024-04-24T23:38:46.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2aca671640 1 -- 172.21.15.57:0/3487725430 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aac004d50 msgr2=0x7f2aac0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:46.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2aca671640 1 --2- 172.21.15.57:0/3487725430 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aac004d50 0x7f2aac0051d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2abc00c110 tx=0x7f2abc01cbc0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2ac8c0e640 1 -- 172.21.15.57:0/3487725430 reap_dead start 2024-04-24T23:38:46.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2aca671640 1 -- 172.21.15.57:0/3487725430 shutdown_connections 2024-04-24T23:38:46.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2aca671640 1 -- 172.21.15.57:0/3487725430 >> 172.21.15.57:0/3487725430 conn(0x7f2ac40c2e70 msgr2=0x7f2ac40c3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:46.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2aca671640 1 -- 172.21.15.57:0/3487725430 shutdown_connections 2024-04-24T23:38:46.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2aca671640 1 -- 172.21.15.57:0/3487725430 wait complete. 2024-04-24T23:38:46.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2aca671640 1 Processor -- start 2024-04-24T23:38:46.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2aca671640 1 -- start start 2024-04-24T23:38:46.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2aca671640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ac41e4cd0 0x7f2ac41e50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:46.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2aca671640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ac414bf00 0x7f2ac414c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:46.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2aca671640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ac413d200 0x7f2ac413d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:46.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2aca671640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac40725e0 con 0x7f2ac41e4cd0 2024-04-24T23:38:46.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2aca671640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac40be0d0 con 0x7f2ac414bf00 2024-04-24T23:38:46.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2aca671640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f2ac4072760 con 0x7f2ac413d200 2024-04-24T23:38:46.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2ac3fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ac41e4cd0 0x7f2ac41e50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:46.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2ac3fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ac41e4cd0 0x7f2ac41e50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42572/0 (socket says 172.21.15.57:42572) 2024-04-24T23:38:46.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2ac3fff640 1 -- 172.21.15.57:0/4142240362 learned_addr learned my addr 172.21.15.57:0/4142240362 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:46.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2ac37fe640 1 --2- 172.21.15.57:0/4142240362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ac414bf00 0x7f2ac414c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:46.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2ac8c0e640 1 --2- 172.21.15.57:0/4142240362 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ac413d200 0x7f2ac413d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:46.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2ac3fff640 1 -- 172.21.15.57:0/4142240362 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ac413d200 msgr2=0x7f2ac413d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:46.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2ac3fff640 1 --2- 172.21.15.57:0/4142240362 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ac413d200 0x7f2ac413d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2ac3fff640 1 -- 172.21.15.57:0/4142240362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ac414bf00 msgr2=0x7f2ac414c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:46.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2ac3fff640 1 --2- 172.21.15.57:0/4142240362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ac414bf00 0x7f2ac414c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2ac3fff640 1 -- 172.21.15.57:0/4142240362 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ac414faf0 con 0x7f2ac41e4cd0 2024-04-24T23:38:46.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2ac37fe640 1 --2- 172.21.15.57:0/4142240362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ac414bf00 0x7f2ac414c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:38:46.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.501+0000 7f2ac3fff640 1 --2- 172.21.15.57:0/4142240362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ac41e4cd0 0x7f2ac41e50b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4007f00 tx=0x7f2ab40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:46.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.505+0000 7f2ac0ff9640 1 -- 172.21.15.57:0/4142240362 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab401a020 con 0x7f2ac41e4cd0 2024-04-24T23:38:46.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.505+0000 7f2ac0ff9640 1 -- 172.21.15.57:0/4142240362 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ab4016470 con 0x7f2ac41e4cd0 2024-04-24T23:38:46.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.505+0000 7f2aca671640 1 -- 172.21.15.57:0/4142240362 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ac41df0d0 con 0x7f2ac41e4cd0 2024-04-24T23:38:46.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.505+0000 7f2ac0ff9640 1 -- 172.21.15.57:0/4142240362 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4016860 con 0x7f2ac41e4cd0 2024-04-24T23:38:46.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.505+0000 7f2aca671640 1 -- 172.21.15.57:0/4142240362 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ac40bbc60 con 0x7f2ac41e4cd0 2024-04-24T23:38:46.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.505+0000 7f2aca671640 1 -- 172.21.15.57:0/4142240362 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ac4068930 con 0x7f2ac41e4cd0 2024-04-24T23:38:46.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.505+0000 7f2ac0ff9640 1 -- 172.21.15.57:0/4142240362 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2ab401d020 con 0x7f2ac41e4cd0 2024-04-24T23:38:46.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.505+0000 7f2ac0ff9640 1 --2- 172.21.15.57:0/4142240362 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f2ab0067800 0x7f2ab0069cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:46.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.505+0000 7f2ac0ff9640 1 -- 172.21.15.57:0/4142240362 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2ab4086ee0 con 0x7f2ac41e4cd0 2024-04-24T23:38:46.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.505+0000 7f2ac37fe640 1 --2- 172.21.15.57:0/4142240362 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f2ab0067800 0x7f2ab0069cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:46.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.505+0000 7f2ac37fe640 1 --2- 172.21.15.57:0/4142240362 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f2ab0067800 0x7f2ab0069cc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2ac414a410 tx=0x7f2ab8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:46.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.509+0000 7f2ac0ff9640 1 -- 172.21.15.57:0/4142240362 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f2ab4024030 con 0x7f2ac41e4cd0 2024-04-24T23:38:46.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.685+0000 7f2aca671640 1 -- 172.21.15.57:0/4142240362 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2ac414a440 con 0x7f2ac41e4cd0 2024-04-24T23:38:46.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.685+0000 7f2ac0ff9640 1 -- 172.21.15.57:0/4142240362 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f2ab40576e0 con 0x7f2ac41e4cd0 2024-04-24T23:38:46.685 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2024-04-24T23:38:46.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.685+0000 7f2aca671640 1 -- 172.21.15.57:0/4142240362 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f2ab0067800 msgr2=0x7f2ab0069cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:46.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.685+0000 7f2aca671640 1 --2- 172.21.15.57:0/4142240362 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f2ab0067800 0x7f2ab0069cc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2ac414a410 tx=0x7f2ab8008040 comp rx=0 tx=0).stop 2024-04-24T23:38:46.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.685+0000 7f2aca671640 1 -- 172.21.15.57:0/4142240362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ac41e4cd0 msgr2=0x7f2ac41e50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:46.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.685+0000 7f2aca671640 1 --2- 172.21.15.57:0/4142240362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ac41e4cd0 0x7f2ac41e50b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4007f00 tx=0x7f2ab40115a0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.685+0000 7f2aca671640 1 -- 172.21.15.57:0/4142240362 shutdown_connections 2024-04-24T23:38:46.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.685+0000 7f2aca671640 1 --2- 172.21.15.57:0/4142240362 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f2ab0067800 0x7f2ab0069cc0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.685+0000 7f2aca671640 1 --2- 172.21.15.57:0/4142240362 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ac413d200 0x7f2ac413d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.685+0000 7f2aca671640 1 --2- 172.21.15.57:0/4142240362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ac414bf00 0x7f2ac414c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.685+0000 7f2aca671640 1 --2- 172.21.15.57:0/4142240362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ac41e4cd0 0x7f2ac41e50b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.685+0000 7f2aca671640 1 -- 172.21.15.57:0/4142240362 >> 172.21.15.57:0/4142240362 conn(0x7f2ac40c2e70 msgr2=0x7f2ac413e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:46.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.685+0000 7f2aca671640 1 -- 172.21.15.57:0/4142240362 shutdown_connections 2024-04-24T23:38:46.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.685+0000 7f2aca671640 1 -- 172.21.15.57:0/4142240362 wait complete. 2024-04-24T23:38:46.705 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-24T23:38:46.705 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:38:46.711 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:38:46.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.825+0000 7f6df2a7f640 1 Processor -- start 2024-04-24T23:38:46.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6df2a7f640 1 -- start start 2024-04-24T23:38:46.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6df2a7f640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6dec0c32d0 0x7f6dec14d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:46.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6df2a7f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6dec0c1080 0x7f6dec150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:46.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6df2a7f640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dec0bd6c0 con 0x7f6dec14dea0 2024-04-24T23:38:46.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6df2a7f640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f6dec0bf4a0 con 0x7f6dec0c1080 2024-04-24T23:38:46.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6df2a7f640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f6dec0bd470 con 0x7f6dec0c32d0 2024-04-24T23:38:46.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6df101c640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6dec14dea0 0x7f6dec151130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52374/0 (socket says 172.21.15.57:52374) 2024-04-24T23:38:46.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6df101c640 1 -- 172.21.15.57:0/4022862005 learned_addr learned my addr 172.21.15.57:0/4022862005 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:38:46.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6debfff640 1 --2- 172.21.15.57:0/4022862005 >> v2:172.21.15.88:3300/0 conn(0x7f6dec0c1080 0x7f6dec150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:46.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6df081b640 1 --2- 172.21.15.57:0/4022862005 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6dec0c32d0 0x7f6dec14d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:46.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6deb7fe640 1 -- 172.21.15.57:0/4022862005 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1421129897 0 0) 0x7f6dec0bd6c0 con 0x7f6dec14dea0 2024-04-24T23:38:46.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6deb7fe640 1 -- 172.21.15.57:0/4022862005 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ddc003530 con 0x7f6dec14dea0 2024-04-24T23:38:46.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6deb7fe640 1 -- 172.21.15.57:0/4022862005 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 137019996 0 0) 0x7f6ddc003530 con 0x7f6dec14dea0 2024-04-24T23:38:46.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6deb7fe640 1 -- 172.21.15.57:0/4022862005 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6dec0c32d0 msgr2=0x7f6dec14d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:46.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6deb7fe640 1 --2- 172.21.15.57:0/4022862005 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6dec0c32d0 0x7f6dec14d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6deb7fe640 1 -- 172.21.15.57:0/4022862005 >> v2:172.21.15.88:3300/0 conn(0x7f6dec0c1080 msgr2=0x7f6dec150bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:46.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6deb7fe640 1 --2- 172.21.15.57:0/4022862005 >> v2:172.21.15.88:3300/0 conn(0x7f6dec0c1080 0x7f6dec150bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6deb7fe640 1 -- 172.21.15.57:0/4022862005 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dec0bd9a0 con 0x7f6dec14dea0 2024-04-24T23:38:46.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6deb7fe640 1 -- 172.21.15.57:0/4022862005 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7f6de4001a00 con 0x7f6dec14dea0 2024-04-24T23:38:46.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6deb7fe640 1 -- 172.21.15.57:0/4022862005 >> v1:172.21.15.57:6789/0 conn(0x7f6dec14dea0 legacy=0x7f6dec151130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:46.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6deb7fe640 1 --2- 172.21.15.57:0/4022862005 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6dec0c32d0 0x7f6ddc0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:46.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6deb7fe640 1 --2- 172.21.15.57:0/4022862005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ddc003f40 0x7f6ddc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:46.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6deb7fe640 1 --2- 172.21.15.57:0/4022862005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ddc004d50 0x7f6ddc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:46.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6deb7fe640 1 -- 172.21.15.57:0/4022862005 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6dec0bf4a0 con 0x7f6ddc004d50 2024-04-24T23:38:46.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6deb7fe640 1 -- 172.21.15.57:0/4022862005 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6dec0bd470 con 0x7f6ddc003f40 2024-04-24T23:38:46.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6deb7fe640 1 -- 172.21.15.57:0/4022862005 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f6ddc00ba20 con 0x7f6dec0c32d0 2024-04-24T23:38:46.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6df101c640 1 --2- 172.21.15.57:0/4022862005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ddc004d50 0x7f6ddc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:46.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6df081b640 1 --2- 172.21.15.57:0/4022862005 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6dec0c32d0 0x7f6ddc0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:46.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6df101c640 1 -- 172.21.15.57:0/4022862005 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6dec0c32d0 msgr2=0x7f6ddc0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:46.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6df101c640 1 --2- 172.21.15.57:0/4022862005 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6dec0c32d0 0x7f6ddc0039c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6df101c640 1 -- 172.21.15.57:0/4022862005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ddc003f40 msgr2=0x7f6ddc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:46.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6df101c640 1 --2- 172.21.15.57:0/4022862005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ddc003f40 0x7f6ddc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.829+0000 7f6df101c640 1 -- 172.21.15.57:0/4022862005 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ddc003530 con 0x7f6ddc004d50 2024-04-24T23:38:46.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6df101c640 1 --2- 172.21.15.57:0/4022862005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ddc004d50 0x7f6ddc0051d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6de400a8b0 tx=0x7f6de401fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ceff74988e96d43 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:46.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6deb7fe640 1 -- 172.21.15.57:0/4022862005 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de400a4a0 con 0x7f6ddc004d50 2024-04-24T23:38:46.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6deb7fe640 1 -- 172.21.15.57:0/4022862005 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6de40ad020 con 0x7f6ddc004d50 2024-04-24T23:38:46.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6deb7fe640 1 -- 172.21.15.57:0/4022862005 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de40a9740 con 0x7f6ddc004d50 2024-04-24T23:38:46.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6df2a7f640 1 -- 172.21.15.57:0/4022862005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ddc004d50 msgr2=0x7f6ddc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:46.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6df2a7f640 1 --2- 172.21.15.57:0/4022862005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ddc004d50 0x7f6ddc0051d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6de400a8b0 tx=0x7f6de401fb00 comp rx=0 tx=0).stop 2024-04-24T23:38:46.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6df101c640 1 -- 172.21.15.57:0/4022862005 reap_dead start 2024-04-24T23:38:46.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6df2a7f640 1 -- 172.21.15.57:0/4022862005 shutdown_connections 2024-04-24T23:38:46.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6df2a7f640 1 -- 172.21.15.57:0/4022862005 >> 172.21.15.57:0/4022862005 conn(0x7f6dec067350 msgr2=0x7f6dec067760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:46.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6df2a7f640 1 -- 172.21.15.57:0/4022862005 shutdown_connections 2024-04-24T23:38:46.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6df2a7f640 1 -- 172.21.15.57:0/4022862005 wait complete. 2024-04-24T23:38:46.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6df2a7f640 1 Processor -- start 2024-04-24T23:38:46.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6df2a7f640 1 -- start start 2024-04-24T23:38:46.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6df2a7f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ddc004d50 0x7f6dec152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:46.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6df2a7f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6dec14e680 0x7f6dec14aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:46.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6df2a7f640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6dec14afb0 0x7f6dec1534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:46.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6df2a7f640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6dec0c36b0 con 0x7f6dec14e680 2024-04-24T23:38:46.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6df2a7f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6dec0c2800 con 0x7f6ddc004d50 2024-04-24T23:38:46.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6df2a7f640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f6dec0c3830 con 0x7f6dec14afb0 2024-04-24T23:38:46.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6debfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6dec14e680 0x7f6dec14aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:46.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6debfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6dec14e680 0x7f6dec14aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42592/0 (socket says 172.21.15.57:42592) 2024-04-24T23:38:46.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6debfff640 1 -- 172.21.15.57:0/359416619 learned_addr learned my addr 172.21.15.57:0/359416619 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:46.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6debfff640 1 -- 172.21.15.57:0/359416619 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6dec14afb0 msgr2=0x7f6dec1534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:46.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6df081b640 1 --2- 172.21.15.57:0/359416619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ddc004d50 0x7f6dec152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:46.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6df101c640 1 --2- 172.21.15.57:0/359416619 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6dec14afb0 0x7f6dec1534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:46.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6debfff640 1 --2- 172.21.15.57:0/359416619 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6dec14afb0 0x7f6dec1534f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6debfff640 1 -- 172.21.15.57:0/359416619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ddc004d50 msgr2=0x7f6dec152700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:46.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6debfff640 1 --2- 172.21.15.57:0/359416619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ddc004d50 0x7f6dec152700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:46.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6debfff640 1 -- 172.21.15.57:0/359416619 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dec152c40 con 0x7f6dec14e680 2024-04-24T23:38:46.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6debfff640 1 --2- 172.21.15.57:0/359416619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6dec14e680 0x7f6dec14aa70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6dd800e7c0 tx=0x7f6dd800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:46.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6de97fa640 1 -- 172.21.15.57:0/359416619 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8017070 con 0x7f6dec14e680 2024-04-24T23:38:46.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6de97fa640 1 -- 172.21.15.57:0/359416619 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dd800ee70 con 0x7f6dec14e680 2024-04-24T23:38:46.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6df2a7f640 1 -- 172.21.15.57:0/359416619 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dec14fed0 con 0x7f6dec14e680 2024-04-24T23:38:46.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.833+0000 7f6de97fa640 1 -- 172.21.15.57:0/359416619 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd800cb60 con 0x7f6dec14e680 2024-04-24T23:38:46.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.837+0000 7f6df2a7f640 1 -- 172.21.15.57:0/359416619 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dec14f880 con 0x7f6dec14e680 2024-04-24T23:38:46.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.837+0000 7f6df2a7f640 1 -- 172.21.15.57:0/359416619 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dec068220 con 0x7f6dec14e680 2024-04-24T23:38:46.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.837+0000 7f6de97fa640 1 -- 172.21.15.57:0/359416619 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6dd801a070 con 0x7f6dec14e680 2024-04-24T23:38:46.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.837+0000 7f6de97fa640 1 --2- 172.21.15.57:0/359416619 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6dd00678f0 0x7f6dd0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:46.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.837+0000 7f6de97fa640 1 -- 172.21.15.57:0/359416619 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6dd8085e80 con 0x7f6dec14e680 2024-04-24T23:38:46.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.837+0000 7f6df081b640 1 --2- 172.21.15.57:0/359416619 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6dd00678f0 0x7f6dd0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:46.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.837+0000 7f6df081b640 1 --2- 172.21.15.57:0/359416619 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6dd00678f0 0x7f6dd0069db0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6de0009930 tx=0x7f6de0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:46.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:46.841+0000 7f6de97fa640 1 -- 172.21.15.57:0/359416619 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f6dec152c40 con 0x7f6dec14e680 2024-04-24T23:38:47.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.001+0000 7f6df2a7f640 1 -- 172.21.15.57:0/359416619 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6dec0c0be0 con 0x7f6dec14e680 2024-04-24T23:38:47.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.005+0000 7f6de97fa640 1 -- 172.21.15.57:0/359416619 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7f6dd8056680 con 0x7f6dec14e680 2024-04-24T23:38:47.005 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:38:47.006 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":24,"fsid":"1ea31698-444a-4667-bcd9-b2608ad103c3","created":"2024-04-24T23:38:16.748774+0000","modified":"2024-04-24T23:38:38.604475+0000","last_up_change":"2024-04-24T23:38:26.956537+0000","last_in_change":"2024-04-24T23:38:18.972175+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:38:27.611782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:38:31.718061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:38:32.469413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:38:36.215724+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"35ce67bc-9b25-416e-ab1e-774c717631f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6825","nonce":671364028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6827","nonce":671364028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6831","nonce":671364028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6829","nonce":671364028}]},"public_addr":"172.21.15.57:6825/671364028","cluster_addr":"172.21.15.57:6827/671364028","heartbeat_back_addr":"172.21.15.57:6831/671364028","heartbeat_front_addr":"172.21.15.57:6829/671364028","state":["exists","up"]},{"osd":1,"uuid":"38f6f4ef-3bc2-4453-9946-7d1d17e735ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6801","nonce":2653552037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6803","nonce":2653552037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6807","nonce":2653552037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6805","nonce":2653552037}]},"public_addr":"172.21.15.57:6801/2653552037","cluster_addr":"172.21.15.57:6803/2653552037","heartbeat_back_addr":"172.21.15.57:6807/2653552037","heartbeat_front_addr":"172.21.15.57:6805/2653552037","state":["exists","up"]},{"osd":2,"uuid":"d77a0a49-b39a-464e-a1c9-49e19280c440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6816","nonce":1565874109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6819","nonce":1565874109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6823","nonce":1565874109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6821","nonce":1565874109}]},"public_addr":"172.21.15.57:6816/1565874109","cluster_addr":"172.21.15.57:6819/1565874109","heartbeat_back_addr":"172.21.15.57:6823/1565874109","heartbeat_front_addr":"172.21.15.57:6821/1565874109","state":["exists","up"]},{"osd":3,"uuid":"f8ea9bfe-d839-44a6-a185-0f0985da314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6809","nonce":3474703186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6811","nonce":3474703186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6817","nonce":3474703186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6813","nonce":3474703186}]},"public_addr":"172.21.15.57:6809/3474703186","cluster_addr":"172.21.15.57:6811/3474703186","heartbeat_back_addr":"172.21.15.57:6817/3474703186","heartbeat_front_addr":"172.21.15.57:6813/3474703186","state":["exists","up"]},{"osd":4,"uuid":"454647d4-6ac2-46b4-8451-320eb951a87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6801","nonce":1271707713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6803","nonce":1271707713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6807","nonce":1271707713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6805","nonce":1271707713}]},"public_addr":"172.21.15.88:6801/1271707713","cluster_addr":"172.21.15.88:6803/1271707713","heartbeat_back_addr":"172.21.15.88:6807/1271707713","heartbeat_front_addr":"172.21.15.88:6805/1271707713","state":["exists","up"]},{"osd":5,"uuid":"f71c03a3-7ad8-46d3-89c9-d61de102586b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6809","nonce":2035054888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6813","nonce":2035054888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6820","nonce":2035054888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6816","nonce":2035054888}]},"public_addr":"172.21.15.88:6809/2035054888","cluster_addr":"172.21.15.88:6813/2035054888","heartbeat_back_addr":"172.21.15.88:6820/2035054888","heartbeat_front_addr":"172.21.15.88:6816/2035054888","state":["exists","up"]},{"osd":6,"uuid":"ec7ae2b7-9cb4-4059-8f98-0022c9763f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6825","nonce":1752291242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6827","nonce":1752291242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6831","nonce":1752291242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6829","nonce":1752291242}]},"public_addr":"172.21.15.88:6825/1752291242","cluster_addr":"172.21.15.88:6827/1752291242","heartbeat_back_addr":"172.21.15.88:6831/1752291242","heartbeat_front_addr":"172.21.15.88:6829/1752291242","state":["exists","up"]},{"osd":7,"uuid":"c0ee7505-60c1-40ba-9902-47313a04dafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6812","nonce":1782800372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6817","nonce":1782800372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6823","nonce":1782800372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6821","nonce":1782800372}]},"public_addr":"172.21.15.88:6812/1782800372","cluster_addr":"172.21.15.88:6817/1782800372","heartbeat_back_addr":"172.21.15.88:6823/1782800372","heartbeat_front_addr":"172.21.15.88:6821/1782800372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.698562+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.682587+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.680197+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.561753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.011095+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.493320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.353451+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.423877+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:38:47.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.005+0000 7f6df2a7f640 1 -- 172.21.15.57:0/359416619 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6dd00678f0 msgr2=0x7f6dd0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:47.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.005+0000 7f6df2a7f640 1 --2- 172.21.15.57:0/359416619 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6dd00678f0 0x7f6dd0069db0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6de0009930 tx=0x7f6de0008040 comp rx=0 tx=0).stop 2024-04-24T23:38:47.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.005+0000 7f6df2a7f640 1 -- 172.21.15.57:0/359416619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6dec14e680 msgr2=0x7f6dec14aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:47.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.005+0000 7f6df2a7f640 1 --2- 172.21.15.57:0/359416619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6dec14e680 0x7f6dec14aa70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6dd800e7c0 tx=0x7f6dd800ec80 comp rx=0 tx=0).stop 2024-04-24T23:38:47.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.005+0000 7f6df2a7f640 1 -- 172.21.15.57:0/359416619 shutdown_connections 2024-04-24T23:38:47.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.005+0000 7f6df2a7f640 1 --2- 172.21.15.57:0/359416619 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6dd00678f0 0x7f6dd0069db0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.005+0000 7f6df2a7f640 1 --2- 172.21.15.57:0/359416619 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6dec14afb0 0x7f6dec1534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.005+0000 7f6df2a7f640 1 --2- 172.21.15.57:0/359416619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6dec14e680 0x7f6dec14aa70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.005+0000 7f6df2a7f640 1 --2- 172.21.15.57:0/359416619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ddc004d50 0x7f6dec152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.005+0000 7f6df2a7f640 1 -- 172.21.15.57:0/359416619 >> 172.21.15.57:0/359416619 conn(0x7f6dec067350 msgr2=0x7f6dec0b85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:47.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.005+0000 7f6df2a7f640 1 -- 172.21.15.57:0/359416619 shutdown_connections 2024-04-24T23:38:47.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.005+0000 7f6df2a7f640 1 -- 172.21.15.57:0/359416619 wait complete. 2024-04-24T23:38:47.023 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:38:27.611782+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:38:31.718061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:38:32.469413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-24T23:38:36.215724+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-24T23:38:47.024 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:38:47.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.137+0000 7fdd97f39640 1 Processor -- start 2024-04-24T23:38:47.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.137+0000 7fdd97f39640 1 -- start start 2024-04-24T23:38:47.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.141+0000 7fdd97f39640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdd9006ea40 0x7fdd901514f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:47.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.141+0000 7fdd97f39640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd900bc3f0 0x7fdd9014a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:47.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.141+0000 7fdd97f39640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd90151a30 con 0x7fdd9014ade0 2024-04-24T23:38:47.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.141+0000 7fdd97f39640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fdd9014d640 con 0x7fdd9006ea40 2024-04-24T23:38:47.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.141+0000 7fdd97f39640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fdd900be040 con 0x7fdd900bc3f0 2024-04-24T23:38:47.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.141+0000 7fdd954d4640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd900bc3f0 0x7fdd9014a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:47.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.141+0000 7fdd95cd5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdd9006ea40 0x7fdd901514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:47.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.141+0000 7fdd954d4640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd900bc3f0 0x7fdd9014a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.57:60150/0 (socket says 172.21.15.57:60150) 2024-04-24T23:38:47.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.141+0000 7fdd954d4640 1 -- 172.21.15.57:0/1418888670 learned_addr learned my addr 172.21.15.57:0/1418888670 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:47.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.141+0000 7fdd94cd3640 1 -- 172.21.15.57:0/1418888670 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1704061445 0 0) 0x7fdd90151a30 con 0x7fdd9014ade0 2024-04-24T23:38:47.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.141+0000 7fdd954d4640 1 -- 172.21.15.57:0/1418888670 >> v2:172.21.15.88:3300/0 conn(0x7fdd9006ea40 msgr2=0x7fdd901514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:47.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.141+0000 7fdd954d4640 1 --2- 172.21.15.57:0/1418888670 >> v2:172.21.15.88:3300/0 conn(0x7fdd9006ea40 0x7fdd901514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.141+0000 7fdd954d4640 1 -- 172.21.15.57:0/1418888670 >> v1:172.21.15.88:6789/0 conn(0x7fdd9014ade0 legacy=0x7fdd9014dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:47.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.141+0000 7fdd954d4640 1 -- 172.21.15.57:0/1418888670 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd900be320 con 0x7fdd900bc3f0 2024-04-24T23:38:47.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd954d4640 1 --2- 172.21.15.57:0/1418888670 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd900bc3f0 0x7fdd9014a8a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdd8000bb10 tx=0x7fdd8001ec30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90618aeba64b8d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:47.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd94cd3640 1 -- 172.21.15.57:0/1418888670 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd800b4070 con 0x7fdd900bc3f0 2024-04-24T23:38:47.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd94cd3640 1 -- 172.21.15.57:0/1418888670 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd800a7a00 con 0x7fdd900bc3f0 2024-04-24T23:38:47.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd94cd3640 1 -- 172.21.15.57:0/1418888670 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd800a7dd0 con 0x7fdd900bc3f0 2024-04-24T23:38:47.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd97f39640 1 -- 172.21.15.57:0/1418888670 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd900bc3f0 msgr2=0x7fdd9014a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:47.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd97f39640 1 --2- 172.21.15.57:0/1418888670 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd900bc3f0 0x7fdd9014a8a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdd8000bb10 tx=0x7fdd8001ec30 comp rx=0 tx=0).stop 2024-04-24T23:38:47.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd97f39640 1 -- 172.21.15.57:0/1418888670 shutdown_connections 2024-04-24T23:38:47.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd97f39640 1 --2- 172.21.15.57:0/1418888670 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd900bc3f0 0x7fdd9014a8a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd97f39640 1 --2- 172.21.15.57:0/1418888670 >> v2:172.21.15.88:3300/0 conn(0x7fdd9006ea40 0x7fdd901514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd97f39640 1 -- 172.21.15.57:0/1418888670 >> 172.21.15.57:0/1418888670 conn(0x7fdd9006b920 msgr2=0x7fdd900c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:47.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd97f39640 1 -- 172.21.15.57:0/1418888670 shutdown_connections 2024-04-24T23:38:47.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd97f39640 1 -- 172.21.15.57:0/1418888670 wait complete. 2024-04-24T23:38:47.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd97f39640 1 Processor -- start 2024-04-24T23:38:47.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd97f39640 1 -- start start 2024-04-24T23:38:47.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd97f39640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd9006ea40 0x7fdd900bb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:47.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd97f39640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd900bc3f0 0x7fdd9013a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:47.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd97f39640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd9014ade0 0x7fdd9013a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:47.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd97f39640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fdd9006e060 con 0x7fdd9006ea40 2024-04-24T23:38:47.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd97f39640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fdd9006dee0 con 0x7fdd900bc3f0 2024-04-24T23:38:47.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd97f39640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fdd9006e1e0 con 0x7fdd9014ade0 2024-04-24T23:38:47.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd95cd5640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd9006ea40 0x7fdd900bb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:47.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd95cd5640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd9006ea40 0x7fdd900bb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42606/0 (socket says 172.21.15.57:42606) 2024-04-24T23:38:47.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd95cd5640 1 -- 172.21.15.57:0/687521924 learned_addr learned my addr 172.21.15.57:0/687521924 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:47.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd954d4640 1 --2- 172.21.15.57:0/687521924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd900bc3f0 0x7fdd9013a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:47.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd964d6640 1 --2- 172.21.15.57:0/687521924 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd9014ade0 0x7fdd9013a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:47.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd95cd5640 1 -- 172.21.15.57:0/687521924 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd9014ade0 msgr2=0x7fdd9013a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:47.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd95cd5640 1 --2- 172.21.15.57:0/687521924 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd9014ade0 0x7fdd9013a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd95cd5640 1 -- 172.21.15.57:0/687521924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd900bc3f0 msgr2=0x7fdd9013a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:47.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd95cd5640 1 --2- 172.21.15.57:0/687521924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd900bc3f0 0x7fdd9013a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd95cd5640 1 -- 172.21.15.57:0/687521924 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd9013ec70 con 0x7fdd9006ea40 2024-04-24T23:38:47.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd95cd5640 1 --2- 172.21.15.57:0/687521924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd9006ea40 0x7fdd900bb740 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00e960 tx=0x7fdd8c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:47.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd867fc640 1 -- 172.21.15.57:0/687521924 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c017070 con 0x7fdd9006ea40 2024-04-24T23:38:47.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd867fc640 1 -- 172.21.15.57:0/687521924 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd8c00ca00 con 0x7fdd9006ea40 2024-04-24T23:38:47.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd97f39640 1 -- 172.21.15.57:0/687521924 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd900bbc80 con 0x7fdd9006ea40 2024-04-24T23:38:47.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd867fc640 1 -- 172.21.15.57:0/687521924 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c00cdb0 con 0x7fdd9006ea40 2024-04-24T23:38:47.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.145+0000 7fdd97f39640 1 -- 172.21.15.57:0/687521924 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd9014ce50 con 0x7fdd9006ea40 2024-04-24T23:38:47.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.149+0000 7fdd97f39640 1 -- 172.21.15.57:0/687521924 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd90068290 con 0x7fdd9006ea40 2024-04-24T23:38:47.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.149+0000 7fdd867fc640 1 -- 172.21.15.57:0/687521924 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdd8c01a070 con 0x7fdd9006ea40 2024-04-24T23:38:47.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.149+0000 7fdd867fc640 1 --2- 172.21.15.57:0/687521924 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fdd740678f0 0x7fdd74069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:47.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.149+0000 7fdd867fc640 1 -- 172.21.15.57:0/687521924 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdd8c085fe0 con 0x7fdd9006ea40 2024-04-24T23:38:47.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.149+0000 7fdd954d4640 1 --2- 172.21.15.57:0/687521924 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fdd740678f0 0x7fdd74069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:47.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.149+0000 7fdd954d4640 1 --2- 172.21.15.57:0/687521924 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fdd740678f0 0x7fdd74069db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdd800b1000 tx=0x7fdd80008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:47.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.153+0000 7fdd867fc640 1 -- 172.21.15.57:0/687521924 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fdd900bbc80 con 0x7fdd9006ea40 2024-04-24T23:38:47.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.313+0000 7fdd97f39640 1 -- 172.21.15.57:0/687521924 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdd90146a70 con 0x7fdd9006ea40 2024-04-24T23:38:47.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.313+0000 7fdd867fc640 1 -- 172.21.15.57:0/687521924 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7fdd8c056810 con 0x7fdd9006ea40 2024-04-24T23:38:47.313 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-04-24T23:38:47.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.313+0000 7fdd97f39640 1 -- 172.21.15.57:0/687521924 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fdd740678f0 msgr2=0x7fdd74069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:47.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.313+0000 7fdd97f39640 1 --2- 172.21.15.57:0/687521924 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fdd740678f0 0x7fdd74069db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdd800b1000 tx=0x7fdd80008040 comp rx=0 tx=0).stop 2024-04-24T23:38:47.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.313+0000 7fdd97f39640 1 -- 172.21.15.57:0/687521924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd9006ea40 msgr2=0x7fdd900bb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:47.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.313+0000 7fdd97f39640 1 --2- 172.21.15.57:0/687521924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd9006ea40 0x7fdd900bb740 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00e960 tx=0x7fdd8c00ee20 comp rx=0 tx=0).stop 2024-04-24T23:38:47.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.313+0000 7fdd97f39640 1 -- 172.21.15.57:0/687521924 shutdown_connections 2024-04-24T23:38:47.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.313+0000 7fdd97f39640 1 --2- 172.21.15.57:0/687521924 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fdd740678f0 0x7fdd74069db0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.313+0000 7fdd97f39640 1 --2- 172.21.15.57:0/687521924 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd9014ade0 0x7fdd9013a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.313+0000 7fdd97f39640 1 --2- 172.21.15.57:0/687521924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd900bc3f0 0x7fdd9013a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.313+0000 7fdd97f39640 1 --2- 172.21.15.57:0/687521924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd9006ea40 0x7fdd900bb740 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.313+0000 7fdd97f39640 1 -- 172.21.15.57:0/687521924 >> 172.21.15.57:0/687521924 conn(0x7fdd9006b920 msgr2=0x7fdd90140c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:47.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.313+0000 7fdd97f39640 1 -- 172.21.15.57:0/687521924 shutdown_connections 2024-04-24T23:38:47.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.313+0000 7fdd97f39640 1 -- 172.21.15.57:0/687521924 wait complete. 2024-04-24T23:38:47.331 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:38:47.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.457+0000 7fe6c96cc640 1 Processor -- start 2024-04-24T23:38:47.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.457+0000 7fe6c96cc640 1 -- start start 2024-04-24T23:38:47.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.457+0000 7fe6c96cc640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe6c406e000 0x7fe6c41513b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:47.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.457+0000 7fe6c96cc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe6c406d6d0 0x7fe6c40bb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:47.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.457+0000 7fe6c96cc640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6c4072150 con 0x7fe6c40bba20 2024-04-24T23:38:47.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.457+0000 7fe6c96cc640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fe6c406e920 con 0x7fe6c406e000 2024-04-24T23:38:47.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.457+0000 7fe6c96cc640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fe6c4072450 con 0x7fe6c406d6d0 2024-04-24T23:38:47.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.461+0000 7fe6c2ffd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe6c406e000 0x7fe6c41513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:47.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.461+0000 7fe6c2ffd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe6c406e000 0x7fe6c41513b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42610/0 (socket says 172.21.15.57:42610) 2024-04-24T23:38:47.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.461+0000 7fe6c2ffd640 1 -- 172.21.15.57:0/2075949598 learned_addr learned my addr 172.21.15.57:0/2075949598 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:47.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.461+0000 7fe6c27fc640 1 --2- 172.21.15.57:0/2075949598 >> v2:172.21.15.88:3300/0 conn(0x7fe6c406d6d0 0x7fe6c40bb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:47.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.461+0000 7fe6c2ffd640 1 -- 172.21.15.57:0/2075949598 >> v2:172.21.15.88:3300/0 conn(0x7fe6c406d6d0 msgr2=0x7fe6c40bb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:47.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.461+0000 7fe6c2ffd640 1 --2- 172.21.15.57:0/2075949598 >> v2:172.21.15.88:3300/0 conn(0x7fe6c406d6d0 0x7fe6c40bb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.461+0000 7fe6c2ffd640 1 -- 172.21.15.57:0/2075949598 >> v1:172.21.15.88:6789/0 conn(0x7fe6c40bba20 legacy=0x7fe6c40728e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:47.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.461+0000 7fe6c2ffd640 1 -- 172.21.15.57:0/2075949598 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c41518f0 con 0x7fe6c406e000 2024-04-24T23:38:47.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.461+0000 7fe6c2ffd640 1 --2- 172.21.15.57:0/2075949598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c406e000 0x7fe6c41513b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe6c406d120 tx=0x7fe6b401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eccbad5f2c9b7f7d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:47.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.461+0000 7fe6c1ffb640 1 -- 172.21.15.57:0/2075949598 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b40aa650 con 0x7fe6c406e000 2024-04-24T23:38:47.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.461+0000 7fe6c1ffb640 1 -- 172.21.15.57:0/2075949598 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b40af070 con 0x7fe6c406e000 2024-04-24T23:38:47.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.461+0000 7fe6c1ffb640 1 -- 172.21.15.57:0/2075949598 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b40aaa10 con 0x7fe6c406e000 2024-04-24T23:38:47.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.461+0000 7fe6c96cc640 1 -- 172.21.15.57:0/2075949598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c406e000 msgr2=0x7fe6c41513b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:47.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.461+0000 7fe6c96cc640 1 --2- 172.21.15.57:0/2075949598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c406e000 0x7fe6c41513b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe6c406d120 tx=0x7fe6b401c4f0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.461+0000 7fe6c96cc640 1 -- 172.21.15.57:0/2075949598 shutdown_connections 2024-04-24T23:38:47.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.461+0000 7fe6c96cc640 1 --2- 172.21.15.57:0/2075949598 >> v2:172.21.15.88:3300/0 conn(0x7fe6c406d6d0 0x7fe6c40bb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.461+0000 7fe6c96cc640 1 --2- 172.21.15.57:0/2075949598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c406e000 0x7fe6c41513b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.461+0000 7fe6c96cc640 1 -- 172.21.15.57:0/2075949598 >> 172.21.15.57:0/2075949598 conn(0x7fe6c406b920 msgr2=0x7fe6c40c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:47.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.461+0000 7fe6c96cc640 1 -- 172.21.15.57:0/2075949598 shutdown_connections 2024-04-24T23:38:47.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.461+0000 7fe6c96cc640 1 -- 172.21.15.57:0/2075949598 wait complete. 2024-04-24T23:38:47.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.465+0000 7fe6c96cc640 1 Processor -- start 2024-04-24T23:38:47.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.465+0000 7fe6c96cc640 1 -- start start 2024-04-24T23:38:47.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.465+0000 7fe6c96cc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6c406d6d0 0x7fe6c4145c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:47.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.465+0000 7fe6c96cc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c406e000 0x7fe6c414c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:47.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.465+0000 7fe6c96cc640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe6c40bba20 0x7fe6c41ec710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:47.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.465+0000 7fe6c96cc640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c4073170 con 0x7fe6c406e000 2024-04-24T23:38:47.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.465+0000 7fe6c96cc640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c4072ff0 con 0x7fe6c406d6d0 2024-04-24T23:38:47.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.465+0000 7fe6c96cc640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fe6c415dad0 con 0x7fe6c40bba20 2024-04-24T23:38:47.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.465+0000 7fe6c27fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c406e000 0x7fe6c414c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:47.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.465+0000 7fe6c27fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c406e000 0x7fe6c414c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42614/0 (socket says 172.21.15.57:42614) 2024-04-24T23:38:47.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.465+0000 7fe6c27fc640 1 -- 172.21.15.57:0/3319539781 learned_addr learned my addr 172.21.15.57:0/3319539781 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:47.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.465+0000 7fe6c2ffd640 1 --2- 172.21.15.57:0/3319539781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6c406d6d0 0x7fe6c4145c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:47.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.465+0000 7fe6c37fe640 1 --2- 172.21.15.57:0/3319539781 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe6c40bba20 0x7fe6c41ec710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:47.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.465+0000 7fe6c27fc640 1 -- 172.21.15.57:0/3319539781 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe6c40bba20 msgr2=0x7fe6c41ec710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:47.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.465+0000 7fe6c27fc640 1 --2- 172.21.15.57:0/3319539781 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe6c40bba20 0x7fe6c41ec710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.465+0000 7fe6c27fc640 1 -- 172.21.15.57:0/3319539781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6c406d6d0 msgr2=0x7fe6c4145c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:47.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.465+0000 7fe6c27fc640 1 --2- 172.21.15.57:0/3319539781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6c406d6d0 0x7fe6c4145c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.465+0000 7fe6c27fc640 1 -- 172.21.15.57:0/3319539781 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c41540f0 con 0x7fe6c406e000 2024-04-24T23:38:47.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.465+0000 7fe6c37fe640 1 --2- 172.21.15.57:0/3319539781 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe6c40bba20 0x7fe6c41ec710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:38:47.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.465+0000 7fe6c2ffd640 1 --2- 172.21.15.57:0/3319539781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6c406d6d0 0x7fe6c4145c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:38:47.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.465+0000 7fe6c27fc640 1 --2- 172.21.15.57:0/3319539781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c406e000 0x7fe6c414c050 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac00d830 tx=0x7fe6ac00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:47.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.465+0000 7fe6bb7fe640 1 -- 172.21.15.57:0/3319539781 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac00b6c0 con 0x7fe6c406e000 2024-04-24T23:38:47.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.465+0000 7fe6bb7fe640 1 -- 172.21.15.57:0/3319539781 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6ac019070 con 0x7fe6c406e000 2024-04-24T23:38:47.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.465+0000 7fe6c96cc640 1 -- 172.21.15.57:0/3319539781 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6c41461c0 con 0x7fe6c406e000 2024-04-24T23:38:47.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.465+0000 7fe6bb7fe640 1 -- 172.21.15.57:0/3319539781 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac00ba60 con 0x7fe6c406e000 2024-04-24T23:38:47.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.465+0000 7fe6c96cc640 1 -- 172.21.15.57:0/3319539781 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6c414c830 con 0x7fe6c406e000 2024-04-24T23:38:47.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.465+0000 7fe6c96cc640 1 -- 172.21.15.57:0/3319539781 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6c4068290 con 0x7fe6c406e000 2024-04-24T23:38:47.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.465+0000 7fe6bb7fe640 1 -- 172.21.15.57:0/3319539781 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe6ac01e460 con 0x7fe6c406e000 2024-04-24T23:38:47.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.469+0000 7fe6bb7fe640 1 --2- 172.21.15.57:0/3319539781 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fe6a40678f0 0x7fe6a4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:47.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.469+0000 7fe6bb7fe640 1 -- 172.21.15.57:0/3319539781 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe6ac086740 con 0x7fe6c406e000 2024-04-24T23:38:47.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.469+0000 7fe6c2ffd640 1 --2- 172.21.15.57:0/3319539781 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fe6a40678f0 0x7fe6a4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:47.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.469+0000 7fe6c2ffd640 1 --2- 172.21.15.57:0/3319539781 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fe6a40678f0 0x7fe6a4069db0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe6b40ae000 tx=0x7fe6b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:47.472 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.473+0000 7fe6bb7fe640 1 -- 172.21.15.57:0/3319539781 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fe6c41461c0 con 0x7fe6c406e000 2024-04-24T23:38:47.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.633+0000 7fe6c96cc640 1 -- 172.21.15.57:0/3319539781 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe6c40bc720 con 0x7fe6c406e000 2024-04-24T23:38:47.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.633+0000 7fe6bb7fe640 1 -- 172.21.15.57:0/3319539781 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7fe6ac056ea0 con 0x7fe6c406e000 2024-04-24T23:38:47.636 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-04-24T23:38:47.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.637+0000 7fe6c96cc640 1 -- 172.21.15.57:0/3319539781 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fe6a40678f0 msgr2=0x7fe6a4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:47.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.637+0000 7fe6c96cc640 1 --2- 172.21.15.57:0/3319539781 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fe6a40678f0 0x7fe6a4069db0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe6b40ae000 tx=0x7fe6b4008040 comp rx=0 tx=0).stop 2024-04-24T23:38:47.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.637+0000 7fe6c96cc640 1 -- 172.21.15.57:0/3319539781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c406e000 msgr2=0x7fe6c414c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:47.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.637+0000 7fe6c96cc640 1 --2- 172.21.15.57:0/3319539781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c406e000 0x7fe6c414c050 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac00d830 tx=0x7fe6ac00dcf0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.637+0000 7fe6c96cc640 1 -- 172.21.15.57:0/3319539781 shutdown_connections 2024-04-24T23:38:47.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.637+0000 7fe6c96cc640 1 --2- 172.21.15.57:0/3319539781 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fe6a40678f0 0x7fe6a4069db0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.637+0000 7fe6c96cc640 1 --2- 172.21.15.57:0/3319539781 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe6c40bba20 0x7fe6c41ec710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.637+0000 7fe6c96cc640 1 --2- 172.21.15.57:0/3319539781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c406e000 0x7fe6c414c050 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.637+0000 7fe6c96cc640 1 --2- 172.21.15.57:0/3319539781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6c406d6d0 0x7fe6c4145c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.637+0000 7fe6c96cc640 1 -- 172.21.15.57:0/3319539781 >> 172.21.15.57:0/3319539781 conn(0x7fe6c406b920 msgr2=0x7fe6c40a6010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:47.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.637+0000 7fe6c96cc640 1 -- 172.21.15.57:0/3319539781 shutdown_connections 2024-04-24T23:38:47.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.637+0000 7fe6c96cc640 1 -- 172.21.15.57:0/3319539781 wait complete. 2024-04-24T23:38:47.654 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:38:47.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.777+0000 7f3249f53640 1 Processor -- start 2024-04-24T23:38:47.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.777+0000 7f3249f53640 1 -- start start 2024-04-24T23:38:47.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.777+0000 7f3249f53640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f324406ea40 0x7f32441514f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:47.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.777+0000 7f3249f53640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f32440bc3f0 0x7f324414a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:47.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.777+0000 7f3249f53640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f324414ade0 0x7f324414dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:47.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.777+0000 7f3249f53640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f324414d640 con 0x7f32440bc3f0 2024-04-24T23:38:47.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.777+0000 7f3249f53640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f3244151a30 con 0x7f324406ea40 2024-04-24T23:38:47.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.777+0000 7f3249f53640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f32440be040 con 0x7f324414ade0 2024-04-24T23:38:47.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.777+0000 7f3242ffd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f32440bc3f0 0x7f324414a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:47.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.777+0000 7f3242ffd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f32440bc3f0 0x7f324414a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36412/0 (socket says 172.21.15.57:36412) 2024-04-24T23:38:47.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.777+0000 7f3242ffd640 1 -- 172.21.15.57:0/4027537760 learned_addr learned my addr 172.21.15.57:0/4027537760 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:47.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.777+0000 7f32437fe640 1 --2- 172.21.15.57:0/4027537760 >> v2:172.21.15.88:3300/0 conn(0x7f324406ea40 0x7f32441514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:47.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.777+0000 7f3243fff640 1 --2- 172.21.15.57:0/4027537760 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f324414ade0 0x7f324414dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:47.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.777+0000 7f3242ffd640 1 -- 172.21.15.57:0/4027537760 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f324414ade0 msgr2=0x7f324414dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:47.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.777+0000 7f3242ffd640 1 --2- 172.21.15.57:0/4027537760 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f324414ade0 0x7f324414dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.777+0000 7f3242ffd640 1 -- 172.21.15.57:0/4027537760 >> v2:172.21.15.88:3300/0 conn(0x7f324406ea40 msgr2=0x7f32441514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:47.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.777+0000 7f3242ffd640 1 --2- 172.21.15.57:0/4027537760 >> v2:172.21.15.88:3300/0 conn(0x7f324406ea40 0x7f32441514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.777+0000 7f3242ffd640 1 -- 172.21.15.57:0/4027537760 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32440be320 con 0x7f32440bc3f0 2024-04-24T23:38:47.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.777+0000 7f32437fe640 1 --2- 172.21.15.57:0/4027537760 >> v2:172.21.15.88:3300/0 conn(0x7f324406ea40 0x7f32441514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:38:47.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f3242ffd640 1 --2- 172.21.15.57:0/4027537760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32440bc3f0 0x7f324414a8a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f32440734f0 tx=0x7f323801ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf96c52188aa76b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:47.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f32427fc640 1 -- 172.21.15.57:0/4027537760 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32380b4070 con 0x7f32440bc3f0 2024-04-24T23:38:47.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f32427fc640 1 -- 172.21.15.57:0/4027537760 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32380a7b00 con 0x7f32440bc3f0 2024-04-24T23:38:47.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f32427fc640 1 -- 172.21.15.57:0/4027537760 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32380af440 con 0x7f32440bc3f0 2024-04-24T23:38:47.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f3249f53640 1 -- 172.21.15.57:0/4027537760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32440bc3f0 msgr2=0x7f324414a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:47.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f3249f53640 1 --2- 172.21.15.57:0/4027537760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32440bc3f0 0x7f324414a8a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f32440734f0 tx=0x7f323801ebf0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f3249f53640 1 -- 172.21.15.57:0/4027537760 shutdown_connections 2024-04-24T23:38:47.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f3249f53640 1 --2- 172.21.15.57:0/4027537760 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f324414ade0 0x7f324414dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f3249f53640 1 --2- 172.21.15.57:0/4027537760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32440bc3f0 0x7f324414a8a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f3249f53640 1 --2- 172.21.15.57:0/4027537760 >> v2:172.21.15.88:3300/0 conn(0x7f324406ea40 0x7f32441514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f3249f53640 1 -- 172.21.15.57:0/4027537760 >> 172.21.15.57:0/4027537760 conn(0x7f324406b920 msgr2=0x7f32440c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:47.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f3249f53640 1 -- 172.21.15.57:0/4027537760 shutdown_connections 2024-04-24T23:38:47.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f3249f53640 1 -- 172.21.15.57:0/4027537760 wait complete. 2024-04-24T23:38:47.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f3249f53640 1 Processor -- start 2024-04-24T23:38:47.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f3249f53640 1 -- start start 2024-04-24T23:38:47.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f3249f53640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f324406ea40 0x7f324414b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:47.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f3249f53640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32440bc3f0 0x7f32441e4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:47.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f3249f53640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f324414ade0 0x7f32441e52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:47.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f3249f53640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f324406efa0 con 0x7f324406ea40 2024-04-24T23:38:47.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f3249f53640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f324406ee20 con 0x7f32440bc3f0 2024-04-24T23:38:47.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f3249f53640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f32440bd2c0 con 0x7f324414ade0 2024-04-24T23:38:47.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f32437fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f324406ea40 0x7f324414b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:47.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f32437fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f324406ea40 0x7f324414b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36416/0 (socket says 172.21.15.57:36416) 2024-04-24T23:38:47.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f32437fe640 1 -- 172.21.15.57:0/3811871789 learned_addr learned my addr 172.21.15.57:0/3811871789 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:47.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f3243fff640 1 --2- 172.21.15.57:0/3811871789 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f324414ade0 0x7f32441e52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:47.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f3242ffd640 1 --2- 172.21.15.57:0/3811871789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32440bc3f0 0x7f32441e4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:47.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f32437fe640 1 -- 172.21.15.57:0/3811871789 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f324414ade0 msgr2=0x7f32441e52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:47.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f32437fe640 1 --2- 172.21.15.57:0/3811871789 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f324414ade0 0x7f32441e52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f32437fe640 1 -- 172.21.15.57:0/3811871789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32440bc3f0 msgr2=0x7f32441e4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:47.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f32437fe640 1 --2- 172.21.15.57:0/3811871789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32440bc3f0 0x7f32441e4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f32437fe640 1 -- 172.21.15.57:0/3811871789 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f324414bb50 con 0x7f324406ea40 2024-04-24T23:38:47.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f32437fe640 1 --2- 172.21.15.57:0/3811871789 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f324406ea40 0x7f324414b610 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f323400c7c0 tx=0x7f323400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:47.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f322bfff640 1 -- 172.21.15.57:0/3811871789 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3234015070 con 0x7f324406ea40 2024-04-24T23:38:47.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f322bfff640 1 -- 172.21.15.57:0/3811871789 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3234007a30 con 0x7f324406ea40 2024-04-24T23:38:47.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f3249f53640 1 -- 172.21.15.57:0/3811871789 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32441e8dd0 con 0x7f324406ea40 2024-04-24T23:38:47.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f322bfff640 1 -- 172.21.15.57:0/3811871789 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3234007e00 con 0x7f324406ea40 2024-04-24T23:38:47.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.781+0000 7f3249f53640 1 -- 172.21.15.57:0/3811871789 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f324414fe30 con 0x7f324406ea40 2024-04-24T23:38:47.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.785+0000 7f3249f53640 1 -- 172.21.15.57:0/3811871789 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3244068290 con 0x7f324406ea40 2024-04-24T23:38:47.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.785+0000 7f322bfff640 1 -- 172.21.15.57:0/3811871789 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3234018070 con 0x7f324406ea40 2024-04-24T23:38:47.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.785+0000 7f322bfff640 1 --2- 172.21.15.57:0/3811871789 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f32300678c0 0x7f3230069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:47.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.785+0000 7f322bfff640 1 -- 172.21.15.57:0/3811871789 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3234085eb0 con 0x7f324406ea40 2024-04-24T23:38:47.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.785+0000 7f3242ffd640 1 --2- 172.21.15.57:0/3811871789 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f32300678c0 0x7f3230069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:47.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.785+0000 7f3242ffd640 1 --2- 172.21.15.57:0/3811871789 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f32300678c0 0x7f3230069d80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f32380b1000 tx=0x7f32380a9070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:47.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.789+0000 7f322bfff640 1 -- 172.21.15.57:0/3811871789 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f324414bb50 con 0x7f324406ea40 2024-04-24T23:38:47.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.945+0000 7f3249f53640 1 -- 172.21.15.57:0/3811871789 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f324406e5c0 con 0x7f324406ea40 2024-04-24T23:38:47.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.945+0000 7f322bfff640 1 -- 172.21.15.57:0/3811871789 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f32340566b0 con 0x7f324406ea40 2024-04-24T23:38:47.945 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-24T23:38:47.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.945+0000 7f3249f53640 1 -- 172.21.15.57:0/3811871789 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f32300678c0 msgr2=0x7f3230069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:47.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.945+0000 7f3249f53640 1 --2- 172.21.15.57:0/3811871789 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f32300678c0 0x7f3230069d80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f32380b1000 tx=0x7f32380a9070 comp rx=0 tx=0).stop 2024-04-24T23:38:47.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.945+0000 7f3249f53640 1 -- 172.21.15.57:0/3811871789 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f324406ea40 msgr2=0x7f324414b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:47.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.945+0000 7f3249f53640 1 --2- 172.21.15.57:0/3811871789 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f324406ea40 0x7f324414b610 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f323400c7c0 tx=0x7f323400cc80 comp rx=0 tx=0).stop 2024-04-24T23:38:47.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.945+0000 7f3249f53640 1 -- 172.21.15.57:0/3811871789 shutdown_connections 2024-04-24T23:38:47.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.945+0000 7f3249f53640 1 --2- 172.21.15.57:0/3811871789 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f32300678c0 0x7f3230069d80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.945+0000 7f3249f53640 1 --2- 172.21.15.57:0/3811871789 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f324414ade0 0x7f32441e52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.945+0000 7f3249f53640 1 --2- 172.21.15.57:0/3811871789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32440bc3f0 0x7f32441e4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.945+0000 7f3249f53640 1 --2- 172.21.15.57:0/3811871789 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f324406ea40 0x7f324414b610 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:47.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.945+0000 7f3249f53640 1 -- 172.21.15.57:0/3811871789 >> 172.21.15.57:0/3811871789 conn(0x7f324406b920 msgr2=0x7f324406d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:47.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.945+0000 7f3249f53640 1 -- 172.21.15.57:0/3811871789 shutdown_connections 2024-04-24T23:38:47.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:47.945+0000 7f3249f53640 1 -- 172.21.15.57:0/3811871789 wait complete. 2024-04-24T23:38:47.962 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-24T23:38:48.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.085+0000 7f3678442640 1 Processor -- start 2024-04-24T23:38:48.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.085+0000 7f3678442640 1 -- start start 2024-04-24T23:38:48.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f3678442640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f36700bd1d0 0x7f36700bc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:48.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f3678442640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f36700bee70 0x7f367014a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:48.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f3678442640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36700703e0 con 0x7f367014a920 2024-04-24T23:38:48.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f3678442640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f367006bde0 con 0x7f36700bee70 2024-04-24T23:38:48.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f3678442640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f367006f620 con 0x7f36700bd1d0 2024-04-24T23:38:48.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f36769df640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f367014a920 0x7f3670153d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43408/0 (socket says 172.21.15.57:43408) 2024-04-24T23:38:48.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f36769df640 1 -- 172.21.15.57:0/804249056 learned_addr learned my addr 172.21.15.57:0/804249056 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:38:48.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f36759dd640 1 --2- 172.21.15.57:0/804249056 >> v2:172.21.15.88:3300/0 conn(0x7f36700bee70 0x7f367014a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:48.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f36761de640 1 --2- 172.21.15.57:0/804249056 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f36700bd1d0 0x7f36700bc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:48.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f36751dc640 1 -- 172.21.15.57:0/804249056 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2896622609 0 0) 0x7f36700703e0 con 0x7f367014a920 2024-04-24T23:38:48.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f36751dc640 1 -- 172.21.15.57:0/804249056 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f365c003530 con 0x7f367014a920 2024-04-24T23:38:48.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f36751dc640 1 -- 172.21.15.57:0/804249056 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3296983739 0 0) 0x7f365c003530 con 0x7f367014a920 2024-04-24T23:38:48.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f36751dc640 1 -- 172.21.15.57:0/804249056 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f36700bd1d0 msgr2=0x7f36700bc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:48.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f36751dc640 1 --2- 172.21.15.57:0/804249056 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f36700bd1d0 0x7f36700bc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:48.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f36751dc640 1 -- 172.21.15.57:0/804249056 >> v2:172.21.15.88:3300/0 conn(0x7f36700bee70 msgr2=0x7f367014a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:48.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f36751dc640 1 --2- 172.21.15.57:0/804249056 >> v2:172.21.15.88:3300/0 conn(0x7f36700bee70 0x7f367014a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:48.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f36751dc640 1 -- 172.21.15.57:0/804249056 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f367006f900 con 0x7f367014a920 2024-04-24T23:38:48.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f36751dc640 1 -- 172.21.15.57:0/804249056 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7f3668001a00 con 0x7f367014a920 2024-04-24T23:38:48.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f36751dc640 1 -- 172.21.15.57:0/804249056 >> v1:172.21.15.57:6789/0 conn(0x7f367014a920 legacy=0x7f3670153d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:48.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f36751dc640 1 --2- 172.21.15.57:0/804249056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f365c0039c0 0x7f365c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:48.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f36751dc640 1 --2- 172.21.15.57:0/804249056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f365c004810 0x7f365c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:48.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f36751dc640 1 --2- 172.21.15.57:0/804249056 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f36700bd1d0 0x7f365c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:48.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f36751dc640 1 -- 172.21.15.57:0/804249056 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f367006bde0 con 0x7f365c004810 2024-04-24T23:38:48.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f36751dc640 1 -- 172.21.15.57:0/804249056 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f367006f620 con 0x7f365c0039c0 2024-04-24T23:38:48.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f36751dc640 1 -- 172.21.15.57:0/804249056 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f365c00b9d0 con 0x7f36700bd1d0 2024-04-24T23:38:48.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f36759dd640 1 --2- 172.21.15.57:0/804249056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f365c004810 0x7f365c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:48.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f36759dd640 1 -- 172.21.15.57:0/804249056 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f36700bd1d0 msgr2=0x7f365c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:48.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f36759dd640 1 --2- 172.21.15.57:0/804249056 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f36700bd1d0 0x7f365c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:48.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f36761de640 1 --2- 172.21.15.57:0/804249056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f365c0039c0 0x7f365c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:48.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f36759dd640 1 -- 172.21.15.57:0/804249056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f365c0039c0 msgr2=0x7f365c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:48.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f36759dd640 1 --2- 172.21.15.57:0/804249056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f365c0039c0 0x7f365c003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:48.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.089+0000 7f36759dd640 1 -- 172.21.15.57:0/804249056 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f365c003530 con 0x7f365c004810 2024-04-24T23:38:48.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f36759dd640 1 --2- 172.21.15.57:0/804249056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f365c004810 0x7f365c004c90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3660009ae0 tx=0x7f366001cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da5e643b6ca1e31 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:48.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f36751dc640 1 -- 172.21.15.57:0/804249056 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36600b2070 con 0x7f365c004810 2024-04-24T23:38:48.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f36751dc640 1 -- 172.21.15.57:0/804249056 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36600a55c0 con 0x7f365c004810 2024-04-24T23:38:48.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f36751dc640 1 -- 172.21.15.57:0/804249056 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36600096b0 con 0x7f365c004810 2024-04-24T23:38:48.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f3678442640 1 -- 172.21.15.57:0/804249056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f365c004810 msgr2=0x7f365c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:48.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f3678442640 1 --2- 172.21.15.57:0/804249056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f365c004810 0x7f365c004c90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3660009ae0 tx=0x7f366001cab0 comp rx=0 tx=0).stop 2024-04-24T23:38:48.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f36769df640 1 -- 172.21.15.57:0/804249056 reap_dead start 2024-04-24T23:38:48.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f3678442640 1 -- 172.21.15.57:0/804249056 shutdown_connections 2024-04-24T23:38:48.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f3678442640 1 -- 172.21.15.57:0/804249056 >> 172.21.15.57:0/804249056 conn(0x7f36700c30c0 msgr2=0x7f36700c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:48.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f3678442640 1 -- 172.21.15.57:0/804249056 shutdown_connections 2024-04-24T23:38:48.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f3678442640 1 -- 172.21.15.57:0/804249056 wait complete. 2024-04-24T23:38:48.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f3678442640 1 Processor -- start 2024-04-24T23:38:48.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f3678442640 1 -- start start 2024-04-24T23:38:48.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f3678442640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f365c004810 0x7f36700a7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:48.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f3678442640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36700a7960 0x7f36701e9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:48.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f3678442640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36701e99b0 0x7f36701427b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:48.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f3678442640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f36700bd5b0 con 0x7f36700a7960 2024-04-24T23:38:48.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f3678442640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f367006fec0 con 0x7f36701e99b0 2024-04-24T23:38:48.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f3678442640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f36700bd730 con 0x7f365c004810 2024-04-24T23:38:48.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f36759dd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36700a7960 0x7f36701e9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:48.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f36759dd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36700a7960 0x7f36701e9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36426/0 (socket says 172.21.15.57:36426) 2024-04-24T23:38:48.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f36759dd640 1 -- 172.21.15.57:0/1783465616 learned_addr learned my addr 172.21.15.57:0/1783465616 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:48.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f36761de640 1 --2- 172.21.15.57:0/1783465616 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f365c004810 0x7f36700a7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:48.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f36769df640 1 --2- 172.21.15.57:0/1783465616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36701e99b0 0x7f36701427b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:48.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f36759dd640 1 -- 172.21.15.57:0/1783465616 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f365c004810 msgr2=0x7f36700a7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:48.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f36759dd640 1 --2- 172.21.15.57:0/1783465616 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f365c004810 0x7f36700a7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:48.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f36759dd640 1 -- 172.21.15.57:0/1783465616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36701e99b0 msgr2=0x7f36701427b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:48.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f36759dd640 1 --2- 172.21.15.57:0/1783465616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36701e99b0 0x7f36701427b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:48.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f36759dd640 1 -- 172.21.15.57:0/1783465616 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3670151750 con 0x7f36700a7960 2024-04-24T23:38:48.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f36759dd640 1 --2- 172.21.15.57:0/1783465616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36700a7960 0x7f36701e9470 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3660009ae0 tx=0x7f365c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:48.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f3666ffd640 1 -- 172.21.15.57:0/1783465616 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36600bc030 con 0x7f36700a7960 2024-04-24T23:38:48.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f3666ffd640 1 -- 172.21.15.57:0/1783465616 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f366000f000 con 0x7f36700a7960 2024-04-24T23:38:48.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f3678442640 1 -- 172.21.15.57:0/1783465616 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3670151a30 con 0x7f36700a7960 2024-04-24T23:38:48.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f3666ffd640 1 -- 172.21.15.57:0/1783465616 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36600b2040 con 0x7f36700a7960 2024-04-24T23:38:48.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.093+0000 7f3678442640 1 -- 172.21.15.57:0/1783465616 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3670151ff0 con 0x7f36700a7960 2024-04-24T23:38:48.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.097+0000 7f3678442640 1 -- 172.21.15.57:0/1783465616 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3670068930 con 0x7f36700a7960 2024-04-24T23:38:48.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.097+0000 7f3666ffd640 1 -- 172.21.15.57:0/1783465616 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f36600bf070 con 0x7f36700a7960 2024-04-24T23:38:48.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.097+0000 7f3666ffd640 1 --2- 172.21.15.57:0/1783465616 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f36540678f0 0x7f3654069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:48.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.097+0000 7f3666ffd640 1 -- 172.21.15.57:0/1783465616 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f36601200f0 con 0x7f36700a7960 2024-04-24T23:38:48.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.097+0000 7f36761de640 1 --2- 172.21.15.57:0/1783465616 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f36540678f0 0x7f3654069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:48.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.097+0000 7f36761de640 1 --2- 172.21.15.57:0/1783465616 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f36540678f0 0x7f3654069db0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f366c009930 tx=0x7f366c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:48.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.101+0000 7f3666ffd640 1 -- 172.21.15.57:0/1783465616 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f36600167c0 con 0x7f36700a7960 2024-04-24T23:38:48.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.253+0000 7f3678442640 1 -- 172.21.15.57:0/1783465616 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f3670154a90 con 0x7f36700a7960 2024-04-24T23:38:48.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.253+0000 7f3666ffd640 1 -- 172.21.15.57:0/1783465616 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f36600f0aa0 con 0x7f36700a7960 2024-04-24T23:38:48.256 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-04-24T23:38:48.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.257+0000 7f3678442640 1 -- 172.21.15.57:0/1783465616 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f36540678f0 msgr2=0x7f3654069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:48.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.257+0000 7f3678442640 1 --2- 172.21.15.57:0/1783465616 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f36540678f0 0x7f3654069db0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f366c009930 tx=0x7f366c008040 comp rx=0 tx=0).stop 2024-04-24T23:38:48.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.257+0000 7f3678442640 1 -- 172.21.15.57:0/1783465616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36700a7960 msgr2=0x7f36701e9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:48.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.257+0000 7f3678442640 1 --2- 172.21.15.57:0/1783465616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36700a7960 0x7f36701e9470 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3660009ae0 tx=0x7f365c005840 comp rx=0 tx=0).stop 2024-04-24T23:38:48.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.257+0000 7f3678442640 1 -- 172.21.15.57:0/1783465616 shutdown_connections 2024-04-24T23:38:48.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.257+0000 7f3678442640 1 --2- 172.21.15.57:0/1783465616 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f36540678f0 0x7f3654069db0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:48.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.257+0000 7f3678442640 1 --2- 172.21.15.57:0/1783465616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36701e99b0 0x7f36701427b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:48.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.257+0000 7f3678442640 1 --2- 172.21.15.57:0/1783465616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36700a7960 0x7f36701e9470 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:48.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.257+0000 7f3678442640 1 --2- 172.21.15.57:0/1783465616 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f365c004810 0x7f36700a7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:48.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.257+0000 7f3678442640 1 -- 172.21.15.57:0/1783465616 >> 172.21.15.57:0/1783465616 conn(0x7f36700c30c0 msgr2=0x7f36700c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:48.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.257+0000 7f3678442640 1 -- 172.21.15.57:0/1783465616 shutdown_connections 2024-04-24T23:38:48.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.257+0000 7f3678442640 1 -- 172.21.15.57:0/1783465616 wait complete. 2024-04-24T23:38:48.274 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:38:48.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.397+0000 7fd7bb64b640 1 Processor -- start 2024-04-24T23:38:48.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.397+0000 7fd7bb64b640 1 -- start start 2024-04-24T23:38:48.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.397+0000 7fd7bb64b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd7b41541d0 0x7fd7b40c5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:48.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.397+0000 7fd7bb64b640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd7b40b9810 0x7fd7b40ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:48.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.397+0000 7fd7bb64b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7b40c0f70 con 0x7fd7b40abe30 2024-04-24T23:38:48.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.397+0000 7fd7bb64b640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fd7b40c0a90 con 0x7fd7b41541d0 2024-04-24T23:38:48.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.397+0000 7fd7bb64b640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b40c44f0 con 0x7fd7b40b9810 2024-04-24T23:38:48.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.397+0000 7fd7b93e7640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd7b41541d0 0x7fd7b40c5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:48.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.397+0000 7fd7b93e7640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd7b41541d0 0x7fd7b40c5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36442/0 (socket says 172.21.15.57:36442) 2024-04-24T23:38:48.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.397+0000 7fd7b93e7640 1 -- 172.21.15.57:0/314903955 learned_addr learned my addr 172.21.15.57:0/314903955 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:48.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.397+0000 7fd7b8be6640 1 --2- 172.21.15.57:0/314903955 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd7b40b9810 0x7fd7b40ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:48.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.397+0000 7fd7b93e7640 1 -- 172.21.15.57:0/314903955 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd7b40b9810 msgr2=0x7fd7b40ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:48.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.397+0000 7fd7b93e7640 1 --2- 172.21.15.57:0/314903955 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd7b40b9810 0x7fd7b40ab8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:48.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.397+0000 7fd7b93e7640 1 -- 172.21.15.57:0/314903955 >> v1:172.21.15.88:6789/0 conn(0x7fd7b40abe30 legacy=0x7fd7b41545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:48.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.397+0000 7fd7b93e7640 1 -- 172.21.15.57:0/314903955 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b40c47d0 con 0x7fd7b41541d0 2024-04-24T23:38:48.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.401+0000 7fd7b93e7640 1 --2- 172.21.15.57:0/314903955 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7b41541d0 0x7fd7b40c5540 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009870 tx=0x7fd7a801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d26591d8cd255e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:48.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.401+0000 7fd7a7fff640 1 -- 172.21.15.57:0/314903955 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a80b0070 con 0x7fd7b41541d0 2024-04-24T23:38:48.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.401+0000 7fd7a7fff640 1 -- 172.21.15.57:0/314903955 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7a80ab600 con 0x7fd7b41541d0 2024-04-24T23:38:48.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.401+0000 7fd7a7fff640 1 -- 172.21.15.57:0/314903955 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a80ab9d0 con 0x7fd7b41541d0 2024-04-24T23:38:48.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.401+0000 7fd7bb64b640 1 -- 172.21.15.57:0/314903955 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7b41541d0 msgr2=0x7fd7b40c5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:48.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.401+0000 7fd7bb64b640 1 --2- 172.21.15.57:0/314903955 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7b41541d0 0x7fd7b40c5540 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009870 tx=0x7fd7a801c4d0 comp rx=0 tx=0).stop 2024-04-24T23:38:48.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.401+0000 7fd7bb64b640 1 -- 172.21.15.57:0/314903955 shutdown_connections 2024-04-24T23:38:48.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.401+0000 7fd7bb64b640 1 --2- 172.21.15.57:0/314903955 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd7b40b9810 0x7fd7b40ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:48.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.401+0000 7fd7bb64b640 1 --2- 172.21.15.57:0/314903955 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7b41541d0 0x7fd7b40c5540 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:48.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.401+0000 7fd7bb64b640 1 -- 172.21.15.57:0/314903955 >> 172.21.15.57:0/314903955 conn(0x7fd7b40c6110 msgr2=0x7fd7b40c6520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:48.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.401+0000 7fd7bb64b640 1 -- 172.21.15.57:0/314903955 shutdown_connections 2024-04-24T23:38:48.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.401+0000 7fd7bb64b640 1 -- 172.21.15.57:0/314903955 wait complete. 2024-04-24T23:38:48.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.401+0000 7fd7bb64b640 1 Processor -- start 2024-04-24T23:38:48.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.401+0000 7fd7bb64b640 1 -- start start 2024-04-24T23:38:48.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.401+0000 7fd7bb64b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7b40abe30 0x7fd7b40a6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:48.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.401+0000 7fd7bb64b640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd7b40b9810 0x7fd7b4150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:48.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.401+0000 7fd7bb64b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7b41541d0 0x7fd7b4151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:48.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.401+0000 7fd7bb64b640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b415dcd0 con 0x7fd7b40abe30 2024-04-24T23:38:48.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.401+0000 7fd7bb64b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b415de50 con 0x7fd7b41541d0 2024-04-24T23:38:48.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.401+0000 7fd7bb64b640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b415dfd0 con 0x7fd7b40b9810 2024-04-24T23:38:48.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.401+0000 7fd7b93e7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7b40abe30 0x7fd7b40a6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:48.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.401+0000 7fd7b93e7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7b40abe30 0x7fd7b40a6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36454/0 (socket says 172.21.15.57:36454) 2024-04-24T23:38:48.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.401+0000 7fd7b93e7640 1 -- 172.21.15.57:0/1861985590 learned_addr learned my addr 172.21.15.57:0/1861985590 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:48.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.401+0000 7fd7b8be6640 1 --2- 172.21.15.57:0/1861985590 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd7b40b9810 0x7fd7b4150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:48.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.401+0000 7fd7b93e7640 1 -- 172.21.15.57:0/1861985590 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd7b40b9810 msgr2=0x7fd7b4150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:48.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.401+0000 7fd7b93e7640 1 --2- 172.21.15.57:0/1861985590 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd7b40b9810 0x7fd7b4150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:48.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.401+0000 7fd7b93e7640 1 -- 172.21.15.57:0/1861985590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7b41541d0 msgr2=0x7fd7b4151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:48.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.401+0000 7fd7b93e7640 1 --2- 172.21.15.57:0/1861985590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7b41541d0 0x7fd7b4151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:48.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.401+0000 7fd7b93e7640 1 -- 172.21.15.57:0/1861985590 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b40a7400 con 0x7fd7b40abe30 2024-04-24T23:38:48.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.401+0000 7fd7b93e7640 1 --2- 172.21.15.57:0/1861985590 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7b40abe30 0x7fd7b40a6ec0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd7a80ae040 tx=0x7fd7a801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:48.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.405+0000 7fd7a5ffb640 1 -- 172.21.15.57:0/1861985590 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a80ba020 con 0x7fd7b40abe30 2024-04-24T23:38:48.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.405+0000 7fd7a5ffb640 1 -- 172.21.15.57:0/1861985590 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7a80b6420 con 0x7fd7b40abe30 2024-04-24T23:38:48.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.405+0000 7fd7bb64b640 1 -- 172.21.15.57:0/1861985590 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7b40bf950 con 0x7fd7b40abe30 2024-04-24T23:38:48.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.405+0000 7fd7a5ffb640 1 -- 172.21.15.57:0/1861985590 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a80b0040 con 0x7fd7b40abe30 2024-04-24T23:38:48.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.405+0000 7fd7bb64b640 1 -- 172.21.15.57:0/1861985590 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7b40befc0 con 0x7fd7b40abe30 2024-04-24T23:38:48.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.405+0000 7fd7bb64b640 1 -- 172.21.15.57:0/1861985590 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7b40bfe70 con 0x7fd7b40abe30 2024-04-24T23:38:48.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.405+0000 7fd7a5ffb640 1 -- 172.21.15.57:0/1861985590 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd7a80bd020 con 0x7fd7b40abe30 2024-04-24T23:38:48.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.405+0000 7fd7a5ffb640 1 --2- 172.21.15.57:0/1861985590 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd7980678c0 0x7fd798069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:48.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.405+0000 7fd7a5ffb640 1 -- 172.21.15.57:0/1861985590 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd7a81205f0 con 0x7fd7b40abe30 2024-04-24T23:38:48.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.405+0000 7fd7b8be6640 1 --2- 172.21.15.57:0/1861985590 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd7980678c0 0x7fd798069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:48.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.405+0000 7fd7b8be6640 1 --2- 172.21.15.57:0/1861985590 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd7980678c0 0x7fd798069d80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd7b40a7650 tx=0x7fd7b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:48.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.409+0000 7fd7a5ffb640 1 -- 172.21.15.57:0/1861985590 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fd7a80c4030 con 0x7fd7b40abe30 2024-04-24T23:38:48.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.581+0000 7fd7bb64b640 1 -- 172.21.15.57:0/1861985590 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd7b4068220 con 0x7fd7b40abe30 2024-04-24T23:38:48.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.581+0000 7fd7a5ffb640 1 -- 172.21.15.57:0/1861985590 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fd7b40a7400 con 0x7fd7b40abe30 2024-04-24T23:38:48.581 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2024-04-24T23:38:48.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.581+0000 7fd7bb64b640 1 -- 172.21.15.57:0/1861985590 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd7980678c0 msgr2=0x7fd798069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:48.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.581+0000 7fd7bb64b640 1 --2- 172.21.15.57:0/1861985590 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd7980678c0 0x7fd798069d80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd7b40a7650 tx=0x7fd7b0008040 comp rx=0 tx=0).stop 2024-04-24T23:38:48.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.581+0000 7fd7bb64b640 1 -- 172.21.15.57:0/1861985590 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7b40abe30 msgr2=0x7fd7b40a6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:48.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.581+0000 7fd7bb64b640 1 --2- 172.21.15.57:0/1861985590 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7b40abe30 0x7fd7b40a6ec0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd7a80ae040 tx=0x7fd7a801ad10 comp rx=0 tx=0).stop 2024-04-24T23:38:48.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.581+0000 7fd7bb64b640 1 -- 172.21.15.57:0/1861985590 shutdown_connections 2024-04-24T23:38:48.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.581+0000 7fd7bb64b640 1 --2- 172.21.15.57:0/1861985590 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd7980678c0 0x7fd798069d80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:48.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.581+0000 7fd7bb64b640 1 --2- 172.21.15.57:0/1861985590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7b41541d0 0x7fd7b4151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:48.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.581+0000 7fd7bb64b640 1 --2- 172.21.15.57:0/1861985590 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd7b40b9810 0x7fd7b4150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:48.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.581+0000 7fd7bb64b640 1 --2- 172.21.15.57:0/1861985590 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7b40abe30 0x7fd7b40a6ec0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:48.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.581+0000 7fd7bb64b640 1 -- 172.21.15.57:0/1861985590 >> 172.21.15.57:0/1861985590 conn(0x7fd7b40c6110 msgr2=0x7fd7b40c64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:48.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.581+0000 7fd7bb64b640 1 -- 172.21.15.57:0/1861985590 shutdown_connections 2024-04-24T23:38:48.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:48.581+0000 7fd7bb64b640 1 -- 172.21.15.57:0/1861985590 wait complete. 2024-04-24T23:38:48.598 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi116.front.sepia.ceph.com... 2024-04-24T23:38:48.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:38:48.599 DEBUG:teuthology.orchestra.run.smithi116:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-24T23:38:48.625 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi116.stderr:ceph-fuse[22849]: fuse finished with error 0 and tester_r 0 2024-04-24T23:38:48.627 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:38:54.729 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi116.front.sepia.ceph.com 2024-04-24T23:38:54.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:38:54.729 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-24T23:38:54.807 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:38:54.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa298316640 1 Processor -- start 2024-04-24T23:38:54.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa298316640 1 -- start start 2024-04-24T23:38:54.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa298316640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2900be620 0x7fa290155420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:54.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa298316640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa29006ee70 con 0x7fa290155960 2024-04-24T23:38:54.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa298316640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2900be360 con 0x7fa2900bf090 2024-04-24T23:38:54.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa298316640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fa29006f460 con 0x7fa2900be620 2024-04-24T23:38:54.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa2968b3640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa290155960 0x7fa29015f690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43418/0 (socket says 172.21.15.57:43418) 2024-04-24T23:38:54.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa2968b3640 1 -- 172.21.15.57:0/3421806918 learned_addr learned my addr 172.21.15.57:0/3421806918 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:38:54.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa2958b1640 1 --2- 172.21.15.57:0/3421806918 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2900be620 0x7fa290155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:54.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa2950b0640 1 -- 172.21.15.57:0/3421806918 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 544053569 0 0) 0x7fa29006ee70 con 0x7fa290155960 2024-04-24T23:38:54.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa2950b0640 1 -- 172.21.15.57:0/3421806918 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa27c003530 con 0x7fa290155960 2024-04-24T23:38:54.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa2950b0640 1 -- 172.21.15.57:0/3421806918 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 474141128 0 0) 0x7fa2900be360 con 0x7fa2900bf090 2024-04-24T23:38:54.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa2950b0640 1 -- 172.21.15.57:0/3421806918 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa29006ee70 con 0x7fa2900bf090 2024-04-24T23:38:54.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa2950b0640 1 -- 172.21.15.57:0/3421806918 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2367888745 0 0) 0x7fa27c003530 con 0x7fa290155960 2024-04-24T23:38:54.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa2950b0640 1 -- 172.21.15.57:0/3421806918 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2900be620 msgr2=0x7fa290155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:54.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa2950b0640 1 --2- 172.21.15.57:0/3421806918 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2900be620 0x7fa290155420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:54.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa2950b0640 1 -- 172.21.15.57:0/3421806918 >> v1:172.21.15.88:6789/0 conn(0x7fa2900bf090 legacy=0x7fa2900bdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:54.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa2950b0640 1 -- 172.21.15.57:0/3421806918 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa29006f180 con 0x7fa290155960 2024-04-24T23:38:54.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa2950b0640 1 -- 172.21.15.57:0/3421806918 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7fa288001a00 con 0x7fa290155960 2024-04-24T23:38:54.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa2950b0640 1 -- 172.21.15.57:0/3421806918 >> v1:172.21.15.57:6789/0 conn(0x7fa290155960 legacy=0x7fa29015f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:54.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa2950b0640 1 --2- 172.21.15.57:0/3421806918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa27c003b80 0x7fa27c003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:54.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa2950b0640 1 --2- 172.21.15.57:0/3421806918 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa27c004810 0x7fa27c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:54.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa2950b0640 1 --2- 172.21.15.57:0/3421806918 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2900be620 0x7fa27c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:54.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa2950b0640 1 -- 172.21.15.57:0/3421806918 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa29006f460 con 0x7fa27c003b80 2024-04-24T23:38:54.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa2950b0640 1 -- 172.21.15.57:0/3421806918 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa27c00ba80 con 0x7fa27c004810 2024-04-24T23:38:54.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa2950b0640 1 -- 172.21.15.57:0/3421806918 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fa27c00bc80 con 0x7fa2900be620 2024-04-24T23:38:54.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa2960b2640 1 --2- 172.21.15.57:0/3421806918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa27c003b80 0x7fa27c003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:54.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa2958b1640 1 --2- 172.21.15.57:0/3421806918 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa27c004810 0x7fa27c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:54.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa2968b3640 1 --2- 172.21.15.57:0/3421806918 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2900be620 0x7fa27c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:54.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa2960b2640 1 -- 172.21.15.57:0/3421806918 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2900be620 msgr2=0x7fa27c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:54.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa2960b2640 1 --2- 172.21.15.57:0/3421806918 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2900be620 0x7fa27c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:54.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa2960b2640 1 -- 172.21.15.57:0/3421806918 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa27c004810 msgr2=0x7fa27c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:54.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa2960b2640 1 --2- 172.21.15.57:0/3421806918 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa27c004810 0x7fa27c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:54.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.941+0000 7fa2960b2640 1 -- 172.21.15.57:0/3421806918 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa27c003530 con 0x7fa27c003b80 2024-04-24T23:38:54.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.945+0000 7fa2960b2640 1 --2- 172.21.15.57:0/3421806918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa27c003b80 0x7fa27c003f80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa2800018d0 tx=0x7fa28001c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff262b1d491c66e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:54.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.945+0000 7fa2950b0640 1 -- 172.21.15.57:0/3421806918 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa280001520 con 0x7fa27c003b80 2024-04-24T23:38:54.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.945+0000 7fa2950b0640 1 -- 172.21.15.57:0/3421806918 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2800052f0 con 0x7fa27c003b80 2024-04-24T23:38:54.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.945+0000 7fa2950b0640 1 -- 172.21.15.57:0/3421806918 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa280003840 con 0x7fa27c003b80 2024-04-24T23:38:54.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.945+0000 7fa298316640 1 -- 172.21.15.57:0/3421806918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa27c003b80 msgr2=0x7fa27c003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:54.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.945+0000 7fa298316640 1 --2- 172.21.15.57:0/3421806918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa27c003b80 0x7fa27c003f80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa2800018d0 tx=0x7fa28001c580 comp rx=0 tx=0).stop 2024-04-24T23:38:54.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.945+0000 7fa2968b3640 1 -- 172.21.15.57:0/3421806918 reap_dead start 2024-04-24T23:38:54.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.945+0000 7fa298316640 1 -- 172.21.15.57:0/3421806918 shutdown_connections 2024-04-24T23:38:54.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.945+0000 7fa298316640 1 -- 172.21.15.57:0/3421806918 >> 172.21.15.57:0/3421806918 conn(0x7fa2900bfbc0 msgr2=0x7fa2900bffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:54.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.945+0000 7fa298316640 1 -- 172.21.15.57:0/3421806918 shutdown_connections 2024-04-24T23:38:54.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.945+0000 7fa298316640 1 -- 172.21.15.57:0/3421806918 wait complete. 2024-04-24T23:38:54.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.945+0000 7fa298316640 1 Processor -- start 2024-04-24T23:38:54.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.945+0000 7fa298316640 1 -- start start 2024-04-24T23:38:54.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.949+0000 7fa298316640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa27c003b80 0x7fa290152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:54.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.949+0000 7fa298316640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2901f0d10 0x7fa2900a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:54.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.949+0000 7fa298316640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2901510f0 0x7fa290151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:54.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.949+0000 7fa298316640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa290155d90 con 0x7fa2901f0d10 2024-04-24T23:38:54.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.949+0000 7fa298316640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa29006e9e0 con 0x7fa27c003b80 2024-04-24T23:38:54.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.949+0000 7fa298316640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fa2900bd660 con 0x7fa2901510f0 2024-04-24T23:38:54.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.949+0000 7fa2958b1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2901f0d10 0x7fa2900a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:54.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.949+0000 7fa2958b1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2901f0d10 0x7fa2900a48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36468/0 (socket says 172.21.15.57:36468) 2024-04-24T23:38:54.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.949+0000 7fa2958b1640 1 -- 172.21.15.57:0/3596817114 learned_addr learned my addr 172.21.15.57:0/3596817114 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:54.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.949+0000 7fa2960b2640 1 --2- 172.21.15.57:0/3596817114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa27c003b80 0x7fa290152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:54.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.949+0000 7fa2968b3640 1 --2- 172.21.15.57:0/3596817114 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2901510f0 0x7fa290151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:54.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.949+0000 7fa2958b1640 1 -- 172.21.15.57:0/3596817114 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2901510f0 msgr2=0x7fa290151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:54.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.949+0000 7fa2958b1640 1 --2- 172.21.15.57:0/3596817114 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2901510f0 0x7fa290151fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:54.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.949+0000 7fa2958b1640 1 -- 172.21.15.57:0/3596817114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa27c003b80 msgr2=0x7fa290152a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:54.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.949+0000 7fa2958b1640 1 --2- 172.21.15.57:0/3596817114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa27c003b80 0x7fa290152a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:54.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.949+0000 7fa2958b1640 1 -- 172.21.15.57:0/3596817114 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa290150c10 con 0x7fa2901f0d10 2024-04-24T23:38:54.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.949+0000 7fa2958b1640 1 --2- 172.21.15.57:0/3596817114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2901f0d10 0x7fa2900a48e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa28c011640 tx=0x7fa28c011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:54.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.949+0000 7fa286ffd640 1 -- 172.21.15.57:0/3596817114 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c00f8c0 con 0x7fa2901f0d10 2024-04-24T23:38:54.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.949+0000 7fa286ffd640 1 -- 172.21.15.57:0/3596817114 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa28c00fa60 con 0x7fa2901f0d10 2024-04-24T23:38:54.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.949+0000 7fa298316640 1 -- 172.21.15.57:0/3596817114 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2900a4f50 con 0x7fa2901f0d10 2024-04-24T23:38:54.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.949+0000 7fa286ffd640 1 -- 172.21.15.57:0/3596817114 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c00fe10 con 0x7fa2901f0d10 2024-04-24T23:38:54.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.949+0000 7fa298316640 1 -- 172.21.15.57:0/3596817114 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa290151570 con 0x7fa2901f0d10 2024-04-24T23:38:54.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.949+0000 7fa298316640 1 -- 172.21.15.57:0/3596817114 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2900a6310 con 0x7fa2901f0d10 2024-04-24T23:38:54.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.949+0000 7fa286ffd640 1 -- 172.21.15.57:0/3596817114 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa28c015460 con 0x7fa2901f0d10 2024-04-24T23:38:54.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.949+0000 7fa286ffd640 1 --2- 172.21.15.57:0/3596817114 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa2740678c0 0x7fa274069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:54.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.949+0000 7fa286ffd640 1 -- 172.21.15.57:0/3596817114 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa28c086890 con 0x7fa2901f0d10 2024-04-24T23:38:54.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.949+0000 7fa2960b2640 1 --2- 172.21.15.57:0/3596817114 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa2740678c0 0x7fa274069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:54.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.953+0000 7fa2960b2640 1 --2- 172.21.15.57:0/3596817114 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa2740678c0 0x7fa274069d80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa2800ac000 tx=0x7fa2800a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:54.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:54.957+0000 7fa286ffd640 1 -- 172.21.15.57:0/3596817114 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fa2900a6310 con 0x7fa2901f0d10 2024-04-24T23:38:55.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.117+0000 7fa298316640 1 -- 172.21.15.57:0/3596817114 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa2900a5120 con 0x7fa2901f0d10 2024-04-24T23:38:55.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.121+0000 7fa286ffd640 1 -- 172.21.15.57:0/3596817114 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7fa28c019030 con 0x7fa2901f0d10 2024-04-24T23:38:55.121 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:38:55.121 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":24,"fsid":"1ea31698-444a-4667-bcd9-b2608ad103c3","created":"2024-04-24T23:38:16.748774+0000","modified":"2024-04-24T23:38:38.604475+0000","last_up_change":"2024-04-24T23:38:26.956537+0000","last_in_change":"2024-04-24T23:38:18.972175+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:38:27.611782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:38:31.718061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:38:32.469413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:38:36.215724+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"35ce67bc-9b25-416e-ab1e-774c717631f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6825","nonce":671364028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6827","nonce":671364028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6831","nonce":671364028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6829","nonce":671364028}]},"public_addr":"172.21.15.57:6825/671364028","cluster_addr":"172.21.15.57:6827/671364028","heartbeat_back_addr":"172.21.15.57:6831/671364028","heartbeat_front_addr":"172.21.15.57:6829/671364028","state":["exists","up"]},{"osd":1,"uuid":"38f6f4ef-3bc2-4453-9946-7d1d17e735ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6801","nonce":2653552037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6803","nonce":2653552037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6807","nonce":2653552037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6805","nonce":2653552037}]},"public_addr":"172.21.15.57:6801/2653552037","cluster_addr":"172.21.15.57:6803/2653552037","heartbeat_back_addr":"172.21.15.57:6807/2653552037","heartbeat_front_addr":"172.21.15.57:6805/2653552037","state":["exists","up"]},{"osd":2,"uuid":"d77a0a49-b39a-464e-a1c9-49e19280c440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6816","nonce":1565874109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6819","nonce":1565874109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6823","nonce":1565874109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6821","nonce":1565874109}]},"public_addr":"172.21.15.57:6816/1565874109","cluster_addr":"172.21.15.57:6819/1565874109","heartbeat_back_addr":"172.21.15.57:6823/1565874109","heartbeat_front_addr":"172.21.15.57:6821/1565874109","state":["exists","up"]},{"osd":3,"uuid":"f8ea9bfe-d839-44a6-a185-0f0985da314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6809","nonce":3474703186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6811","nonce":3474703186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6817","nonce":3474703186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6813","nonce":3474703186}]},"public_addr":"172.21.15.57:6809/3474703186","cluster_addr":"172.21.15.57:6811/3474703186","heartbeat_back_addr":"172.21.15.57:6817/3474703186","heartbeat_front_addr":"172.21.15.57:6813/3474703186","state":["exists","up"]},{"osd":4,"uuid":"454647d4-6ac2-46b4-8451-320eb951a87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6801","nonce":1271707713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6803","nonce":1271707713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6807","nonce":1271707713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6805","nonce":1271707713}]},"public_addr":"172.21.15.88:6801/1271707713","cluster_addr":"172.21.15.88:6803/1271707713","heartbeat_back_addr":"172.21.15.88:6807/1271707713","heartbeat_front_addr":"172.21.15.88:6805/1271707713","state":["exists","up"]},{"osd":5,"uuid":"f71c03a3-7ad8-46d3-89c9-d61de102586b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6809","nonce":2035054888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6813","nonce":2035054888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6820","nonce":2035054888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6816","nonce":2035054888}]},"public_addr":"172.21.15.88:6809/2035054888","cluster_addr":"172.21.15.88:6813/2035054888","heartbeat_back_addr":"172.21.15.88:6820/2035054888","heartbeat_front_addr":"172.21.15.88:6816/2035054888","state":["exists","up"]},{"osd":6,"uuid":"ec7ae2b7-9cb4-4059-8f98-0022c9763f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6825","nonce":1752291242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6827","nonce":1752291242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6831","nonce":1752291242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6829","nonce":1752291242}]},"public_addr":"172.21.15.88:6825/1752291242","cluster_addr":"172.21.15.88:6827/1752291242","heartbeat_back_addr":"172.21.15.88:6831/1752291242","heartbeat_front_addr":"172.21.15.88:6829/1752291242","state":["exists","up"]},{"osd":7,"uuid":"c0ee7505-60c1-40ba-9902-47313a04dafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6812","nonce":1782800372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6817","nonce":1782800372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6823","nonce":1782800372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6821","nonce":1782800372}]},"public_addr":"172.21.15.88:6812/1782800372","cluster_addr":"172.21.15.88:6817/1782800372","heartbeat_back_addr":"172.21.15.88:6823/1782800372","heartbeat_front_addr":"172.21.15.88:6821/1782800372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.698562+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.682587+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.680197+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.561753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.011095+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.493320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.353451+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.423877+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:38:55.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.121+0000 7fa298316640 1 -- 172.21.15.57:0/3596817114 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa2740678c0 msgr2=0x7fa274069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:55.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.121+0000 7fa298316640 1 --2- 172.21.15.57:0/3596817114 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa2740678c0 0x7fa274069d80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa2800ac000 tx=0x7fa2800a6000 comp rx=0 tx=0).stop 2024-04-24T23:38:55.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.121+0000 7fa298316640 1 -- 172.21.15.57:0/3596817114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2901f0d10 msgr2=0x7fa2900a48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:55.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.121+0000 7fa298316640 1 --2- 172.21.15.57:0/3596817114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2901f0d10 0x7fa2900a48e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa28c011640 tx=0x7fa28c011b00 comp rx=0 tx=0).stop 2024-04-24T23:38:55.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.121+0000 7fa298316640 1 -- 172.21.15.57:0/3596817114 shutdown_connections 2024-04-24T23:38:55.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.121+0000 7fa298316640 1 --2- 172.21.15.57:0/3596817114 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa2740678c0 0x7fa274069d80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:55.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.121+0000 7fa298316640 1 --2- 172.21.15.57:0/3596817114 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2901510f0 0x7fa290151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:55.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.121+0000 7fa298316640 1 --2- 172.21.15.57:0/3596817114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2901f0d10 0x7fa2900a48e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:55.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.121+0000 7fa298316640 1 --2- 172.21.15.57:0/3596817114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa27c003b80 0x7fa290152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:55.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.121+0000 7fa298316640 1 -- 172.21.15.57:0/3596817114 >> 172.21.15.57:0/3596817114 conn(0x7fa2900bfbc0 msgr2=0x7fa29006b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:55.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.121+0000 7fa298316640 1 -- 172.21.15.57:0/3596817114 shutdown_connections 2024-04-24T23:38:55.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.121+0000 7fa298316640 1 -- 172.21.15.57:0/3596817114 wait complete. 2024-04-24T23:38:55.139 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:38:55.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.253+0000 7f8aaf7d4640 1 Processor -- start 2024-04-24T23:38:55.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.253+0000 7f8aaf7d4640 1 -- start start 2024-04-24T23:38:55.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.253+0000 7f8aaf7d4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8aa80bdbe0 0x7f8aa80b6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:55.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.253+0000 7f8aaf7d4640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8aa80b7510 0x7f8aa8159050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:55.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.253+0000 7f8aaf7d4640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8aa814e8e0 con 0x7f8aa814bc60 2024-04-24T23:38:55.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.253+0000 7f8aaf7d4640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f8aa8152c20 con 0x7f8aa80bdbe0 2024-04-24T23:38:55.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.253+0000 7f8aaf7d4640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f8aa814ebc0 con 0x7f8aa80b7510 2024-04-24T23:38:55.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.253+0000 7f8aadd71640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8aa80b7510 0x7f8aa8159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:55.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.253+0000 7f8aacd6f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8aa80bdbe0 0x7f8aa80b6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:55.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.253+0000 7f8aadd71640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8aa80b7510 0x7f8aa8159050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.57:53274/0 (socket says 172.21.15.57:53274) 2024-04-24T23:38:55.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.253+0000 7f8aadd71640 1 -- 172.21.15.57:0/2112951106 learned_addr learned my addr 172.21.15.57:0/2112951106 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:55.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.253+0000 7f8aad570640 1 --1- 172.21.15.57:0/2112951106 >> v1:172.21.15.88:6789/0 conn(0x7f8aa814bc60 0x7f8aa806eb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.57:47388/0 (socket says 172.21.15.57:47388) 2024-04-24T23:38:55.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.253+0000 7f8aadd71640 1 -- 172.21.15.57:0/2112951106 >> v2:172.21.15.88:3300/0 conn(0x7f8aa80bdbe0 msgr2=0x7f8aa80b6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:55.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.253+0000 7f8aadd71640 1 --2- 172.21.15.57:0/2112951106 >> v2:172.21.15.88:3300/0 conn(0x7f8aa80bdbe0 0x7f8aa80b6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:55.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.253+0000 7f8aadd71640 1 -- 172.21.15.57:0/2112951106 >> v1:172.21.15.88:6789/0 conn(0x7f8aa814bc60 legacy=0x7f8aa806eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:55.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.253+0000 7f8aadd71640 1 -- 172.21.15.57:0/2112951106 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aa806f260 con 0x7f8aa80b7510 2024-04-24T23:38:55.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.253+0000 7f8aacd6f640 1 --2- 172.21.15.57:0/2112951106 >> v2:172.21.15.88:3300/0 conn(0x7f8aa80bdbe0 0x7f8aa80b6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:38:55.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.257+0000 7f8aadd71640 1 --2- 172.21.15.57:0/2112951106 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8aa80b7510 0x7f8aa8159050 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0009e50 tx=0x7f8aa001ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61269a9cd64872a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:55.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.257+0000 7f8a9bfff640 1 -- 172.21.15.57:0/2112951106 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa00a5700 con 0x7f8aa80b7510 2024-04-24T23:38:55.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.257+0000 7f8a9bfff640 1 -- 172.21.15.57:0/2112951106 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa00a58a0 con 0x7f8aa80b7510 2024-04-24T23:38:55.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.257+0000 7f8a9bfff640 1 -- 172.21.15.57:0/2112951106 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa00a5c70 con 0x7f8aa80b7510 2024-04-24T23:38:55.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.257+0000 7f8aaf7d4640 1 -- 172.21.15.57:0/2112951106 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8aa80b7510 msgr2=0x7f8aa8159050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:55.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.257+0000 7f8aaf7d4640 1 --2- 172.21.15.57:0/2112951106 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8aa80b7510 0x7f8aa8159050 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0009e50 tx=0x7f8aa001ca30 comp rx=0 tx=0).stop 2024-04-24T23:38:55.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.257+0000 7f8aaf7d4640 1 -- 172.21.15.57:0/2112951106 shutdown_connections 2024-04-24T23:38:55.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.257+0000 7f8aaf7d4640 1 --2- 172.21.15.57:0/2112951106 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8aa80b7510 0x7f8aa8159050 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:55.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.257+0000 7f8aaf7d4640 1 --2- 172.21.15.57:0/2112951106 >> v2:172.21.15.88:3300/0 conn(0x7f8aa80bdbe0 0x7f8aa80b6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:55.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.257+0000 7f8aaf7d4640 1 -- 172.21.15.57:0/2112951106 >> 172.21.15.57:0/2112951106 conn(0x7f8aa80beab0 msgr2=0x7f8aa80beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:55.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.257+0000 7f8aaf7d4640 1 -- 172.21.15.57:0/2112951106 shutdown_connections 2024-04-24T23:38:55.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.257+0000 7f8aaf7d4640 1 -- 172.21.15.57:0/2112951106 wait complete. 2024-04-24T23:38:55.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.257+0000 7f8aaf7d4640 1 Processor -- start 2024-04-24T23:38:55.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.257+0000 7f8aaf7d4640 1 -- start start 2024-04-24T23:38:55.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.257+0000 7f8aaf7d4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8aa80b7510 0x7f8aa814fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:55.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.257+0000 7f8aaf7d4640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8aa80bdbe0 0x7f8aa81489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:55.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.261+0000 7f8aaf7d4640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8aa814bc60 0x7f8aa80bb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:55.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.261+0000 7f8aaf7d4640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa8071230 con 0x7f8aa80bdbe0 2024-04-24T23:38:55.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.261+0000 7f8aaf7d4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa80710b0 con 0x7f8aa80b7510 2024-04-24T23:38:55.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.261+0000 7f8aaf7d4640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f8aa80713b0 con 0x7f8aa814bc60 2024-04-24T23:38:55.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.261+0000 7f8aacd6f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8aa80bdbe0 0x7f8aa81489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:55.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.261+0000 7f8aacd6f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8aa80bdbe0 0x7f8aa81489b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36480/0 (socket says 172.21.15.57:36480) 2024-04-24T23:38:55.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.261+0000 7f8aacd6f640 1 -- 172.21.15.57:0/3586658305 learned_addr learned my addr 172.21.15.57:0/3586658305 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:55.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.261+0000 7f8aad570640 1 --2- 172.21.15.57:0/3586658305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8aa80b7510 0x7f8aa814fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:55.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.261+0000 7f8aadd71640 1 --2- 172.21.15.57:0/3586658305 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8aa814bc60 0x7f8aa80bb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:55.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.261+0000 7f8aacd6f640 1 -- 172.21.15.57:0/3586658305 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8aa814bc60 msgr2=0x7f8aa80bb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:55.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.261+0000 7f8aacd6f640 1 --2- 172.21.15.57:0/3586658305 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8aa814bc60 0x7f8aa80bb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:55.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.261+0000 7f8aacd6f640 1 -- 172.21.15.57:0/3586658305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8aa80b7510 msgr2=0x7f8aa814fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:55.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.261+0000 7f8aacd6f640 1 --2- 172.21.15.57:0/3586658305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8aa80b7510 0x7f8aa814fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:55.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.261+0000 7f8aacd6f640 1 -- 172.21.15.57:0/3586658305 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aa8148ef0 con 0x7f8aa80bdbe0 2024-04-24T23:38:55.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.261+0000 7f8aacd6f640 1 --2- 172.21.15.57:0/3586658305 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8aa80bdbe0 0x7f8aa81489b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00ec10 tx=0x7f8a9c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:55.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.261+0000 7f8a99ffb640 1 -- 172.21.15.57:0/3586658305 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c017070 con 0x7f8aa80bdbe0 2024-04-24T23:38:55.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.261+0000 7f8a99ffb640 1 -- 172.21.15.57:0/3586658305 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a9c00cc30 con 0x7f8aa80bdbe0 2024-04-24T23:38:55.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.261+0000 7f8aaf7d4640 1 -- 172.21.15.57:0/3586658305 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aa80bac20 con 0x7f8aa80bdbe0 2024-04-24T23:38:55.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.261+0000 7f8a99ffb640 1 -- 172.21.15.57:0/3586658305 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c013470 con 0x7f8aa80bdbe0 2024-04-24T23:38:55.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.261+0000 7f8aaf7d4640 1 -- 172.21.15.57:0/3586658305 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aa8147030 con 0x7f8aa80bdbe0 2024-04-24T23:38:55.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.261+0000 7f8aaf7d4640 1 -- 172.21.15.57:0/3586658305 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8aa8068220 con 0x7f8aa80bdbe0 2024-04-24T23:38:55.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.261+0000 7f8a99ffb640 1 -- 172.21.15.57:0/3586658305 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8a9c01a070 con 0x7f8aa80bdbe0 2024-04-24T23:38:55.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.261+0000 7f8a99ffb640 1 --2- 172.21.15.57:0/3586658305 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f8a8c0678c0 0x7f8a8c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:55.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.261+0000 7f8a99ffb640 1 -- 172.21.15.57:0/3586658305 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8a9c086780 con 0x7f8aa80bdbe0 2024-04-24T23:38:55.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.261+0000 7f8aad570640 1 --2- 172.21.15.57:0/3586658305 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f8a8c0678c0 0x7f8a8c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:55.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.265+0000 7f8aad570640 1 --2- 172.21.15.57:0/3586658305 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f8a8c0678c0 0x7f8a8c069d80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4000f70 tx=0x7f8aa4007cf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:55.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.265+0000 7f8a99ffb640 1 -- 172.21.15.57:0/3586658305 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f8aa8148ef0 con 0x7f8aa80bdbe0 2024-04-24T23:38:55.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.421+0000 7f8aaf7d4640 1 -- 172.21.15.57:0/3586658305 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8aa80bd9c0 con 0x7f8aa80bdbe0 2024-04-24T23:38:55.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.425+0000 7f8a99ffb640 1 -- 172.21.15.57:0/3586658305 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7f8a9c056f60 con 0x7f8aa80bdbe0 2024-04-24T23:38:55.425 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:38:55.425 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":24,"fsid":"1ea31698-444a-4667-bcd9-b2608ad103c3","created":"2024-04-24T23:38:16.748774+0000","modified":"2024-04-24T23:38:38.604475+0000","last_up_change":"2024-04-24T23:38:26.956537+0000","last_in_change":"2024-04-24T23:38:18.972175+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:38:27.611782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:38:31.718061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:38:32.469413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:38:36.215724+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"35ce67bc-9b25-416e-ab1e-774c717631f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6825","nonce":671364028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6827","nonce":671364028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6831","nonce":671364028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6829","nonce":671364028}]},"public_addr":"172.21.15.57:6825/671364028","cluster_addr":"172.21.15.57:6827/671364028","heartbeat_back_addr":"172.21.15.57:6831/671364028","heartbeat_front_addr":"172.21.15.57:6829/671364028","state":["exists","up"]},{"osd":1,"uuid":"38f6f4ef-3bc2-4453-9946-7d1d17e735ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6801","nonce":2653552037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6803","nonce":2653552037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6807","nonce":2653552037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6805","nonce":2653552037}]},"public_addr":"172.21.15.57:6801/2653552037","cluster_addr":"172.21.15.57:6803/2653552037","heartbeat_back_addr":"172.21.15.57:6807/2653552037","heartbeat_front_addr":"172.21.15.57:6805/2653552037","state":["exists","up"]},{"osd":2,"uuid":"d77a0a49-b39a-464e-a1c9-49e19280c440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6816","nonce":1565874109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6819","nonce":1565874109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6823","nonce":1565874109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6821","nonce":1565874109}]},"public_addr":"172.21.15.57:6816/1565874109","cluster_addr":"172.21.15.57:6819/1565874109","heartbeat_back_addr":"172.21.15.57:6823/1565874109","heartbeat_front_addr":"172.21.15.57:6821/1565874109","state":["exists","up"]},{"osd":3,"uuid":"f8ea9bfe-d839-44a6-a185-0f0985da314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6809","nonce":3474703186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6811","nonce":3474703186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6817","nonce":3474703186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6813","nonce":3474703186}]},"public_addr":"172.21.15.57:6809/3474703186","cluster_addr":"172.21.15.57:6811/3474703186","heartbeat_back_addr":"172.21.15.57:6817/3474703186","heartbeat_front_addr":"172.21.15.57:6813/3474703186","state":["exists","up"]},{"osd":4,"uuid":"454647d4-6ac2-46b4-8451-320eb951a87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6801","nonce":1271707713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6803","nonce":1271707713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6807","nonce":1271707713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6805","nonce":1271707713}]},"public_addr":"172.21.15.88:6801/1271707713","cluster_addr":"172.21.15.88:6803/1271707713","heartbeat_back_addr":"172.21.15.88:6807/1271707713","heartbeat_front_addr":"172.21.15.88:6805/1271707713","state":["exists","up"]},{"osd":5,"uuid":"f71c03a3-7ad8-46d3-89c9-d61de102586b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6809","nonce":2035054888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6813","nonce":2035054888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6820","nonce":2035054888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6816","nonce":2035054888}]},"public_addr":"172.21.15.88:6809/2035054888","cluster_addr":"172.21.15.88:6813/2035054888","heartbeat_back_addr":"172.21.15.88:6820/2035054888","heartbeat_front_addr":"172.21.15.88:6816/2035054888","state":["exists","up"]},{"osd":6,"uuid":"ec7ae2b7-9cb4-4059-8f98-0022c9763f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6825","nonce":1752291242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6827","nonce":1752291242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6831","nonce":1752291242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6829","nonce":1752291242}]},"public_addr":"172.21.15.88:6825/1752291242","cluster_addr":"172.21.15.88:6827/1752291242","heartbeat_back_addr":"172.21.15.88:6831/1752291242","heartbeat_front_addr":"172.21.15.88:6829/1752291242","state":["exists","up"]},{"osd":7,"uuid":"c0ee7505-60c1-40ba-9902-47313a04dafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6812","nonce":1782800372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6817","nonce":1782800372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6823","nonce":1782800372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6821","nonce":1782800372}]},"public_addr":"172.21.15.88:6812/1782800372","cluster_addr":"172.21.15.88:6817/1782800372","heartbeat_back_addr":"172.21.15.88:6823/1782800372","heartbeat_front_addr":"172.21.15.88:6821/1782800372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.698562+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.682587+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.680197+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.561753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.011095+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.493320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.353451+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.423877+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:38:55.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.425+0000 7f8aaf7d4640 1 -- 172.21.15.57:0/3586658305 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f8a8c0678c0 msgr2=0x7f8a8c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:55.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.425+0000 7f8aaf7d4640 1 --2- 172.21.15.57:0/3586658305 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f8a8c0678c0 0x7f8a8c069d80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4000f70 tx=0x7f8aa4007cf0 comp rx=0 tx=0).stop 2024-04-24T23:38:55.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.425+0000 7f8aaf7d4640 1 -- 172.21.15.57:0/3586658305 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8aa80bdbe0 msgr2=0x7f8aa81489b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:55.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.425+0000 7f8aaf7d4640 1 --2- 172.21.15.57:0/3586658305 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8aa80bdbe0 0x7f8aa81489b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00ec10 tx=0x7f8a9c00c520 comp rx=0 tx=0).stop 2024-04-24T23:38:55.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.425+0000 7f8aaf7d4640 1 -- 172.21.15.57:0/3586658305 shutdown_connections 2024-04-24T23:38:55.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.425+0000 7f8aaf7d4640 1 --2- 172.21.15.57:0/3586658305 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f8a8c0678c0 0x7f8a8c069d80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:55.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.425+0000 7f8aaf7d4640 1 --2- 172.21.15.57:0/3586658305 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8aa814bc60 0x7f8aa80bb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:55.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.425+0000 7f8aaf7d4640 1 --2- 172.21.15.57:0/3586658305 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8aa80bdbe0 0x7f8aa81489b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:55.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.425+0000 7f8aaf7d4640 1 --2- 172.21.15.57:0/3586658305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8aa80b7510 0x7f8aa814fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:55.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.425+0000 7f8aaf7d4640 1 -- 172.21.15.57:0/3586658305 >> 172.21.15.57:0/3586658305 conn(0x7f8aa80beab0 msgr2=0x7f8aa806db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:55.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.425+0000 7f8aaf7d4640 1 -- 172.21.15.57:0/3586658305 shutdown_connections 2024-04-24T23:38:55.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.425+0000 7f8aaf7d4640 1 -- 172.21.15.57:0/3586658305 wait complete. 2024-04-24T23:38:55.443 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-24T23:38:55.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.557+0000 7f0465270640 1 Processor -- start 2024-04-24T23:38:55.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.557+0000 7f0465270640 1 -- start start 2024-04-24T23:38:55.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.557+0000 7f0465270640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f04600bc3f0 0x7f046014a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:55.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.557+0000 7f0465270640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f046014ade0 0x7f046014dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:55.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.557+0000 7f0465270640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04600be040 con 0x7f046006ea40 2024-04-24T23:38:55.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.557+0000 7f0465270640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f046014d640 con 0x7f04600bc3f0 2024-04-24T23:38:55.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.557+0000 7f0465270640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f04600be320 con 0x7f046014ade0 2024-04-24T23:38:55.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.557+0000 7f045e7fc640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f04600bc3f0 0x7f046014a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:55.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.557+0000 7f045e7fc640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f04600bc3f0 0x7f046014a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36490/0 (socket says 172.21.15.57:36490) 2024-04-24T23:38:55.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.557+0000 7f045e7fc640 1 -- 172.21.15.57:0/4248838496 learned_addr learned my addr 172.21.15.57:0/4248838496 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:55.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.557+0000 7f045f7fe640 1 --2- 172.21.15.57:0/4248838496 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f046014ade0 0x7f046014dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:55.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.557+0000 7f045e7fc640 1 -- 172.21.15.57:0/4248838496 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f046014ade0 msgr2=0x7f046014dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:55.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.557+0000 7f045e7fc640 1 --2- 172.21.15.57:0/4248838496 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f046014ade0 0x7f046014dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:55.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.557+0000 7f045e7fc640 1 -- 172.21.15.57:0/4248838496 >> v1:172.21.15.88:6789/0 conn(0x7f046006ea40 legacy=0x7f04601514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:55.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.557+0000 7f045e7fc640 1 -- 172.21.15.57:0/4248838496 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04600be600 con 0x7f04600bc3f0 2024-04-24T23:38:55.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f045e7fc640 1 --2- 172.21.15.57:0/4248838496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04600bc3f0 0x7f046014a8a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f045400bb10 tx=0x7f045401ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a93558bc35d69519 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:55.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f045dffb640 1 -- 172.21.15.57:0/4248838496 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04540b4070 con 0x7f04600bc3f0 2024-04-24T23:38:55.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f045dffb640 1 -- 172.21.15.57:0/4248838496 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04540a7b10 con 0x7f04600bc3f0 2024-04-24T23:38:55.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f045dffb640 1 -- 172.21.15.57:0/4248838496 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04540af440 con 0x7f04600bc3f0 2024-04-24T23:38:55.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f0465270640 1 -- 172.21.15.57:0/4248838496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04600bc3f0 msgr2=0x7f046014a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:55.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f0465270640 1 --2- 172.21.15.57:0/4248838496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04600bc3f0 0x7f046014a8a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f045400bb10 tx=0x7f045401ec30 comp rx=0 tx=0).stop 2024-04-24T23:38:55.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f0465270640 1 -- 172.21.15.57:0/4248838496 shutdown_connections 2024-04-24T23:38:55.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f0465270640 1 --2- 172.21.15.57:0/4248838496 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f046014ade0 0x7f046014dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:55.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f0465270640 1 --2- 172.21.15.57:0/4248838496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04600bc3f0 0x7f046014a8a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:55.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f0465270640 1 -- 172.21.15.57:0/4248838496 >> 172.21.15.57:0/4248838496 conn(0x7f046006b920 msgr2=0x7f04600c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:55.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f0465270640 1 -- 172.21.15.57:0/4248838496 shutdown_connections 2024-04-24T23:38:55.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f0465270640 1 -- 172.21.15.57:0/4248838496 wait complete. 2024-04-24T23:38:55.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f0465270640 1 Processor -- start 2024-04-24T23:38:55.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f0465270640 1 -- start start 2024-04-24T23:38:55.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f0465270640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f046006ea40 0x7f04600726f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:55.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f0465270640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04600bc3f0 0x7f04601e4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:55.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f0465270640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f046014ade0 0x7f04601e5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:55.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f0465270640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f046006e060 con 0x7f046006ea40 2024-04-24T23:38:55.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f0465270640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f046006dee0 con 0x7f04600bc3f0 2024-04-24T23:38:55.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f0465270640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f046006e1e0 con 0x7f046014ade0 2024-04-24T23:38:55.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f045effd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f046006ea40 0x7f04600726f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:55.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f045effd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f046006ea40 0x7f04600726f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36492/0 (socket says 172.21.15.57:36492) 2024-04-24T23:38:55.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f045effd640 1 -- 172.21.15.57:0/3607553097 learned_addr learned my addr 172.21.15.57:0/3607553097 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:55.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f045e7fc640 1 --2- 172.21.15.57:0/3607553097 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04600bc3f0 0x7f04601e4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:55.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f045effd640 1 -- 172.21.15.57:0/3607553097 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f046014ade0 msgr2=0x7f04601e5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:55.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f045effd640 1 --2- 172.21.15.57:0/3607553097 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f046014ade0 0x7f04601e5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:55.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f045effd640 1 -- 172.21.15.57:0/3607553097 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04600bc3f0 msgr2=0x7f04601e4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:55.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f045effd640 1 --2- 172.21.15.57:0/3607553097 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04600bc3f0 0x7f04601e4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:55.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f045effd640 1 -- 172.21.15.57:0/3607553097 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0460072c30 con 0x7f046006ea40 2024-04-24T23:38:55.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f045e7fc640 1 --2- 172.21.15.57:0/3607553097 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04600bc3f0 0x7f04601e4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:38:55.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.561+0000 7f045effd640 1 --2- 172.21.15.57:0/3607553097 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f046006ea40 0x7f04600726f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f045000c420 tx=0x7f045000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:55.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.565+0000 7f04477fe640 1 -- 172.21.15.57:0/3607553097 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04500052d0 con 0x7f046006ea40 2024-04-24T23:38:55.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.565+0000 7f04477fe640 1 -- 172.21.15.57:0/3607553097 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0450005470 con 0x7f046006ea40 2024-04-24T23:38:55.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.565+0000 7f0465270640 1 -- 172.21.15.57:0/3607553097 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04600c1cd0 con 0x7f046006ea40 2024-04-24T23:38:55.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.565+0000 7f04477fe640 1 -- 172.21.15.57:0/3607553097 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0450007260 con 0x7f046006ea40 2024-04-24T23:38:55.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.565+0000 7f0465270640 1 -- 172.21.15.57:0/3607553097 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0460144d10 con 0x7f046006ea40 2024-04-24T23:38:55.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.565+0000 7f0465270640 1 -- 172.21.15.57:0/3607553097 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0460068290 con 0x7f046006ea40 2024-04-24T23:38:55.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.565+0000 7f04477fe640 1 -- 172.21.15.57:0/3607553097 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0450007400 con 0x7f046006ea40 2024-04-24T23:38:55.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.565+0000 7f04477fe640 1 --2- 172.21.15.57:0/3607553097 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f044c0678c0 0x7f044c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:55.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.565+0000 7f04477fe640 1 -- 172.21.15.57:0/3607553097 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0450085490 con 0x7f046006ea40 2024-04-24T23:38:55.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.565+0000 7f045e7fc640 1 --2- 172.21.15.57:0/3607553097 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f044c0678c0 0x7f044c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:55.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.565+0000 7f045e7fc640 1 --2- 172.21.15.57:0/3607553097 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f044c0678c0 0x7f044c069d80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f04540b1000 tx=0x7f04540a9070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:55.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.569+0000 7f04477fe640 1 -- 172.21.15.57:0/3607553097 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f0460072c30 con 0x7f046006ea40 2024-04-24T23:38:55.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:55.765+0000 7f0465270640 1 -- 172.21.15.57:0/3607553097 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f0460146c30 con 0x7f046006ea40 2024-04-24T23:38:56.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.669+0000 7f04477fe640 1 -- 172.21.15.57:0/3607553097 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7f0450055c80 con 0x7f046006ea40 2024-04-24T23:38:56.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.673+0000 7f0465270640 1 -- 172.21.15.57:0/3607553097 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f044c0678c0 msgr2=0x7f044c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:56.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.673+0000 7f0465270640 1 --2- 172.21.15.57:0/3607553097 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f044c0678c0 0x7f044c069d80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f04540b1000 tx=0x7f04540a9070 comp rx=0 tx=0).stop 2024-04-24T23:38:56.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.673+0000 7f0465270640 1 -- 172.21.15.57:0/3607553097 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f046006ea40 msgr2=0x7f04600726f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:56.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.673+0000 7f0465270640 1 --2- 172.21.15.57:0/3607553097 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f046006ea40 0x7f04600726f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f045000c420 tx=0x7f045000c8e0 comp rx=0 tx=0).stop 2024-04-24T23:38:56.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.673+0000 7f0465270640 1 -- 172.21.15.57:0/3607553097 shutdown_connections 2024-04-24T23:38:56.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.673+0000 7f0465270640 1 --2- 172.21.15.57:0/3607553097 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f044c0678c0 0x7f044c069d80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:56.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.673+0000 7f0465270640 1 --2- 172.21.15.57:0/3607553097 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f046014ade0 0x7f04601e5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:56.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.673+0000 7f0465270640 1 --2- 172.21.15.57:0/3607553097 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04600bc3f0 0x7f04601e4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:56.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.673+0000 7f0465270640 1 --2- 172.21.15.57:0/3607553097 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f046006ea40 0x7f04600726f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:56.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.673+0000 7f0465270640 1 -- 172.21.15.57:0/3607553097 >> 172.21.15.57:0/3607553097 conn(0x7f046006b920 msgr2=0x7f04600a6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:56.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.673+0000 7f0465270640 1 -- 172.21.15.57:0/3607553097 shutdown_connections 2024-04-24T23:38:56.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.673+0000 7f0465270640 1 -- 172.21.15.57:0/3607553097 wait complete. 2024-04-24T23:38:56.698 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-04-24T23:38:56.699 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-24T23:38:56.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.833+0000 7fc68c830640 1 Processor -- start 2024-04-24T23:38:56.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.833+0000 7fc68c830640 1 -- start start 2024-04-24T23:38:56.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.833+0000 7fc68c830640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6880c2cf0 0x7fc6880c1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:56.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.833+0000 7fc68c830640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6881506c0 con 0x7fc68814d9c0 2024-04-24T23:38:56.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.833+0000 7fc68c830640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc688150980 con 0x7fc6880b86b0 2024-04-24T23:38:56.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.833+0000 7fc68c830640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fc6881522c0 con 0x7fc6880c2cf0 2024-04-24T23:38:56.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.833+0000 7fc686d9d640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc68814d9c0 0x7fc68815b040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43420/0 (socket says 172.21.15.57:43420) 2024-04-24T23:38:56.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.833+0000 7fc686d9d640 1 -- 172.21.15.57:0/25307064 learned_addr learned my addr 172.21.15.57:0/25307064 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:38:56.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.833+0000 7fc68659c640 1 --2- 172.21.15.57:0/25307064 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6880c2cf0 0x7fc6880c1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:56.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.833+0000 7fc685d9b640 1 -- 172.21.15.57:0/25307064 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3522073391 0 0) 0x7fc6881506c0 con 0x7fc68814d9c0 2024-04-24T23:38:56.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.833+0000 7fc685d9b640 1 -- 172.21.15.57:0/25307064 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc674003530 con 0x7fc68814d9c0 2024-04-24T23:38:56.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.833+0000 7fc685d9b640 1 -- 172.21.15.57:0/25307064 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2804953973 0 0) 0x7fc674003530 con 0x7fc68814d9c0 2024-04-24T23:38:56.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.833+0000 7fc685d9b640 1 -- 172.21.15.57:0/25307064 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6880c2cf0 msgr2=0x7fc6880c1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:56.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.833+0000 7fc685d9b640 1 --2- 172.21.15.57:0/25307064 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6880c2cf0 0x7fc6880c1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:56.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.833+0000 7fc685d9b640 1 -- 172.21.15.57:0/25307064 >> v1:172.21.15.88:6789/0 conn(0x7fc6880b86b0 legacy=0x7fc688151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:56.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.833+0000 7fc685d9b640 1 -- 172.21.15.57:0/25307064 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6880c0b60 con 0x7fc68814d9c0 2024-04-24T23:38:56.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.833+0000 7fc685d9b640 1 -- 172.21.15.57:0/25307064 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7fc680001a00 con 0x7fc68814d9c0 2024-04-24T23:38:56.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.833+0000 7fc685d9b640 1 -- 172.21.15.57:0/25307064 >> v1:172.21.15.57:6789/0 conn(0x7fc68814d9c0 legacy=0x7fc68815b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:56.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.833+0000 7fc685d9b640 1 --2- 172.21.15.57:0/25307064 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6740039f0 0x7fc674003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:56.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.833+0000 7fc685d9b640 1 --2- 172.21.15.57:0/25307064 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6880c2cf0 0x7fc674004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:56.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.833+0000 7fc685d9b640 1 --2- 172.21.15.57:0/25307064 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc674004d50 0x7fc6740051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:56.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.833+0000 7fc685d9b640 1 -- 172.21.15.57:0/25307064 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc6881522c0 con 0x7fc6740039f0 2024-04-24T23:38:56.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.833+0000 7fc685d9b640 1 -- 172.21.15.57:0/25307064 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc67400b9d0 con 0x7fc674004d50 2024-04-24T23:38:56.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.833+0000 7fc685d9b640 1 -- 172.21.15.57:0/25307064 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fc67400bbd0 con 0x7fc6880c2cf0 2024-04-24T23:38:56.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.833+0000 7fc68659c640 1 --2- 172.21.15.57:0/25307064 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6740039f0 0x7fc674003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:56.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.833+0000 7fc686d9d640 1 --2- 172.21.15.57:0/25307064 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc674004d50 0x7fc6740051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:56.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.833+0000 7fc67dd9b640 1 --2- 172.21.15.57:0/25307064 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6880c2cf0 0x7fc674004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:56.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.833+0000 7fc68659c640 1 -- 172.21.15.57:0/25307064 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6880c2cf0 msgr2=0x7fc674004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:56.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.833+0000 7fc68659c640 1 --2- 172.21.15.57:0/25307064 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6880c2cf0 0x7fc674004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:56.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.837+0000 7fc68659c640 1 -- 172.21.15.57:0/25307064 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc674004d50 msgr2=0x7fc6740051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:56.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.837+0000 7fc68659c640 1 --2- 172.21.15.57:0/25307064 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc674004d50 0x7fc6740051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:56.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.837+0000 7fc68659c640 1 -- 172.21.15.57:0/25307064 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc674003530 con 0x7fc6740039f0 2024-04-24T23:38:56.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.837+0000 7fc68659c640 1 --2- 172.21.15.57:0/25307064 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6740039f0 0x7fc674003dd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc678009ac0 tx=0x7fc67801c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5998e978a5adca7b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:56.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.837+0000 7fc685d9b640 1 -- 172.21.15.57:0/25307064 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6780b2070 con 0x7fc6740039f0 2024-04-24T23:38:56.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.837+0000 7fc685d9b640 1 -- 172.21.15.57:0/25307064 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6780a5580 con 0x7fc6740039f0 2024-04-24T23:38:56.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.837+0000 7fc685d9b640 1 -- 172.21.15.57:0/25307064 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc678009690 con 0x7fc6740039f0 2024-04-24T23:38:56.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.837+0000 7fc68c830640 1 -- 172.21.15.57:0/25307064 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6740039f0 msgr2=0x7fc674003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:56.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.837+0000 7fc68c830640 1 --2- 172.21.15.57:0/25307064 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6740039f0 0x7fc674003dd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc678009ac0 tx=0x7fc67801c990 comp rx=0 tx=0).stop 2024-04-24T23:38:56.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.837+0000 7fc686d9d640 1 -- 172.21.15.57:0/25307064 reap_dead start 2024-04-24T23:38:56.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.837+0000 7fc68c830640 1 -- 172.21.15.57:0/25307064 shutdown_connections 2024-04-24T23:38:56.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.837+0000 7fc68c830640 1 -- 172.21.15.57:0/25307064 >> 172.21.15.57:0/25307064 conn(0x7fc688066f50 msgr2=0x7fc688067360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:56.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.837+0000 7fc68c830640 1 -- 172.21.15.57:0/25307064 shutdown_connections 2024-04-24T23:38:56.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.837+0000 7fc68c830640 1 -- 172.21.15.57:0/25307064 wait complete. 2024-04-24T23:38:56.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.837+0000 7fc68c830640 1 Processor -- start 2024-04-24T23:38:56.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.841+0000 7fc68c830640 1 -- start start 2024-04-24T23:38:56.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.841+0000 7fc68c830640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6740039f0 0x7fc6881e5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:56.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.841+0000 7fc68c830640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc688148330 0x7fc688154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:56.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.841+0000 7fc68c830640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6881e9560 0x7fc68813d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:56.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.841+0000 7fc68c830640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc6880c30d0 con 0x7fc688148330 2024-04-24T23:38:56.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.841+0000 7fc68c830640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc6880c11b0 con 0x7fc6740039f0 2024-04-24T23:38:56.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.841+0000 7fc68c830640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fc6880c3250 con 0x7fc6881e9560 2024-04-24T23:38:56.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.841+0000 7fc67dd9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc688148330 0x7fc688154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:56.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.841+0000 7fc67dd9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc688148330 0x7fc688154030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36514/0 (socket says 172.21.15.57:36514) 2024-04-24T23:38:56.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.841+0000 7fc67dd9b640 1 -- 172.21.15.57:0/1056400904 learned_addr learned my addr 172.21.15.57:0/1056400904 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:56.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.841+0000 7fc68659c640 1 --2- 172.21.15.57:0/1056400904 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6740039f0 0x7fc6881e5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:56.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.841+0000 7fc686d9d640 1 --2- 172.21.15.57:0/1056400904 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6881e9560 0x7fc68813d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:56.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.841+0000 7fc67dd9b640 1 -- 172.21.15.57:0/1056400904 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6881e9560 msgr2=0x7fc68813d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:56.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.841+0000 7fc67dd9b640 1 --2- 172.21.15.57:0/1056400904 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6881e9560 0x7fc68813d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:56.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.841+0000 7fc67dd9b640 1 -- 172.21.15.57:0/1056400904 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6740039f0 msgr2=0x7fc6881e5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:56.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.841+0000 7fc67dd9b640 1 --2- 172.21.15.57:0/1056400904 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6740039f0 0x7fc6881e5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:56.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.841+0000 7fc67dd9b640 1 -- 172.21.15.57:0/1056400904 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6880bea20 con 0x7fc688148330 2024-04-24T23:38:56.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.841+0000 7fc68659c640 1 --2- 172.21.15.57:0/1056400904 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6740039f0 0x7fc6881e5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:38:56.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.841+0000 7fc67dd9b640 1 --2- 172.21.15.57:0/1056400904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc688148330 0x7fc688154030 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc670010f10 tx=0x7fc67000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:56.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.841+0000 7fc67f7fe640 1 -- 172.21.15.57:0/1056400904 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc670018020 con 0x7fc688148330 2024-04-24T23:38:56.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.841+0000 7fc67f7fe640 1 -- 172.21.15.57:0/1056400904 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc67000ee50 con 0x7fc688148330 2024-04-24T23:38:56.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.841+0000 7fc67f7fe640 1 -- 172.21.15.57:0/1056400904 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6700054b0 con 0x7fc688148330 2024-04-24T23:38:56.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.841+0000 7fc68c830640 1 -- 172.21.15.57:0/1056400904 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6880bda80 con 0x7fc688148330 2024-04-24T23:38:56.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.841+0000 7fc68c830640 1 -- 172.21.15.57:0/1056400904 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc688154570 con 0x7fc688148330 2024-04-24T23:38:56.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.841+0000 7fc68c830640 1 -- 172.21.15.57:0/1056400904 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc688068290 con 0x7fc688148330 2024-04-24T23:38:56.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.841+0000 7fc67f7fe640 1 -- 172.21.15.57:0/1056400904 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc67001b020 con 0x7fc688148330 2024-04-24T23:38:56.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.841+0000 7fc67f7fe640 1 --2- 172.21.15.57:0/1056400904 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc668067a60 0x7fc668069f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:56.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.845+0000 7fc67f7fe640 1 -- 172.21.15.57:0/1056400904 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc6700897b0 con 0x7fc688148330 2024-04-24T23:38:56.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.845+0000 7fc68659c640 1 --2- 172.21.15.57:0/1056400904 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc668067a60 0x7fc668069f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:56.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.845+0000 7fc68659c640 1 --2- 172.21.15.57:0/1056400904 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc668067a60 0x7fc668069f20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc6780af000 tx=0x7fc6780046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:56.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:56.849+0000 7fc67f7fe640 1 -- 172.21.15.57:0/1056400904 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fc670022020 con 0x7fc688148330 2024-04-24T23:38:57.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.037+0000 7fc68c830640 1 -- 172.21.15.57:0/1056400904 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc6880bd830 con 0x7fc688148330 2024-04-24T23:38:57.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.681+0000 7fc67f7fe640 1 -- 172.21.15.57:0/1056400904 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7fc67005a040 con 0x7fc688148330 2024-04-24T23:38:57.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.685+0000 7fc68c830640 1 -- 172.21.15.57:0/1056400904 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc668067a60 msgr2=0x7fc668069f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:57.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.685+0000 7fc68c830640 1 --2- 172.21.15.57:0/1056400904 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc668067a60 0x7fc668069f20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc6780af000 tx=0x7fc6780046d0 comp rx=0 tx=0).stop 2024-04-24T23:38:57.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.685+0000 7fc68c830640 1 -- 172.21.15.57:0/1056400904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc688148330 msgr2=0x7fc688154030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:57.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.685+0000 7fc68c830640 1 --2- 172.21.15.57:0/1056400904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc688148330 0x7fc688154030 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc670010f10 tx=0x7fc67000e530 comp rx=0 tx=0).stop 2024-04-24T23:38:57.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.685+0000 7fc68c830640 1 -- 172.21.15.57:0/1056400904 shutdown_connections 2024-04-24T23:38:57.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.685+0000 7fc68c830640 1 --2- 172.21.15.57:0/1056400904 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc668067a60 0x7fc668069f20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:57.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.685+0000 7fc68c830640 1 --2- 172.21.15.57:0/1056400904 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6881e9560 0x7fc68813d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:57.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.685+0000 7fc68c830640 1 --2- 172.21.15.57:0/1056400904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc688148330 0x7fc688154030 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:57.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.685+0000 7fc68c830640 1 --2- 172.21.15.57:0/1056400904 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6740039f0 0x7fc6881e5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:57.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.685+0000 7fc68c830640 1 -- 172.21.15.57:0/1056400904 >> 172.21.15.57:0/1056400904 conn(0x7fc688066f50 msgr2=0x7fc6880c5080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:57.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.685+0000 7fc68c830640 1 -- 172.21.15.57:0/1056400904 shutdown_connections 2024-04-24T23:38:57.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.685+0000 7fc68c830640 1 -- 172.21.15.57:0/1056400904 wait complete. 2024-04-24T23:38:57.706 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-24T23:38:57.707 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:38:57.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59f4a45640 1 Processor -- start 2024-04-24T23:38:57.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59f4a45640 1 -- start start 2024-04-24T23:38:57.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59f4a45640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f59f00c1e30 0x7f59f00c32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:57.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59f4a45640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59f00be5a0 con 0x7f59f00be8b0 2024-04-24T23:38:57.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59f4a45640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59f0154aa0 con 0x7f59f014ac10 2024-04-24T23:38:57.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59f4a45640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f59f0154d80 con 0x7f59f00c1e30 2024-04-24T23:38:57.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59eed9d640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f59f00be8b0 0x7f59f015b2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52944/0 (socket says 172.21.15.57:52944) 2024-04-24T23:38:57.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59eed9d640 1 -- 172.21.15.57:0/2225823437 learned_addr learned my addr 172.21.15.57:0/2225823437 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:38:57.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59edd9b640 1 --2- 172.21.15.57:0/2225823437 >> v2:172.21.15.88:3300/0 conn(0x7f59f00c1e30 0x7f59f00c32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:57.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59ed59a640 1 -- 172.21.15.57:0/2225823437 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3028624581 0 0) 0x7f59f00be5a0 con 0x7f59f00be8b0 2024-04-24T23:38:57.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59ed59a640 1 -- 172.21.15.57:0/2225823437 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59d8003530 con 0x7f59f00be8b0 2024-04-24T23:38:57.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59ed59a640 1 -- 172.21.15.57:0/2225823437 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1656523713 0 0) 0x7f59d8003530 con 0x7f59f00be8b0 2024-04-24T23:38:57.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59ed59a640 1 -- 172.21.15.57:0/2225823437 >> v2:172.21.15.88:3300/0 conn(0x7f59f00c1e30 msgr2=0x7f59f00c32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:57.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59ed59a640 1 --2- 172.21.15.57:0/2225823437 >> v2:172.21.15.88:3300/0 conn(0x7f59f00c1e30 0x7f59f00c32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:57.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59ed59a640 1 -- 172.21.15.57:0/2225823437 >> v1:172.21.15.88:6789/0 conn(0x7f59f014ac10 legacy=0x7f59f00a6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:57.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59ed59a640 1 -- 172.21.15.57:0/2225823437 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f00c2ab0 con 0x7f59f00be8b0 2024-04-24T23:38:57.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59ed59a640 1 -- 172.21.15.57:0/2225823437 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7f59e8001a20 con 0x7f59f00be8b0 2024-04-24T23:38:57.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59ed59a640 1 -- 172.21.15.57:0/2225823437 >> v1:172.21.15.57:6789/0 conn(0x7f59f00be8b0 legacy=0x7f59f015b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:57.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59ed59a640 1 --2- 172.21.15.57:0/2225823437 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59d80039c0 0x7f59d8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:57.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59ed59a640 1 --2- 172.21.15.57:0/2225823437 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f59d8004810 0x7f59d8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:57.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59ed59a640 1 --2- 172.21.15.57:0/2225823437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59d80051d0 0x7f59d800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:57.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59ed59a640 1 -- 172.21.15.57:0/2225823437 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f59f0154d80 con 0x7f59d80039c0 2024-04-24T23:38:57.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59ed59a640 1 -- 172.21.15.57:0/2225823437 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f59d800c170 con 0x7f59d80051d0 2024-04-24T23:38:57.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59ed59a640 1 -- 172.21.15.57:0/2225823437 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f59d800c370 con 0x7f59d8004810 2024-04-24T23:38:57.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59ee59c640 1 --2- 172.21.15.57:0/2225823437 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59d80039c0 0x7f59d8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:57.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59edd9b640 1 --2- 172.21.15.57:0/2225823437 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f59d8004810 0x7f59d8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:57.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59ee59c640 1 -- 172.21.15.57:0/2225823437 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f59d8004810 msgr2=0x7f59d8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:57.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59ee59c640 1 --2- 172.21.15.57:0/2225823437 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f59d8004810 0x7f59d8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:57.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59ee59c640 1 -- 172.21.15.57:0/2225823437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59d80051d0 msgr2=0x7f59d800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:57.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59eed9d640 1 --2- 172.21.15.57:0/2225823437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59d80051d0 0x7f59d800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:57.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59ee59c640 1 --2- 172.21.15.57:0/2225823437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59d80051d0 0x7f59d800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:57.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59ee59c640 1 -- 172.21.15.57:0/2225823437 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d8003530 con 0x7f59d80039c0 2024-04-24T23:38:57.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59edd9b640 1 --2- 172.21.15.57:0/2225823437 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f59d8004810 0x7f59d8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:38:57.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59eed9d640 1 --2- 172.21.15.57:0/2225823437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59d80051d0 0x7f59d800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:38:57.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.833+0000 7f59eed9d640 1 -- 172.21.15.57:0/2225823437 reap_dead start 2024-04-24T23:38:57.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.837+0000 7f59ee59c640 1 --2- 172.21.15.57:0/2225823437 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59d80039c0 0x7f59d8003de0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f59e0001780 tx=0x7f59e001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aeafcf1c75eba48 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:57.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.837+0000 7f59ed59a640 1 -- 172.21.15.57:0/2225823437 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e00013a0 con 0x7f59d80039c0 2024-04-24T23:38:57.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.837+0000 7f59ed59a640 1 -- 172.21.15.57:0/2225823437 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59e00052f0 con 0x7f59d80039c0 2024-04-24T23:38:57.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.837+0000 7f59ed59a640 1 -- 172.21.15.57:0/2225823437 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e0003840 con 0x7f59d80039c0 2024-04-24T23:38:57.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.837+0000 7f59f4a45640 1 -- 172.21.15.57:0/2225823437 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59d80039c0 msgr2=0x7f59d8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:57.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.837+0000 7f59f4a45640 1 --2- 172.21.15.57:0/2225823437 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59d80039c0 0x7f59d8003de0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f59e0001780 tx=0x7f59e001c400 comp rx=0 tx=0).stop 2024-04-24T23:38:57.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.837+0000 7f59f4a45640 1 -- 172.21.15.57:0/2225823437 shutdown_connections 2024-04-24T23:38:57.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.837+0000 7f59f4a45640 1 --2- 172.21.15.57:0/2225823437 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59d80039c0 0x7f59d8003de0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:57.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.837+0000 7f59f4a45640 1 -- 172.21.15.57:0/2225823437 >> 172.21.15.57:0/2225823437 conn(0x7f59f006b8a0 msgr2=0x7f59f00a5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:57.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.837+0000 7f59f4a45640 1 -- 172.21.15.57:0/2225823437 shutdown_connections 2024-04-24T23:38:57.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.837+0000 7f59f4a45640 1 -- 172.21.15.57:0/2225823437 wait complete. 2024-04-24T23:38:57.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.837+0000 7f59f4a45640 1 Processor -- start 2024-04-24T23:38:57.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.837+0000 7f59f4a45640 1 -- start start 2024-04-24T23:38:57.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.837+0000 7f59f4a45640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59d80039c0 0x7f59f0153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:57.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.837+0000 7f59f4a45640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f59f0149eb0 0x7f59f01e0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:57.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.837+0000 7f59f4a45640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59f01e0a40 0x7f59f00a78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:57.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.837+0000 7f59f4a45640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f59f00c3640 con 0x7f59d80039c0 2024-04-24T23:38:57.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.837+0000 7f59f4a45640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f59f00c34c0 con 0x7f59f01e0a40 2024-04-24T23:38:57.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.837+0000 7f59f4a45640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f59f00c37c0 con 0x7f59f0149eb0 2024-04-24T23:38:57.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.837+0000 7f59ee59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59d80039c0 0x7f59f0153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:57.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.837+0000 7f59ee59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59d80039c0 0x7f59f0153630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59822/0 (socket says 172.21.15.57:59822) 2024-04-24T23:38:57.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.837+0000 7f59ee59c640 1 -- 172.21.15.57:0/1368612527 learned_addr learned my addr 172.21.15.57:0/1368612527 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:57.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.837+0000 7f59eed9d640 1 --2- 172.21.15.57:0/1368612527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59f01e0a40 0x7f59f00a78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:57.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.837+0000 7f59ee59c640 1 -- 172.21.15.57:0/1368612527 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f59f0149eb0 msgr2=0x7f59f01e0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:57.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.841+0000 7f59ee59c640 1 --2- 172.21.15.57:0/1368612527 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f59f0149eb0 0x7f59f01e0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:57.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.841+0000 7f59ee59c640 1 -- 172.21.15.57:0/1368612527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59f01e0a40 msgr2=0x7f59f00a78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:57.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.841+0000 7f59ee59c640 1 --2- 172.21.15.57:0/1368612527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59f01e0a40 0x7f59f00a78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:57.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.841+0000 7f59ee59c640 1 -- 172.21.15.57:0/1368612527 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f0153b70 con 0x7f59d80039c0 2024-04-24T23:38:57.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.841+0000 7f59eed9d640 1 --2- 172.21.15.57:0/1368612527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59f01e0a40 0x7f59f00a78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:38:57.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.841+0000 7f59ee59c640 1 --2- 172.21.15.57:0/1368612527 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59d80039c0 0x7f59f0153630 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f59e0005040 tx=0x7f59d8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:57.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.841+0000 7f59deffd640 1 -- 172.21.15.57:0/1368612527 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e0007a40 con 0x7f59d80039c0 2024-04-24T23:38:57.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.841+0000 7f59deffd640 1 -- 172.21.15.57:0/1368612527 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59e00ba070 con 0x7f59d80039c0 2024-04-24T23:38:57.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.841+0000 7f59deffd640 1 -- 172.21.15.57:0/1368612527 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e00054a0 con 0x7f59d80039c0 2024-04-24T23:38:57.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.841+0000 7f59f4a45640 1 -- 172.21.15.57:0/1368612527 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59f0144250 con 0x7f59d80039c0 2024-04-24T23:38:57.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.841+0000 7f59f4a45640 1 -- 172.21.15.57:0/1368612527 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59f01dcd80 con 0x7f59d80039c0 2024-04-24T23:38:57.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.841+0000 7f59f4a45640 1 -- 172.21.15.57:0/1368612527 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59f01ece90 con 0x7f59d80039c0 2024-04-24T23:38:57.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.841+0000 7f59deffd640 1 -- 172.21.15.57:0/1368612527 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f59e0007030 con 0x7f59d80039c0 2024-04-24T23:38:57.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.841+0000 7f59deffd640 1 --2- 172.21.15.57:0/1368612527 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f59d00678c0 0x7f59d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:57.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.841+0000 7f59deffd640 1 -- 172.21.15.57:0/1368612527 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f59e011ffd0 con 0x7f59d80039c0 2024-04-24T23:38:57.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.841+0000 7f59edd9b640 1 --2- 172.21.15.57:0/1368612527 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f59d00678c0 0x7f59d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:57.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.845+0000 7f59edd9b640 1 --2- 172.21.15.57:0/1368612527 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f59d00678c0 0x7f59d0069d80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f59f01490a0 tx=0x7f59e4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:57.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:57.845+0000 7f59deffd640 1 -- 172.21.15.57:0/1368612527 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f59f0153b70 con 0x7f59d80039c0 2024-04-24T23:38:58.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.045+0000 7f59f4a45640 1 -- 172.21.15.57:0/1368612527 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59f0068930 con 0x7f59d80039c0 2024-04-24T23:38:58.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.045+0000 7f59deffd640 1 -- 172.21.15.57:0/1368612527 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+4350 (secure 0 0 0) 0x7f59e0016110 con 0x7f59d80039c0 2024-04-24T23:38:58.048 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:38:58.048 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2925410225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2925410225},{"type":"v1","addr":"172.21.15.88:6835","nonce":2925410225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4227,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/173597347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":173597347},{"type":"v1","addr":"172.21.15.57:6834","nonce":173597347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:38:33.449139+0000","modified":"2024-04-24T23:38:57.042000+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4230":{"gid":4230,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/1701414040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":1701414040},{"type":"v1","addr":"172.21.15.57:6835","nonce":1701414040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4230,"qdb_cluster":[4230]},"id":1}]} 2024-04-24T23:38:58.049 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 9 2024-04-24T23:38:58.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.049+0000 7f59f4a45640 1 -- 172.21.15.57:0/1368612527 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f59d00678c0 msgr2=0x7f59d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:58.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.049+0000 7f59f4a45640 1 --2- 172.21.15.57:0/1368612527 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f59d00678c0 0x7f59d0069d80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f59f01490a0 tx=0x7f59e4008040 comp rx=0 tx=0).stop 2024-04-24T23:38:58.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.049+0000 7f59f4a45640 1 -- 172.21.15.57:0/1368612527 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59d80039c0 msgr2=0x7f59f0153630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:58.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.049+0000 7f59f4a45640 1 --2- 172.21.15.57:0/1368612527 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59d80039c0 0x7f59f0153630 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f59e0005040 tx=0x7f59d8005840 comp rx=0 tx=0).stop 2024-04-24T23:38:58.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.049+0000 7f59f4a45640 1 -- 172.21.15.57:0/1368612527 shutdown_connections 2024-04-24T23:38:58.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.049+0000 7f59f4a45640 1 --2- 172.21.15.57:0/1368612527 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f59d00678c0 0x7f59d0069d80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:58.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.049+0000 7f59f4a45640 1 --2- 172.21.15.57:0/1368612527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59f01e0a40 0x7f59f00a78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:58.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.049+0000 7f59f4a45640 1 --2- 172.21.15.57:0/1368612527 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f59f0149eb0 0x7f59f01e0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:58.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.049+0000 7f59f4a45640 1 --2- 172.21.15.57:0/1368612527 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59d80039c0 0x7f59f0153630 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:58.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.049+0000 7f59f4a45640 1 -- 172.21.15.57:0/1368612527 >> 172.21.15.57:0/1368612527 conn(0x7f59f006b8a0 msgr2=0x7f59f0070050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:58.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.049+0000 7f59f4a45640 1 -- 172.21.15.57:0/1368612527 shutdown_connections 2024-04-24T23:38:58.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.049+0000 7f59f4a45640 1 -- 172.21.15.57:0/1368612527 wait complete. 2024-04-24T23:38:58.067 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:38:58.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.193+0000 7f9960393640 1 Processor -- start 2024-04-24T23:38:58.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.193+0000 7f9960393640 1 -- start start 2024-04-24T23:38:58.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.193+0000 7f9960393640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f99580bdbe0 0x7f99580b6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:58.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.193+0000 7f9960393640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f99580b7510 0x7f9958159050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:58.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.193+0000 7f9960393640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f995814e8e0 con 0x7f995814bc60 2024-04-24T23:38:58.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.193+0000 7f9960393640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f9958152c20 con 0x7f99580b7510 2024-04-24T23:38:58.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.193+0000 7f9960393640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f995814ebc0 con 0x7f99580bdbe0 2024-04-24T23:38:58.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.193+0000 7f995e12f640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f995814bc60 0x7f995806eb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52960/0 (socket says 172.21.15.57:52960) 2024-04-24T23:38:58.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.193+0000 7f995e12f640 1 -- 172.21.15.57:0/1964666449 learned_addr learned my addr 172.21.15.57:0/1964666449 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:38:58.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.193+0000 7f995e930640 1 --2- 172.21.15.57:0/1964666449 >> v2:172.21.15.57:3300/0 conn(0x7f99580b7510 0x7f9958159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:58.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.193+0000 7f995d92e640 1 --2- 172.21.15.57:0/1964666449 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f99580bdbe0 0x7f99580b6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:58.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.193+0000 7f995d12d640 1 -- 172.21.15.57:0/1964666449 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1066542238 0 0) 0x7f995814e8e0 con 0x7f995814bc60 2024-04-24T23:38:58.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.193+0000 7f995d12d640 1 -- 172.21.15.57:0/1964666449 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9944003530 con 0x7f995814bc60 2024-04-24T23:38:58.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.193+0000 7f995e930640 1 -- 172.21.15.57:0/1964666449 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f99580bdbe0 msgr2=0x7f99580b6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:58.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.193+0000 7f995e930640 1 --2- 172.21.15.57:0/1964666449 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f99580bdbe0 0x7f99580b6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:58.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.193+0000 7f995e930640 1 -- 172.21.15.57:0/1964666449 >> v1:172.21.15.57:6789/0 conn(0x7f995814bc60 legacy=0x7f995806eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:58.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.193+0000 7f995e930640 1 -- 172.21.15.57:0/1964666449 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f995806f260 con 0x7f99580b7510 2024-04-24T23:38:58.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.193+0000 7f995d92e640 1 --2- 172.21.15.57:0/1964666449 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f99580bdbe0 0x7f99580b6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:38:58.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f995e930640 1 --2- 172.21.15.57:0/1964666449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99580b7510 0x7f9958159050 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9950009d90 tx=0x7f995001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9219717340a84fa server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:58.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f995d12d640 1 -- 172.21.15.57:0/1964666449 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99500b2070 con 0x7f99580b7510 2024-04-24T23:38:58.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f995d12d640 1 -- 172.21.15.57:0/1964666449 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99500a5830 con 0x7f99580b7510 2024-04-24T23:38:58.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f995d12d640 1 -- 172.21.15.57:0/1964666449 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99500a5be0 con 0x7f99580b7510 2024-04-24T23:38:58.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f9960393640 1 -- 172.21.15.57:0/1964666449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99580b7510 msgr2=0x7f9958159050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:58.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f9960393640 1 --2- 172.21.15.57:0/1964666449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99580b7510 0x7f9958159050 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9950009d90 tx=0x7f995001c970 comp rx=0 tx=0).stop 2024-04-24T23:38:58.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f9960393640 1 -- 172.21.15.57:0/1964666449 shutdown_connections 2024-04-24T23:38:58.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f9960393640 1 --2- 172.21.15.57:0/1964666449 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f99580bdbe0 0x7f99580b6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:58.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f9960393640 1 --2- 172.21.15.57:0/1964666449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99580b7510 0x7f9958159050 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:58.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f9960393640 1 -- 172.21.15.57:0/1964666449 >> 172.21.15.57:0/1964666449 conn(0x7f99580beab0 msgr2=0x7f99580beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:58.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f9960393640 1 -- 172.21.15.57:0/1964666449 shutdown_connections 2024-04-24T23:38:58.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f9960393640 1 -- 172.21.15.57:0/1964666449 wait complete. 2024-04-24T23:38:58.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f9960393640 1 Processor -- start 2024-04-24T23:38:58.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f9960393640 1 -- start start 2024-04-24T23:38:58.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f9960393640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99580b7510 0x7f99581eb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:58.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f9960393640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f99580bdbe0 0x7f9958145120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:58.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f9960393640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f995814bc60 0x7f99581e7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:58.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f9960393640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f995815bf30 con 0x7f99580b7510 2024-04-24T23:38:58.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f9960393640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f995815bdb0 con 0x7f995814bc60 2024-04-24T23:38:58.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f9960393640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f995815c0b0 con 0x7f99580bdbe0 2024-04-24T23:38:58.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f995e12f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99580b7510 0x7f99581eb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:58.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f995e12f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99580b7510 0x7f99581eb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59848/0 (socket says 172.21.15.57:59848) 2024-04-24T23:38:58.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f995e12f640 1 -- 172.21.15.57:0/587343289 learned_addr learned my addr 172.21.15.57:0/587343289 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:58.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f995e930640 1 --2- 172.21.15.57:0/587343289 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f995814bc60 0x7f99581e7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:58.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f995d92e640 1 --2- 172.21.15.57:0/587343289 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f99580bdbe0 0x7f9958145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:58.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f995e12f640 1 -- 172.21.15.57:0/587343289 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f99580bdbe0 msgr2=0x7f9958145120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:58.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f995e12f640 1 --2- 172.21.15.57:0/587343289 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f99580bdbe0 0x7f9958145120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:58.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f995e12f640 1 -- 172.21.15.57:0/587343289 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f995814bc60 msgr2=0x7f99581e7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:58.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f995e12f640 1 --2- 172.21.15.57:0/587343289 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f995814bc60 0x7f99581e7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:58.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f995e12f640 1 -- 172.21.15.57:0/587343289 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9958159320 con 0x7f99580b7510 2024-04-24T23:38:58.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f995d92e640 1 --2- 172.21.15.57:0/587343289 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f99580bdbe0 0x7f9958145120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:38:58.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f995e12f640 1 --2- 172.21.15.57:0/587343289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99580b7510 0x7f99581eb310 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f995400c3f0 tx=0x7f995400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:58.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.197+0000 7f994effd640 1 -- 172.21.15.57:0/587343289 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9954017070 con 0x7f99580b7510 2024-04-24T23:38:58.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.201+0000 7f994effd640 1 -- 172.21.15.57:0/587343289 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9954005cf0 con 0x7f99580b7510 2024-04-24T23:38:58.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.201+0000 7f994effd640 1 -- 172.21.15.57:0/587343289 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99540072f0 con 0x7f99580b7510 2024-04-24T23:38:58.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.201+0000 7f9960393640 1 -- 172.21.15.57:0/587343289 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9958142640 con 0x7f99580b7510 2024-04-24T23:38:58.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.201+0000 7f9960393640 1 -- 172.21.15.57:0/587343289 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99580bbc80 con 0x7f99580b7510 2024-04-24T23:38:58.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.201+0000 7f9960393640 1 -- 172.21.15.57:0/587343289 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9958068220 con 0x7f99580b7510 2024-04-24T23:38:58.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.201+0000 7f994effd640 1 -- 172.21.15.57:0/587343289 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f995401a070 con 0x7f99580b7510 2024-04-24T23:38:58.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.201+0000 7f994effd640 1 --2- 172.21.15.57:0/587343289 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f993c0678c0 0x7f993c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:58.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.201+0000 7f994effd640 1 -- 172.21.15.57:0/587343289 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9954085480 con 0x7f99580b7510 2024-04-24T23:38:58.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.201+0000 7f995d92e640 1 --2- 172.21.15.57:0/587343289 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f993c0678c0 0x7f993c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:58.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.201+0000 7f995d92e640 1 --2- 172.21.15.57:0/587343289 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f993c0678c0 0x7f993c069d80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9958151ae0 tx=0x7f9948008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:58.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.205+0000 7f994effd640 1 -- 172.21.15.57:0/587343289 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f9954055be0 con 0x7f99580b7510 2024-04-24T23:38:58.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.369+0000 7f9960393640 1 -- 172.21.15.57:0/587343289 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99580bd9c0 con 0x7f99580b7510 2024-04-24T23:38:58.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.369+0000 7f994effd640 1 -- 172.21.15.57:0/587343289 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7f99540554e0 con 0x7f99580b7510 2024-04-24T23:38:58.372 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:38:58.372 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":24,"fsid":"1ea31698-444a-4667-bcd9-b2608ad103c3","created":"2024-04-24T23:38:16.748774+0000","modified":"2024-04-24T23:38:38.604475+0000","last_up_change":"2024-04-24T23:38:26.956537+0000","last_in_change":"2024-04-24T23:38:18.972175+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:38:27.611782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:38:31.718061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:38:32.469413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:38:36.215724+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"35ce67bc-9b25-416e-ab1e-774c717631f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6825","nonce":671364028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6827","nonce":671364028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6831","nonce":671364028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6829","nonce":671364028}]},"public_addr":"172.21.15.57:6825/671364028","cluster_addr":"172.21.15.57:6827/671364028","heartbeat_back_addr":"172.21.15.57:6831/671364028","heartbeat_front_addr":"172.21.15.57:6829/671364028","state":["exists","up"]},{"osd":1,"uuid":"38f6f4ef-3bc2-4453-9946-7d1d17e735ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6801","nonce":2653552037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6803","nonce":2653552037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6807","nonce":2653552037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6805","nonce":2653552037}]},"public_addr":"172.21.15.57:6801/2653552037","cluster_addr":"172.21.15.57:6803/2653552037","heartbeat_back_addr":"172.21.15.57:6807/2653552037","heartbeat_front_addr":"172.21.15.57:6805/2653552037","state":["exists","up"]},{"osd":2,"uuid":"d77a0a49-b39a-464e-a1c9-49e19280c440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6816","nonce":1565874109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6819","nonce":1565874109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6823","nonce":1565874109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6821","nonce":1565874109}]},"public_addr":"172.21.15.57:6816/1565874109","cluster_addr":"172.21.15.57:6819/1565874109","heartbeat_back_addr":"172.21.15.57:6823/1565874109","heartbeat_front_addr":"172.21.15.57:6821/1565874109","state":["exists","up"]},{"osd":3,"uuid":"f8ea9bfe-d839-44a6-a185-0f0985da314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6809","nonce":3474703186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6811","nonce":3474703186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6817","nonce":3474703186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6813","nonce":3474703186}]},"public_addr":"172.21.15.57:6809/3474703186","cluster_addr":"172.21.15.57:6811/3474703186","heartbeat_back_addr":"172.21.15.57:6817/3474703186","heartbeat_front_addr":"172.21.15.57:6813/3474703186","state":["exists","up"]},{"osd":4,"uuid":"454647d4-6ac2-46b4-8451-320eb951a87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6801","nonce":1271707713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6803","nonce":1271707713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6807","nonce":1271707713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6805","nonce":1271707713}]},"public_addr":"172.21.15.88:6801/1271707713","cluster_addr":"172.21.15.88:6803/1271707713","heartbeat_back_addr":"172.21.15.88:6807/1271707713","heartbeat_front_addr":"172.21.15.88:6805/1271707713","state":["exists","up"]},{"osd":5,"uuid":"f71c03a3-7ad8-46d3-89c9-d61de102586b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6809","nonce":2035054888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6813","nonce":2035054888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6820","nonce":2035054888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6816","nonce":2035054888}]},"public_addr":"172.21.15.88:6809/2035054888","cluster_addr":"172.21.15.88:6813/2035054888","heartbeat_back_addr":"172.21.15.88:6820/2035054888","heartbeat_front_addr":"172.21.15.88:6816/2035054888","state":["exists","up"]},{"osd":6,"uuid":"ec7ae2b7-9cb4-4059-8f98-0022c9763f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6825","nonce":1752291242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6827","nonce":1752291242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6831","nonce":1752291242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6829","nonce":1752291242}]},"public_addr":"172.21.15.88:6825/1752291242","cluster_addr":"172.21.15.88:6827/1752291242","heartbeat_back_addr":"172.21.15.88:6831/1752291242","heartbeat_front_addr":"172.21.15.88:6829/1752291242","state":["exists","up"]},{"osd":7,"uuid":"c0ee7505-60c1-40ba-9902-47313a04dafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6812","nonce":1782800372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6817","nonce":1782800372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6823","nonce":1782800372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6821","nonce":1782800372}]},"public_addr":"172.21.15.88:6812/1782800372","cluster_addr":"172.21.15.88:6817/1782800372","heartbeat_back_addr":"172.21.15.88:6823/1782800372","heartbeat_front_addr":"172.21.15.88:6821/1782800372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.698562+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.682587+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.680197+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.561753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.011095+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.493320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.353451+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.423877+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:38:58.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.373+0000 7f9960393640 1 -- 172.21.15.57:0/587343289 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f993c0678c0 msgr2=0x7f993c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:58.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.373+0000 7f9960393640 1 --2- 172.21.15.57:0/587343289 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f993c0678c0 0x7f993c069d80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9958151ae0 tx=0x7f9948008040 comp rx=0 tx=0).stop 2024-04-24T23:38:58.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.373+0000 7f9960393640 1 -- 172.21.15.57:0/587343289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99580b7510 msgr2=0x7f99581eb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:58.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.373+0000 7f9960393640 1 --2- 172.21.15.57:0/587343289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99580b7510 0x7f99581eb310 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f995400c3f0 tx=0x7f995400c8b0 comp rx=0 tx=0).stop 2024-04-24T23:38:58.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.373+0000 7f9960393640 1 -- 172.21.15.57:0/587343289 shutdown_connections 2024-04-24T23:38:58.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.373+0000 7f9960393640 1 --2- 172.21.15.57:0/587343289 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f993c0678c0 0x7f993c069d80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:58.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.373+0000 7f9960393640 1 --2- 172.21.15.57:0/587343289 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f995814bc60 0x7f99581e7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:58.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.373+0000 7f9960393640 1 --2- 172.21.15.57:0/587343289 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f99580bdbe0 0x7f9958145120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:58.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.373+0000 7f9960393640 1 --2- 172.21.15.57:0/587343289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99580b7510 0x7f99581eb310 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:58.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.373+0000 7f9960393640 1 -- 172.21.15.57:0/587343289 >> 172.21.15.57:0/587343289 conn(0x7f99580beab0 msgr2=0x7f995814aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:58.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.373+0000 7f9960393640 1 -- 172.21.15.57:0/587343289 shutdown_connections 2024-04-24T23:38:58.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.373+0000 7f9960393640 1 -- 172.21.15.57:0/587343289 wait complete. 2024-04-24T23:38:58.392 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-24T23:38:58.392 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:38:58.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.505+0000 7fbbcb94f640 1 Processor -- start 2024-04-24T23:38:58.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.505+0000 7fbbcb94f640 1 -- start start 2024-04-24T23:38:58.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.509+0000 7fbbcb94f640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbbc4072980 0x7fbbc40b7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:58.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.509+0000 7fbbcb94f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbbc40bde80 0x7fbbc40be3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:58.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.509+0000 7fbbcb94f640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbc40b8fa0 con 0x7fbbc414ada0 2024-04-24T23:38:58.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.509+0000 7fbbcb94f640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fbbc40be920 con 0x7fbbc4072980 2024-04-24T23:38:58.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.509+0000 7fbbcb94f640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fbbc4072e10 con 0x7fbbc40bde80 2024-04-24T23:38:58.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.509+0000 7fbbc8eea640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbbc4072980 0x7fbbc40b7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:58.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.509+0000 7fbbc8eea640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbbc4072980 0x7fbbc40b7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59862/0 (socket says 172.21.15.57:59862) 2024-04-24T23:38:58.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.509+0000 7fbbc96eb640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbbc414ada0 0x7fbbc406eb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52976/0 (socket says 172.21.15.57:52976) 2024-04-24T23:38:58.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.509+0000 7fbbc8eea640 1 -- 172.21.15.57:0/4147701479 learned_addr learned my addr 172.21.15.57:0/4147701479 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:58.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.509+0000 7fbbc9eec640 1 --2- 172.21.15.57:0/4147701479 >> v2:172.21.15.88:3300/0 conn(0x7fbbc40bde80 0x7fbbc40be3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:58.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.509+0000 7fbbc8eea640 1 -- 172.21.15.57:0/4147701479 >> v2:172.21.15.88:3300/0 conn(0x7fbbc40bde80 msgr2=0x7fbbc40be3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:58.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.509+0000 7fbbc8eea640 1 --2- 172.21.15.57:0/4147701479 >> v2:172.21.15.88:3300/0 conn(0x7fbbc40bde80 0x7fbbc40be3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:58.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.509+0000 7fbbc8eea640 1 -- 172.21.15.57:0/4147701479 >> v1:172.21.15.57:6789/0 conn(0x7fbbc414ada0 legacy=0x7fbbc406eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:58.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.509+0000 7fbbc8eea640 1 -- 172.21.15.57:0/4147701479 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc406f260 con 0x7fbbc4072980 2024-04-24T23:38:58.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.509+0000 7fbbc9eec640 1 --2- 172.21.15.57:0/4147701479 >> v2:172.21.15.88:3300/0 conn(0x7fbbc40bde80 0x7fbbc40be3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:38:58.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.509+0000 7fbbc8eea640 1 --2- 172.21.15.57:0/4147701479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbc4072980 0x7fbbc40b7470 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbbc406d3b0 tx=0x7fbbc001eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86baab5af7a76f0c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:58.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.509+0000 7fbbbbfff640 1 -- 172.21.15.57:0/4147701479 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc00b4070 con 0x7fbbc4072980 2024-04-24T23:38:58.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.509+0000 7fbbbbfff640 1 -- 172.21.15.57:0/4147701479 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbc00a7a40 con 0x7fbbc4072980 2024-04-24T23:38:58.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.509+0000 7fbbbbfff640 1 -- 172.21.15.57:0/4147701479 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc00a7e10 con 0x7fbbc4072980 2024-04-24T23:38:58.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.509+0000 7fbbcb94f640 1 -- 172.21.15.57:0/4147701479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbc4072980 msgr2=0x7fbbc40b7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:58.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.509+0000 7fbbcb94f640 1 --2- 172.21.15.57:0/4147701479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbc4072980 0x7fbbc40b7470 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbbc406d3b0 tx=0x7fbbc001eb60 comp rx=0 tx=0).stop 2024-04-24T23:38:58.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.509+0000 7fbbcb94f640 1 -- 172.21.15.57:0/4147701479 shutdown_connections 2024-04-24T23:38:58.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.509+0000 7fbbcb94f640 1 --2- 172.21.15.57:0/4147701479 >> v2:172.21.15.88:3300/0 conn(0x7fbbc40bde80 0x7fbbc40be3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:58.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.509+0000 7fbbcb94f640 1 --2- 172.21.15.57:0/4147701479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbc4072980 0x7fbbc40b7470 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:58.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.509+0000 7fbbcb94f640 1 -- 172.21.15.57:0/4147701479 >> 172.21.15.57:0/4147701479 conn(0x7fbbc40beab0 msgr2=0x7fbbc40beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:58.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.509+0000 7fbbcb94f640 1 -- 172.21.15.57:0/4147701479 shutdown_connections 2024-04-24T23:38:58.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.509+0000 7fbbcb94f640 1 -- 172.21.15.57:0/4147701479 wait complete. 2024-04-24T23:38:58.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.513+0000 7fbbcb94f640 1 Processor -- start 2024-04-24T23:38:58.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.513+0000 7fbbcb94f640 1 -- start start 2024-04-24T23:38:58.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.513+0000 7fbbcb94f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbc4072980 0x7fbbc4148c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:58.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.513+0000 7fbbcb94f640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbbc40bde80 0x7fbbc4150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:58.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.513+0000 7fbbcb94f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbc414ada0 0x7fbbc4147550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:58.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.513+0000 7fbbcb94f640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc40bd340 con 0x7fbbc4072980 2024-04-24T23:38:58.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.513+0000 7fbbcb94f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc40bd1c0 con 0x7fbbc414ada0 2024-04-24T23:38:58.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.513+0000 7fbbcb94f640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fbbc40bd4c0 con 0x7fbbc40bde80 2024-04-24T23:38:58.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.513+0000 7fbbc96eb640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbc4072980 0x7fbbc4148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:58.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.513+0000 7fbbc96eb640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbc4072980 0x7fbbc4148c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59876/0 (socket says 172.21.15.57:59876) 2024-04-24T23:38:58.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.513+0000 7fbbc96eb640 1 -- 172.21.15.57:0/684887709 learned_addr learned my addr 172.21.15.57:0/684887709 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:58.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.513+0000 7fbbc9eec640 1 --2- 172.21.15.57:0/684887709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbc414ada0 0x7fbbc4147550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:58.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.513+0000 7fbbc96eb640 1 -- 172.21.15.57:0/684887709 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbbc40bde80 msgr2=0x7fbbc4150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:58.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.513+0000 7fbbc96eb640 1 --2- 172.21.15.57:0/684887709 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbbc40bde80 0x7fbbc4150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:58.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.513+0000 7fbbc96eb640 1 -- 172.21.15.57:0/684887709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbc414ada0 msgr2=0x7fbbc4147550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:58.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.513+0000 7fbbc96eb640 1 --2- 172.21.15.57:0/684887709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbc414ada0 0x7fbbc4147550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:58.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.513+0000 7fbbc96eb640 1 -- 172.21.15.57:0/684887709 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc41506b0 con 0x7fbbc4072980 2024-04-24T23:38:58.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.513+0000 7fbbc9eec640 1 --2- 172.21.15.57:0/684887709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbc414ada0 0x7fbbc4147550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:38:58.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.513+0000 7fbbc96eb640 1 --2- 172.21.15.57:0/684887709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbc4072980 0x7fbbc4148c70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbbb400c370 tx=0x7fbbb400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:58.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.513+0000 7fbbb9ffb640 1 -- 172.21.15.57:0/684887709 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb40074e0 con 0x7fbbc4072980 2024-04-24T23:38:58.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.513+0000 7fbbb9ffb640 1 -- 172.21.15.57:0/684887709 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbb4007680 con 0x7fbbc4072980 2024-04-24T23:38:58.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.513+0000 7fbbb9ffb640 1 -- 172.21.15.57:0/684887709 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4004a30 con 0x7fbbc4072980 2024-04-24T23:38:58.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.513+0000 7fbbcb94f640 1 -- 172.21.15.57:0/684887709 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbc4143050 con 0x7fbbc4072980 2024-04-24T23:38:58.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.513+0000 7fbbcb94f640 1 -- 172.21.15.57:0/684887709 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbc4151540 con 0x7fbbc4072980 2024-04-24T23:38:58.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.513+0000 7fbbcb94f640 1 -- 172.21.15.57:0/684887709 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbc4068220 con 0x7fbbc4072980 2024-04-24T23:38:58.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.517+0000 7fbbb9ffb640 1 -- 172.21.15.57:0/684887709 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbbb401a020 con 0x7fbbc4072980 2024-04-24T23:38:58.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.517+0000 7fbbb9ffb640 1 --2- 172.21.15.57:0/684887709 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fbba80678c0 0x7fbba8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:58.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.517+0000 7fbbb9ffb640 1 -- 172.21.15.57:0/684887709 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbbb4085650 con 0x7fbbc4072980 2024-04-24T23:38:58.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.517+0000 7fbbc8eea640 1 --2- 172.21.15.57:0/684887709 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fbba80678c0 0x7fbba8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:58.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.517+0000 7fbbc8eea640 1 --2- 172.21.15.57:0/684887709 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fbba80678c0 0x7fbba8069d80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbbc00b1000 tx=0x7fbbc0004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:58.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.521+0000 7fbbb9ffb640 1 -- 172.21.15.57:0/684887709 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fbbc41506b0 con 0x7fbbc4072980 2024-04-24T23:38:58.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.677+0000 7fbbcb94f640 1 -- 172.21.15.57:0/684887709 --> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbbc406cbd0 con 0x7fbba80678c0 2024-04-24T23:38:58.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.705+0000 7fbbb9ffb640 1 -- 172.21.15.57:0/684887709 <== mgr.4105 v2:172.21.15.88:6832/3931748276 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332635 (secure 0 0 0) 0x7fbbc406cbd0 con 0x7fbba80678c0 2024-04-24T23:38:58.709 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:38:58.711 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-24T23:38:58.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.709+0000 7fbbcb94f640 1 -- 172.21.15.57:0/684887709 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fbba80678c0 msgr2=0x7fbba8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:58.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.709+0000 7fbbcb94f640 1 --2- 172.21.15.57:0/684887709 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fbba80678c0 0x7fbba8069d80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbbc00b1000 tx=0x7fbbc0004740 comp rx=0 tx=0).stop 2024-04-24T23:38:58.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.709+0000 7fbbcb94f640 1 -- 172.21.15.57:0/684887709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbc4072980 msgr2=0x7fbbc4148c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:58.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.709+0000 7fbbcb94f640 1 --2- 172.21.15.57:0/684887709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbc4072980 0x7fbbc4148c70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbbb400c370 tx=0x7fbbb400c830 comp rx=0 tx=0).stop 2024-04-24T23:38:58.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.709+0000 7fbbcb94f640 1 -- 172.21.15.57:0/684887709 shutdown_connections 2024-04-24T23:38:58.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.709+0000 7fbbcb94f640 1 --2- 172.21.15.57:0/684887709 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fbba80678c0 0x7fbba8069d80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:58.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.709+0000 7fbbcb94f640 1 --2- 172.21.15.57:0/684887709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbc414ada0 0x7fbbc4147550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:58.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.709+0000 7fbbcb94f640 1 --2- 172.21.15.57:0/684887709 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbbc40bde80 0x7fbbc4150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:58.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.709+0000 7fbbcb94f640 1 --2- 172.21.15.57:0/684887709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbc4072980 0x7fbbc4148c70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:58.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.709+0000 7fbbcb94f640 1 -- 172.21.15.57:0/684887709 >> 172.21.15.57:0/684887709 conn(0x7fbbc40beab0 msgr2=0x7fbbc406e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:58.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.709+0000 7fbbcb94f640 1 -- 172.21.15.57:0/684887709 shutdown_connections 2024-04-24T23:38:58.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.709+0000 7fbbcb94f640 1 -- 172.21.15.57:0/684887709 wait complete. 2024-04-24T23:38:58.726 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-04-24T23:38:57.548045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234996,"kb_used_data":2176,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739724,"statfs":{"total":773094113280,"available":772853477376,"internally_reserved":0,"allocated":2228224,"data_stored":1992064,"data_compressed":67594,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004774"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373865+0000","last_change":"2024-04-24T23:38:33.135015+0000","last_active":"2024-04-24T23:38:39.373865+0000","last_peered":"2024-04-24T23:38:39.373865+0000","last_clean":"2024-04-24T23:38:39.373865+0000","last_became_active":"2024-04-24T23:38:33.134584+0000","last_became_peered":"2024-04-24T23:38:33.134584+0000","last_unstale":"2024-04-24T23:38:39.373865+0000","last_undegraded":"2024-04-24T23:38:39.373865+0000","last_fullsized":"2024-04-24T23:38:39.373865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:21.418436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370791+0000","last_change":"2024-04-24T23:38:34.164655+0000","last_active":"2024-04-24T23:38:39.370791+0000","last_peered":"2024-04-24T23:38:39.370791+0000","last_clean":"2024-04-24T23:38:39.370791+0000","last_became_active":"2024-04-24T23:38:34.162093+0000","last_became_peered":"2024-04-24T23:38:34.162093+0000","last_unstale":"2024-04-24T23:38:39.370791+0000","last_undegraded":"2024-04-24T23:38:39.370791+0000","last_fullsized":"2024-04-24T23:38:39.370791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370307+0000","last_change":"2024-04-24T23:38:38.252169+0000","last_active":"2024-04-24T23:38:39.370307+0000","last_peered":"2024-04-24T23:38:39.370307+0000","last_clean":"2024-04-24T23:38:39.370307+0000","last_became_active":"2024-04-24T23:38:38.251653+0000","last_became_peered":"2024-04-24T23:38:38.251653+0000","last_unstale":"2024-04-24T23:38:39.370307+0000","last_undegraded":"2024-04-24T23:38:39.370307+0000","last_fullsized":"2024-04-24T23:38:39.370307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:57.651551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371463+0000","last_change":"2024-04-24T23:38:33.124025+0000","last_active":"2024-04-24T23:38:39.371463+0000","last_peered":"2024-04-24T23:38:39.371463+0000","last_clean":"2024-04-24T23:38:39.371463+0000","last_became_active":"2024-04-24T23:38:33.123681+0000","last_became_peered":"2024-04-24T23:38:33.123681+0000","last_unstale":"2024-04-24T23:38:39.371463+0000","last_undegraded":"2024-04-24T23:38:39.371463+0000","last_fullsized":"2024-04-24T23:38:39.371463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:27:41.421732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373542+0000","last_change":"2024-04-24T23:38:34.169793+0000","last_active":"2024-04-24T23:38:39.373542+0000","last_peered":"2024-04-24T23:38:39.373542+0000","last_clean":"2024-04-24T23:38:39.373542+0000","last_became_active":"2024-04-24T23:38:34.169115+0000","last_became_peered":"2024-04-24T23:38:34.169115+0000","last_unstale":"2024-04-24T23:38:39.373542+0000","last_undegraded":"2024-04-24T23:38:39.373542+0000","last_fullsized":"2024-04-24T23:38:39.373542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:39.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.234391+0000","last_change":"2024-04-24T23:38:38.221580+0000","last_active":"2024-04-24T23:38:39.234391+0000","last_peered":"2024-04-24T23:38:39.234391+0000","last_clean":"2024-04-24T23:38:39.234391+0000","last_became_active":"2024-04-24T23:38:38.220392+0000","last_became_peered":"2024-04-24T23:38:38.220392+0000","last_unstale":"2024-04-24T23:38:39.234391+0000","last_undegraded":"2024-04-24T23:38:39.234391+0000","last_fullsized":"2024-04-24T23:38:39.234391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:16:01.852170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372470+0000","last_change":"2024-04-24T23:38:33.144231+0000","last_active":"2024-04-24T23:38:39.372470+0000","last_peered":"2024-04-24T23:38:39.372470+0000","last_clean":"2024-04-24T23:38:39.372470+0000","last_became_active":"2024-04-24T23:38:33.143542+0000","last_became_peered":"2024-04-24T23:38:33.143542+0000","last_unstale":"2024-04-24T23:38:39.372470+0000","last_undegraded":"2024-04-24T23:38:39.372470+0000","last_fullsized":"2024-04-24T23:38:39.372470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:09.575181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371937+0000","last_change":"2024-04-24T23:38:34.170796+0000","last_active":"2024-04-24T23:38:39.371937+0000","last_peered":"2024-04-24T23:38:39.371937+0000","last_clean":"2024-04-24T23:38:39.371937+0000","last_became_active":"2024-04-24T23:38:34.169908+0000","last_became_peered":"2024-04-24T23:38:34.169908+0000","last_unstale":"2024-04-24T23:38:39.371937+0000","last_undegraded":"2024-04-24T23:38:39.371937+0000","last_fullsized":"2024-04-24T23:38:39.371937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:17:07.009163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.234557+0000","last_change":"2024-04-24T23:38:38.218416+0000","last_active":"2024-04-24T23:38:39.234557+0000","last_peered":"2024-04-24T23:38:39.234557+0000","last_clean":"2024-04-24T23:38:39.234557+0000","last_became_active":"2024-04-24T23:38:38.217390+0000","last_became_peered":"2024-04-24T23:38:38.217390+0000","last_unstale":"2024-04-24T23:38:39.234557+0000","last_undegraded":"2024-04-24T23:38:39.234557+0000","last_fullsized":"2024-04-24T23:38:39.234557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:31.231780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371812+0000","last_change":"2024-04-24T23:38:33.149114+0000","last_active":"2024-04-24T23:38:39.371812+0000","last_peered":"2024-04-24T23:38:39.371812+0000","last_clean":"2024-04-24T23:38:39.371812+0000","last_became_active":"2024-04-24T23:38:33.148510+0000","last_became_peered":"2024-04-24T23:38:33.148510+0000","last_unstale":"2024-04-24T23:38:39.371812+0000","last_undegraded":"2024-04-24T23:38:39.371812+0000","last_fullsized":"2024-04-24T23:38:39.371812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:39.396571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373009+0000","last_change":"2024-04-24T23:38:34.153747+0000","last_active":"2024-04-24T23:38:39.373009+0000","last_peered":"2024-04-24T23:38:39.373009+0000","last_clean":"2024-04-24T23:38:39.373009+0000","last_became_active":"2024-04-24T23:38:34.152984+0000","last_became_peered":"2024-04-24T23:38:34.152984+0000","last_unstale":"2024-04-24T23:38:39.373009+0000","last_undegraded":"2024-04-24T23:38:39.373009+0000","last_fullsized":"2024-04-24T23:38:39.373009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:54.469544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233889+0000","last_change":"2024-04-24T23:38:38.222542+0000","last_active":"2024-04-24T23:38:39.233889+0000","last_peered":"2024-04-24T23:38:39.233889+0000","last_clean":"2024-04-24T23:38:39.233889+0000","last_became_active":"2024-04-24T23:38:38.220601+0000","last_became_peered":"2024-04-24T23:38:38.220601+0000","last_unstale":"2024-04-24T23:38:39.233889+0000","last_undegraded":"2024-04-24T23:38:39.233889+0000","last_fullsized":"2024-04-24T23:38:39.233889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:32.372869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233089+0000","last_change":"2024-04-24T23:38:34.142429+0000","last_active":"2024-04-24T23:38:39.233089+0000","last_peered":"2024-04-24T23:38:39.233089+0000","last_clean":"2024-04-24T23:38:39.233089+0000","last_became_active":"2024-04-24T23:38:34.141681+0000","last_became_peered":"2024-04-24T23:38:34.141681+0000","last_unstale":"2024-04-24T23:38:39.233089+0000","last_undegraded":"2024-04-24T23:38:39.233089+0000","last_fullsized":"2024-04-24T23:38:39.233089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:57:25.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371592+0000","last_change":"2024-04-24T23:38:33.140585+0000","last_active":"2024-04-24T23:38:39.371592+0000","last_peered":"2024-04-24T23:38:39.371592+0000","last_clean":"2024-04-24T23:38:39.371592+0000","last_became_active":"2024-04-24T23:38:33.139303+0000","last_became_peered":"2024-04-24T23:38:33.139303+0000","last_unstale":"2024-04-24T23:38:39.371592+0000","last_undegraded":"2024-04-24T23:38:39.371592+0000","last_fullsized":"2024-04-24T23:38:39.371592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:23.343617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.237020+0000","last_change":"2024-04-24T23:38:38.216184+0000","last_active":"2024-04-24T23:38:39.237020+0000","last_peered":"2024-04-24T23:38:39.237020+0000","last_clean":"2024-04-24T23:38:39.237020+0000","last_became_active":"2024-04-24T23:38:38.214813+0000","last_became_peered":"2024-04-24T23:38:38.214813+0000","last_unstale":"2024-04-24T23:38:39.237020+0000","last_undegraded":"2024-04-24T23:38:39.237020+0000","last_fullsized":"2024-04-24T23:38:39.237020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:58.553943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371206+0000","last_change":"2024-04-24T23:38:34.174790+0000","last_active":"2024-04-24T23:38:39.371206+0000","last_peered":"2024-04-24T23:38:39.371206+0000","last_clean":"2024-04-24T23:38:39.371206+0000","last_became_active":"2024-04-24T23:38:34.174504+0000","last_became_peered":"2024-04-24T23:38:34.174504+0000","last_unstale":"2024-04-24T23:38:39.371206+0000","last_undegraded":"2024-04-24T23:38:39.371206+0000","last_fullsized":"2024-04-24T23:38:39.371206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:27.147380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.368995+0000","last_change":"2024-04-24T23:38:33.125559+0000","last_active":"2024-04-24T23:38:39.368995+0000","last_peered":"2024-04-24T23:38:39.368995+0000","last_clean":"2024-04-24T23:38:39.368995+0000","last_became_active":"2024-04-24T23:38:33.125115+0000","last_became_peered":"2024-04-24T23:38:33.125115+0000","last_unstale":"2024-04-24T23:38:39.368995+0000","last_undegraded":"2024-04-24T23:38:39.368995+0000","last_fullsized":"2024-04-24T23:38:39.368995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:07.598128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.236267+0000","last_change":"2024-04-24T23:38:38.221669+0000","last_active":"2024-04-24T23:38:39.236267+0000","last_peered":"2024-04-24T23:38:39.236267+0000","last_clean":"2024-04-24T23:38:39.236267+0000","last_became_active":"2024-04-24T23:38:38.219797+0000","last_became_peered":"2024-04-24T23:38:38.219797+0000","last_unstale":"2024-04-24T23:38:39.236267+0000","last_undegraded":"2024-04-24T23:38:39.236267+0000","last_fullsized":"2024-04-24T23:38:39.236267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:04.091622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370565+0000","last_change":"2024-04-24T23:38:34.163966+0000","last_active":"2024-04-24T23:38:39.370565+0000","last_peered":"2024-04-24T23:38:39.370565+0000","last_clean":"2024-04-24T23:38:39.370565+0000","last_became_active":"2024-04-24T23:38:34.163291+0000","last_became_peered":"2024-04-24T23:38:34.163291+0000","last_unstale":"2024-04-24T23:38:39.370565+0000","last_undegraded":"2024-04-24T23:38:39.370565+0000","last_fullsized":"2024-04-24T23:38:39.370565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:34.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.368689+0000","last_change":"2024-04-24T23:38:33.119549+0000","last_active":"2024-04-24T23:38:39.368689+0000","last_peered":"2024-04-24T23:38:39.368689+0000","last_clean":"2024-04-24T23:38:39.368689+0000","last_became_active":"2024-04-24T23:38:33.119052+0000","last_became_peered":"2024-04-24T23:38:33.119052+0000","last_unstale":"2024-04-24T23:38:39.368689+0000","last_undegraded":"2024-04-24T23:38:39.368689+0000","last_fullsized":"2024-04-24T23:38:39.368689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369506+0000","last_change":"2024-04-24T23:38:38.252720+0000","last_active":"2024-04-24T23:38:39.369506+0000","last_peered":"2024-04-24T23:38:39.369506+0000","last_clean":"2024-04-24T23:38:39.369506+0000","last_became_active":"2024-04-24T23:38:38.252138+0000","last_became_peered":"2024-04-24T23:38:38.252138+0000","last_unstale":"2024-04-24T23:38:39.369506+0000","last_undegraded":"2024-04-24T23:38:39.369506+0000","last_fullsized":"2024-04-24T23:38:39.369506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:18.964372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.234166+0000","last_change":"2024-04-24T23:38:34.157008+0000","last_active":"2024-04-24T23:38:39.234166+0000","last_peered":"2024-04-24T23:38:39.234166+0000","last_clean":"2024-04-24T23:38:39.234166+0000","last_became_active":"2024-04-24T23:38:34.152682+0000","last_became_peered":"2024-04-24T23:38:34.152682+0000","last_unstale":"2024-04-24T23:38:39.234166+0000","last_undegraded":"2024-04-24T23:38:39.234166+0000","last_fullsized":"2024-04-24T23:38:39.234166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:48.697457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370213+0000","last_change":"2024-04-24T23:38:33.139819+0000","last_active":"2024-04-24T23:38:39.370213+0000","last_peered":"2024-04-24T23:38:39.370213+0000","last_clean":"2024-04-24T23:38:39.370213+0000","last_became_active":"2024-04-24T23:38:33.139175+0000","last_became_peered":"2024-04-24T23:38:33.139175+0000","last_unstale":"2024-04-24T23:38:39.370213+0000","last_undegraded":"2024-04-24T23:38:39.370213+0000","last_fullsized":"2024-04-24T23:38:39.370213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:52.007425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.236331+0000","last_change":"2024-04-24T23:38:38.217726+0000","last_active":"2024-04-24T23:38:39.236331+0000","last_peered":"2024-04-24T23:38:39.236331+0000","last_clean":"2024-04-24T23:38:39.236331+0000","last_became_active":"2024-04-24T23:38:38.216742+0000","last_became_peered":"2024-04-24T23:38:38.216742+0000","last_unstale":"2024-04-24T23:38:39.236331+0000","last_undegraded":"2024-04-24T23:38:39.236331+0000","last_fullsized":"2024-04-24T23:38:39.236331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:09:48.267004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.374038+0000","last_change":"2024-04-24T23:38:34.154755+0000","last_active":"2024-04-24T23:38:39.374038+0000","last_peered":"2024-04-24T23:38:39.374038+0000","last_clean":"2024-04-24T23:38:39.374038+0000","last_became_active":"2024-04-24T23:38:34.153967+0000","last_became_peered":"2024-04-24T23:38:34.153967+0000","last_unstale":"2024-04-24T23:38:39.374038+0000","last_undegraded":"2024-04-24T23:38:39.374038+0000","last_fullsized":"2024-04-24T23:38:39.374038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.236385+0000","last_change":"2024-04-24T23:38:33.135885+0000","last_active":"2024-04-24T23:38:39.236385+0000","last_peered":"2024-04-24T23:38:39.236385+0000","last_clean":"2024-04-24T23:38:39.236385+0000","last_became_active":"2024-04-24T23:38:33.135225+0000","last_became_peered":"2024-04-24T23:38:33.135225+0000","last_unstale":"2024-04-24T23:38:39.236385+0000","last_undegraded":"2024-04-24T23:38:39.236385+0000","last_fullsized":"2024-04-24T23:38:39.236385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:52.007425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233734+0000","last_change":"2024-04-24T23:38:38.252002+0000","last_active":"2024-04-24T23:38:39.233734+0000","last_peered":"2024-04-24T23:38:39.233734+0000","last_clean":"2024-04-24T23:38:39.233734+0000","last_became_active":"2024-04-24T23:38:38.251057+0000","last_became_peered":"2024-04-24T23:38:38.251057+0000","last_unstale":"2024-04-24T23:38:39.233734+0000","last_undegraded":"2024-04-24T23:38:39.233734+0000","last_fullsized":"2024-04-24T23:38:39.233734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:49.920273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372125+0000","last_change":"2024-04-24T23:38:34.197959+0000","last_active":"2024-04-24T23:38:39.372125+0000","last_peered":"2024-04-24T23:38:39.372125+0000","last_clean":"2024-04-24T23:38:39.372125+0000","last_became_active":"2024-04-24T23:38:34.197702+0000","last_became_peered":"2024-04-24T23:38:34.197702+0000","last_unstale":"2024-04-24T23:38:39.372125+0000","last_undegraded":"2024-04-24T23:38:39.372125+0000","last_fullsized":"2024-04-24T23:38:39.372125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:56.049789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369618+0000","last_change":"2024-04-24T23:38:33.115409+0000","last_active":"2024-04-24T23:38:39.369618+0000","last_peered":"2024-04-24T23:38:39.369618+0000","last_clean":"2024-04-24T23:38:39.369618+0000","last_became_active":"2024-04-24T23:38:33.115039+0000","last_became_peered":"2024-04-24T23:38:33.115039+0000","last_unstale":"2024-04-24T23:38:39.369618+0000","last_undegraded":"2024-04-24T23:38:39.369618+0000","last_fullsized":"2024-04-24T23:38:39.369618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:52.007425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370020+0000","last_change":"2024-04-24T23:38:38.246602+0000","last_active":"2024-04-24T23:38:39.370020+0000","last_peered":"2024-04-24T23:38:39.370020+0000","last_clean":"2024-04-24T23:38:39.370020+0000","last_became_active":"2024-04-24T23:38:38.245775+0000","last_became_peered":"2024-04-24T23:38:38.245775+0000","last_unstale":"2024-04-24T23:38:39.370020+0000","last_undegraded":"2024-04-24T23:38:39.370020+0000","last_fullsized":"2024-04-24T23:38:39.370020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:29.684133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371153+0000","last_change":"2024-04-24T23:38:34.149008+0000","last_active":"2024-04-24T23:38:39.371153+0000","last_peered":"2024-04-24T23:38:39.371153+0000","last_clean":"2024-04-24T23:38:39.371153+0000","last_became_active":"2024-04-24T23:38:34.148122+0000","last_became_peered":"2024-04-24T23:38:34.148122+0000","last_unstale":"2024-04-24T23:38:39.371153+0000","last_undegraded":"2024-04-24T23:38:39.371153+0000","last_fullsized":"2024-04-24T23:38:39.371153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:39.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372690+0000","last_change":"2024-04-24T23:38:33.142490+0000","last_active":"2024-04-24T23:38:39.372690+0000","last_peered":"2024-04-24T23:38:39.372690+0000","last_clean":"2024-04-24T23:38:39.372690+0000","last_became_active":"2024-04-24T23:38:33.140003+0000","last_became_peered":"2024-04-24T23:38:33.140003+0000","last_unstale":"2024-04-24T23:38:39.372690+0000","last_undegraded":"2024-04-24T23:38:39.372690+0000","last_fullsized":"2024-04-24T23:38:39.372690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:45:12.216173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373352+0000","last_change":"2024-04-24T23:38:38.246291+0000","last_active":"2024-04-24T23:38:39.373352+0000","last_peered":"2024-04-24T23:38:39.373352+0000","last_clean":"2024-04-24T23:38:39.373352+0000","last_became_active":"2024-04-24T23:38:38.245611+0000","last_became_peered":"2024-04-24T23:38:38.245611+0000","last_unstale":"2024-04-24T23:38:39.373352+0000","last_undegraded":"2024-04-24T23:38:39.373352+0000","last_fullsized":"2024-04-24T23:38:39.373352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:47.898644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373130+0000","last_change":"2024-04-24T23:38:34.186285+0000","last_active":"2024-04-24T23:38:39.373130+0000","last_peered":"2024-04-24T23:38:39.373130+0000","last_clean":"2024-04-24T23:38:39.373130+0000","last_became_active":"2024-04-24T23:38:34.185023+0000","last_became_peered":"2024-04-24T23:38:34.185023+0000","last_unstale":"2024-04-24T23:38:39.373130+0000","last_undegraded":"2024-04-24T23:38:39.373130+0000","last_fullsized":"2024-04-24T23:38:39.373130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:56.947423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371300+0000","last_change":"2024-04-24T23:38:33.108447+0000","last_active":"2024-04-24T23:38:39.371300+0000","last_peered":"2024-04-24T23:38:39.371300+0000","last_clean":"2024-04-24T23:38:39.371300+0000","last_became_active":"2024-04-24T23:38:33.108102+0000","last_became_peered":"2024-04-24T23:38:33.108102+0000","last_unstale":"2024-04-24T23:38:39.371300+0000","last_undegraded":"2024-04-24T23:38:39.371300+0000","last_fullsized":"2024-04-24T23:38:39.371300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:47.686974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.368678+0000","last_change":"2024-04-24T23:38:38.213425+0000","last_active":"2024-04-24T23:38:39.368678+0000","last_peered":"2024-04-24T23:38:39.368678+0000","last_clean":"2024-04-24T23:38:39.368678+0000","last_became_active":"2024-04-24T23:38:38.212691+0000","last_became_peered":"2024-04-24T23:38:38.212691+0000","last_unstale":"2024-04-24T23:38:39.368678+0000","last_undegraded":"2024-04-24T23:38:39.368678+0000","last_fullsized":"2024-04-24T23:38:39.368678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:01.031822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.235941+0000","last_change":"2024-04-24T23:38:34.154178+0000","last_active":"2024-04-24T23:38:39.235941+0000","last_peered":"2024-04-24T23:38:39.235941+0000","last_clean":"2024-04-24T23:38:39.235941+0000","last_became_active":"2024-04-24T23:38:34.153372+0000","last_became_peered":"2024-04-24T23:38:34.153372+0000","last_unstale":"2024-04-24T23:38:39.235941+0000","last_undegraded":"2024-04-24T23:38:39.235941+0000","last_fullsized":"2024-04-24T23:38:39.235941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:10.585665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370977+0000","last_change":"2024-04-24T23:38:33.140060+0000","last_active":"2024-04-24T23:38:39.370977+0000","last_peered":"2024-04-24T23:38:39.370977+0000","last_clean":"2024-04-24T23:38:39.370977+0000","last_became_active":"2024-04-24T23:38:33.139012+0000","last_became_peered":"2024-04-24T23:38:33.139012+0000","last_unstale":"2024-04-24T23:38:39.370977+0000","last_undegraded":"2024-04-24T23:38:39.370977+0000","last_fullsized":"2024-04-24T23:38:39.370977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371155+0000","last_change":"2024-04-24T23:38:38.209741+0000","last_active":"2024-04-24T23:38:39.371155+0000","last_peered":"2024-04-24T23:38:39.371155+0000","last_clean":"2024-04-24T23:38:39.371155+0000","last_became_active":"2024-04-24T23:38:38.209117+0000","last_became_peered":"2024-04-24T23:38:38.209117+0000","last_unstale":"2024-04-24T23:38:39.371155+0000","last_undegraded":"2024-04-24T23:38:39.371155+0000","last_fullsized":"2024-04-24T23:38:39.371155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:57.246661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369969+0000","last_change":"2024-04-24T23:38:34.152846+0000","last_active":"2024-04-24T23:38:39.369969+0000","last_peered":"2024-04-24T23:38:39.369969+0000","last_clean":"2024-04-24T23:38:39.369969+0000","last_became_active":"2024-04-24T23:38:34.151917+0000","last_became_peered":"2024-04-24T23:38:34.151917+0000","last_unstale":"2024-04-24T23:38:39.369969+0000","last_undegraded":"2024-04-24T23:38:39.369969+0000","last_fullsized":"2024-04-24T23:38:39.369969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:34.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233390+0000","last_change":"2024-04-24T23:38:33.124295+0000","last_active":"2024-04-24T23:38:39.233390+0000","last_peered":"2024-04-24T23:38:39.233390+0000","last_clean":"2024-04-24T23:38:39.233390+0000","last_became_active":"2024-04-24T23:38:33.123674+0000","last_became_peered":"2024-04-24T23:38:33.123674+0000","last_unstale":"2024-04-24T23:38:39.233390+0000","last_undegraded":"2024-04-24T23:38:39.233390+0000","last_fullsized":"2024-04-24T23:38:39.233390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369687+0000","last_change":"2024-04-24T23:38:38.214721+0000","last_active":"2024-04-24T23:38:39.369687+0000","last_peered":"2024-04-24T23:38:39.369687+0000","last_clean":"2024-04-24T23:38:39.369687+0000","last_became_active":"2024-04-24T23:38:38.214005+0000","last_became_peered":"2024-04-24T23:38:38.214005+0000","last_unstale":"2024-04-24T23:38:39.369687+0000","last_undegraded":"2024-04-24T23:38:39.369687+0000","last_fullsized":"2024-04-24T23:38:39.369687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:29:56.066046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371950+0000","last_change":"2024-04-24T23:38:34.139551+0000","last_active":"2024-04-24T23:38:39.371950+0000","last_peered":"2024-04-24T23:38:39.371950+0000","last_clean":"2024-04-24T23:38:39.371950+0000","last_became_active":"2024-04-24T23:38:34.138681+0000","last_became_peered":"2024-04-24T23:38:34.138681+0000","last_unstale":"2024-04-24T23:38:39.371950+0000","last_undegraded":"2024-04-24T23:38:39.371950+0000","last_fullsized":"2024-04-24T23:38:39.371950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:47.556651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370480+0000","last_change":"2024-04-24T23:38:33.141279+0000","last_active":"2024-04-24T23:38:39.370480+0000","last_peered":"2024-04-24T23:38:39.370480+0000","last_clean":"2024-04-24T23:38:39.370480+0000","last_became_active":"2024-04-24T23:38:33.140618+0000","last_became_peered":"2024-04-24T23:38:33.140618+0000","last_unstale":"2024-04-24T23:38:39.370480+0000","last_undegraded":"2024-04-24T23:38:39.370480+0000","last_fullsized":"2024-04-24T23:38:39.370480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373893+0000","last_change":"2024-04-24T23:38:38.250074+0000","last_active":"2024-04-24T23:38:39.373893+0000","last_peered":"2024-04-24T23:38:39.373893+0000","last_clean":"2024-04-24T23:38:39.373893+0000","last_became_active":"2024-04-24T23:38:38.249402+0000","last_became_peered":"2024-04-24T23:38:38.249402+0000","last_unstale":"2024-04-24T23:38:39.373893+0000","last_undegraded":"2024-04-24T23:38:39.373893+0000","last_fullsized":"2024-04-24T23:38:39.373893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:57.246661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370993+0000","last_change":"2024-04-24T23:38:34.187980+0000","last_active":"2024-04-24T23:38:39.370993+0000","last_peered":"2024-04-24T23:38:39.370993+0000","last_clean":"2024-04-24T23:38:39.370993+0000","last_became_active":"2024-04-24T23:38:34.187655+0000","last_became_peered":"2024-04-24T23:38:34.187655+0000","last_unstale":"2024-04-24T23:38:39.370993+0000","last_undegraded":"2024-04-24T23:38:39.370993+0000","last_fullsized":"2024-04-24T23:38:39.370993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:39.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371342+0000","last_change":"2024-04-24T23:38:33.125255+0000","last_active":"2024-04-24T23:38:39.371342+0000","last_peered":"2024-04-24T23:38:39.371342+0000","last_clean":"2024-04-24T23:38:39.371342+0000","last_became_active":"2024-04-24T23:38:33.115926+0000","last_became_peered":"2024-04-24T23:38:33.115926+0000","last_unstale":"2024-04-24T23:38:39.371342+0000","last_undegraded":"2024-04-24T23:38:39.371342+0000","last_fullsized":"2024-04-24T23:38:39.371342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:42.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370492+0000","last_change":"2024-04-24T23:38:29.564705+0000","last_active":"2024-04-24T23:38:39.370492+0000","last_peered":"2024-04-24T23:38:39.370492+0000","last_clean":"2024-04-24T23:38:39.370492+0000","last_became_active":"2024-04-24T23:38:29.562027+0000","last_became_peered":"2024-04-24T23:38:29.562027+0000","last_unstale":"2024-04-24T23:38:39.370492+0000","last_undegraded":"2024-04-24T23:38:39.370492+0000","last_fullsized":"2024-04-24T23:38:39.370492+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:27.959678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:27.959678+0000","last_clean_scrub_stamp":"2024-04-24T23:38:27.959678+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:40.724497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.234993+0000","last_change":"2024-04-24T23:38:38.254846+0000","last_active":"2024-04-24T23:38:39.234993+0000","last_peered":"2024-04-24T23:38:39.234993+0000","last_clean":"2024-04-24T23:38:39.234993+0000","last_became_active":"2024-04-24T23:38:38.253792+0000","last_became_peered":"2024-04-24T23:38:38.253792+0000","last_unstale":"2024-04-24T23:38:39.234993+0000","last_undegraded":"2024-04-24T23:38:39.234993+0000","last_fullsized":"2024-04-24T23:38:39.234993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:17:11.093562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372209+0000","last_change":"2024-04-24T23:38:34.195003+0000","last_active":"2024-04-24T23:38:39.372209+0000","last_peered":"2024-04-24T23:38:39.372209+0000","last_clean":"2024-04-24T23:38:39.372209+0000","last_became_active":"2024-04-24T23:38:34.194530+0000","last_became_peered":"2024-04-24T23:38:34.194530+0000","last_unstale":"2024-04-24T23:38:39.372209+0000","last_undegraded":"2024-04-24T23:38:39.372209+0000","last_fullsized":"2024-04-24T23:38:39.372209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:00.007223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233847+0000","last_change":"2024-04-24T23:38:33.130165+0000","last_active":"2024-04-24T23:38:39.233847+0000","last_peered":"2024-04-24T23:38:39.233847+0000","last_clean":"2024-04-24T23:38:39.233847+0000","last_became_active":"2024-04-24T23:38:33.129888+0000","last_became_peered":"2024-04-24T23:38:33.129888+0000","last_unstale":"2024-04-24T23:38:39.233847+0000","last_undegraded":"2024-04-24T23:38:39.233847+0000","last_fullsized":"2024-04-24T23:38:39.233847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:27:41.421732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233796+0000","last_change":"2024-04-24T23:38:38.253780+0000","last_active":"2024-04-24T23:38:39.233796+0000","last_peered":"2024-04-24T23:38:39.233796+0000","last_clean":"2024-04-24T23:38:39.233796+0000","last_became_active":"2024-04-24T23:38:38.252899+0000","last_became_peered":"2024-04-24T23:38:38.252899+0000","last_unstale":"2024-04-24T23:38:39.233796+0000","last_undegraded":"2024-04-24T23:38:39.233796+0000","last_fullsized":"2024-04-24T23:38:39.233796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:58.553943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372148+0000","last_change":"2024-04-24T23:38:34.187942+0000","last_active":"2024-04-24T23:38:39.372148+0000","last_peered":"2024-04-24T23:38:39.372148+0000","last_clean":"2024-04-24T23:38:39.372148+0000","last_became_active":"2024-04-24T23:38:34.184929+0000","last_became_peered":"2024-04-24T23:38:34.184929+0000","last_unstale":"2024-04-24T23:38:39.372148+0000","last_undegraded":"2024-04-24T23:38:39.372148+0000","last_fullsized":"2024-04-24T23:38:39.372148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:43.814245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369941+0000","last_change":"2024-04-24T23:38:33.120289+0000","last_active":"2024-04-24T23:38:39.369941+0000","last_peered":"2024-04-24T23:38:39.369941+0000","last_clean":"2024-04-24T23:38:39.369941+0000","last_became_active":"2024-04-24T23:38:33.119790+0000","last_became_peered":"2024-04-24T23:38:33.119790+0000","last_unstale":"2024-04-24T23:38:39.369941+0000","last_undegraded":"2024-04-24T23:38:39.369941+0000","last_fullsized":"2024-04-24T23:38:39.369941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373416+0000","last_change":"2024-04-24T23:38:38.216064+0000","last_active":"2024-04-24T23:38:39.373416+0000","last_peered":"2024-04-24T23:38:39.373416+0000","last_clean":"2024-04-24T23:38:39.373416+0000","last_became_active":"2024-04-24T23:38:38.215599+0000","last_became_peered":"2024-04-24T23:38:38.215599+0000","last_unstale":"2024-04-24T23:38:39.373416+0000","last_undegraded":"2024-04-24T23:38:39.373416+0000","last_fullsized":"2024-04-24T23:38:39.373416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:01.031822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373089+0000","last_change":"2024-04-24T23:38:34.194305+0000","last_active":"2024-04-24T23:38:39.373089+0000","last_peered":"2024-04-24T23:38:39.373089+0000","last_clean":"2024-04-24T23:38:39.373089+0000","last_became_active":"2024-04-24T23:38:34.188815+0000","last_became_peered":"2024-04-24T23:38:34.188815+0000","last_unstale":"2024-04-24T23:38:39.373089+0000","last_undegraded":"2024-04-24T23:38:39.373089+0000","last_fullsized":"2024-04-24T23:38:39.373089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:25.599734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233801+0000","last_change":"2024-04-24T23:38:33.125221+0000","last_active":"2024-04-24T23:38:39.233801+0000","last_peered":"2024-04-24T23:38:39.233801+0000","last_clean":"2024-04-24T23:38:39.233801+0000","last_became_active":"2024-04-24T23:38:33.124849+0000","last_became_peered":"2024-04-24T23:38:33.124849+0000","last_unstale":"2024-04-24T23:38:39.233801+0000","last_undegraded":"2024-04-24T23:38:39.233801+0000","last_fullsized":"2024-04-24T23:38:39.233801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:42.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369725+0000","last_change":"2024-04-24T23:38:38.250618+0000","last_active":"2024-04-24T23:38:39.369725+0000","last_peered":"2024-04-24T23:38:39.369725+0000","last_clean":"2024-04-24T23:38:39.369725+0000","last_became_active":"2024-04-24T23:38:38.249521+0000","last_became_peered":"2024-04-24T23:38:38.249521+0000","last_unstale":"2024-04-24T23:38:39.369725+0000","last_undegraded":"2024-04-24T23:38:39.369725+0000","last_fullsized":"2024-04-24T23:38:39.369725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:57.651551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372769+0000","last_change":"2024-04-24T23:38:34.166018+0000","last_active":"2024-04-24T23:38:39.372769+0000","last_peered":"2024-04-24T23:38:39.372769+0000","last_clean":"2024-04-24T23:38:39.372769+0000","last_became_active":"2024-04-24T23:38:34.165229+0000","last_became_peered":"2024-04-24T23:38:34.165229+0000","last_unstale":"2024-04-24T23:38:39.372769+0000","last_undegraded":"2024-04-24T23:38:39.372769+0000","last_fullsized":"2024-04-24T23:38:39.372769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:56.947423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.236714+0000","last_change":"2024-04-24T23:38:33.109771+0000","last_active":"2024-04-24T23:38:39.236714+0000","last_peered":"2024-04-24T23:38:39.236714+0000","last_clean":"2024-04-24T23:38:39.236714+0000","last_became_active":"2024-04-24T23:38:33.108928+0000","last_became_peered":"2024-04-24T23:38:33.108928+0000","last_unstale":"2024-04-24T23:38:39.236714+0000","last_undegraded":"2024-04-24T23:38:39.236714+0000","last_fullsized":"2024-04-24T23:38:39.236714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:44.838533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233300+0000","last_change":"2024-04-24T23:38:38.221186+0000","last_active":"2024-04-24T23:38:39.233300+0000","last_peered":"2024-04-24T23:38:39.233300+0000","last_clean":"2024-04-24T23:38:39.233300+0000","last_became_active":"2024-04-24T23:38:38.219780+0000","last_became_peered":"2024-04-24T23:38:38.219780+0000","last_unstale":"2024-04-24T23:38:39.233300+0000","last_undegraded":"2024-04-24T23:38:39.233300+0000","last_fullsized":"2024-04-24T23:38:39.233300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:43.959509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370916+0000","last_change":"2024-04-24T23:38:34.188981+0000","last_active":"2024-04-24T23:38:39.370916+0000","last_peered":"2024-04-24T23:38:39.370916+0000","last_clean":"2024-04-24T23:38:39.370916+0000","last_became_active":"2024-04-24T23:38:34.188416+0000","last_became_peered":"2024-04-24T23:38:34.188416+0000","last_unstale":"2024-04-24T23:38:39.370916+0000","last_undegraded":"2024-04-24T23:38:39.370916+0000","last_fullsized":"2024-04-24T23:38:39.370916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:17:07.009163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.232834+0000","last_change":"2024-04-24T23:38:33.100912+0000","last_active":"2024-04-24T23:38:39.232834+0000","last_peered":"2024-04-24T23:38:39.232834+0000","last_clean":"2024-04-24T23:38:39.232834+0000","last_became_active":"2024-04-24T23:38:33.100464+0000","last_became_peered":"2024-04-24T23:38:33.100464+0000","last_unstale":"2024-04-24T23:38:39.232834+0000","last_undegraded":"2024-04-24T23:38:39.232834+0000","last_fullsized":"2024-04-24T23:38:39.232834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:47:27.107958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373806+0000","last_change":"2024-04-24T23:38:38.207627+0000","last_active":"2024-04-24T23:38:39.373806+0000","last_peered":"2024-04-24T23:38:39.373806+0000","last_clean":"2024-04-24T23:38:39.373806+0000","last_became_active":"2024-04-24T23:38:38.207049+0000","last_became_peered":"2024-04-24T23:38:38.207049+0000","last_unstale":"2024-04-24T23:38:39.373806+0000","last_undegraded":"2024-04-24T23:38:39.373806+0000","last_fullsized":"2024-04-24T23:38:39.373806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:29:56.066046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233320+0000","last_change":"2024-04-24T23:38:34.161654+0000","last_active":"2024-04-24T23:38:39.233320+0000","last_peered":"2024-04-24T23:38:39.233320+0000","last_clean":"2024-04-24T23:38:39.233320+0000","last_became_active":"2024-04-24T23:38:34.158756+0000","last_became_peered":"2024-04-24T23:38:34.158756+0000","last_unstale":"2024-04-24T23:38:39.233320+0000","last_undegraded":"2024-04-24T23:38:39.233320+0000","last_fullsized":"2024-04-24T23:38:39.233320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:29.660159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233535+0000","last_change":"2024-04-24T23:38:33.116071+0000","last_active":"2024-04-24T23:38:39.233535+0000","last_peered":"2024-04-24T23:38:39.233535+0000","last_clean":"2024-04-24T23:38:39.233535+0000","last_became_active":"2024-04-24T23:38:33.115472+0000","last_became_peered":"2024-04-24T23:38:33.115472+0000","last_unstale":"2024-04-24T23:38:39.233535+0000","last_undegraded":"2024-04-24T23:38:39.233535+0000","last_fullsized":"2024-04-24T23:38:39.233535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:47.686974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372026+0000","last_change":"2024-04-24T23:38:38.248841+0000","last_active":"2024-04-24T23:38:39.372026+0000","last_peered":"2024-04-24T23:38:39.372026+0000","last_clean":"2024-04-24T23:38:39.372026+0000","last_became_active":"2024-04-24T23:38:38.248311+0000","last_became_peered":"2024-04-24T23:38:38.248311+0000","last_unstale":"2024-04-24T23:38:39.372026+0000","last_undegraded":"2024-04-24T23:38:39.372026+0000","last_fullsized":"2024-04-24T23:38:39.372026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:22.798878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371400+0000","last_change":"2024-04-24T23:38:34.189772+0000","last_active":"2024-04-24T23:38:39.371400+0000","last_peered":"2024-04-24T23:38:39.371400+0000","last_clean":"2024-04-24T23:38:39.371400+0000","last_became_active":"2024-04-24T23:38:34.179801+0000","last_became_peered":"2024-04-24T23:38:34.179801+0000","last_unstale":"2024-04-24T23:38:39.371400+0000","last_undegraded":"2024-04-24T23:38:39.371400+0000","last_fullsized":"2024-04-24T23:38:39.371400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:54.469544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370810+0000","last_change":"2024-04-24T23:38:33.146611+0000","last_active":"2024-04-24T23:38:39.370810+0000","last_peered":"2024-04-24T23:38:39.370810+0000","last_clean":"2024-04-24T23:38:39.370810+0000","last_became_active":"2024-04-24T23:38:33.145896+0000","last_became_peered":"2024-04-24T23:38:33.145896+0000","last_unstale":"2024-04-24T23:38:39.370810+0000","last_undegraded":"2024-04-24T23:38:39.370810+0000","last_fullsized":"2024-04-24T23:38:39.370810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:47.686974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371670+0000","last_change":"2024-04-24T23:38:38.252023+0000","last_active":"2024-04-24T23:38:39.371670+0000","last_peered":"2024-04-24T23:38:39.371670+0000","last_clean":"2024-04-24T23:38:39.371670+0000","last_became_active":"2024-04-24T23:38:38.251541+0000","last_became_peered":"2024-04-24T23:38:38.251541+0000","last_unstale":"2024-04-24T23:38:39.371670+0000","last_undegraded":"2024-04-24T23:38:39.371670+0000","last_fullsized":"2024-04-24T23:38:39.371670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:25:30.720742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372969+0000","last_change":"2024-04-24T23:38:34.164658+0000","last_active":"2024-04-24T23:38:39.372969+0000","last_peered":"2024-04-24T23:38:39.372969+0000","last_clean":"2024-04-24T23:38:39.372969+0000","last_became_active":"2024-04-24T23:38:34.164024+0000","last_became_peered":"2024-04-24T23:38:34.164024+0000","last_unstale":"2024-04-24T23:38:39.372969+0000","last_undegraded":"2024-04-24T23:38:39.372969+0000","last_fullsized":"2024-04-24T23:38:39.372969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:47.516208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373646+0000","last_change":"2024-04-24T23:38:33.111314+0000","last_active":"2024-04-24T23:38:39.373646+0000","last_peered":"2024-04-24T23:38:39.373646+0000","last_clean":"2024-04-24T23:38:39.373646+0000","last_became_active":"2024-04-24T23:38:33.109819+0000","last_became_peered":"2024-04-24T23:38:33.109819+0000","last_unstale":"2024-04-24T23:38:39.373646+0000","last_undegraded":"2024-04-24T23:38:39.373646+0000","last_fullsized":"2024-04-24T23:38:39.373646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:21:39.944505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372849+0000","last_change":"2024-04-24T23:38:38.247323+0000","last_active":"2024-04-24T23:38:39.372849+0000","last_peered":"2024-04-24T23:38:39.372849+0000","last_clean":"2024-04-24T23:38:39.372849+0000","last_became_active":"2024-04-24T23:38:38.246172+0000","last_became_peered":"2024-04-24T23:38:38.246172+0000","last_unstale":"2024-04-24T23:38:39.372849+0000","last_undegraded":"2024-04-24T23:38:39.372849+0000","last_fullsized":"2024-04-24T23:38:39.372849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:32.771055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371920+0000","last_change":"2024-04-24T23:38:34.189746+0000","last_active":"2024-04-24T23:38:39.371920+0000","last_peered":"2024-04-24T23:38:39.371920+0000","last_clean":"2024-04-24T23:38:39.371920+0000","last_became_active":"2024-04-24T23:38:34.179433+0000","last_became_peered":"2024-04-24T23:38:34.179433+0000","last_unstale":"2024-04-24T23:38:39.371920+0000","last_undegraded":"2024-04-24T23:38:39.371920+0000","last_fullsized":"2024-04-24T23:38:39.371920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:56.049789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:44.751455+0000","last_change":"2024-04-24T23:38:33.127637+0000","last_active":"2024-04-24T23:38:44.751455+0000","last_peered":"2024-04-24T23:38:44.751455+0000","last_clean":"2024-04-24T23:38:44.751455+0000","last_became_active":"2024-04-24T23:38:33.127122+0000","last_became_peered":"2024-04-24T23:38:33.127122+0000","last_unstale":"2024-04-24T23:38:44.751455+0000","last_undegraded":"2024-04-24T23:38:44.751455+0000","last_fullsized":"2024-04-24T23:38:44.751455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.368989+0000","last_change":"2024-04-24T23:38:38.216781+0000","last_active":"2024-04-24T23:38:39.368989+0000","last_peered":"2024-04-24T23:38:39.368989+0000","last_clean":"2024-04-24T23:38:39.368989+0000","last_became_active":"2024-04-24T23:38:38.215741+0000","last_became_peered":"2024-04-24T23:38:38.215741+0000","last_unstale":"2024-04-24T23:38:39.368989+0000","last_undegraded":"2024-04-24T23:38:39.368989+0000","last_fullsized":"2024-04-24T23:38:39.368989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:47.898644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.236646+0000","last_change":"2024-04-24T23:38:34.167424+0000","last_active":"2024-04-24T23:38:39.236646+0000","last_peered":"2024-04-24T23:38:39.236646+0000","last_clean":"2024-04-24T23:38:39.236646+0000","last_became_active":"2024-04-24T23:38:34.166602+0000","last_became_peered":"2024-04-24T23:38:34.166602+0000","last_unstale":"2024-04-24T23:38:39.236646+0000","last_undegraded":"2024-04-24T23:38:39.236646+0000","last_fullsized":"2024-04-24T23:38:39.236646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:31.033906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369922+0000","last_change":"2024-04-24T23:38:33.146758+0000","last_active":"2024-04-24T23:38:39.369922+0000","last_peered":"2024-04-24T23:38:39.369922+0000","last_clean":"2024-04-24T23:38:39.369922+0000","last_became_active":"2024-04-24T23:38:33.146311+0000","last_became_peered":"2024-04-24T23:38:33.146311+0000","last_unstale":"2024-04-24T23:38:39.369922+0000","last_undegraded":"2024-04-24T23:38:39.369922+0000","last_fullsized":"2024-04-24T23:38:39.369922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:09.575181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.235128+0000","last_change":"2024-04-24T23:38:38.221177+0000","last_active":"2024-04-24T23:38:39.235128+0000","last_peered":"2024-04-24T23:38:39.235128+0000","last_clean":"2024-04-24T23:38:39.235128+0000","last_became_active":"2024-04-24T23:38:38.219482+0000","last_became_peered":"2024-04-24T23:38:38.219482+0000","last_unstale":"2024-04-24T23:38:39.235128+0000","last_undegraded":"2024-04-24T23:38:39.235128+0000","last_fullsized":"2024-04-24T23:38:39.235128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:00.134189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373742+0000","last_change":"2024-04-24T23:38:34.170044+0000","last_active":"2024-04-24T23:38:39.373742+0000","last_peered":"2024-04-24T23:38:39.373742+0000","last_clean":"2024-04-24T23:38:39.373742+0000","last_became_active":"2024-04-24T23:38:34.169512+0000","last_became_peered":"2024-04-24T23:38:34.169512+0000","last_unstale":"2024-04-24T23:38:39.373742+0000","last_undegraded":"2024-04-24T23:38:39.373742+0000","last_fullsized":"2024-04-24T23:38:39.373742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373445+0000","last_change":"2024-04-24T23:38:33.131079+0000","last_active":"2024-04-24T23:38:39.373445+0000","last_peered":"2024-04-24T23:38:39.373445+0000","last_clean":"2024-04-24T23:38:39.373445+0000","last_became_active":"2024-04-24T23:38:33.130150+0000","last_became_peered":"2024-04-24T23:38:33.130150+0000","last_unstale":"2024-04-24T23:38:39.373445+0000","last_undegraded":"2024-04-24T23:38:39.373445+0000","last_fullsized":"2024-04-24T23:38:39.373445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:07.598128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370359+0000","last_change":"2024-04-24T23:38:38.212241+0000","last_active":"2024-04-24T23:38:39.370359+0000","last_peered":"2024-04-24T23:38:39.370359+0000","last_clean":"2024-04-24T23:38:39.370359+0000","last_became_active":"2024-04-24T23:38:38.208130+0000","last_became_peered":"2024-04-24T23:38:38.208130+0000","last_unstale":"2024-04-24T23:38:39.370359+0000","last_undegraded":"2024-04-24T23:38:39.370359+0000","last_fullsized":"2024-04-24T23:38:39.370359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:32.771055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372578+0000","last_change":"2024-04-24T23:38:34.199814+0000","last_active":"2024-04-24T23:38:39.372578+0000","last_peered":"2024-04-24T23:38:39.372578+0000","last_clean":"2024-04-24T23:38:39.372578+0000","last_became_active":"2024-04-24T23:38:34.199311+0000","last_became_peered":"2024-04-24T23:38:34.199311+0000","last_unstale":"2024-04-24T23:38:39.372578+0000","last_undegraded":"2024-04-24T23:38:39.372578+0000","last_fullsized":"2024-04-24T23:38:39.372578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:09:44.182605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.235904+0000","last_change":"2024-04-24T23:38:33.140029+0000","last_active":"2024-04-24T23:38:39.235904+0000","last_peered":"2024-04-24T23:38:39.235904+0000","last_clean":"2024-04-24T23:38:39.235904+0000","last_became_active":"2024-04-24T23:38:33.139325+0000","last_became_peered":"2024-04-24T23:38:33.139325+0000","last_unstale":"2024-04-24T23:38:39.235904+0000","last_undegraded":"2024-04-24T23:38:39.235904+0000","last_fullsized":"2024-04-24T23:38:39.235904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:07.598128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370490+0000","last_change":"2024-04-24T23:38:38.246245+0000","last_active":"2024-04-24T23:38:39.370490+0000","last_peered":"2024-04-24T23:38:39.370490+0000","last_clean":"2024-04-24T23:38:39.370490+0000","last_became_active":"2024-04-24T23:38:38.245657+0000","last_became_peered":"2024-04-24T23:38:38.245657+0000","last_unstale":"2024-04-24T23:38:39.370490+0000","last_undegraded":"2024-04-24T23:38:39.370490+0000","last_fullsized":"2024-04-24T23:38:39.370490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:45.297412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373571+0000","last_change":"2024-04-24T23:38:38.251308+0000","last_active":"2024-04-24T23:38:39.373571+0000","last_peered":"2024-04-24T23:38:39.373571+0000","last_clean":"2024-04-24T23:38:39.373571+0000","last_became_active":"2024-04-24T23:38:38.250718+0000","last_became_peered":"2024-04-24T23:38:38.250718+0000","last_unstale":"2024-04-24T23:38:39.373571+0000","last_undegraded":"2024-04-24T23:38:39.373571+0000","last_fullsized":"2024-04-24T23:38:39.373571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:18.964372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.368478+0000","last_change":"2024-04-24T23:38:34.174658+0000","last_active":"2024-04-24T23:38:39.368478+0000","last_peered":"2024-04-24T23:38:39.368478+0000","last_clean":"2024-04-24T23:38:39.368478+0000","last_became_active":"2024-04-24T23:38:34.174289+0000","last_became_peered":"2024-04-24T23:38:34.174289+0000","last_unstale":"2024-04-24T23:38:39.368478+0000","last_undegraded":"2024-04-24T23:38:39.368478+0000","last_fullsized":"2024-04-24T23:38:39.368478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:29.660159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370081+0000","last_change":"2024-04-24T23:38:33.131171+0000","last_active":"2024-04-24T23:38:39.370081+0000","last_peered":"2024-04-24T23:38:39.370081+0000","last_clean":"2024-04-24T23:38:39.370081+0000","last_became_active":"2024-04-24T23:38:33.130621+0000","last_became_peered":"2024-04-24T23:38:33.130621+0000","last_unstale":"2024-04-24T23:38:39.370081+0000","last_undegraded":"2024-04-24T23:38:39.370081+0000","last_fullsized":"2024-04-24T23:38:39.370081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.237281+0000","last_change":"2024-04-24T23:38:38.214392+0000","last_active":"2024-04-24T23:38:39.237281+0000","last_peered":"2024-04-24T23:38:39.237281+0000","last_clean":"2024-04-24T23:38:39.237281+0000","last_became_active":"2024-04-24T23:38:38.213249+0000","last_became_peered":"2024-04-24T23:38:38.213249+0000","last_unstale":"2024-04-24T23:38:39.237281+0000","last_undegraded":"2024-04-24T23:38:39.237281+0000","last_fullsized":"2024-04-24T23:38:39.237281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:01.031822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370465+0000","last_change":"2024-04-24T23:38:34.164231+0000","last_active":"2024-04-24T23:38:39.370465+0000","last_peered":"2024-04-24T23:38:39.370465+0000","last_clean":"2024-04-24T23:38:39.370465+0000","last_became_active":"2024-04-24T23:38:34.163685+0000","last_became_peered":"2024-04-24T23:38:34.163685+0000","last_unstale":"2024-04-24T23:38:39.370465+0000","last_undegraded":"2024-04-24T23:38:39.370465+0000","last_fullsized":"2024-04-24T23:38:39.370465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:29.660159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370805+0000","last_change":"2024-04-24T23:38:33.116249+0000","last_active":"2024-04-24T23:38:39.370805+0000","last_peered":"2024-04-24T23:38:39.370805+0000","last_clean":"2024-04-24T23:38:39.370805+0000","last_became_active":"2024-04-24T23:38:33.113333+0000","last_became_peered":"2024-04-24T23:38:33.113333+0000","last_unstale":"2024-04-24T23:38:39.370805+0000","last_undegraded":"2024-04-24T23:38:39.370805+0000","last_fullsized":"2024-04-24T23:38:39.370805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:47:27.107958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.234325+0000","last_change":"2024-04-24T23:38:33.111080+0000","last_active":"2024-04-24T23:38:39.234325+0000","last_peered":"2024-04-24T23:38:39.234325+0000","last_clean":"2024-04-24T23:38:39.234325+0000","last_became_active":"2024-04-24T23:38:33.110315+0000","last_became_peered":"2024-04-24T23:38:33.110315+0000","last_unstale":"2024-04-24T23:38:39.234325+0000","last_undegraded":"2024-04-24T23:38:39.234325+0000","last_fullsized":"2024-04-24T23:38:39.234325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373627+0000","last_change":"2024-04-24T23:38:34.148734+0000","last_active":"2024-04-24T23:38:39.373627+0000","last_peered":"2024-04-24T23:38:39.373627+0000","last_clean":"2024-04-24T23:38:39.373627+0000","last_became_active":"2024-04-24T23:38:34.146909+0000","last_became_peered":"2024-04-24T23:38:34.146909+0000","last_unstale":"2024-04-24T23:38:39.373627+0000","last_undegraded":"2024-04-24T23:38:39.373627+0000","last_fullsized":"2024-04-24T23:38:39.373627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:57:25.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233481+0000","last_change":"2024-04-24T23:38:38.215787+0000","last_active":"2024-04-24T23:38:39.233481+0000","last_peered":"2024-04-24T23:38:39.233481+0000","last_clean":"2024-04-24T23:38:39.233481+0000","last_became_active":"2024-04-24T23:38:38.215395+0000","last_became_peered":"2024-04-24T23:38:38.215395+0000","last_unstale":"2024-04-24T23:38:39.233481+0000","last_undegraded":"2024-04-24T23:38:39.233481+0000","last_fullsized":"2024-04-24T23:38:39.233481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:51.641050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371303+0000","last_change":"2024-04-24T23:38:33.131735+0000","last_active":"2024-04-24T23:38:39.371303+0000","last_peered":"2024-04-24T23:38:39.371303+0000","last_clean":"2024-04-24T23:38:39.371303+0000","last_became_active":"2024-04-24T23:38:33.131314+0000","last_became_peered":"2024-04-24T23:38:33.131314+0000","last_unstale":"2024-04-24T23:38:39.371303+0000","last_undegraded":"2024-04-24T23:38:39.371303+0000","last_fullsized":"2024-04-24T23:38:39.371303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:42.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.234423+0000","last_change":"2024-04-24T23:38:34.150894+0000","last_active":"2024-04-24T23:38:39.234423+0000","last_peered":"2024-04-24T23:38:39.234423+0000","last_clean":"2024-04-24T23:38:39.234423+0000","last_became_active":"2024-04-24T23:38:34.149910+0000","last_became_peered":"2024-04-24T23:38:34.149910+0000","last_unstale":"2024-04-24T23:38:39.234423+0000","last_undegraded":"2024-04-24T23:38:39.234423+0000","last_fullsized":"2024-04-24T23:38:39.234423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:08.608611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370852+0000","last_change":"2024-04-24T23:38:38.219498+0000","last_active":"2024-04-24T23:38:39.370852+0000","last_peered":"2024-04-24T23:38:39.370852+0000","last_clean":"2024-04-24T23:38:39.370852+0000","last_became_active":"2024-04-24T23:38:38.219100+0000","last_became_peered":"2024-04-24T23:38:38.219100+0000","last_unstale":"2024-04-24T23:38:39.370852+0000","last_undegraded":"2024-04-24T23:38:39.370852+0000","last_fullsized":"2024-04-24T23:38:39.370852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:17.585261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.234025+0000","last_change":"2024-04-24T23:38:34.162139+0000","last_active":"2024-04-24T23:38:39.234025+0000","last_peered":"2024-04-24T23:38:39.234025+0000","last_clean":"2024-04-24T23:38:39.234025+0000","last_became_active":"2024-04-24T23:38:34.159701+0000","last_became_peered":"2024-04-24T23:38:34.159701+0000","last_unstale":"2024-04-24T23:38:39.234025+0000","last_undegraded":"2024-04-24T23:38:39.234025+0000","last_fullsized":"2024-04-24T23:38:39.234025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:34.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.232917+0000","last_change":"2024-04-24T23:38:34.156925+0000","last_active":"2024-04-24T23:38:39.232917+0000","last_peered":"2024-04-24T23:38:39.232917+0000","last_clean":"2024-04-24T23:38:39.232917+0000","last_became_active":"2024-04-24T23:38:34.155969+0000","last_became_peered":"2024-04-24T23:38:34.155969+0000","last_unstale":"2024-04-24T23:38:39.232917+0000","last_undegraded":"2024-04-24T23:38:39.232917+0000","last_fullsized":"2024-04-24T23:38:39.232917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:31.033906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370758+0000","last_change":"2024-04-24T23:38:34.188234+0000","last_active":"2024-04-24T23:38:39.370758+0000","last_peered":"2024-04-24T23:38:39.370758+0000","last_clean":"2024-04-24T23:38:39.370758+0000","last_became_active":"2024-04-24T23:38:34.186332+0000","last_became_peered":"2024-04-24T23:38:34.186332+0000","last_unstale":"2024-04-24T23:38:39.370758+0000","last_undegraded":"2024-04-24T23:38:39.370758+0000","last_fullsized":"2024-04-24T23:38:39.370758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:56.049789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373534+0000","last_change":"2024-04-24T23:38:34.154728+0000","last_active":"2024-04-24T23:38:39.373534+0000","last_peered":"2024-04-24T23:38:39.373534+0000","last_clean":"2024-04-24T23:38:39.373534+0000","last_became_active":"2024-04-24T23:38:34.147038+0000","last_became_peered":"2024-04-24T23:38:34.147038+0000","last_unstale":"2024-04-24T23:38:39.373534+0000","last_undegraded":"2024-04-24T23:38:39.373534+0000","last_fullsized":"2024-04-24T23:38:39.373534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:34.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371833+0000","last_change":"2024-04-24T23:38:34.164080+0000","last_active":"2024-04-24T23:38:39.371833+0000","last_peered":"2024-04-24T23:38:39.371833+0000","last_clean":"2024-04-24T23:38:39.371833+0000","last_became_active":"2024-04-24T23:38:34.163761+0000","last_became_peered":"2024-04-24T23:38:34.163761+0000","last_unstale":"2024-04-24T23:38:39.371833+0000","last_undegraded":"2024-04-24T23:38:39.371833+0000","last_fullsized":"2024-04-24T23:38:39.371833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:00.007223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369406+0000","last_change":"2024-04-24T23:38:34.166482+0000","last_active":"2024-04-24T23:38:39.369406+0000","last_peered":"2024-04-24T23:38:39.369406+0000","last_clean":"2024-04-24T23:38:39.369406+0000","last_became_active":"2024-04-24T23:38:34.166059+0000","last_became_peered":"2024-04-24T23:38:34.166059+0000","last_unstale":"2024-04-24T23:38:39.369406+0000","last_undegraded":"2024-04-24T23:38:39.369406+0000","last_fullsized":"2024-04-24T23:38:39.369406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.235851+0000","last_change":"2024-04-24T23:38:34.179301+0000","last_active":"2024-04-24T23:38:39.235851+0000","last_peered":"2024-04-24T23:38:39.235851+0000","last_clean":"2024-04-24T23:38:39.235851+0000","last_became_active":"2024-04-24T23:38:34.178651+0000","last_became_peered":"2024-04-24T23:38:34.178651+0000","last_unstale":"2024-04-24T23:38:39.235851+0000","last_undegraded":"2024-04-24T23:38:39.235851+0000","last_fullsized":"2024-04-24T23:38:39.235851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:57.767771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372076+0000","last_change":"2024-04-24T23:38:34.162572+0000","last_active":"2024-04-24T23:38:39.372076+0000","last_peered":"2024-04-24T23:38:39.372076+0000","last_clean":"2024-04-24T23:38:39.372076+0000","last_became_active":"2024-04-24T23:38:34.162156+0000","last_became_peered":"2024-04-24T23:38:34.162156+0000","last_unstale":"2024-04-24T23:38:39.372076+0000","last_undegraded":"2024-04-24T23:38:39.372076+0000","last_fullsized":"2024-04-24T23:38:39.372076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:57.767771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370006+0000","last_change":"2024-04-24T23:38:34.187429+0000","last_active":"2024-04-24T23:38:39.370006+0000","last_peered":"2024-04-24T23:38:39.370006+0000","last_clean":"2024-04-24T23:38:39.370006+0000","last_became_active":"2024-04-24T23:38:34.184827+0000","last_became_peered":"2024-04-24T23:38:34.184827+0000","last_unstale":"2024-04-24T23:38:39.370006+0000","last_undegraded":"2024-04-24T23:38:39.370006+0000","last_fullsized":"2024-04-24T23:38:39.370006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370651+0000","last_change":"2024-04-24T23:38:34.165830+0000","last_active":"2024-04-24T23:38:39.370651+0000","last_peered":"2024-04-24T23:38:39.370651+0000","last_clean":"2024-04-24T23:38:39.370651+0000","last_became_active":"2024-04-24T23:38:34.165531+0000","last_became_peered":"2024-04-24T23:38:34.165531+0000","last_unstale":"2024-04-24T23:38:39.370651+0000","last_undegraded":"2024-04-24T23:38:39.370651+0000","last_fullsized":"2024-04-24T23:38:39.370651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:57:25.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370515+0000","last_change":"2024-04-24T23:38:34.199810+0000","last_active":"2024-04-24T23:38:39.370515+0000","last_peered":"2024-04-24T23:38:39.370515+0000","last_clean":"2024-04-24T23:38:39.370515+0000","last_became_active":"2024-04-24T23:38:34.199173+0000","last_became_peered":"2024-04-24T23:38:34.199173+0000","last_unstale":"2024-04-24T23:38:39.370515+0000","last_undegraded":"2024-04-24T23:38:39.370515+0000","last_fullsized":"2024-04-24T23:38:39.370515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:27.147380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373229+0000","last_change":"2024-04-24T23:38:34.165276+0000","last_active":"2024-04-24T23:38:39.373229+0000","last_peered":"2024-04-24T23:38:39.373229+0000","last_clean":"2024-04-24T23:38:39.373229+0000","last_became_active":"2024-04-24T23:38:34.165000+0000","last_became_peered":"2024-04-24T23:38:34.165000+0000","last_unstale":"2024-04-24T23:38:39.373229+0000","last_undegraded":"2024-04-24T23:38:39.373229+0000","last_fullsized":"2024-04-24T23:38:39.373229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:30:58.955608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.235067+0000","last_change":"2024-04-24T23:38:34.146904+0000","last_active":"2024-04-24T23:38:39.235067+0000","last_peered":"2024-04-24T23:38:39.235067+0000","last_clean":"2024-04-24T23:38:39.235067+0000","last_became_active":"2024-04-24T23:38:34.146096+0000","last_became_peered":"2024-04-24T23:38:34.146096+0000","last_unstale":"2024-04-24T23:38:39.235067+0000","last_undegraded":"2024-04-24T23:38:39.235067+0000","last_fullsized":"2024-04-24T23:38:39.235067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:39.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372502+0000","last_change":"2024-04-24T23:38:34.178750+0000","last_active":"2024-04-24T23:38:39.372502+0000","last_peered":"2024-04-24T23:38:39.372502+0000","last_clean":"2024-04-24T23:38:39.372502+0000","last_became_active":"2024-04-24T23:38:34.177451+0000","last_became_peered":"2024-04-24T23:38:34.177451+0000","last_unstale":"2024-04-24T23:38:39.372502+0000","last_undegraded":"2024-04-24T23:38:39.372502+0000","last_fullsized":"2024-04-24T23:38:39.372502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:43.814245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233777+0000","last_change":"2024-04-24T23:38:34.160937+0000","last_active":"2024-04-24T23:38:39.233777+0000","last_peered":"2024-04-24T23:38:39.233777+0000","last_clean":"2024-04-24T23:38:39.233777+0000","last_became_active":"2024-04-24T23:38:34.159252+0000","last_became_peered":"2024-04-24T23:38:34.159252+0000","last_unstale":"2024-04-24T23:38:39.233777+0000","last_undegraded":"2024-04-24T23:38:39.233777+0000","last_fullsized":"2024-04-24T23:38:39.233777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:10.585665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373731+0000","last_change":"2024-04-24T23:38:34.199973+0000","last_active":"2024-04-24T23:38:39.373731+0000","last_peered":"2024-04-24T23:38:39.373731+0000","last_clean":"2024-04-24T23:38:39.373731+0000","last_became_active":"2024-04-24T23:38:34.199464+0000","last_became_peered":"2024-04-24T23:38:34.199464+0000","last_unstale":"2024-04-24T23:38:39.373731+0000","last_undegraded":"2024-04-24T23:38:39.373731+0000","last_fullsized":"2024-04-24T23:38:39.373731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:14.879972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369776+0000","last_change":"2024-04-24T23:38:34.182144+0000","last_active":"2024-04-24T23:38:39.369776+0000","last_peered":"2024-04-24T23:38:39.369776+0000","last_clean":"2024-04-24T23:38:39.369776+0000","last_became_active":"2024-04-24T23:38:34.181459+0000","last_became_peered":"2024-04-24T23:38:34.181459+0000","last_unstale":"2024-04-24T23:38:39.369776+0000","last_undegraded":"2024-04-24T23:38:39.369776+0000","last_fullsized":"2024-04-24T23:38:39.369776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.368577+0000","last_change":"2024-04-24T23:38:34.150090+0000","last_active":"2024-04-24T23:38:39.368577+0000","last_peered":"2024-04-24T23:38:39.368577+0000","last_clean":"2024-04-24T23:38:39.368577+0000","last_became_active":"2024-04-24T23:38:34.149272+0000","last_became_peered":"2024-04-24T23:38:34.149272+0000","last_unstale":"2024-04-24T23:38:39.368577+0000","last_undegraded":"2024-04-24T23:38:39.368577+0000","last_fullsized":"2024-04-24T23:38:39.368577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:57:25.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372819+0000","last_change":"2024-04-24T23:38:34.155641+0000","last_active":"2024-04-24T23:38:39.372819+0000","last_peered":"2024-04-24T23:38:39.372819+0000","last_clean":"2024-04-24T23:38:39.372819+0000","last_became_active":"2024-04-24T23:38:34.153683+0000","last_became_peered":"2024-04-24T23:38:34.153683+0000","last_unstale":"2024-04-24T23:38:39.372819+0000","last_undegraded":"2024-04-24T23:38:39.372819+0000","last_fullsized":"2024-04-24T23:38:39.372819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:24.354101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371146+0000","last_change":"2024-04-24T23:38:34.173601+0000","last_active":"2024-04-24T23:38:39.371146+0000","last_peered":"2024-04-24T23:38:39.371146+0000","last_clean":"2024-04-24T23:38:39.371146+0000","last_became_active":"2024-04-24T23:38:34.165764+0000","last_became_peered":"2024-04-24T23:38:34.165764+0000","last_unstale":"2024-04-24T23:38:39.371146+0000","last_undegraded":"2024-04-24T23:38:39.371146+0000","last_fullsized":"2024-04-24T23:38:39.371146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.236674+0000","last_change":"2024-04-24T23:38:34.142409+0000","last_active":"2024-04-24T23:38:39.236674+0000","last_peered":"2024-04-24T23:38:39.236674+0000","last_clean":"2024-04-24T23:38:39.236674+0000","last_became_active":"2024-04-24T23:38:34.141699+0000","last_became_peered":"2024-04-24T23:38:34.141699+0000","last_unstale":"2024-04-24T23:38:39.236674+0000","last_undegraded":"2024-04-24T23:38:39.236674+0000","last_fullsized":"2024-04-24T23:38:39.236674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:53.017909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.235416+0000","last_change":"2024-04-24T23:38:34.155964+0000","last_active":"2024-04-24T23:38:39.235416+0000","last_peered":"2024-04-24T23:38:39.235416+0000","last_clean":"2024-04-24T23:38:39.235416+0000","last_became_active":"2024-04-24T23:38:34.155106+0000","last_became_peered":"2024-04-24T23:38:34.155106+0000","last_unstale":"2024-04-24T23:38:39.235416+0000","last_undegraded":"2024-04-24T23:38:39.235416+0000","last_fullsized":"2024-04-24T23:38:39.235416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.236714+0000","last_change":"2024-04-24T23:38:34.157245+0000","last_active":"2024-04-24T23:38:39.236714+0000","last_peered":"2024-04-24T23:38:39.236714+0000","last_clean":"2024-04-24T23:38:39.236714+0000","last_became_active":"2024-04-24T23:38:34.156452+0000","last_became_peered":"2024-04-24T23:38:34.156452+0000","last_unstale":"2024-04-24T23:38:39.236714+0000","last_undegraded":"2024-04-24T23:38:39.236714+0000","last_fullsized":"2024-04-24T23:38:39.236714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372998+0000","last_change":"2024-04-24T23:38:34.195530+0000","last_active":"2024-04-24T23:38:39.372998+0000","last_peered":"2024-04-24T23:38:39.372998+0000","last_clean":"2024-04-24T23:38:39.372998+0000","last_became_active":"2024-04-24T23:38:34.194908+0000","last_became_peered":"2024-04-24T23:38:34.194908+0000","last_unstale":"2024-04-24T23:38:39.372998+0000","last_undegraded":"2024-04-24T23:38:39.372998+0000","last_fullsized":"2024-04-24T23:38:39.372998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:53.162262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370190+0000","last_change":"2024-04-24T23:38:34.184693+0000","last_active":"2024-04-24T23:38:39.370190+0000","last_peered":"2024-04-24T23:38:39.370190+0000","last_clean":"2024-04-24T23:38:39.370190+0000","last_became_active":"2024-04-24T23:38:34.184367+0000","last_became_peered":"2024-04-24T23:38:34.184367+0000","last_unstale":"2024-04-24T23:38:39.370190+0000","last_undegraded":"2024-04-24T23:38:39.370190+0000","last_fullsized":"2024-04-24T23:38:39.370190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:30:58.955608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370659+0000","last_change":"2024-04-24T23:38:34.176406+0000","last_active":"2024-04-24T23:38:39.370659+0000","last_peered":"2024-04-24T23:38:39.370659+0000","last_clean":"2024-04-24T23:38:39.370659+0000","last_became_active":"2024-04-24T23:38:34.165882+0000","last_became_peered":"2024-04-24T23:38:34.165882+0000","last_unstale":"2024-04-24T23:38:39.370659+0000","last_undegraded":"2024-04-24T23:38:39.370659+0000","last_fullsized":"2024-04-24T23:38:39.370659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:09:44.182605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370261+0000","last_change":"2024-04-24T23:38:34.184368+0000","last_active":"2024-04-24T23:38:39.370261+0000","last_peered":"2024-04-24T23:38:39.370261+0000","last_clean":"2024-04-24T23:38:39.370261+0000","last_became_active":"2024-04-24T23:38:34.183652+0000","last_became_peered":"2024-04-24T23:38:34.183652+0000","last_unstale":"2024-04-24T23:38:39.370261+0000","last_undegraded":"2024-04-24T23:38:39.370261+0000","last_fullsized":"2024-04-24T23:38:39.370261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:57.767771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371091+0000","last_change":"2024-04-24T23:38:34.176656+0000","last_active":"2024-04-24T23:38:39.371091+0000","last_peered":"2024-04-24T23:38:39.371091+0000","last_clean":"2024-04-24T23:38:39.371091+0000","last_became_active":"2024-04-24T23:38:34.165931+0000","last_became_peered":"2024-04-24T23:38:34.165931+0000","last_unstale":"2024-04-24T23:38:39.371091+0000","last_undegraded":"2024-04-24T23:38:39.371091+0000","last_fullsized":"2024-04-24T23:38:39.371091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:14.879972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371772+0000","last_change":"2024-04-24T23:38:34.187001+0000","last_active":"2024-04-24T23:38:39.371772+0000","last_peered":"2024-04-24T23:38:39.371772+0000","last_clean":"2024-04-24T23:38:39.371772+0000","last_became_active":"2024-04-24T23:38:34.186251+0000","last_became_peered":"2024-04-24T23:38:34.186251+0000","last_unstale":"2024-04-24T23:38:39.371772+0000","last_undegraded":"2024-04-24T23:38:39.371772+0000","last_fullsized":"2024-04-24T23:38:39.371772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:00.007223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373733+0000","last_change":"2024-04-24T23:38:34.150280+0000","last_active":"2024-04-24T23:38:39.373733+0000","last_peered":"2024-04-24T23:38:39.373733+0000","last_clean":"2024-04-24T23:38:39.373733+0000","last_became_active":"2024-04-24T23:38:34.148402+0000","last_became_peered":"2024-04-24T23:38:34.148402+0000","last_unstale":"2024-04-24T23:38:39.373733+0000","last_undegraded":"2024-04-24T23:38:39.373733+0000","last_fullsized":"2024-04-24T23:38:39.373733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:29.660159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369506+0000","last_change":"2024-04-24T23:38:34.151749+0000","last_active":"2024-04-24T23:38:39.369506+0000","last_peered":"2024-04-24T23:38:39.369506+0000","last_clean":"2024-04-24T23:38:39.369506+0000","last_became_active":"2024-04-24T23:38:34.150987+0000","last_became_peered":"2024-04-24T23:38:34.150987+0000","last_unstale":"2024-04-24T23:38:39.369506+0000","last_undegraded":"2024-04-24T23:38:39.369506+0000","last_fullsized":"2024-04-24T23:38:39.369506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372849+0000","last_change":"2024-04-24T23:38:34.194857+0000","last_active":"2024-04-24T23:38:39.372849+0000","last_peered":"2024-04-24T23:38:39.372849+0000","last_clean":"2024-04-24T23:38:39.372849+0000","last_became_active":"2024-04-24T23:38:34.194195+0000","last_became_peered":"2024-04-24T23:38:34.194195+0000","last_unstale":"2024-04-24T23:38:39.372849+0000","last_undegraded":"2024-04-24T23:38:39.372849+0000","last_fullsized":"2024-04-24T23:38:39.372849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:29:51.981646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67594,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":691206,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":331776,"data_stored":691262,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:38:58.733 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:38:58.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.885+0000 7f315c904640 1 Processor -- start 2024-04-24T23:38:58.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.885+0000 7f315c904640 1 -- start start 2024-04-24T23:38:58.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.889+0000 7f315c904640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f315814f3c0 0x7f315815a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:58.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.889+0000 7f315c904640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f315814e8e0 con 0x7f31580bdbe0 2024-04-24T23:38:58.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.889+0000 7f315c904640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f315814ebc0 con 0x7f315814bc60 2024-04-24T23:38:58.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.889+0000 7f315c904640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f3158152c20 con 0x7f315814f3c0 2024-04-24T23:38:58.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.889+0000 7f3155d9b640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f31580bdbe0 0x7f31580b6fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52978/0 (socket says 172.21.15.57:52978) 2024-04-24T23:38:58.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.889+0000 7f3155d9b640 1 -- 172.21.15.57:0/2860746416 learned_addr learned my addr 172.21.15.57:0/2860746416 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:38:58.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.889+0000 7f3156d9d640 1 --2- 172.21.15.57:0/2860746416 >> v2:172.21.15.57:3300/0 conn(0x7f315814f3c0 0x7f315815a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:58.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.889+0000 7f315559a640 1 -- 172.21.15.57:0/2860746416 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2701757390 0 0) 0x7f315814e8e0 con 0x7f31580bdbe0 2024-04-24T23:38:58.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.889+0000 7f315559a640 1 -- 172.21.15.57:0/2860746416 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3144003530 con 0x7f31580bdbe0 2024-04-24T23:38:58.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.889+0000 7f3156d9d640 1 -- 172.21.15.57:0/2860746416 >> v1:172.21.15.88:6789/0 conn(0x7f315814bc60 legacy=0x7f315806eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:58.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.889+0000 7f3156d9d640 1 -- 172.21.15.57:0/2860746416 >> v1:172.21.15.57:6789/0 conn(0x7f31580bdbe0 legacy=0x7f31580b6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:58.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.889+0000 7f3156d9d640 1 -- 172.21.15.57:0/2860746416 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315806f260 con 0x7f315814f3c0 2024-04-24T23:38:58.892 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.889+0000 7f3156d9d640 1 --2- 172.21.15.57:0/2860746416 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315814f3c0 0x7f315815a060 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f31480097c0 tx=0x7f314801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0c51833f485582 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:58.892 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.889+0000 7f315559a640 1 -- 172.21.15.57:0/2860746416 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31480b0070 con 0x7f315814f3c0 2024-04-24T23:38:58.892 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.889+0000 7f315559a640 1 -- 172.21.15.57:0/2860746416 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31480ab600 con 0x7f315814f3c0 2024-04-24T23:38:58.892 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.889+0000 7f315559a640 1 -- 172.21.15.57:0/2860746416 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31480ab9d0 con 0x7f315814f3c0 2024-04-24T23:38:58.893 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f315c904640 1 -- 172.21.15.57:0/2860746416 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315814f3c0 msgr2=0x7f315815a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:58.893 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f315c904640 1 --2- 172.21.15.57:0/2860746416 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315814f3c0 0x7f315815a060 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f31480097c0 tx=0x7f314801c4a0 comp rx=0 tx=0).stop 2024-04-24T23:38:58.893 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f315c904640 1 -- 172.21.15.57:0/2860746416 shutdown_connections 2024-04-24T23:38:58.893 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f315c904640 1 --2- 172.21.15.57:0/2860746416 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315814f3c0 0x7f315815a060 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:58.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f315c904640 1 -- 172.21.15.57:0/2860746416 >> 172.21.15.57:0/2860746416 conn(0x7f31580beab0 msgr2=0x7f31580beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:58.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f315c904640 1 -- 172.21.15.57:0/2860746416 shutdown_connections 2024-04-24T23:38:58.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f315c904640 1 -- 172.21.15.57:0/2860746416 wait complete. 2024-04-24T23:38:58.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f315c904640 1 Processor -- start 2024-04-24T23:38:58.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f315c904640 1 -- start start 2024-04-24T23:38:58.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f315c904640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31580bdbe0 0x7f31581ea320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:58.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f315c904640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f315814bc60 0x7f31580c05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:58.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f315c904640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315814f3c0 0x7f31580c0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:58.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f315c904640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3158151e40 con 0x7f315814f3c0 2024-04-24T23:38:58.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f315c904640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f3158151cc0 con 0x7f31580bdbe0 2024-04-24T23:38:58.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f315c904640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f315815cdc0 con 0x7f315814bc60 2024-04-24T23:38:58.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f3156d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315814f3c0 0x7f31580c0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:58.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f3156d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315814f3c0 0x7f31580c0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59890/0 (socket says 172.21.15.57:59890) 2024-04-24T23:38:58.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f3156d9d640 1 -- 172.21.15.57:0/2390472702 learned_addr learned my addr 172.21.15.57:0/2390472702 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:58.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f315659c640 1 --2- 172.21.15.57:0/2390472702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31580bdbe0 0x7f31581ea320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:58.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f3155d9b640 1 --2- 172.21.15.57:0/2390472702 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f315814bc60 0x7f31580c05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:58.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f3156d9d640 1 -- 172.21.15.57:0/2390472702 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f315814bc60 msgr2=0x7f31580c05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:58.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f3156d9d640 1 --2- 172.21.15.57:0/2390472702 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f315814bc60 0x7f31580c05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:58.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f3156d9d640 1 -- 172.21.15.57:0/2390472702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31580bdbe0 msgr2=0x7f31581ea320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:58.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f3156d9d640 1 --2- 172.21.15.57:0/2390472702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31580bdbe0 0x7f31581ea320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:58.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f3156d9d640 1 -- 172.21.15.57:0/2390472702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31581eabc0 con 0x7f315814f3c0 2024-04-24T23:38:58.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f3156d9d640 1 --2- 172.21.15.57:0/2390472702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315814f3c0 0x7f31580c0af0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f31480190b0 tx=0x7f3148019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:58.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f314effd640 1 -- 172.21.15.57:0/2390472702 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31480b0040 con 0x7f315814f3c0 2024-04-24T23:38:58.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f314effd640 1 -- 172.21.15.57:0/2390472702 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31480b9070 con 0x7f315814f3c0 2024-04-24T23:38:58.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f314effd640 1 -- 172.21.15.57:0/2390472702 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31480b4650 con 0x7f315814f3c0 2024-04-24T23:38:58.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f315c904640 1 -- 172.21.15.57:0/2390472702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31581eae80 con 0x7f315814f3c0 2024-04-24T23:38:58.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.893+0000 7f315c904640 1 -- 172.21.15.57:0/2390472702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3158145e90 con 0x7f315814f3c0 2024-04-24T23:38:58.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.897+0000 7f315c904640 1 -- 172.21.15.57:0/2390472702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3158068220 con 0x7f315814f3c0 2024-04-24T23:38:58.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.897+0000 7f314effd640 1 -- 172.21.15.57:0/2390472702 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f31480b47f0 con 0x7f315814f3c0 2024-04-24T23:38:58.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.897+0000 7f314effd640 1 --2- 172.21.15.57:0/2390472702 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f31380678c0 0x7f3138069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:58.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.897+0000 7f314effd640 1 -- 172.21.15.57:0/2390472702 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f314811fae0 con 0x7f315814f3c0 2024-04-24T23:38:58.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.897+0000 7f315659c640 1 --2- 172.21.15.57:0/2390472702 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f31380678c0 0x7f3138069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:58.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.897+0000 7f315659c640 1 --2- 172.21.15.57:0/2390472702 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f31380678c0 0x7f3138069d80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3150000f70 tx=0x7f3150009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:58.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:58.901+0000 7f314effd640 1 -- 172.21.15.57:0/2390472702 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f3148016090 con 0x7f315814f3c0 2024-04-24T23:38:59.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.061+0000 7f315c904640 1 -- 172.21.15.57:0/2390472702 --> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3158143100 con 0x7f31380678c0 2024-04-24T23:38:59.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.081+0000 7f314effd640 1 -- 172.21.15.57:0/2390472702 <== mgr.4105 v2:172.21.15.88:6832/3931748276 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332635 (secure 0 0 0) 0x7f3158143100 con 0x7f31380678c0 2024-04-24T23:38:59.087 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:38:59.089 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-24T23:38:59.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.085+0000 7f315c904640 1 -- 172.21.15.57:0/2390472702 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f31380678c0 msgr2=0x7f3138069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:59.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.085+0000 7f315c904640 1 --2- 172.21.15.57:0/2390472702 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f31380678c0 0x7f3138069d80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3150000f70 tx=0x7f3150009040 comp rx=0 tx=0).stop 2024-04-24T23:38:59.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.085+0000 7f315c904640 1 -- 172.21.15.57:0/2390472702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315814f3c0 msgr2=0x7f31580c0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:59.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.085+0000 7f315c904640 1 --2- 172.21.15.57:0/2390472702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315814f3c0 0x7f31580c0af0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f31480190b0 tx=0x7f3148019240 comp rx=0 tx=0).stop 2024-04-24T23:38:59.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.089+0000 7f315c904640 1 -- 172.21.15.57:0/2390472702 shutdown_connections 2024-04-24T23:38:59.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.089+0000 7f315c904640 1 --2- 172.21.15.57:0/2390472702 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f31380678c0 0x7f3138069d80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:59.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.089+0000 7f315c904640 1 --2- 172.21.15.57:0/2390472702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315814f3c0 0x7f31580c0af0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:59.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.089+0000 7f315c904640 1 --2- 172.21.15.57:0/2390472702 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f315814bc60 0x7f31580c05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:59.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.089+0000 7f315c904640 1 --2- 172.21.15.57:0/2390472702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31580bdbe0 0x7f31581ea320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:59.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.089+0000 7f315c904640 1 -- 172.21.15.57:0/2390472702 >> 172.21.15.57:0/2390472702 conn(0x7f31580beab0 msgr2=0x7f31580b6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:59.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.089+0000 7f315c904640 1 -- 172.21.15.57:0/2390472702 shutdown_connections 2024-04-24T23:38:59.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.089+0000 7f315c904640 1 -- 172.21.15.57:0/2390472702 wait complete. 2024-04-24T23:38:59.106 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-04-24T23:38:57.548045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234996,"kb_used_data":2176,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739724,"statfs":{"total":773094113280,"available":772853477376,"internally_reserved":0,"allocated":2228224,"data_stored":1992064,"data_compressed":67594,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004774"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373865+0000","last_change":"2024-04-24T23:38:33.135015+0000","last_active":"2024-04-24T23:38:39.373865+0000","last_peered":"2024-04-24T23:38:39.373865+0000","last_clean":"2024-04-24T23:38:39.373865+0000","last_became_active":"2024-04-24T23:38:33.134584+0000","last_became_peered":"2024-04-24T23:38:33.134584+0000","last_unstale":"2024-04-24T23:38:39.373865+0000","last_undegraded":"2024-04-24T23:38:39.373865+0000","last_fullsized":"2024-04-24T23:38:39.373865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:21.418436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370791+0000","last_change":"2024-04-24T23:38:34.164655+0000","last_active":"2024-04-24T23:38:39.370791+0000","last_peered":"2024-04-24T23:38:39.370791+0000","last_clean":"2024-04-24T23:38:39.370791+0000","last_became_active":"2024-04-24T23:38:34.162093+0000","last_became_peered":"2024-04-24T23:38:34.162093+0000","last_unstale":"2024-04-24T23:38:39.370791+0000","last_undegraded":"2024-04-24T23:38:39.370791+0000","last_fullsized":"2024-04-24T23:38:39.370791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370307+0000","last_change":"2024-04-24T23:38:38.252169+0000","last_active":"2024-04-24T23:38:39.370307+0000","last_peered":"2024-04-24T23:38:39.370307+0000","last_clean":"2024-04-24T23:38:39.370307+0000","last_became_active":"2024-04-24T23:38:38.251653+0000","last_became_peered":"2024-04-24T23:38:38.251653+0000","last_unstale":"2024-04-24T23:38:39.370307+0000","last_undegraded":"2024-04-24T23:38:39.370307+0000","last_fullsized":"2024-04-24T23:38:39.370307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:57.651551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371463+0000","last_change":"2024-04-24T23:38:33.124025+0000","last_active":"2024-04-24T23:38:39.371463+0000","last_peered":"2024-04-24T23:38:39.371463+0000","last_clean":"2024-04-24T23:38:39.371463+0000","last_became_active":"2024-04-24T23:38:33.123681+0000","last_became_peered":"2024-04-24T23:38:33.123681+0000","last_unstale":"2024-04-24T23:38:39.371463+0000","last_undegraded":"2024-04-24T23:38:39.371463+0000","last_fullsized":"2024-04-24T23:38:39.371463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:27:41.421732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373542+0000","last_change":"2024-04-24T23:38:34.169793+0000","last_active":"2024-04-24T23:38:39.373542+0000","last_peered":"2024-04-24T23:38:39.373542+0000","last_clean":"2024-04-24T23:38:39.373542+0000","last_became_active":"2024-04-24T23:38:34.169115+0000","last_became_peered":"2024-04-24T23:38:34.169115+0000","last_unstale":"2024-04-24T23:38:39.373542+0000","last_undegraded":"2024-04-24T23:38:39.373542+0000","last_fullsized":"2024-04-24T23:38:39.373542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:39.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.234391+0000","last_change":"2024-04-24T23:38:38.221580+0000","last_active":"2024-04-24T23:38:39.234391+0000","last_peered":"2024-04-24T23:38:39.234391+0000","last_clean":"2024-04-24T23:38:39.234391+0000","last_became_active":"2024-04-24T23:38:38.220392+0000","last_became_peered":"2024-04-24T23:38:38.220392+0000","last_unstale":"2024-04-24T23:38:39.234391+0000","last_undegraded":"2024-04-24T23:38:39.234391+0000","last_fullsized":"2024-04-24T23:38:39.234391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:16:01.852170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372470+0000","last_change":"2024-04-24T23:38:33.144231+0000","last_active":"2024-04-24T23:38:39.372470+0000","last_peered":"2024-04-24T23:38:39.372470+0000","last_clean":"2024-04-24T23:38:39.372470+0000","last_became_active":"2024-04-24T23:38:33.143542+0000","last_became_peered":"2024-04-24T23:38:33.143542+0000","last_unstale":"2024-04-24T23:38:39.372470+0000","last_undegraded":"2024-04-24T23:38:39.372470+0000","last_fullsized":"2024-04-24T23:38:39.372470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:09.575181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371937+0000","last_change":"2024-04-24T23:38:34.170796+0000","last_active":"2024-04-24T23:38:39.371937+0000","last_peered":"2024-04-24T23:38:39.371937+0000","last_clean":"2024-04-24T23:38:39.371937+0000","last_became_active":"2024-04-24T23:38:34.169908+0000","last_became_peered":"2024-04-24T23:38:34.169908+0000","last_unstale":"2024-04-24T23:38:39.371937+0000","last_undegraded":"2024-04-24T23:38:39.371937+0000","last_fullsized":"2024-04-24T23:38:39.371937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:17:07.009163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.234557+0000","last_change":"2024-04-24T23:38:38.218416+0000","last_active":"2024-04-24T23:38:39.234557+0000","last_peered":"2024-04-24T23:38:39.234557+0000","last_clean":"2024-04-24T23:38:39.234557+0000","last_became_active":"2024-04-24T23:38:38.217390+0000","last_became_peered":"2024-04-24T23:38:38.217390+0000","last_unstale":"2024-04-24T23:38:39.234557+0000","last_undegraded":"2024-04-24T23:38:39.234557+0000","last_fullsized":"2024-04-24T23:38:39.234557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:31.231780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371812+0000","last_change":"2024-04-24T23:38:33.149114+0000","last_active":"2024-04-24T23:38:39.371812+0000","last_peered":"2024-04-24T23:38:39.371812+0000","last_clean":"2024-04-24T23:38:39.371812+0000","last_became_active":"2024-04-24T23:38:33.148510+0000","last_became_peered":"2024-04-24T23:38:33.148510+0000","last_unstale":"2024-04-24T23:38:39.371812+0000","last_undegraded":"2024-04-24T23:38:39.371812+0000","last_fullsized":"2024-04-24T23:38:39.371812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:39.396571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373009+0000","last_change":"2024-04-24T23:38:34.153747+0000","last_active":"2024-04-24T23:38:39.373009+0000","last_peered":"2024-04-24T23:38:39.373009+0000","last_clean":"2024-04-24T23:38:39.373009+0000","last_became_active":"2024-04-24T23:38:34.152984+0000","last_became_peered":"2024-04-24T23:38:34.152984+0000","last_unstale":"2024-04-24T23:38:39.373009+0000","last_undegraded":"2024-04-24T23:38:39.373009+0000","last_fullsized":"2024-04-24T23:38:39.373009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:54.469544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233889+0000","last_change":"2024-04-24T23:38:38.222542+0000","last_active":"2024-04-24T23:38:39.233889+0000","last_peered":"2024-04-24T23:38:39.233889+0000","last_clean":"2024-04-24T23:38:39.233889+0000","last_became_active":"2024-04-24T23:38:38.220601+0000","last_became_peered":"2024-04-24T23:38:38.220601+0000","last_unstale":"2024-04-24T23:38:39.233889+0000","last_undegraded":"2024-04-24T23:38:39.233889+0000","last_fullsized":"2024-04-24T23:38:39.233889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:32.372869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233089+0000","last_change":"2024-04-24T23:38:34.142429+0000","last_active":"2024-04-24T23:38:39.233089+0000","last_peered":"2024-04-24T23:38:39.233089+0000","last_clean":"2024-04-24T23:38:39.233089+0000","last_became_active":"2024-04-24T23:38:34.141681+0000","last_became_peered":"2024-04-24T23:38:34.141681+0000","last_unstale":"2024-04-24T23:38:39.233089+0000","last_undegraded":"2024-04-24T23:38:39.233089+0000","last_fullsized":"2024-04-24T23:38:39.233089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:57:25.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371592+0000","last_change":"2024-04-24T23:38:33.140585+0000","last_active":"2024-04-24T23:38:39.371592+0000","last_peered":"2024-04-24T23:38:39.371592+0000","last_clean":"2024-04-24T23:38:39.371592+0000","last_became_active":"2024-04-24T23:38:33.139303+0000","last_became_peered":"2024-04-24T23:38:33.139303+0000","last_unstale":"2024-04-24T23:38:39.371592+0000","last_undegraded":"2024-04-24T23:38:39.371592+0000","last_fullsized":"2024-04-24T23:38:39.371592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:23.343617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.237020+0000","last_change":"2024-04-24T23:38:38.216184+0000","last_active":"2024-04-24T23:38:39.237020+0000","last_peered":"2024-04-24T23:38:39.237020+0000","last_clean":"2024-04-24T23:38:39.237020+0000","last_became_active":"2024-04-24T23:38:38.214813+0000","last_became_peered":"2024-04-24T23:38:38.214813+0000","last_unstale":"2024-04-24T23:38:39.237020+0000","last_undegraded":"2024-04-24T23:38:39.237020+0000","last_fullsized":"2024-04-24T23:38:39.237020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:58.553943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371206+0000","last_change":"2024-04-24T23:38:34.174790+0000","last_active":"2024-04-24T23:38:39.371206+0000","last_peered":"2024-04-24T23:38:39.371206+0000","last_clean":"2024-04-24T23:38:39.371206+0000","last_became_active":"2024-04-24T23:38:34.174504+0000","last_became_peered":"2024-04-24T23:38:34.174504+0000","last_unstale":"2024-04-24T23:38:39.371206+0000","last_undegraded":"2024-04-24T23:38:39.371206+0000","last_fullsized":"2024-04-24T23:38:39.371206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:27.147380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.368995+0000","last_change":"2024-04-24T23:38:33.125559+0000","last_active":"2024-04-24T23:38:39.368995+0000","last_peered":"2024-04-24T23:38:39.368995+0000","last_clean":"2024-04-24T23:38:39.368995+0000","last_became_active":"2024-04-24T23:38:33.125115+0000","last_became_peered":"2024-04-24T23:38:33.125115+0000","last_unstale":"2024-04-24T23:38:39.368995+0000","last_undegraded":"2024-04-24T23:38:39.368995+0000","last_fullsized":"2024-04-24T23:38:39.368995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:07.598128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.236267+0000","last_change":"2024-04-24T23:38:38.221669+0000","last_active":"2024-04-24T23:38:39.236267+0000","last_peered":"2024-04-24T23:38:39.236267+0000","last_clean":"2024-04-24T23:38:39.236267+0000","last_became_active":"2024-04-24T23:38:38.219797+0000","last_became_peered":"2024-04-24T23:38:38.219797+0000","last_unstale":"2024-04-24T23:38:39.236267+0000","last_undegraded":"2024-04-24T23:38:39.236267+0000","last_fullsized":"2024-04-24T23:38:39.236267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:04.091622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370565+0000","last_change":"2024-04-24T23:38:34.163966+0000","last_active":"2024-04-24T23:38:39.370565+0000","last_peered":"2024-04-24T23:38:39.370565+0000","last_clean":"2024-04-24T23:38:39.370565+0000","last_became_active":"2024-04-24T23:38:34.163291+0000","last_became_peered":"2024-04-24T23:38:34.163291+0000","last_unstale":"2024-04-24T23:38:39.370565+0000","last_undegraded":"2024-04-24T23:38:39.370565+0000","last_fullsized":"2024-04-24T23:38:39.370565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:34.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.368689+0000","last_change":"2024-04-24T23:38:33.119549+0000","last_active":"2024-04-24T23:38:39.368689+0000","last_peered":"2024-04-24T23:38:39.368689+0000","last_clean":"2024-04-24T23:38:39.368689+0000","last_became_active":"2024-04-24T23:38:33.119052+0000","last_became_peered":"2024-04-24T23:38:33.119052+0000","last_unstale":"2024-04-24T23:38:39.368689+0000","last_undegraded":"2024-04-24T23:38:39.368689+0000","last_fullsized":"2024-04-24T23:38:39.368689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369506+0000","last_change":"2024-04-24T23:38:38.252720+0000","last_active":"2024-04-24T23:38:39.369506+0000","last_peered":"2024-04-24T23:38:39.369506+0000","last_clean":"2024-04-24T23:38:39.369506+0000","last_became_active":"2024-04-24T23:38:38.252138+0000","last_became_peered":"2024-04-24T23:38:38.252138+0000","last_unstale":"2024-04-24T23:38:39.369506+0000","last_undegraded":"2024-04-24T23:38:39.369506+0000","last_fullsized":"2024-04-24T23:38:39.369506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:18.964372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.234166+0000","last_change":"2024-04-24T23:38:34.157008+0000","last_active":"2024-04-24T23:38:39.234166+0000","last_peered":"2024-04-24T23:38:39.234166+0000","last_clean":"2024-04-24T23:38:39.234166+0000","last_became_active":"2024-04-24T23:38:34.152682+0000","last_became_peered":"2024-04-24T23:38:34.152682+0000","last_unstale":"2024-04-24T23:38:39.234166+0000","last_undegraded":"2024-04-24T23:38:39.234166+0000","last_fullsized":"2024-04-24T23:38:39.234166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:48.697457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370213+0000","last_change":"2024-04-24T23:38:33.139819+0000","last_active":"2024-04-24T23:38:39.370213+0000","last_peered":"2024-04-24T23:38:39.370213+0000","last_clean":"2024-04-24T23:38:39.370213+0000","last_became_active":"2024-04-24T23:38:33.139175+0000","last_became_peered":"2024-04-24T23:38:33.139175+0000","last_unstale":"2024-04-24T23:38:39.370213+0000","last_undegraded":"2024-04-24T23:38:39.370213+0000","last_fullsized":"2024-04-24T23:38:39.370213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:52.007425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.236331+0000","last_change":"2024-04-24T23:38:38.217726+0000","last_active":"2024-04-24T23:38:39.236331+0000","last_peered":"2024-04-24T23:38:39.236331+0000","last_clean":"2024-04-24T23:38:39.236331+0000","last_became_active":"2024-04-24T23:38:38.216742+0000","last_became_peered":"2024-04-24T23:38:38.216742+0000","last_unstale":"2024-04-24T23:38:39.236331+0000","last_undegraded":"2024-04-24T23:38:39.236331+0000","last_fullsized":"2024-04-24T23:38:39.236331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:09:48.267004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.374038+0000","last_change":"2024-04-24T23:38:34.154755+0000","last_active":"2024-04-24T23:38:39.374038+0000","last_peered":"2024-04-24T23:38:39.374038+0000","last_clean":"2024-04-24T23:38:39.374038+0000","last_became_active":"2024-04-24T23:38:34.153967+0000","last_became_peered":"2024-04-24T23:38:34.153967+0000","last_unstale":"2024-04-24T23:38:39.374038+0000","last_undegraded":"2024-04-24T23:38:39.374038+0000","last_fullsized":"2024-04-24T23:38:39.374038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.236385+0000","last_change":"2024-04-24T23:38:33.135885+0000","last_active":"2024-04-24T23:38:39.236385+0000","last_peered":"2024-04-24T23:38:39.236385+0000","last_clean":"2024-04-24T23:38:39.236385+0000","last_became_active":"2024-04-24T23:38:33.135225+0000","last_became_peered":"2024-04-24T23:38:33.135225+0000","last_unstale":"2024-04-24T23:38:39.236385+0000","last_undegraded":"2024-04-24T23:38:39.236385+0000","last_fullsized":"2024-04-24T23:38:39.236385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:52.007425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233734+0000","last_change":"2024-04-24T23:38:38.252002+0000","last_active":"2024-04-24T23:38:39.233734+0000","last_peered":"2024-04-24T23:38:39.233734+0000","last_clean":"2024-04-24T23:38:39.233734+0000","last_became_active":"2024-04-24T23:38:38.251057+0000","last_became_peered":"2024-04-24T23:38:38.251057+0000","last_unstale":"2024-04-24T23:38:39.233734+0000","last_undegraded":"2024-04-24T23:38:39.233734+0000","last_fullsized":"2024-04-24T23:38:39.233734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:49.920273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372125+0000","last_change":"2024-04-24T23:38:34.197959+0000","last_active":"2024-04-24T23:38:39.372125+0000","last_peered":"2024-04-24T23:38:39.372125+0000","last_clean":"2024-04-24T23:38:39.372125+0000","last_became_active":"2024-04-24T23:38:34.197702+0000","last_became_peered":"2024-04-24T23:38:34.197702+0000","last_unstale":"2024-04-24T23:38:39.372125+0000","last_undegraded":"2024-04-24T23:38:39.372125+0000","last_fullsized":"2024-04-24T23:38:39.372125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:56.049789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369618+0000","last_change":"2024-04-24T23:38:33.115409+0000","last_active":"2024-04-24T23:38:39.369618+0000","last_peered":"2024-04-24T23:38:39.369618+0000","last_clean":"2024-04-24T23:38:39.369618+0000","last_became_active":"2024-04-24T23:38:33.115039+0000","last_became_peered":"2024-04-24T23:38:33.115039+0000","last_unstale":"2024-04-24T23:38:39.369618+0000","last_undegraded":"2024-04-24T23:38:39.369618+0000","last_fullsized":"2024-04-24T23:38:39.369618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:52.007425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370020+0000","last_change":"2024-04-24T23:38:38.246602+0000","last_active":"2024-04-24T23:38:39.370020+0000","last_peered":"2024-04-24T23:38:39.370020+0000","last_clean":"2024-04-24T23:38:39.370020+0000","last_became_active":"2024-04-24T23:38:38.245775+0000","last_became_peered":"2024-04-24T23:38:38.245775+0000","last_unstale":"2024-04-24T23:38:39.370020+0000","last_undegraded":"2024-04-24T23:38:39.370020+0000","last_fullsized":"2024-04-24T23:38:39.370020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:29.684133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371153+0000","last_change":"2024-04-24T23:38:34.149008+0000","last_active":"2024-04-24T23:38:39.371153+0000","last_peered":"2024-04-24T23:38:39.371153+0000","last_clean":"2024-04-24T23:38:39.371153+0000","last_became_active":"2024-04-24T23:38:34.148122+0000","last_became_peered":"2024-04-24T23:38:34.148122+0000","last_unstale":"2024-04-24T23:38:39.371153+0000","last_undegraded":"2024-04-24T23:38:39.371153+0000","last_fullsized":"2024-04-24T23:38:39.371153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:39.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372690+0000","last_change":"2024-04-24T23:38:33.142490+0000","last_active":"2024-04-24T23:38:39.372690+0000","last_peered":"2024-04-24T23:38:39.372690+0000","last_clean":"2024-04-24T23:38:39.372690+0000","last_became_active":"2024-04-24T23:38:33.140003+0000","last_became_peered":"2024-04-24T23:38:33.140003+0000","last_unstale":"2024-04-24T23:38:39.372690+0000","last_undegraded":"2024-04-24T23:38:39.372690+0000","last_fullsized":"2024-04-24T23:38:39.372690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:45:12.216173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373352+0000","last_change":"2024-04-24T23:38:38.246291+0000","last_active":"2024-04-24T23:38:39.373352+0000","last_peered":"2024-04-24T23:38:39.373352+0000","last_clean":"2024-04-24T23:38:39.373352+0000","last_became_active":"2024-04-24T23:38:38.245611+0000","last_became_peered":"2024-04-24T23:38:38.245611+0000","last_unstale":"2024-04-24T23:38:39.373352+0000","last_undegraded":"2024-04-24T23:38:39.373352+0000","last_fullsized":"2024-04-24T23:38:39.373352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:47.898644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373130+0000","last_change":"2024-04-24T23:38:34.186285+0000","last_active":"2024-04-24T23:38:39.373130+0000","last_peered":"2024-04-24T23:38:39.373130+0000","last_clean":"2024-04-24T23:38:39.373130+0000","last_became_active":"2024-04-24T23:38:34.185023+0000","last_became_peered":"2024-04-24T23:38:34.185023+0000","last_unstale":"2024-04-24T23:38:39.373130+0000","last_undegraded":"2024-04-24T23:38:39.373130+0000","last_fullsized":"2024-04-24T23:38:39.373130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:56.947423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371300+0000","last_change":"2024-04-24T23:38:33.108447+0000","last_active":"2024-04-24T23:38:39.371300+0000","last_peered":"2024-04-24T23:38:39.371300+0000","last_clean":"2024-04-24T23:38:39.371300+0000","last_became_active":"2024-04-24T23:38:33.108102+0000","last_became_peered":"2024-04-24T23:38:33.108102+0000","last_unstale":"2024-04-24T23:38:39.371300+0000","last_undegraded":"2024-04-24T23:38:39.371300+0000","last_fullsized":"2024-04-24T23:38:39.371300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:47.686974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.368678+0000","last_change":"2024-04-24T23:38:38.213425+0000","last_active":"2024-04-24T23:38:39.368678+0000","last_peered":"2024-04-24T23:38:39.368678+0000","last_clean":"2024-04-24T23:38:39.368678+0000","last_became_active":"2024-04-24T23:38:38.212691+0000","last_became_peered":"2024-04-24T23:38:38.212691+0000","last_unstale":"2024-04-24T23:38:39.368678+0000","last_undegraded":"2024-04-24T23:38:39.368678+0000","last_fullsized":"2024-04-24T23:38:39.368678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:01.031822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.235941+0000","last_change":"2024-04-24T23:38:34.154178+0000","last_active":"2024-04-24T23:38:39.235941+0000","last_peered":"2024-04-24T23:38:39.235941+0000","last_clean":"2024-04-24T23:38:39.235941+0000","last_became_active":"2024-04-24T23:38:34.153372+0000","last_became_peered":"2024-04-24T23:38:34.153372+0000","last_unstale":"2024-04-24T23:38:39.235941+0000","last_undegraded":"2024-04-24T23:38:39.235941+0000","last_fullsized":"2024-04-24T23:38:39.235941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:10.585665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370977+0000","last_change":"2024-04-24T23:38:33.140060+0000","last_active":"2024-04-24T23:38:39.370977+0000","last_peered":"2024-04-24T23:38:39.370977+0000","last_clean":"2024-04-24T23:38:39.370977+0000","last_became_active":"2024-04-24T23:38:33.139012+0000","last_became_peered":"2024-04-24T23:38:33.139012+0000","last_unstale":"2024-04-24T23:38:39.370977+0000","last_undegraded":"2024-04-24T23:38:39.370977+0000","last_fullsized":"2024-04-24T23:38:39.370977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371155+0000","last_change":"2024-04-24T23:38:38.209741+0000","last_active":"2024-04-24T23:38:39.371155+0000","last_peered":"2024-04-24T23:38:39.371155+0000","last_clean":"2024-04-24T23:38:39.371155+0000","last_became_active":"2024-04-24T23:38:38.209117+0000","last_became_peered":"2024-04-24T23:38:38.209117+0000","last_unstale":"2024-04-24T23:38:39.371155+0000","last_undegraded":"2024-04-24T23:38:39.371155+0000","last_fullsized":"2024-04-24T23:38:39.371155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:57.246661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369969+0000","last_change":"2024-04-24T23:38:34.152846+0000","last_active":"2024-04-24T23:38:39.369969+0000","last_peered":"2024-04-24T23:38:39.369969+0000","last_clean":"2024-04-24T23:38:39.369969+0000","last_became_active":"2024-04-24T23:38:34.151917+0000","last_became_peered":"2024-04-24T23:38:34.151917+0000","last_unstale":"2024-04-24T23:38:39.369969+0000","last_undegraded":"2024-04-24T23:38:39.369969+0000","last_fullsized":"2024-04-24T23:38:39.369969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:34.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233390+0000","last_change":"2024-04-24T23:38:33.124295+0000","last_active":"2024-04-24T23:38:39.233390+0000","last_peered":"2024-04-24T23:38:39.233390+0000","last_clean":"2024-04-24T23:38:39.233390+0000","last_became_active":"2024-04-24T23:38:33.123674+0000","last_became_peered":"2024-04-24T23:38:33.123674+0000","last_unstale":"2024-04-24T23:38:39.233390+0000","last_undegraded":"2024-04-24T23:38:39.233390+0000","last_fullsized":"2024-04-24T23:38:39.233390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369687+0000","last_change":"2024-04-24T23:38:38.214721+0000","last_active":"2024-04-24T23:38:39.369687+0000","last_peered":"2024-04-24T23:38:39.369687+0000","last_clean":"2024-04-24T23:38:39.369687+0000","last_became_active":"2024-04-24T23:38:38.214005+0000","last_became_peered":"2024-04-24T23:38:38.214005+0000","last_unstale":"2024-04-24T23:38:39.369687+0000","last_undegraded":"2024-04-24T23:38:39.369687+0000","last_fullsized":"2024-04-24T23:38:39.369687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:29:56.066046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371950+0000","last_change":"2024-04-24T23:38:34.139551+0000","last_active":"2024-04-24T23:38:39.371950+0000","last_peered":"2024-04-24T23:38:39.371950+0000","last_clean":"2024-04-24T23:38:39.371950+0000","last_became_active":"2024-04-24T23:38:34.138681+0000","last_became_peered":"2024-04-24T23:38:34.138681+0000","last_unstale":"2024-04-24T23:38:39.371950+0000","last_undegraded":"2024-04-24T23:38:39.371950+0000","last_fullsized":"2024-04-24T23:38:39.371950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:47.556651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370480+0000","last_change":"2024-04-24T23:38:33.141279+0000","last_active":"2024-04-24T23:38:39.370480+0000","last_peered":"2024-04-24T23:38:39.370480+0000","last_clean":"2024-04-24T23:38:39.370480+0000","last_became_active":"2024-04-24T23:38:33.140618+0000","last_became_peered":"2024-04-24T23:38:33.140618+0000","last_unstale":"2024-04-24T23:38:39.370480+0000","last_undegraded":"2024-04-24T23:38:39.370480+0000","last_fullsized":"2024-04-24T23:38:39.370480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373893+0000","last_change":"2024-04-24T23:38:38.250074+0000","last_active":"2024-04-24T23:38:39.373893+0000","last_peered":"2024-04-24T23:38:39.373893+0000","last_clean":"2024-04-24T23:38:39.373893+0000","last_became_active":"2024-04-24T23:38:38.249402+0000","last_became_peered":"2024-04-24T23:38:38.249402+0000","last_unstale":"2024-04-24T23:38:39.373893+0000","last_undegraded":"2024-04-24T23:38:39.373893+0000","last_fullsized":"2024-04-24T23:38:39.373893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:57.246661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370993+0000","last_change":"2024-04-24T23:38:34.187980+0000","last_active":"2024-04-24T23:38:39.370993+0000","last_peered":"2024-04-24T23:38:39.370993+0000","last_clean":"2024-04-24T23:38:39.370993+0000","last_became_active":"2024-04-24T23:38:34.187655+0000","last_became_peered":"2024-04-24T23:38:34.187655+0000","last_unstale":"2024-04-24T23:38:39.370993+0000","last_undegraded":"2024-04-24T23:38:39.370993+0000","last_fullsized":"2024-04-24T23:38:39.370993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:39.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371342+0000","last_change":"2024-04-24T23:38:33.125255+0000","last_active":"2024-04-24T23:38:39.371342+0000","last_peered":"2024-04-24T23:38:39.371342+0000","last_clean":"2024-04-24T23:38:39.371342+0000","last_became_active":"2024-04-24T23:38:33.115926+0000","last_became_peered":"2024-04-24T23:38:33.115926+0000","last_unstale":"2024-04-24T23:38:39.371342+0000","last_undegraded":"2024-04-24T23:38:39.371342+0000","last_fullsized":"2024-04-24T23:38:39.371342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:42.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370492+0000","last_change":"2024-04-24T23:38:29.564705+0000","last_active":"2024-04-24T23:38:39.370492+0000","last_peered":"2024-04-24T23:38:39.370492+0000","last_clean":"2024-04-24T23:38:39.370492+0000","last_became_active":"2024-04-24T23:38:29.562027+0000","last_became_peered":"2024-04-24T23:38:29.562027+0000","last_unstale":"2024-04-24T23:38:39.370492+0000","last_undegraded":"2024-04-24T23:38:39.370492+0000","last_fullsized":"2024-04-24T23:38:39.370492+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:27.959678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:27.959678+0000","last_clean_scrub_stamp":"2024-04-24T23:38:27.959678+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:40.724497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.234993+0000","last_change":"2024-04-24T23:38:38.254846+0000","last_active":"2024-04-24T23:38:39.234993+0000","last_peered":"2024-04-24T23:38:39.234993+0000","last_clean":"2024-04-24T23:38:39.234993+0000","last_became_active":"2024-04-24T23:38:38.253792+0000","last_became_peered":"2024-04-24T23:38:38.253792+0000","last_unstale":"2024-04-24T23:38:39.234993+0000","last_undegraded":"2024-04-24T23:38:39.234993+0000","last_fullsized":"2024-04-24T23:38:39.234993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:17:11.093562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372209+0000","last_change":"2024-04-24T23:38:34.195003+0000","last_active":"2024-04-24T23:38:39.372209+0000","last_peered":"2024-04-24T23:38:39.372209+0000","last_clean":"2024-04-24T23:38:39.372209+0000","last_became_active":"2024-04-24T23:38:34.194530+0000","last_became_peered":"2024-04-24T23:38:34.194530+0000","last_unstale":"2024-04-24T23:38:39.372209+0000","last_undegraded":"2024-04-24T23:38:39.372209+0000","last_fullsized":"2024-04-24T23:38:39.372209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:00.007223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233847+0000","last_change":"2024-04-24T23:38:33.130165+0000","last_active":"2024-04-24T23:38:39.233847+0000","last_peered":"2024-04-24T23:38:39.233847+0000","last_clean":"2024-04-24T23:38:39.233847+0000","last_became_active":"2024-04-24T23:38:33.129888+0000","last_became_peered":"2024-04-24T23:38:33.129888+0000","last_unstale":"2024-04-24T23:38:39.233847+0000","last_undegraded":"2024-04-24T23:38:39.233847+0000","last_fullsized":"2024-04-24T23:38:39.233847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:27:41.421732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233796+0000","last_change":"2024-04-24T23:38:38.253780+0000","last_active":"2024-04-24T23:38:39.233796+0000","last_peered":"2024-04-24T23:38:39.233796+0000","last_clean":"2024-04-24T23:38:39.233796+0000","last_became_active":"2024-04-24T23:38:38.252899+0000","last_became_peered":"2024-04-24T23:38:38.252899+0000","last_unstale":"2024-04-24T23:38:39.233796+0000","last_undegraded":"2024-04-24T23:38:39.233796+0000","last_fullsized":"2024-04-24T23:38:39.233796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:58.553943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372148+0000","last_change":"2024-04-24T23:38:34.187942+0000","last_active":"2024-04-24T23:38:39.372148+0000","last_peered":"2024-04-24T23:38:39.372148+0000","last_clean":"2024-04-24T23:38:39.372148+0000","last_became_active":"2024-04-24T23:38:34.184929+0000","last_became_peered":"2024-04-24T23:38:34.184929+0000","last_unstale":"2024-04-24T23:38:39.372148+0000","last_undegraded":"2024-04-24T23:38:39.372148+0000","last_fullsized":"2024-04-24T23:38:39.372148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:43.814245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369941+0000","last_change":"2024-04-24T23:38:33.120289+0000","last_active":"2024-04-24T23:38:39.369941+0000","last_peered":"2024-04-24T23:38:39.369941+0000","last_clean":"2024-04-24T23:38:39.369941+0000","last_became_active":"2024-04-24T23:38:33.119790+0000","last_became_peered":"2024-04-24T23:38:33.119790+0000","last_unstale":"2024-04-24T23:38:39.369941+0000","last_undegraded":"2024-04-24T23:38:39.369941+0000","last_fullsized":"2024-04-24T23:38:39.369941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373416+0000","last_change":"2024-04-24T23:38:38.216064+0000","last_active":"2024-04-24T23:38:39.373416+0000","last_peered":"2024-04-24T23:38:39.373416+0000","last_clean":"2024-04-24T23:38:39.373416+0000","last_became_active":"2024-04-24T23:38:38.215599+0000","last_became_peered":"2024-04-24T23:38:38.215599+0000","last_unstale":"2024-04-24T23:38:39.373416+0000","last_undegraded":"2024-04-24T23:38:39.373416+0000","last_fullsized":"2024-04-24T23:38:39.373416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:01.031822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373089+0000","last_change":"2024-04-24T23:38:34.194305+0000","last_active":"2024-04-24T23:38:39.373089+0000","last_peered":"2024-04-24T23:38:39.373089+0000","last_clean":"2024-04-24T23:38:39.373089+0000","last_became_active":"2024-04-24T23:38:34.188815+0000","last_became_peered":"2024-04-24T23:38:34.188815+0000","last_unstale":"2024-04-24T23:38:39.373089+0000","last_undegraded":"2024-04-24T23:38:39.373089+0000","last_fullsized":"2024-04-24T23:38:39.373089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:25.599734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233801+0000","last_change":"2024-04-24T23:38:33.125221+0000","last_active":"2024-04-24T23:38:39.233801+0000","last_peered":"2024-04-24T23:38:39.233801+0000","last_clean":"2024-04-24T23:38:39.233801+0000","last_became_active":"2024-04-24T23:38:33.124849+0000","last_became_peered":"2024-04-24T23:38:33.124849+0000","last_unstale":"2024-04-24T23:38:39.233801+0000","last_undegraded":"2024-04-24T23:38:39.233801+0000","last_fullsized":"2024-04-24T23:38:39.233801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:42.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369725+0000","last_change":"2024-04-24T23:38:38.250618+0000","last_active":"2024-04-24T23:38:39.369725+0000","last_peered":"2024-04-24T23:38:39.369725+0000","last_clean":"2024-04-24T23:38:39.369725+0000","last_became_active":"2024-04-24T23:38:38.249521+0000","last_became_peered":"2024-04-24T23:38:38.249521+0000","last_unstale":"2024-04-24T23:38:39.369725+0000","last_undegraded":"2024-04-24T23:38:39.369725+0000","last_fullsized":"2024-04-24T23:38:39.369725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:57.651551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372769+0000","last_change":"2024-04-24T23:38:34.166018+0000","last_active":"2024-04-24T23:38:39.372769+0000","last_peered":"2024-04-24T23:38:39.372769+0000","last_clean":"2024-04-24T23:38:39.372769+0000","last_became_active":"2024-04-24T23:38:34.165229+0000","last_became_peered":"2024-04-24T23:38:34.165229+0000","last_unstale":"2024-04-24T23:38:39.372769+0000","last_undegraded":"2024-04-24T23:38:39.372769+0000","last_fullsized":"2024-04-24T23:38:39.372769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:56.947423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.236714+0000","last_change":"2024-04-24T23:38:33.109771+0000","last_active":"2024-04-24T23:38:39.236714+0000","last_peered":"2024-04-24T23:38:39.236714+0000","last_clean":"2024-04-24T23:38:39.236714+0000","last_became_active":"2024-04-24T23:38:33.108928+0000","last_became_peered":"2024-04-24T23:38:33.108928+0000","last_unstale":"2024-04-24T23:38:39.236714+0000","last_undegraded":"2024-04-24T23:38:39.236714+0000","last_fullsized":"2024-04-24T23:38:39.236714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:44.838533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233300+0000","last_change":"2024-04-24T23:38:38.221186+0000","last_active":"2024-04-24T23:38:39.233300+0000","last_peered":"2024-04-24T23:38:39.233300+0000","last_clean":"2024-04-24T23:38:39.233300+0000","last_became_active":"2024-04-24T23:38:38.219780+0000","last_became_peered":"2024-04-24T23:38:38.219780+0000","last_unstale":"2024-04-24T23:38:39.233300+0000","last_undegraded":"2024-04-24T23:38:39.233300+0000","last_fullsized":"2024-04-24T23:38:39.233300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:43.959509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370916+0000","last_change":"2024-04-24T23:38:34.188981+0000","last_active":"2024-04-24T23:38:39.370916+0000","last_peered":"2024-04-24T23:38:39.370916+0000","last_clean":"2024-04-24T23:38:39.370916+0000","last_became_active":"2024-04-24T23:38:34.188416+0000","last_became_peered":"2024-04-24T23:38:34.188416+0000","last_unstale":"2024-04-24T23:38:39.370916+0000","last_undegraded":"2024-04-24T23:38:39.370916+0000","last_fullsized":"2024-04-24T23:38:39.370916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:17:07.009163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.232834+0000","last_change":"2024-04-24T23:38:33.100912+0000","last_active":"2024-04-24T23:38:39.232834+0000","last_peered":"2024-04-24T23:38:39.232834+0000","last_clean":"2024-04-24T23:38:39.232834+0000","last_became_active":"2024-04-24T23:38:33.100464+0000","last_became_peered":"2024-04-24T23:38:33.100464+0000","last_unstale":"2024-04-24T23:38:39.232834+0000","last_undegraded":"2024-04-24T23:38:39.232834+0000","last_fullsized":"2024-04-24T23:38:39.232834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:47:27.107958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373806+0000","last_change":"2024-04-24T23:38:38.207627+0000","last_active":"2024-04-24T23:38:39.373806+0000","last_peered":"2024-04-24T23:38:39.373806+0000","last_clean":"2024-04-24T23:38:39.373806+0000","last_became_active":"2024-04-24T23:38:38.207049+0000","last_became_peered":"2024-04-24T23:38:38.207049+0000","last_unstale":"2024-04-24T23:38:39.373806+0000","last_undegraded":"2024-04-24T23:38:39.373806+0000","last_fullsized":"2024-04-24T23:38:39.373806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:29:56.066046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233320+0000","last_change":"2024-04-24T23:38:34.161654+0000","last_active":"2024-04-24T23:38:39.233320+0000","last_peered":"2024-04-24T23:38:39.233320+0000","last_clean":"2024-04-24T23:38:39.233320+0000","last_became_active":"2024-04-24T23:38:34.158756+0000","last_became_peered":"2024-04-24T23:38:34.158756+0000","last_unstale":"2024-04-24T23:38:39.233320+0000","last_undegraded":"2024-04-24T23:38:39.233320+0000","last_fullsized":"2024-04-24T23:38:39.233320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:29.660159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233535+0000","last_change":"2024-04-24T23:38:33.116071+0000","last_active":"2024-04-24T23:38:39.233535+0000","last_peered":"2024-04-24T23:38:39.233535+0000","last_clean":"2024-04-24T23:38:39.233535+0000","last_became_active":"2024-04-24T23:38:33.115472+0000","last_became_peered":"2024-04-24T23:38:33.115472+0000","last_unstale":"2024-04-24T23:38:39.233535+0000","last_undegraded":"2024-04-24T23:38:39.233535+0000","last_fullsized":"2024-04-24T23:38:39.233535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:47.686974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372026+0000","last_change":"2024-04-24T23:38:38.248841+0000","last_active":"2024-04-24T23:38:39.372026+0000","last_peered":"2024-04-24T23:38:39.372026+0000","last_clean":"2024-04-24T23:38:39.372026+0000","last_became_active":"2024-04-24T23:38:38.248311+0000","last_became_peered":"2024-04-24T23:38:38.248311+0000","last_unstale":"2024-04-24T23:38:39.372026+0000","last_undegraded":"2024-04-24T23:38:39.372026+0000","last_fullsized":"2024-04-24T23:38:39.372026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:22.798878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371400+0000","last_change":"2024-04-24T23:38:34.189772+0000","last_active":"2024-04-24T23:38:39.371400+0000","last_peered":"2024-04-24T23:38:39.371400+0000","last_clean":"2024-04-24T23:38:39.371400+0000","last_became_active":"2024-04-24T23:38:34.179801+0000","last_became_peered":"2024-04-24T23:38:34.179801+0000","last_unstale":"2024-04-24T23:38:39.371400+0000","last_undegraded":"2024-04-24T23:38:39.371400+0000","last_fullsized":"2024-04-24T23:38:39.371400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:54.469544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370810+0000","last_change":"2024-04-24T23:38:33.146611+0000","last_active":"2024-04-24T23:38:39.370810+0000","last_peered":"2024-04-24T23:38:39.370810+0000","last_clean":"2024-04-24T23:38:39.370810+0000","last_became_active":"2024-04-24T23:38:33.145896+0000","last_became_peered":"2024-04-24T23:38:33.145896+0000","last_unstale":"2024-04-24T23:38:39.370810+0000","last_undegraded":"2024-04-24T23:38:39.370810+0000","last_fullsized":"2024-04-24T23:38:39.370810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:47.686974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371670+0000","last_change":"2024-04-24T23:38:38.252023+0000","last_active":"2024-04-24T23:38:39.371670+0000","last_peered":"2024-04-24T23:38:39.371670+0000","last_clean":"2024-04-24T23:38:39.371670+0000","last_became_active":"2024-04-24T23:38:38.251541+0000","last_became_peered":"2024-04-24T23:38:38.251541+0000","last_unstale":"2024-04-24T23:38:39.371670+0000","last_undegraded":"2024-04-24T23:38:39.371670+0000","last_fullsized":"2024-04-24T23:38:39.371670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:25:30.720742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372969+0000","last_change":"2024-04-24T23:38:34.164658+0000","last_active":"2024-04-24T23:38:39.372969+0000","last_peered":"2024-04-24T23:38:39.372969+0000","last_clean":"2024-04-24T23:38:39.372969+0000","last_became_active":"2024-04-24T23:38:34.164024+0000","last_became_peered":"2024-04-24T23:38:34.164024+0000","last_unstale":"2024-04-24T23:38:39.372969+0000","last_undegraded":"2024-04-24T23:38:39.372969+0000","last_fullsized":"2024-04-24T23:38:39.372969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:47.516208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373646+0000","last_change":"2024-04-24T23:38:33.111314+0000","last_active":"2024-04-24T23:38:39.373646+0000","last_peered":"2024-04-24T23:38:39.373646+0000","last_clean":"2024-04-24T23:38:39.373646+0000","last_became_active":"2024-04-24T23:38:33.109819+0000","last_became_peered":"2024-04-24T23:38:33.109819+0000","last_unstale":"2024-04-24T23:38:39.373646+0000","last_undegraded":"2024-04-24T23:38:39.373646+0000","last_fullsized":"2024-04-24T23:38:39.373646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:21:39.944505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372849+0000","last_change":"2024-04-24T23:38:38.247323+0000","last_active":"2024-04-24T23:38:39.372849+0000","last_peered":"2024-04-24T23:38:39.372849+0000","last_clean":"2024-04-24T23:38:39.372849+0000","last_became_active":"2024-04-24T23:38:38.246172+0000","last_became_peered":"2024-04-24T23:38:38.246172+0000","last_unstale":"2024-04-24T23:38:39.372849+0000","last_undegraded":"2024-04-24T23:38:39.372849+0000","last_fullsized":"2024-04-24T23:38:39.372849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:32.771055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371920+0000","last_change":"2024-04-24T23:38:34.189746+0000","last_active":"2024-04-24T23:38:39.371920+0000","last_peered":"2024-04-24T23:38:39.371920+0000","last_clean":"2024-04-24T23:38:39.371920+0000","last_became_active":"2024-04-24T23:38:34.179433+0000","last_became_peered":"2024-04-24T23:38:34.179433+0000","last_unstale":"2024-04-24T23:38:39.371920+0000","last_undegraded":"2024-04-24T23:38:39.371920+0000","last_fullsized":"2024-04-24T23:38:39.371920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:56.049789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:44.751455+0000","last_change":"2024-04-24T23:38:33.127637+0000","last_active":"2024-04-24T23:38:44.751455+0000","last_peered":"2024-04-24T23:38:44.751455+0000","last_clean":"2024-04-24T23:38:44.751455+0000","last_became_active":"2024-04-24T23:38:33.127122+0000","last_became_peered":"2024-04-24T23:38:33.127122+0000","last_unstale":"2024-04-24T23:38:44.751455+0000","last_undegraded":"2024-04-24T23:38:44.751455+0000","last_fullsized":"2024-04-24T23:38:44.751455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.368989+0000","last_change":"2024-04-24T23:38:38.216781+0000","last_active":"2024-04-24T23:38:39.368989+0000","last_peered":"2024-04-24T23:38:39.368989+0000","last_clean":"2024-04-24T23:38:39.368989+0000","last_became_active":"2024-04-24T23:38:38.215741+0000","last_became_peered":"2024-04-24T23:38:38.215741+0000","last_unstale":"2024-04-24T23:38:39.368989+0000","last_undegraded":"2024-04-24T23:38:39.368989+0000","last_fullsized":"2024-04-24T23:38:39.368989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:47.898644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.236646+0000","last_change":"2024-04-24T23:38:34.167424+0000","last_active":"2024-04-24T23:38:39.236646+0000","last_peered":"2024-04-24T23:38:39.236646+0000","last_clean":"2024-04-24T23:38:39.236646+0000","last_became_active":"2024-04-24T23:38:34.166602+0000","last_became_peered":"2024-04-24T23:38:34.166602+0000","last_unstale":"2024-04-24T23:38:39.236646+0000","last_undegraded":"2024-04-24T23:38:39.236646+0000","last_fullsized":"2024-04-24T23:38:39.236646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:31.033906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369922+0000","last_change":"2024-04-24T23:38:33.146758+0000","last_active":"2024-04-24T23:38:39.369922+0000","last_peered":"2024-04-24T23:38:39.369922+0000","last_clean":"2024-04-24T23:38:39.369922+0000","last_became_active":"2024-04-24T23:38:33.146311+0000","last_became_peered":"2024-04-24T23:38:33.146311+0000","last_unstale":"2024-04-24T23:38:39.369922+0000","last_undegraded":"2024-04-24T23:38:39.369922+0000","last_fullsized":"2024-04-24T23:38:39.369922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:09.575181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.235128+0000","last_change":"2024-04-24T23:38:38.221177+0000","last_active":"2024-04-24T23:38:39.235128+0000","last_peered":"2024-04-24T23:38:39.235128+0000","last_clean":"2024-04-24T23:38:39.235128+0000","last_became_active":"2024-04-24T23:38:38.219482+0000","last_became_peered":"2024-04-24T23:38:38.219482+0000","last_unstale":"2024-04-24T23:38:39.235128+0000","last_undegraded":"2024-04-24T23:38:39.235128+0000","last_fullsized":"2024-04-24T23:38:39.235128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:00.134189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373742+0000","last_change":"2024-04-24T23:38:34.170044+0000","last_active":"2024-04-24T23:38:39.373742+0000","last_peered":"2024-04-24T23:38:39.373742+0000","last_clean":"2024-04-24T23:38:39.373742+0000","last_became_active":"2024-04-24T23:38:34.169512+0000","last_became_peered":"2024-04-24T23:38:34.169512+0000","last_unstale":"2024-04-24T23:38:39.373742+0000","last_undegraded":"2024-04-24T23:38:39.373742+0000","last_fullsized":"2024-04-24T23:38:39.373742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373445+0000","last_change":"2024-04-24T23:38:33.131079+0000","last_active":"2024-04-24T23:38:39.373445+0000","last_peered":"2024-04-24T23:38:39.373445+0000","last_clean":"2024-04-24T23:38:39.373445+0000","last_became_active":"2024-04-24T23:38:33.130150+0000","last_became_peered":"2024-04-24T23:38:33.130150+0000","last_unstale":"2024-04-24T23:38:39.373445+0000","last_undegraded":"2024-04-24T23:38:39.373445+0000","last_fullsized":"2024-04-24T23:38:39.373445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:07.598128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370359+0000","last_change":"2024-04-24T23:38:38.212241+0000","last_active":"2024-04-24T23:38:39.370359+0000","last_peered":"2024-04-24T23:38:39.370359+0000","last_clean":"2024-04-24T23:38:39.370359+0000","last_became_active":"2024-04-24T23:38:38.208130+0000","last_became_peered":"2024-04-24T23:38:38.208130+0000","last_unstale":"2024-04-24T23:38:39.370359+0000","last_undegraded":"2024-04-24T23:38:39.370359+0000","last_fullsized":"2024-04-24T23:38:39.370359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:32.771055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372578+0000","last_change":"2024-04-24T23:38:34.199814+0000","last_active":"2024-04-24T23:38:39.372578+0000","last_peered":"2024-04-24T23:38:39.372578+0000","last_clean":"2024-04-24T23:38:39.372578+0000","last_became_active":"2024-04-24T23:38:34.199311+0000","last_became_peered":"2024-04-24T23:38:34.199311+0000","last_unstale":"2024-04-24T23:38:39.372578+0000","last_undegraded":"2024-04-24T23:38:39.372578+0000","last_fullsized":"2024-04-24T23:38:39.372578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:09:44.182605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.235904+0000","last_change":"2024-04-24T23:38:33.140029+0000","last_active":"2024-04-24T23:38:39.235904+0000","last_peered":"2024-04-24T23:38:39.235904+0000","last_clean":"2024-04-24T23:38:39.235904+0000","last_became_active":"2024-04-24T23:38:33.139325+0000","last_became_peered":"2024-04-24T23:38:33.139325+0000","last_unstale":"2024-04-24T23:38:39.235904+0000","last_undegraded":"2024-04-24T23:38:39.235904+0000","last_fullsized":"2024-04-24T23:38:39.235904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:07.598128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370490+0000","last_change":"2024-04-24T23:38:38.246245+0000","last_active":"2024-04-24T23:38:39.370490+0000","last_peered":"2024-04-24T23:38:39.370490+0000","last_clean":"2024-04-24T23:38:39.370490+0000","last_became_active":"2024-04-24T23:38:38.245657+0000","last_became_peered":"2024-04-24T23:38:38.245657+0000","last_unstale":"2024-04-24T23:38:39.370490+0000","last_undegraded":"2024-04-24T23:38:39.370490+0000","last_fullsized":"2024-04-24T23:38:39.370490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:45.297412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373571+0000","last_change":"2024-04-24T23:38:38.251308+0000","last_active":"2024-04-24T23:38:39.373571+0000","last_peered":"2024-04-24T23:38:39.373571+0000","last_clean":"2024-04-24T23:38:39.373571+0000","last_became_active":"2024-04-24T23:38:38.250718+0000","last_became_peered":"2024-04-24T23:38:38.250718+0000","last_unstale":"2024-04-24T23:38:39.373571+0000","last_undegraded":"2024-04-24T23:38:39.373571+0000","last_fullsized":"2024-04-24T23:38:39.373571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:18.964372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.368478+0000","last_change":"2024-04-24T23:38:34.174658+0000","last_active":"2024-04-24T23:38:39.368478+0000","last_peered":"2024-04-24T23:38:39.368478+0000","last_clean":"2024-04-24T23:38:39.368478+0000","last_became_active":"2024-04-24T23:38:34.174289+0000","last_became_peered":"2024-04-24T23:38:34.174289+0000","last_unstale":"2024-04-24T23:38:39.368478+0000","last_undegraded":"2024-04-24T23:38:39.368478+0000","last_fullsized":"2024-04-24T23:38:39.368478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:29.660159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370081+0000","last_change":"2024-04-24T23:38:33.131171+0000","last_active":"2024-04-24T23:38:39.370081+0000","last_peered":"2024-04-24T23:38:39.370081+0000","last_clean":"2024-04-24T23:38:39.370081+0000","last_became_active":"2024-04-24T23:38:33.130621+0000","last_became_peered":"2024-04-24T23:38:33.130621+0000","last_unstale":"2024-04-24T23:38:39.370081+0000","last_undegraded":"2024-04-24T23:38:39.370081+0000","last_fullsized":"2024-04-24T23:38:39.370081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.237281+0000","last_change":"2024-04-24T23:38:38.214392+0000","last_active":"2024-04-24T23:38:39.237281+0000","last_peered":"2024-04-24T23:38:39.237281+0000","last_clean":"2024-04-24T23:38:39.237281+0000","last_became_active":"2024-04-24T23:38:38.213249+0000","last_became_peered":"2024-04-24T23:38:38.213249+0000","last_unstale":"2024-04-24T23:38:39.237281+0000","last_undegraded":"2024-04-24T23:38:39.237281+0000","last_fullsized":"2024-04-24T23:38:39.237281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:01.031822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370465+0000","last_change":"2024-04-24T23:38:34.164231+0000","last_active":"2024-04-24T23:38:39.370465+0000","last_peered":"2024-04-24T23:38:39.370465+0000","last_clean":"2024-04-24T23:38:39.370465+0000","last_became_active":"2024-04-24T23:38:34.163685+0000","last_became_peered":"2024-04-24T23:38:34.163685+0000","last_unstale":"2024-04-24T23:38:39.370465+0000","last_undegraded":"2024-04-24T23:38:39.370465+0000","last_fullsized":"2024-04-24T23:38:39.370465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:29.660159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370805+0000","last_change":"2024-04-24T23:38:33.116249+0000","last_active":"2024-04-24T23:38:39.370805+0000","last_peered":"2024-04-24T23:38:39.370805+0000","last_clean":"2024-04-24T23:38:39.370805+0000","last_became_active":"2024-04-24T23:38:33.113333+0000","last_became_peered":"2024-04-24T23:38:33.113333+0000","last_unstale":"2024-04-24T23:38:39.370805+0000","last_undegraded":"2024-04-24T23:38:39.370805+0000","last_fullsized":"2024-04-24T23:38:39.370805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:47:27.107958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.234325+0000","last_change":"2024-04-24T23:38:33.111080+0000","last_active":"2024-04-24T23:38:39.234325+0000","last_peered":"2024-04-24T23:38:39.234325+0000","last_clean":"2024-04-24T23:38:39.234325+0000","last_became_active":"2024-04-24T23:38:33.110315+0000","last_became_peered":"2024-04-24T23:38:33.110315+0000","last_unstale":"2024-04-24T23:38:39.234325+0000","last_undegraded":"2024-04-24T23:38:39.234325+0000","last_fullsized":"2024-04-24T23:38:39.234325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373627+0000","last_change":"2024-04-24T23:38:34.148734+0000","last_active":"2024-04-24T23:38:39.373627+0000","last_peered":"2024-04-24T23:38:39.373627+0000","last_clean":"2024-04-24T23:38:39.373627+0000","last_became_active":"2024-04-24T23:38:34.146909+0000","last_became_peered":"2024-04-24T23:38:34.146909+0000","last_unstale":"2024-04-24T23:38:39.373627+0000","last_undegraded":"2024-04-24T23:38:39.373627+0000","last_fullsized":"2024-04-24T23:38:39.373627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:57:25.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233481+0000","last_change":"2024-04-24T23:38:38.215787+0000","last_active":"2024-04-24T23:38:39.233481+0000","last_peered":"2024-04-24T23:38:39.233481+0000","last_clean":"2024-04-24T23:38:39.233481+0000","last_became_active":"2024-04-24T23:38:38.215395+0000","last_became_peered":"2024-04-24T23:38:38.215395+0000","last_unstale":"2024-04-24T23:38:39.233481+0000","last_undegraded":"2024-04-24T23:38:39.233481+0000","last_fullsized":"2024-04-24T23:38:39.233481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:51.641050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371303+0000","last_change":"2024-04-24T23:38:33.131735+0000","last_active":"2024-04-24T23:38:39.371303+0000","last_peered":"2024-04-24T23:38:39.371303+0000","last_clean":"2024-04-24T23:38:39.371303+0000","last_became_active":"2024-04-24T23:38:33.131314+0000","last_became_peered":"2024-04-24T23:38:33.131314+0000","last_unstale":"2024-04-24T23:38:39.371303+0000","last_undegraded":"2024-04-24T23:38:39.371303+0000","last_fullsized":"2024-04-24T23:38:39.371303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:42.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.234423+0000","last_change":"2024-04-24T23:38:34.150894+0000","last_active":"2024-04-24T23:38:39.234423+0000","last_peered":"2024-04-24T23:38:39.234423+0000","last_clean":"2024-04-24T23:38:39.234423+0000","last_became_active":"2024-04-24T23:38:34.149910+0000","last_became_peered":"2024-04-24T23:38:34.149910+0000","last_unstale":"2024-04-24T23:38:39.234423+0000","last_undegraded":"2024-04-24T23:38:39.234423+0000","last_fullsized":"2024-04-24T23:38:39.234423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:08.608611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370852+0000","last_change":"2024-04-24T23:38:38.219498+0000","last_active":"2024-04-24T23:38:39.370852+0000","last_peered":"2024-04-24T23:38:39.370852+0000","last_clean":"2024-04-24T23:38:39.370852+0000","last_became_active":"2024-04-24T23:38:38.219100+0000","last_became_peered":"2024-04-24T23:38:38.219100+0000","last_unstale":"2024-04-24T23:38:39.370852+0000","last_undegraded":"2024-04-24T23:38:39.370852+0000","last_fullsized":"2024-04-24T23:38:39.370852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:17.585261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.234025+0000","last_change":"2024-04-24T23:38:34.162139+0000","last_active":"2024-04-24T23:38:39.234025+0000","last_peered":"2024-04-24T23:38:39.234025+0000","last_clean":"2024-04-24T23:38:39.234025+0000","last_became_active":"2024-04-24T23:38:34.159701+0000","last_became_peered":"2024-04-24T23:38:34.159701+0000","last_unstale":"2024-04-24T23:38:39.234025+0000","last_undegraded":"2024-04-24T23:38:39.234025+0000","last_fullsized":"2024-04-24T23:38:39.234025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:34.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.232917+0000","last_change":"2024-04-24T23:38:34.156925+0000","last_active":"2024-04-24T23:38:39.232917+0000","last_peered":"2024-04-24T23:38:39.232917+0000","last_clean":"2024-04-24T23:38:39.232917+0000","last_became_active":"2024-04-24T23:38:34.155969+0000","last_became_peered":"2024-04-24T23:38:34.155969+0000","last_unstale":"2024-04-24T23:38:39.232917+0000","last_undegraded":"2024-04-24T23:38:39.232917+0000","last_fullsized":"2024-04-24T23:38:39.232917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:31.033906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370758+0000","last_change":"2024-04-24T23:38:34.188234+0000","last_active":"2024-04-24T23:38:39.370758+0000","last_peered":"2024-04-24T23:38:39.370758+0000","last_clean":"2024-04-24T23:38:39.370758+0000","last_became_active":"2024-04-24T23:38:34.186332+0000","last_became_peered":"2024-04-24T23:38:34.186332+0000","last_unstale":"2024-04-24T23:38:39.370758+0000","last_undegraded":"2024-04-24T23:38:39.370758+0000","last_fullsized":"2024-04-24T23:38:39.370758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:56.049789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373534+0000","last_change":"2024-04-24T23:38:34.154728+0000","last_active":"2024-04-24T23:38:39.373534+0000","last_peered":"2024-04-24T23:38:39.373534+0000","last_clean":"2024-04-24T23:38:39.373534+0000","last_became_active":"2024-04-24T23:38:34.147038+0000","last_became_peered":"2024-04-24T23:38:34.147038+0000","last_unstale":"2024-04-24T23:38:39.373534+0000","last_undegraded":"2024-04-24T23:38:39.373534+0000","last_fullsized":"2024-04-24T23:38:39.373534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:34.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371833+0000","last_change":"2024-04-24T23:38:34.164080+0000","last_active":"2024-04-24T23:38:39.371833+0000","last_peered":"2024-04-24T23:38:39.371833+0000","last_clean":"2024-04-24T23:38:39.371833+0000","last_became_active":"2024-04-24T23:38:34.163761+0000","last_became_peered":"2024-04-24T23:38:34.163761+0000","last_unstale":"2024-04-24T23:38:39.371833+0000","last_undegraded":"2024-04-24T23:38:39.371833+0000","last_fullsized":"2024-04-24T23:38:39.371833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:00.007223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369406+0000","last_change":"2024-04-24T23:38:34.166482+0000","last_active":"2024-04-24T23:38:39.369406+0000","last_peered":"2024-04-24T23:38:39.369406+0000","last_clean":"2024-04-24T23:38:39.369406+0000","last_became_active":"2024-04-24T23:38:34.166059+0000","last_became_peered":"2024-04-24T23:38:34.166059+0000","last_unstale":"2024-04-24T23:38:39.369406+0000","last_undegraded":"2024-04-24T23:38:39.369406+0000","last_fullsized":"2024-04-24T23:38:39.369406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.235851+0000","last_change":"2024-04-24T23:38:34.179301+0000","last_active":"2024-04-24T23:38:39.235851+0000","last_peered":"2024-04-24T23:38:39.235851+0000","last_clean":"2024-04-24T23:38:39.235851+0000","last_became_active":"2024-04-24T23:38:34.178651+0000","last_became_peered":"2024-04-24T23:38:34.178651+0000","last_unstale":"2024-04-24T23:38:39.235851+0000","last_undegraded":"2024-04-24T23:38:39.235851+0000","last_fullsized":"2024-04-24T23:38:39.235851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:57.767771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372076+0000","last_change":"2024-04-24T23:38:34.162572+0000","last_active":"2024-04-24T23:38:39.372076+0000","last_peered":"2024-04-24T23:38:39.372076+0000","last_clean":"2024-04-24T23:38:39.372076+0000","last_became_active":"2024-04-24T23:38:34.162156+0000","last_became_peered":"2024-04-24T23:38:34.162156+0000","last_unstale":"2024-04-24T23:38:39.372076+0000","last_undegraded":"2024-04-24T23:38:39.372076+0000","last_fullsized":"2024-04-24T23:38:39.372076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:57.767771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370006+0000","last_change":"2024-04-24T23:38:34.187429+0000","last_active":"2024-04-24T23:38:39.370006+0000","last_peered":"2024-04-24T23:38:39.370006+0000","last_clean":"2024-04-24T23:38:39.370006+0000","last_became_active":"2024-04-24T23:38:34.184827+0000","last_became_peered":"2024-04-24T23:38:34.184827+0000","last_unstale":"2024-04-24T23:38:39.370006+0000","last_undegraded":"2024-04-24T23:38:39.370006+0000","last_fullsized":"2024-04-24T23:38:39.370006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370651+0000","last_change":"2024-04-24T23:38:34.165830+0000","last_active":"2024-04-24T23:38:39.370651+0000","last_peered":"2024-04-24T23:38:39.370651+0000","last_clean":"2024-04-24T23:38:39.370651+0000","last_became_active":"2024-04-24T23:38:34.165531+0000","last_became_peered":"2024-04-24T23:38:34.165531+0000","last_unstale":"2024-04-24T23:38:39.370651+0000","last_undegraded":"2024-04-24T23:38:39.370651+0000","last_fullsized":"2024-04-24T23:38:39.370651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:57:25.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370515+0000","last_change":"2024-04-24T23:38:34.199810+0000","last_active":"2024-04-24T23:38:39.370515+0000","last_peered":"2024-04-24T23:38:39.370515+0000","last_clean":"2024-04-24T23:38:39.370515+0000","last_became_active":"2024-04-24T23:38:34.199173+0000","last_became_peered":"2024-04-24T23:38:34.199173+0000","last_unstale":"2024-04-24T23:38:39.370515+0000","last_undegraded":"2024-04-24T23:38:39.370515+0000","last_fullsized":"2024-04-24T23:38:39.370515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:27.147380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373229+0000","last_change":"2024-04-24T23:38:34.165276+0000","last_active":"2024-04-24T23:38:39.373229+0000","last_peered":"2024-04-24T23:38:39.373229+0000","last_clean":"2024-04-24T23:38:39.373229+0000","last_became_active":"2024-04-24T23:38:34.165000+0000","last_became_peered":"2024-04-24T23:38:34.165000+0000","last_unstale":"2024-04-24T23:38:39.373229+0000","last_undegraded":"2024-04-24T23:38:39.373229+0000","last_fullsized":"2024-04-24T23:38:39.373229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:30:58.955608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.235067+0000","last_change":"2024-04-24T23:38:34.146904+0000","last_active":"2024-04-24T23:38:39.235067+0000","last_peered":"2024-04-24T23:38:39.235067+0000","last_clean":"2024-04-24T23:38:39.235067+0000","last_became_active":"2024-04-24T23:38:34.146096+0000","last_became_peered":"2024-04-24T23:38:34.146096+0000","last_unstale":"2024-04-24T23:38:39.235067+0000","last_undegraded":"2024-04-24T23:38:39.235067+0000","last_fullsized":"2024-04-24T23:38:39.235067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:39.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372502+0000","last_change":"2024-04-24T23:38:34.178750+0000","last_active":"2024-04-24T23:38:39.372502+0000","last_peered":"2024-04-24T23:38:39.372502+0000","last_clean":"2024-04-24T23:38:39.372502+0000","last_became_active":"2024-04-24T23:38:34.177451+0000","last_became_peered":"2024-04-24T23:38:34.177451+0000","last_unstale":"2024-04-24T23:38:39.372502+0000","last_undegraded":"2024-04-24T23:38:39.372502+0000","last_fullsized":"2024-04-24T23:38:39.372502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:43.814245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233777+0000","last_change":"2024-04-24T23:38:34.160937+0000","last_active":"2024-04-24T23:38:39.233777+0000","last_peered":"2024-04-24T23:38:39.233777+0000","last_clean":"2024-04-24T23:38:39.233777+0000","last_became_active":"2024-04-24T23:38:34.159252+0000","last_became_peered":"2024-04-24T23:38:34.159252+0000","last_unstale":"2024-04-24T23:38:39.233777+0000","last_undegraded":"2024-04-24T23:38:39.233777+0000","last_fullsized":"2024-04-24T23:38:39.233777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:10.585665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373731+0000","last_change":"2024-04-24T23:38:34.199973+0000","last_active":"2024-04-24T23:38:39.373731+0000","last_peered":"2024-04-24T23:38:39.373731+0000","last_clean":"2024-04-24T23:38:39.373731+0000","last_became_active":"2024-04-24T23:38:34.199464+0000","last_became_peered":"2024-04-24T23:38:34.199464+0000","last_unstale":"2024-04-24T23:38:39.373731+0000","last_undegraded":"2024-04-24T23:38:39.373731+0000","last_fullsized":"2024-04-24T23:38:39.373731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:14.879972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369776+0000","last_change":"2024-04-24T23:38:34.182144+0000","last_active":"2024-04-24T23:38:39.369776+0000","last_peered":"2024-04-24T23:38:39.369776+0000","last_clean":"2024-04-24T23:38:39.369776+0000","last_became_active":"2024-04-24T23:38:34.181459+0000","last_became_peered":"2024-04-24T23:38:34.181459+0000","last_unstale":"2024-04-24T23:38:39.369776+0000","last_undegraded":"2024-04-24T23:38:39.369776+0000","last_fullsized":"2024-04-24T23:38:39.369776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.368577+0000","last_change":"2024-04-24T23:38:34.150090+0000","last_active":"2024-04-24T23:38:39.368577+0000","last_peered":"2024-04-24T23:38:39.368577+0000","last_clean":"2024-04-24T23:38:39.368577+0000","last_became_active":"2024-04-24T23:38:34.149272+0000","last_became_peered":"2024-04-24T23:38:34.149272+0000","last_unstale":"2024-04-24T23:38:39.368577+0000","last_undegraded":"2024-04-24T23:38:39.368577+0000","last_fullsized":"2024-04-24T23:38:39.368577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:57:25.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372819+0000","last_change":"2024-04-24T23:38:34.155641+0000","last_active":"2024-04-24T23:38:39.372819+0000","last_peered":"2024-04-24T23:38:39.372819+0000","last_clean":"2024-04-24T23:38:39.372819+0000","last_became_active":"2024-04-24T23:38:34.153683+0000","last_became_peered":"2024-04-24T23:38:34.153683+0000","last_unstale":"2024-04-24T23:38:39.372819+0000","last_undegraded":"2024-04-24T23:38:39.372819+0000","last_fullsized":"2024-04-24T23:38:39.372819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:24.354101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371146+0000","last_change":"2024-04-24T23:38:34.173601+0000","last_active":"2024-04-24T23:38:39.371146+0000","last_peered":"2024-04-24T23:38:39.371146+0000","last_clean":"2024-04-24T23:38:39.371146+0000","last_became_active":"2024-04-24T23:38:34.165764+0000","last_became_peered":"2024-04-24T23:38:34.165764+0000","last_unstale":"2024-04-24T23:38:39.371146+0000","last_undegraded":"2024-04-24T23:38:39.371146+0000","last_fullsized":"2024-04-24T23:38:39.371146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.236674+0000","last_change":"2024-04-24T23:38:34.142409+0000","last_active":"2024-04-24T23:38:39.236674+0000","last_peered":"2024-04-24T23:38:39.236674+0000","last_clean":"2024-04-24T23:38:39.236674+0000","last_became_active":"2024-04-24T23:38:34.141699+0000","last_became_peered":"2024-04-24T23:38:34.141699+0000","last_unstale":"2024-04-24T23:38:39.236674+0000","last_undegraded":"2024-04-24T23:38:39.236674+0000","last_fullsized":"2024-04-24T23:38:39.236674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:53.017909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.235416+0000","last_change":"2024-04-24T23:38:34.155964+0000","last_active":"2024-04-24T23:38:39.235416+0000","last_peered":"2024-04-24T23:38:39.235416+0000","last_clean":"2024-04-24T23:38:39.235416+0000","last_became_active":"2024-04-24T23:38:34.155106+0000","last_became_peered":"2024-04-24T23:38:34.155106+0000","last_unstale":"2024-04-24T23:38:39.235416+0000","last_undegraded":"2024-04-24T23:38:39.235416+0000","last_fullsized":"2024-04-24T23:38:39.235416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.236714+0000","last_change":"2024-04-24T23:38:34.157245+0000","last_active":"2024-04-24T23:38:39.236714+0000","last_peered":"2024-04-24T23:38:39.236714+0000","last_clean":"2024-04-24T23:38:39.236714+0000","last_became_active":"2024-04-24T23:38:34.156452+0000","last_became_peered":"2024-04-24T23:38:34.156452+0000","last_unstale":"2024-04-24T23:38:39.236714+0000","last_undegraded":"2024-04-24T23:38:39.236714+0000","last_fullsized":"2024-04-24T23:38:39.236714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372998+0000","last_change":"2024-04-24T23:38:34.195530+0000","last_active":"2024-04-24T23:38:39.372998+0000","last_peered":"2024-04-24T23:38:39.372998+0000","last_clean":"2024-04-24T23:38:39.372998+0000","last_became_active":"2024-04-24T23:38:34.194908+0000","last_became_peered":"2024-04-24T23:38:34.194908+0000","last_unstale":"2024-04-24T23:38:39.372998+0000","last_undegraded":"2024-04-24T23:38:39.372998+0000","last_fullsized":"2024-04-24T23:38:39.372998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:53.162262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370190+0000","last_change":"2024-04-24T23:38:34.184693+0000","last_active":"2024-04-24T23:38:39.370190+0000","last_peered":"2024-04-24T23:38:39.370190+0000","last_clean":"2024-04-24T23:38:39.370190+0000","last_became_active":"2024-04-24T23:38:34.184367+0000","last_became_peered":"2024-04-24T23:38:34.184367+0000","last_unstale":"2024-04-24T23:38:39.370190+0000","last_undegraded":"2024-04-24T23:38:39.370190+0000","last_fullsized":"2024-04-24T23:38:39.370190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:30:58.955608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370659+0000","last_change":"2024-04-24T23:38:34.176406+0000","last_active":"2024-04-24T23:38:39.370659+0000","last_peered":"2024-04-24T23:38:39.370659+0000","last_clean":"2024-04-24T23:38:39.370659+0000","last_became_active":"2024-04-24T23:38:34.165882+0000","last_became_peered":"2024-04-24T23:38:34.165882+0000","last_unstale":"2024-04-24T23:38:39.370659+0000","last_undegraded":"2024-04-24T23:38:39.370659+0000","last_fullsized":"2024-04-24T23:38:39.370659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:09:44.182605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370261+0000","last_change":"2024-04-24T23:38:34.184368+0000","last_active":"2024-04-24T23:38:39.370261+0000","last_peered":"2024-04-24T23:38:39.370261+0000","last_clean":"2024-04-24T23:38:39.370261+0000","last_became_active":"2024-04-24T23:38:34.183652+0000","last_became_peered":"2024-04-24T23:38:34.183652+0000","last_unstale":"2024-04-24T23:38:39.370261+0000","last_undegraded":"2024-04-24T23:38:39.370261+0000","last_fullsized":"2024-04-24T23:38:39.370261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:57.767771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371091+0000","last_change":"2024-04-24T23:38:34.176656+0000","last_active":"2024-04-24T23:38:39.371091+0000","last_peered":"2024-04-24T23:38:39.371091+0000","last_clean":"2024-04-24T23:38:39.371091+0000","last_became_active":"2024-04-24T23:38:34.165931+0000","last_became_peered":"2024-04-24T23:38:34.165931+0000","last_unstale":"2024-04-24T23:38:39.371091+0000","last_undegraded":"2024-04-24T23:38:39.371091+0000","last_fullsized":"2024-04-24T23:38:39.371091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:14.879972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371772+0000","last_change":"2024-04-24T23:38:34.187001+0000","last_active":"2024-04-24T23:38:39.371772+0000","last_peered":"2024-04-24T23:38:39.371772+0000","last_clean":"2024-04-24T23:38:39.371772+0000","last_became_active":"2024-04-24T23:38:34.186251+0000","last_became_peered":"2024-04-24T23:38:34.186251+0000","last_unstale":"2024-04-24T23:38:39.371772+0000","last_undegraded":"2024-04-24T23:38:39.371772+0000","last_fullsized":"2024-04-24T23:38:39.371772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:00.007223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373733+0000","last_change":"2024-04-24T23:38:34.150280+0000","last_active":"2024-04-24T23:38:39.373733+0000","last_peered":"2024-04-24T23:38:39.373733+0000","last_clean":"2024-04-24T23:38:39.373733+0000","last_became_active":"2024-04-24T23:38:34.148402+0000","last_became_peered":"2024-04-24T23:38:34.148402+0000","last_unstale":"2024-04-24T23:38:39.373733+0000","last_undegraded":"2024-04-24T23:38:39.373733+0000","last_fullsized":"2024-04-24T23:38:39.373733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:29.660159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369506+0000","last_change":"2024-04-24T23:38:34.151749+0000","last_active":"2024-04-24T23:38:39.369506+0000","last_peered":"2024-04-24T23:38:39.369506+0000","last_clean":"2024-04-24T23:38:39.369506+0000","last_became_active":"2024-04-24T23:38:34.150987+0000","last_became_peered":"2024-04-24T23:38:34.150987+0000","last_unstale":"2024-04-24T23:38:39.369506+0000","last_undegraded":"2024-04-24T23:38:39.369506+0000","last_fullsized":"2024-04-24T23:38:39.369506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372849+0000","last_change":"2024-04-24T23:38:34.194857+0000","last_active":"2024-04-24T23:38:39.372849+0000","last_peered":"2024-04-24T23:38:39.372849+0000","last_clean":"2024-04-24T23:38:39.372849+0000","last_became_active":"2024-04-24T23:38:34.194195+0000","last_became_peered":"2024-04-24T23:38:34.194195+0000","last_unstale":"2024-04-24T23:38:39.372849+0000","last_undegraded":"2024-04-24T23:38:39.372849+0000","last_fullsized":"2024-04-24T23:38:39.372849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:29:51.981646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67594,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":691206,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":331776,"data_stored":691262,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:38:59.112 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-24T23:38:59.112 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-24T23:38:59.112 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-24T23:38:59.113 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-24T23:38:59.113 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-24T23:38:59.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.273+0000 7f5b9fd29640 1 Processor -- start 2024-04-24T23:38:59.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.273+0000 7f5b9fd29640 1 -- start start 2024-04-24T23:38:59.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.273+0000 7f5b9fd29640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5b980b8800 0x7f5b980b8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:59.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.273+0000 7f5b9fd29640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b980be040 0x7f5b98071d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:59.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.273+0000 7f5b9fd29640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b980730b0 con 0x7f5b980bdbf0 2024-04-24T23:38:59.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.273+0000 7f5b9fd29640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f5b9814d7b0 con 0x7f5b980b8800 2024-04-24T23:38:59.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.273+0000 7f5b9fd29640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f5b9814da90 con 0x7f5b980be040 2024-04-24T23:38:59.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.273+0000 7f5b9dac5640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5b980b8800 0x7f5b980b8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:59.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.273+0000 7f5b9dac5640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5b980b8800 0x7f5b980b8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59900/0 (socket says 172.21.15.57:59900) 2024-04-24T23:38:59.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.273+0000 7f5b9dac5640 1 -- 172.21.15.57:0/1074254311 learned_addr learned my addr 172.21.15.57:0/1074254311 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:59.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.273+0000 7f5b9e2c6640 1 --2- 172.21.15.57:0/1074254311 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b980be040 0x7f5b98071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:59.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.273+0000 7f5b9dac5640 1 -- 172.21.15.57:0/1074254311 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b980be040 msgr2=0x7f5b98071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:59.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.273+0000 7f5b9dac5640 1 --2- 172.21.15.57:0/1074254311 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b980be040 0x7f5b98071d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:59.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.273+0000 7f5b9dac5640 1 -- 172.21.15.57:0/1074254311 >> v1:172.21.15.88:6789/0 conn(0x7f5b980bdbf0 legacy=0x7f5b98071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:59.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.273+0000 7f5b9dac5640 1 -- 172.21.15.57:0/1074254311 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b980722a0 con 0x7f5b980b8800 2024-04-24T23:38:59.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.273+0000 7f5b9e2c6640 1 --2- 172.21.15.57:0/1074254311 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b980be040 0x7f5b98071d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:38:59.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.273+0000 7f5b9dac5640 1 --2- 172.21.15.57:0/1074254311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b980b8800 0x7f5b980b8be0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5b940098a0 tx=0x7f5b9401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b758e0b67ab12183 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:59.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9cac3640 1 -- 172.21.15.57:0/1074254311 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b940b0070 con 0x7f5b980b8800 2024-04-24T23:38:59.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9cac3640 1 -- 172.21.15.57:0/1074254311 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b940ab600 con 0x7f5b980b8800 2024-04-24T23:38:59.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9cac3640 1 -- 172.21.15.57:0/1074254311 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b940ab9d0 con 0x7f5b980b8800 2024-04-24T23:38:59.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9fd29640 1 -- 172.21.15.57:0/1074254311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b980b8800 msgr2=0x7f5b980b8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:59.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9fd29640 1 --2- 172.21.15.57:0/1074254311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b980b8800 0x7f5b980b8be0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5b940098a0 tx=0x7f5b9401c500 comp rx=0 tx=0).stop 2024-04-24T23:38:59.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9fd29640 1 -- 172.21.15.57:0/1074254311 shutdown_connections 2024-04-24T23:38:59.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9fd29640 1 --2- 172.21.15.57:0/1074254311 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b980be040 0x7f5b98071d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:59.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9fd29640 1 --2- 172.21.15.57:0/1074254311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b980b8800 0x7f5b980b8be0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:59.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9fd29640 1 -- 172.21.15.57:0/1074254311 >> 172.21.15.57:0/1074254311 conn(0x7f5b980beab0 msgr2=0x7f5b980beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:59.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9fd29640 1 -- 172.21.15.57:0/1074254311 shutdown_connections 2024-04-24T23:38:59.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9fd29640 1 -- 172.21.15.57:0/1074254311 wait complete. 2024-04-24T23:38:59.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9fd29640 1 Processor -- start 2024-04-24T23:38:59.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9fd29640 1 -- start start 2024-04-24T23:38:59.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9fd29640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b980b8800 0x7f5b98155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:59.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9fd29640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b980bdbf0 0x7f5b9814fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:59.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9fd29640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b980be040 0x7f5b98150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:59.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9fd29640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5b980a7f90 con 0x7f5b980be040 2024-04-24T23:38:59.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9fd29640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5b980b8110 con 0x7f5b980b8800 2024-04-24T23:38:59.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9fd29640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f5b980a8110 con 0x7f5b980bdbf0 2024-04-24T23:38:59.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9e2c6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b980be040 0x7f5b98150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:59.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9e2c6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b980be040 0x7f5b98150330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59908/0 (socket says 172.21.15.57:59908) 2024-04-24T23:38:59.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9e2c6640 1 -- 172.21.15.57:0/3627408393 learned_addr learned my addr 172.21.15.57:0/3627408393 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:59.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9dac5640 1 --2- 172.21.15.57:0/3627408393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b980b8800 0x7f5b98155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:59.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9d2c4640 1 --2- 172.21.15.57:0/3627408393 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b980bdbf0 0x7f5b9814fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:59.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9e2c6640 1 -- 172.21.15.57:0/3627408393 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b980bdbf0 msgr2=0x7f5b9814fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:59.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9e2c6640 1 --2- 172.21.15.57:0/3627408393 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b980bdbf0 0x7f5b9814fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:59.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9e2c6640 1 -- 172.21.15.57:0/3627408393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b980b8800 msgr2=0x7f5b98155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:59.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9e2c6640 1 --2- 172.21.15.57:0/3627408393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b980b8800 0x7f5b98155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:59.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9e2c6640 1 -- 172.21.15.57:0/3627408393 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b98156230 con 0x7f5b980be040 2024-04-24T23:38:59.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9e2c6640 1 --2- 172.21.15.57:0/3627408393 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b980be040 0x7f5b98150330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5b9000cf20 tx=0x7f5b9000a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:59.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b8e7fc640 1 -- 172.21.15.57:0/3627408393 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9001a070 con 0x7f5b980be040 2024-04-24T23:38:59.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b8e7fc640 1 -- 172.21.15.57:0/3627408393 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b9000d840 con 0x7f5b980be040 2024-04-24T23:38:59.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9fd29640 1 -- 172.21.15.57:0/3627408393 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b9814a520 con 0x7f5b980be040 2024-04-24T23:38:59.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b8e7fc640 1 -- 172.21.15.57:0/3627408393 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9000dc30 con 0x7f5b980be040 2024-04-24T23:38:59.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.277+0000 7f5b9fd29640 1 -- 172.21.15.57:0/3627408393 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b981ea020 con 0x7f5b980be040 2024-04-24T23:38:59.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.281+0000 7f5b9fd29640 1 -- 172.21.15.57:0/3627408393 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b98068220 con 0x7f5b980be040 2024-04-24T23:38:59.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.281+0000 7f5b8e7fc640 1 -- 172.21.15.57:0/3627408393 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5b9001d070 con 0x7f5b980be040 2024-04-24T23:38:59.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.281+0000 7f5b8e7fc640 1 --2- 172.21.15.57:0/3627408393 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f5b7c0678f0 0x7f5b7c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:59.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.281+0000 7f5b8e7fc640 1 -- 172.21.15.57:0/3627408393 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5b90086a10 con 0x7f5b980be040 2024-04-24T23:38:59.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.281+0000 7f5b9dac5640 1 --2- 172.21.15.57:0/3627408393 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f5b7c0678f0 0x7f5b7c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:59.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.281+0000 7f5b9dac5640 1 --2- 172.21.15.57:0/3627408393 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f5b7c0678f0 0x7f5b7c069db0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5b940ad000 tx=0x7f5b94008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:59.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.285+0000 7f5b8e7fc640 1 -- 172.21.15.57:0/3627408393 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f5b98156230 con 0x7f5b980be040 2024-04-24T23:38:59.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.489+0000 7f5b9fd29640 1 -- 172.21.15.57:0/3627408393 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f5b98071990 con 0x7f5b980be040 2024-04-24T23:38:59.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.493+0000 7f5b8e7fc640 1 -- 172.21.15.57:0/3627408393 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+166887 (secure 0 0 0) 0x7f5b90057060 con 0x7f5b980be040 2024-04-24T23:38:59.499 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:38:59.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.497+0000 7f5b9fd29640 1 -- 172.21.15.57:0/3627408393 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f5b7c0678f0 msgr2=0x7f5b7c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:59.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.497+0000 7f5b9fd29640 1 --2- 172.21.15.57:0/3627408393 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f5b7c0678f0 0x7f5b7c069db0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5b940ad000 tx=0x7f5b94008040 comp rx=0 tx=0).stop 2024-04-24T23:38:59.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.497+0000 7f5b9fd29640 1 -- 172.21.15.57:0/3627408393 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b980be040 msgr2=0x7f5b98150330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:59.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.497+0000 7f5b9fd29640 1 --2- 172.21.15.57:0/3627408393 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b980be040 0x7f5b98150330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5b9000cf20 tx=0x7f5b9000a7d0 comp rx=0 tx=0).stop 2024-04-24T23:38:59.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.497+0000 7f5b9fd29640 1 -- 172.21.15.57:0/3627408393 shutdown_connections 2024-04-24T23:38:59.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.497+0000 7f5b9fd29640 1 --2- 172.21.15.57:0/3627408393 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f5b7c0678f0 0x7f5b7c069db0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:59.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.497+0000 7f5b9fd29640 1 --2- 172.21.15.57:0/3627408393 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b980be040 0x7f5b98150330 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:59.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.497+0000 7f5b9fd29640 1 --2- 172.21.15.57:0/3627408393 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b980bdbf0 0x7f5b9814fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:59.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.497+0000 7f5b9fd29640 1 --2- 172.21.15.57:0/3627408393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b980b8800 0x7f5b98155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:59.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.497+0000 7f5b9fd29640 1 -- 172.21.15.57:0/3627408393 >> 172.21.15.57:0/3627408393 conn(0x7f5b980beab0 msgr2=0x7f5b980bfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:59.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.497+0000 7f5b9fd29640 1 -- 172.21.15.57:0/3627408393 shutdown_connections 2024-04-24T23:38:59.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.497+0000 7f5b9fd29640 1 -- 172.21.15.57:0/3627408393 wait complete. 2024-04-24T23:38:59.516 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3931748276},{"type":"v1","addr":"172.21.15.88:6833","nonce":3931748276}]},"active_addr":"172.21.15.88:6833/3931748276","active_change":"2024-04-24T23:38:21.526045+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":3720004278}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":1509583175}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":1816998378}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":2879585158}]}]} 2024-04-24T23:38:59.521 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-24T23:38:59.521 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-24T23:38:59.521 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:38:59.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.641+0000 7fc383434640 1 Processor -- start 2024-04-24T23:38:59.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.641+0000 7fc383434640 1 -- start start 2024-04-24T23:38:59.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.641+0000 7fc383434640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc37c0b8800 0x7fc37c0b8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:59.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.641+0000 7fc383434640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc37c0be040 0x7fc37c071d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:59.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.641+0000 7fc383434640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc37c0730b0 con 0x7fc37c0bdbf0 2024-04-24T23:38:59.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.641+0000 7fc383434640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fc37c14d7b0 con 0x7fc37c0be040 2024-04-24T23:38:59.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.641+0000 7fc383434640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fc37c14da90 con 0x7fc37c0b8800 2024-04-24T23:38:59.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.641+0000 7fc3809cf640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc37c0bdbf0 0x7fc37c071650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52986/0 (socket says 172.21.15.57:52986) 2024-04-24T23:38:59.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.641+0000 7fc3809cf640 1 -- 172.21.15.57:0/2561938433 learned_addr learned my addr 172.21.15.57:0/2561938433 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:38:59.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.641+0000 7fc3819d1640 1 --2- 172.21.15.57:0/2561938433 >> v2:172.21.15.57:3300/0 conn(0x7fc37c0be040 0x7fc37c071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:59.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.641+0000 7fc3811d0640 1 --2- 172.21.15.57:0/2561938433 >> v2:172.21.15.88:3300/0 conn(0x7fc37c0b8800 0x7fc37c0b8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:59.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.641+0000 7fc373fff640 1 -- 172.21.15.57:0/2561938433 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2751818336 0 0) 0x7fc37c0730b0 con 0x7fc37c0bdbf0 2024-04-24T23:38:59.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.641+0000 7fc373fff640 1 -- 172.21.15.57:0/2561938433 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc368003530 con 0x7fc37c0bdbf0 2024-04-24T23:38:59.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.641+0000 7fc3819d1640 1 -- 172.21.15.57:0/2561938433 >> v2:172.21.15.88:3300/0 conn(0x7fc37c0b8800 msgr2=0x7fc37c0b8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:59.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.641+0000 7fc3819d1640 1 --2- 172.21.15.57:0/2561938433 >> v2:172.21.15.88:3300/0 conn(0x7fc37c0b8800 0x7fc37c0b8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:59.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.641+0000 7fc3819d1640 1 -- 172.21.15.57:0/2561938433 >> v1:172.21.15.57:6789/0 conn(0x7fc37c0bdbf0 legacy=0x7fc37c071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:59.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.641+0000 7fc3819d1640 1 -- 172.21.15.57:0/2561938433 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc37c0722a0 con 0x7fc37c0be040 2024-04-24T23:38:59.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc3819d1640 1 --2- 172.21.15.57:0/2561938433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc37c0be040 0x7fc37c071d60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc374009d90 tx=0x7fc37401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2395d6a27625da46 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:59.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc373fff640 1 -- 172.21.15.57:0/2561938433 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3740b2070 con 0x7fc37c0be040 2024-04-24T23:38:59.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc373fff640 1 -- 172.21.15.57:0/2561938433 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3740a5880 con 0x7fc37c0be040 2024-04-24T23:38:59.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc373fff640 1 -- 172.21.15.57:0/2561938433 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3740a5c30 con 0x7fc37c0be040 2024-04-24T23:38:59.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc383434640 1 -- 172.21.15.57:0/2561938433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc37c0be040 msgr2=0x7fc37c071d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:59.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc383434640 1 --2- 172.21.15.57:0/2561938433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc37c0be040 0x7fc37c071d60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc374009d90 tx=0x7fc37401c930 comp rx=0 tx=0).stop 2024-04-24T23:38:59.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc383434640 1 -- 172.21.15.57:0/2561938433 shutdown_connections 2024-04-24T23:38:59.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc383434640 1 --2- 172.21.15.57:0/2561938433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc37c0be040 0x7fc37c071d60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:59.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc383434640 1 --2- 172.21.15.57:0/2561938433 >> v2:172.21.15.88:3300/0 conn(0x7fc37c0b8800 0x7fc37c0b8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:59.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc383434640 1 -- 172.21.15.57:0/2561938433 >> 172.21.15.57:0/2561938433 conn(0x7fc37c0beab0 msgr2=0x7fc37c0beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:59.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc383434640 1 -- 172.21.15.57:0/2561938433 shutdown_connections 2024-04-24T23:38:59.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc383434640 1 -- 172.21.15.57:0/2561938433 wait complete. 2024-04-24T23:38:59.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc383434640 1 Processor -- start 2024-04-24T23:38:59.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc383434640 1 -- start start 2024-04-24T23:38:59.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc383434640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc37c0b8800 0x7fc37c1457a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:59.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc383434640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc37c0bdbf0 0x7fc37c0bb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:59.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc383434640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc37c0be040 0x7fc37c1446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:59.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc383434640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc37c0a7f90 con 0x7fc37c0bdbf0 2024-04-24T23:38:59.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc383434640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc37c0b8110 con 0x7fc37c0be040 2024-04-24T23:38:59.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc383434640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fc37c0a8110 con 0x7fc37c0b8800 2024-04-24T23:38:59.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc3809cf640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc37c0bdbf0 0x7fc37c0bb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:59.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc3809cf640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc37c0bdbf0 0x7fc37c0bb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59928/0 (socket says 172.21.15.57:59928) 2024-04-24T23:38:59.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc3809cf640 1 -- 172.21.15.57:0/4103262438 learned_addr learned my addr 172.21.15.57:0/4103262438 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:59.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc3819d1640 1 --2- 172.21.15.57:0/4103262438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc37c0be040 0x7fc37c1446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:59.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc3811d0640 1 --2- 172.21.15.57:0/4103262438 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc37c0b8800 0x7fc37c1457a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:59.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc3809cf640 1 -- 172.21.15.57:0/4103262438 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc37c0b8800 msgr2=0x7fc37c1457a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:59.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc3809cf640 1 --2- 172.21.15.57:0/4103262438 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc37c0b8800 0x7fc37c1457a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:59.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc3809cf640 1 -- 172.21.15.57:0/4103262438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc37c0be040 msgr2=0x7fc37c1446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:59.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc3809cf640 1 --2- 172.21.15.57:0/4103262438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc37c0be040 0x7fc37c1446c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:59.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc3809cf640 1 -- 172.21.15.57:0/4103262438 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc37c0bbd20 con 0x7fc37c0bdbf0 2024-04-24T23:38:59.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.645+0000 7fc3809cf640 1 --2- 172.21.15.57:0/4103262438 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc37c0bdbf0 0x7fc37c0bb7e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc36c00c480 tx=0x7fc36c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:59.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.649+0000 7fc371ffb640 1 -- 172.21.15.57:0/4103262438 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36c017070 con 0x7fc37c0bdbf0 2024-04-24T23:38:59.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.649+0000 7fc371ffb640 1 -- 172.21.15.57:0/4103262438 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc36c005cf0 con 0x7fc37c0bdbf0 2024-04-24T23:38:59.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.649+0000 7fc383434640 1 -- 172.21.15.57:0/4103262438 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc37c1444a0 con 0x7fc37c0bdbf0 2024-04-24T23:38:59.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.649+0000 7fc371ffb640 1 -- 172.21.15.57:0/4103262438 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36c007290 con 0x7fc37c0bdbf0 2024-04-24T23:38:59.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.649+0000 7fc383434640 1 -- 172.21.15.57:0/4103262438 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc37c0c1d00 con 0x7fc37c0bdbf0 2024-04-24T23:38:59.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.649+0000 7fc383434640 1 -- 172.21.15.57:0/4103262438 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc37c068220 con 0x7fc37c0bdbf0 2024-04-24T23:38:59.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.649+0000 7fc371ffb640 1 -- 172.21.15.57:0/4103262438 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc36c01a070 con 0x7fc37c0bdbf0 2024-04-24T23:38:59.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.649+0000 7fc371ffb640 1 --2- 172.21.15.57:0/4103262438 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc3600678c0 0x7fc360069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:59.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.649+0000 7fc371ffb640 1 -- 172.21.15.57:0/4103262438 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc36c085330 con 0x7fc37c0bdbf0 2024-04-24T23:38:59.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.649+0000 7fc3811d0640 1 --2- 172.21.15.57:0/4103262438 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc3600678c0 0x7fc360069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:59.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.649+0000 7fc3811d0640 1 --2- 172.21.15.57:0/4103262438 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc3600678c0 0x7fc360069d80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc378009af0 tx=0x7fc378008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:59.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.653+0000 7fc371ffb640 1 -- 172.21.15.57:0/4103262438 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fc37c0bbd20 con 0x7fc37c0bdbf0 2024-04-24T23:38:59.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.817+0000 7fc383434640 1 -- 172.21.15.57:0/4103262438 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc37c0bc3e0 con 0x7fc37c0bdbf0 2024-04-24T23:38:59.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.821+0000 7fc371ffb640 1 -- 172.21.15.57:0/4103262438 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7fc36c0554f0 con 0x7fc37c0bdbf0 2024-04-24T23:38:59.821 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:38:59.821 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":24,"fsid":"1ea31698-444a-4667-bcd9-b2608ad103c3","created":"2024-04-24T23:38:16.748774+0000","modified":"2024-04-24T23:38:38.604475+0000","last_up_change":"2024-04-24T23:38:26.956537+0000","last_in_change":"2024-04-24T23:38:18.972175+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:38:27.611782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:38:31.718061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:38:32.469413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:38:36.215724+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"35ce67bc-9b25-416e-ab1e-774c717631f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6825","nonce":671364028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6827","nonce":671364028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6831","nonce":671364028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6829","nonce":671364028}]},"public_addr":"172.21.15.57:6825/671364028","cluster_addr":"172.21.15.57:6827/671364028","heartbeat_back_addr":"172.21.15.57:6831/671364028","heartbeat_front_addr":"172.21.15.57:6829/671364028","state":["exists","up"]},{"osd":1,"uuid":"38f6f4ef-3bc2-4453-9946-7d1d17e735ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6801","nonce":2653552037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6803","nonce":2653552037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6807","nonce":2653552037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6805","nonce":2653552037}]},"public_addr":"172.21.15.57:6801/2653552037","cluster_addr":"172.21.15.57:6803/2653552037","heartbeat_back_addr":"172.21.15.57:6807/2653552037","heartbeat_front_addr":"172.21.15.57:6805/2653552037","state":["exists","up"]},{"osd":2,"uuid":"d77a0a49-b39a-464e-a1c9-49e19280c440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6816","nonce":1565874109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6819","nonce":1565874109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6823","nonce":1565874109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6821","nonce":1565874109}]},"public_addr":"172.21.15.57:6816/1565874109","cluster_addr":"172.21.15.57:6819/1565874109","heartbeat_back_addr":"172.21.15.57:6823/1565874109","heartbeat_front_addr":"172.21.15.57:6821/1565874109","state":["exists","up"]},{"osd":3,"uuid":"f8ea9bfe-d839-44a6-a185-0f0985da314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6809","nonce":3474703186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6811","nonce":3474703186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6817","nonce":3474703186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6813","nonce":3474703186}]},"public_addr":"172.21.15.57:6809/3474703186","cluster_addr":"172.21.15.57:6811/3474703186","heartbeat_back_addr":"172.21.15.57:6817/3474703186","heartbeat_front_addr":"172.21.15.57:6813/3474703186","state":["exists","up"]},{"osd":4,"uuid":"454647d4-6ac2-46b4-8451-320eb951a87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6801","nonce":1271707713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6803","nonce":1271707713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6807","nonce":1271707713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6805","nonce":1271707713}]},"public_addr":"172.21.15.88:6801/1271707713","cluster_addr":"172.21.15.88:6803/1271707713","heartbeat_back_addr":"172.21.15.88:6807/1271707713","heartbeat_front_addr":"172.21.15.88:6805/1271707713","state":["exists","up"]},{"osd":5,"uuid":"f71c03a3-7ad8-46d3-89c9-d61de102586b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6809","nonce":2035054888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6813","nonce":2035054888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6820","nonce":2035054888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6816","nonce":2035054888}]},"public_addr":"172.21.15.88:6809/2035054888","cluster_addr":"172.21.15.88:6813/2035054888","heartbeat_back_addr":"172.21.15.88:6820/2035054888","heartbeat_front_addr":"172.21.15.88:6816/2035054888","state":["exists","up"]},{"osd":6,"uuid":"ec7ae2b7-9cb4-4059-8f98-0022c9763f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6825","nonce":1752291242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6827","nonce":1752291242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6831","nonce":1752291242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6829","nonce":1752291242}]},"public_addr":"172.21.15.88:6825/1752291242","cluster_addr":"172.21.15.88:6827/1752291242","heartbeat_back_addr":"172.21.15.88:6831/1752291242","heartbeat_front_addr":"172.21.15.88:6829/1752291242","state":["exists","up"]},{"osd":7,"uuid":"c0ee7505-60c1-40ba-9902-47313a04dafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6812","nonce":1782800372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6817","nonce":1782800372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6823","nonce":1782800372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6821","nonce":1782800372}]},"public_addr":"172.21.15.88:6812/1782800372","cluster_addr":"172.21.15.88:6817/1782800372","heartbeat_back_addr":"172.21.15.88:6823/1782800372","heartbeat_front_addr":"172.21.15.88:6821/1782800372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.698562+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.682587+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.680197+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.561753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.011095+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.493320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.353451+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.423877+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:38:59.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.821+0000 7fc383434640 1 -- 172.21.15.57:0/4103262438 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc3600678c0 msgr2=0x7fc360069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:59.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.821+0000 7fc383434640 1 --2- 172.21.15.57:0/4103262438 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc3600678c0 0x7fc360069d80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc378009af0 tx=0x7fc378008040 comp rx=0 tx=0).stop 2024-04-24T23:38:59.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.821+0000 7fc383434640 1 -- 172.21.15.57:0/4103262438 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc37c0bdbf0 msgr2=0x7fc37c0bb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:59.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.821+0000 7fc383434640 1 --2- 172.21.15.57:0/4103262438 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc37c0bdbf0 0x7fc37c0bb7e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc36c00c480 tx=0x7fc36c00c940 comp rx=0 tx=0).stop 2024-04-24T23:38:59.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.821+0000 7fc383434640 1 -- 172.21.15.57:0/4103262438 shutdown_connections 2024-04-24T23:38:59.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.821+0000 7fc383434640 1 --2- 172.21.15.57:0/4103262438 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc3600678c0 0x7fc360069d80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:59.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.821+0000 7fc383434640 1 --2- 172.21.15.57:0/4103262438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc37c0be040 0x7fc37c1446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:59.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.821+0000 7fc383434640 1 --2- 172.21.15.57:0/4103262438 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc37c0bdbf0 0x7fc37c0bb7e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:59.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.821+0000 7fc383434640 1 --2- 172.21.15.57:0/4103262438 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc37c0b8800 0x7fc37c1457a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:59.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.821+0000 7fc383434640 1 -- 172.21.15.57:0/4103262438 >> 172.21.15.57:0/4103262438 conn(0x7fc37c0beab0 msgr2=0x7fc37c143720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:59.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.821+0000 7fc383434640 1 -- 172.21.15.57:0/4103262438 shutdown_connections 2024-04-24T23:38:59.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.821+0000 7fc383434640 1 -- 172.21.15.57:0/4103262438 wait complete. 2024-04-24T23:38:59.839 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-24T23:38:59.840 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:38:59.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.949+0000 7fa4dfcd1640 1 Processor -- start 2024-04-24T23:38:59.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.953+0000 7fa4dfcd1640 1 -- start start 2024-04-24T23:38:59.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.953+0000 7fa4dfcd1640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa4d814bc60 0x7fa4d806eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:59.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.953+0000 7fa4dfcd1640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa4d80bdbe0 0x7fa4d8159050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:59.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.953+0000 7fa4dfcd1640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4d814e8e0 con 0x7fa4d806f090 2024-04-24T23:38:59.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.953+0000 7fa4dfcd1640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fa4d8152c20 con 0x7fa4d814bc60 2024-04-24T23:38:59.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.953+0000 7fa4dfcd1640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fa4d814ebc0 con 0x7fa4d80bdbe0 2024-04-24T23:38:59.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.953+0000 7fa4dda6d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa4d814bc60 0x7fa4d806eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:59.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.953+0000 7fa4dd26c640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa4d806f090 0x7fa4d80b6fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52996/0 (socket says 172.21.15.57:52996) 2024-04-24T23:38:59.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.953+0000 7fa4dd26c640 1 -- 172.21.15.57:0/1036880523 learned_addr learned my addr 172.21.15.57:0/1036880523 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:38:59.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.953+0000 7fa4de26e640 1 --2- 172.21.15.57:0/1036880523 >> v2:172.21.15.88:3300/0 conn(0x7fa4d80bdbe0 0x7fa4d8159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:59.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.953+0000 7fa4dda6d640 1 -- 172.21.15.57:0/1036880523 >> v2:172.21.15.88:3300/0 conn(0x7fa4d80bdbe0 msgr2=0x7fa4d8159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:38:59.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.953+0000 7fa4dda6d640 1 --2- 172.21.15.57:0/1036880523 >> v2:172.21.15.88:3300/0 conn(0x7fa4d80bdbe0 0x7fa4d8159050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:59.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.953+0000 7fa4dda6d640 1 -- 172.21.15.57:0/1036880523 >> v1:172.21.15.57:6789/0 conn(0x7fa4d806f090 legacy=0x7fa4d80b6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:59.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.953+0000 7fa4dda6d640 1 -- 172.21.15.57:0/1036880523 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d80b76e0 con 0x7fa4d814bc60 2024-04-24T23:38:59.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.953+0000 7fa4dca6b640 1 -- 172.21.15.57:0/1036880523 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2893825771 0 0) 0x7fa4d814e8e0 con 0x7fa4d806f090 2024-04-24T23:38:59.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.953+0000 7fa4dda6d640 1 --2- 172.21.15.57:0/1036880523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4d814bc60 0x7fa4d806eb50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa4d80b8fb0 tx=0x7fa4d001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3634fd1a48d67410 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:59.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.953+0000 7fa4dca6b640 1 -- 172.21.15.57:0/1036880523 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d00b2070 con 0x7fa4d814bc60 2024-04-24T23:38:59.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.953+0000 7fa4dca6b640 1 -- 172.21.15.57:0/1036880523 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4d00a57f0 con 0x7fa4d814bc60 2024-04-24T23:38:59.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.953+0000 7fa4dca6b640 1 -- 172.21.15.57:0/1036880523 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d00a5bc0 con 0x7fa4d814bc60 2024-04-24T23:38:59.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4dfcd1640 1 -- 172.21.15.57:0/1036880523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4d814bc60 msgr2=0x7fa4d806eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:59.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4dfcd1640 1 --2- 172.21.15.57:0/1036880523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4d814bc60 0x7fa4d806eb50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa4d80b8fb0 tx=0x7fa4d001c930 comp rx=0 tx=0).stop 2024-04-24T23:38:59.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4dfcd1640 1 -- 172.21.15.57:0/1036880523 shutdown_connections 2024-04-24T23:38:59.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4dfcd1640 1 --2- 172.21.15.57:0/1036880523 >> v2:172.21.15.88:3300/0 conn(0x7fa4d80bdbe0 0x7fa4d8159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:59.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4dfcd1640 1 --2- 172.21.15.57:0/1036880523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4d814bc60 0x7fa4d806eb50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:59.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4dfcd1640 1 -- 172.21.15.57:0/1036880523 >> 172.21.15.57:0/1036880523 conn(0x7fa4d80beab0 msgr2=0x7fa4d80beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:38:59.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4dfcd1640 1 -- 172.21.15.57:0/1036880523 shutdown_connections 2024-04-24T23:38:59.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4dfcd1640 1 -- 172.21.15.57:0/1036880523 wait complete. 2024-04-24T23:38:59.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4dfcd1640 1 Processor -- start 2024-04-24T23:38:59.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4dfcd1640 1 -- start start 2024-04-24T23:38:59.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4dfcd1640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa4d806f090 0x7fa4d8143490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:59.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4dfcd1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d80bdbe0 0x7fa4d81ea4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:59.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4dfcd1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4d814bc60 0x7fa4d814e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:59.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4dfcd1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d815bf30 con 0x7fa4d814bc60 2024-04-24T23:38:59.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4dfcd1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d815bdb0 con 0x7fa4d80bdbe0 2024-04-24T23:38:59.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4dfcd1640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fa4d815c0b0 con 0x7fa4d806f090 2024-04-24T23:38:59.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4de26e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4d814bc60 0x7fa4d814e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:59.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4dd26c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d80bdbe0 0x7fa4d81ea4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:59.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4dda6d640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa4d806f090 0x7fa4d8143490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:59.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4de26e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4d814bc60 0x7fa4d814e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59952/0 (socket says 172.21.15.57:59952) 2024-04-24T23:38:59.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4de26e640 1 -- 172.21.15.57:0/173291310 learned_addr learned my addr 172.21.15.57:0/173291310 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:38:59.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4de26e640 1 -- 172.21.15.57:0/173291310 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa4d806f090 msgr2=0x7fa4d8143490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:59.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4de26e640 1 --2- 172.21.15.57:0/173291310 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa4d806f090 0x7fa4d8143490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:59.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4de26e640 1 -- 172.21.15.57:0/173291310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d80bdbe0 msgr2=0x7fa4d81ea4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:38:59.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4de26e640 1 --2- 172.21.15.57:0/173291310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d80bdbe0 0x7fa4d81ea4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:38:59.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4de26e640 1 -- 172.21.15.57:0/173291310 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d814e5d0 con 0x7fa4d814bc60 2024-04-24T23:38:59.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4dda6d640 1 --2- 172.21.15.57:0/173291310 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa4d806f090 0x7fa4d8143490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:38:59.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4de26e640 1 --2- 172.21.15.57:0/173291310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4d814bc60 0x7fa4d814e090 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa4c800d830 tx=0x7fa4c800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:59.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4d67fc640 1 -- 172.21.15.57:0/173291310 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c800b6c0 con 0x7fa4d814bc60 2024-04-24T23:38:59.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4d67fc640 1 -- 172.21.15.57:0/173291310 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c8019070 con 0x7fa4d814bc60 2024-04-24T23:38:59.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4dfcd1640 1 -- 172.21.15.57:0/173291310 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4d8147f30 con 0x7fa4d814bc60 2024-04-24T23:38:59.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4d67fc640 1 -- 172.21.15.57:0/173291310 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c800baa0 con 0x7fa4d814bc60 2024-04-24T23:38:59.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4dfcd1640 1 -- 172.21.15.57:0/173291310 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4d814d330 con 0x7fa4d814bc60 2024-04-24T23:38:59.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.957+0000 7fa4dfcd1640 1 -- 172.21.15.57:0/173291310 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4d8068220 con 0x7fa4d814bc60 2024-04-24T23:38:59.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.961+0000 7fa4d67fc640 1 -- 172.21.15.57:0/173291310 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa4c801e460 con 0x7fa4d814bc60 2024-04-24T23:38:59.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.961+0000 7fa4d67fc640 1 --2- 172.21.15.57:0/173291310 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa4c40678f0 0x7fa4c4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:38:59.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.961+0000 7fa4d67fc640 1 -- 172.21.15.57:0/173291310 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa4c8086630 con 0x7fa4d814bc60 2024-04-24T23:38:59.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.961+0000 7fa4dda6d640 1 --2- 172.21.15.57:0/173291310 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa4c40678f0 0x7fa4c4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:38:59.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.961+0000 7fa4dda6d640 1 --2- 172.21.15.57:0/173291310 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa4c40678f0 0x7fa4c4069db0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00af000 tx=0x7fa4d00a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:38:59.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:38:59.965+0000 7fa4d67fc640 1 -- 172.21.15.57:0/173291310 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fa4d814e5d0 con 0x7fa4d814bc60 2024-04-24T23:39:00.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.125+0000 7fa4dfcd1640 1 -- 172.21.15.57:0/173291310 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa4d80b8b10 con 0x7fa4d814bc60 2024-04-24T23:39:00.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.129+0000 7fa4d67fc640 1 -- 172.21.15.57:0/173291310 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7fa4c8056d90 con 0x7fa4d814bc60 2024-04-24T23:39:00.129 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:39:00.130 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":24,"fsid":"1ea31698-444a-4667-bcd9-b2608ad103c3","created":"2024-04-24T23:38:16.748774+0000","modified":"2024-04-24T23:38:38.604475+0000","last_up_change":"2024-04-24T23:38:26.956537+0000","last_in_change":"2024-04-24T23:38:18.972175+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:38:27.611782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:38:31.718061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:38:32.469413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:38:36.215724+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"35ce67bc-9b25-416e-ab1e-774c717631f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6825","nonce":671364028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6827","nonce":671364028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6831","nonce":671364028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6829","nonce":671364028}]},"public_addr":"172.21.15.57:6825/671364028","cluster_addr":"172.21.15.57:6827/671364028","heartbeat_back_addr":"172.21.15.57:6831/671364028","heartbeat_front_addr":"172.21.15.57:6829/671364028","state":["exists","up"]},{"osd":1,"uuid":"38f6f4ef-3bc2-4453-9946-7d1d17e735ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6801","nonce":2653552037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6803","nonce":2653552037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6807","nonce":2653552037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6805","nonce":2653552037}]},"public_addr":"172.21.15.57:6801/2653552037","cluster_addr":"172.21.15.57:6803/2653552037","heartbeat_back_addr":"172.21.15.57:6807/2653552037","heartbeat_front_addr":"172.21.15.57:6805/2653552037","state":["exists","up"]},{"osd":2,"uuid":"d77a0a49-b39a-464e-a1c9-49e19280c440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6816","nonce":1565874109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6819","nonce":1565874109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6823","nonce":1565874109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6821","nonce":1565874109}]},"public_addr":"172.21.15.57:6816/1565874109","cluster_addr":"172.21.15.57:6819/1565874109","heartbeat_back_addr":"172.21.15.57:6823/1565874109","heartbeat_front_addr":"172.21.15.57:6821/1565874109","state":["exists","up"]},{"osd":3,"uuid":"f8ea9bfe-d839-44a6-a185-0f0985da314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6809","nonce":3474703186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6811","nonce":3474703186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6817","nonce":3474703186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6813","nonce":3474703186}]},"public_addr":"172.21.15.57:6809/3474703186","cluster_addr":"172.21.15.57:6811/3474703186","heartbeat_back_addr":"172.21.15.57:6817/3474703186","heartbeat_front_addr":"172.21.15.57:6813/3474703186","state":["exists","up"]},{"osd":4,"uuid":"454647d4-6ac2-46b4-8451-320eb951a87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6801","nonce":1271707713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6803","nonce":1271707713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6807","nonce":1271707713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6805","nonce":1271707713}]},"public_addr":"172.21.15.88:6801/1271707713","cluster_addr":"172.21.15.88:6803/1271707713","heartbeat_back_addr":"172.21.15.88:6807/1271707713","heartbeat_front_addr":"172.21.15.88:6805/1271707713","state":["exists","up"]},{"osd":5,"uuid":"f71c03a3-7ad8-46d3-89c9-d61de102586b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6809","nonce":2035054888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6813","nonce":2035054888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6820","nonce":2035054888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6816","nonce":2035054888}]},"public_addr":"172.21.15.88:6809/2035054888","cluster_addr":"172.21.15.88:6813/2035054888","heartbeat_back_addr":"172.21.15.88:6820/2035054888","heartbeat_front_addr":"172.21.15.88:6816/2035054888","state":["exists","up"]},{"osd":6,"uuid":"ec7ae2b7-9cb4-4059-8f98-0022c9763f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6825","nonce":1752291242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6827","nonce":1752291242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6831","nonce":1752291242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6829","nonce":1752291242}]},"public_addr":"172.21.15.88:6825/1752291242","cluster_addr":"172.21.15.88:6827/1752291242","heartbeat_back_addr":"172.21.15.88:6831/1752291242","heartbeat_front_addr":"172.21.15.88:6829/1752291242","state":["exists","up"]},{"osd":7,"uuid":"c0ee7505-60c1-40ba-9902-47313a04dafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6812","nonce":1782800372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6817","nonce":1782800372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6823","nonce":1782800372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6821","nonce":1782800372}]},"public_addr":"172.21.15.88:6812/1782800372","cluster_addr":"172.21.15.88:6817/1782800372","heartbeat_back_addr":"172.21.15.88:6823/1782800372","heartbeat_front_addr":"172.21.15.88:6821/1782800372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.698562+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.682587+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.680197+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.561753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.011095+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.493320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.353451+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.423877+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:39:00.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.129+0000 7fa4dfcd1640 1 -- 172.21.15.57:0/173291310 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa4c40678f0 msgr2=0x7fa4c4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.129+0000 7fa4dfcd1640 1 --2- 172.21.15.57:0/173291310 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa4c40678f0 0x7fa4c4069db0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00af000 tx=0x7fa4d00a7070 comp rx=0 tx=0).stop 2024-04-24T23:39:00.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.129+0000 7fa4dfcd1640 1 -- 172.21.15.57:0/173291310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4d814bc60 msgr2=0x7fa4d814e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.129+0000 7fa4dfcd1640 1 --2- 172.21.15.57:0/173291310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4d814bc60 0x7fa4d814e090 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa4c800d830 tx=0x7fa4c800dcf0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.129+0000 7fa4dfcd1640 1 -- 172.21.15.57:0/173291310 shutdown_connections 2024-04-24T23:39:00.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.129+0000 7fa4dfcd1640 1 --2- 172.21.15.57:0/173291310 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa4c40678f0 0x7fa4c4069db0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.129+0000 7fa4dfcd1640 1 --2- 172.21.15.57:0/173291310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4d814bc60 0x7fa4d814e090 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.129+0000 7fa4dfcd1640 1 --2- 172.21.15.57:0/173291310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d80bdbe0 0x7fa4d81ea4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.129+0000 7fa4dfcd1640 1 --2- 172.21.15.57:0/173291310 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa4d806f090 0x7fa4d8143490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.129+0000 7fa4dfcd1640 1 -- 172.21.15.57:0/173291310 >> 172.21.15.57:0/173291310 conn(0x7fa4d80beab0 msgr2=0x7fa4d80c17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:00.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.129+0000 7fa4dfcd1640 1 -- 172.21.15.57:0/173291310 shutdown_connections 2024-04-24T23:39:00.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.129+0000 7fa4dfcd1640 1 -- 172.21.15.57:0/173291310 wait complete. 2024-04-24T23:39:00.148 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-24T23:39:00.149 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-24T23:39:00.149 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-24T23:39:00.149 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-24T23:39:00.150 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-24T23:39:00.150 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-24T23:39:00.151 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-24T23:39:00.151 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-24T23:39:00.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.325+0000 7fd8eb59e640 1 Processor -- start 2024-04-24T23:39:00.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.325+0000 7fd8eb59e640 1 -- start start 2024-04-24T23:39:00.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.325+0000 7fd8eb59e640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd8ec135970 0x7fd8ec06f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.325+0000 7fd8eb59e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd8ec0bdd60 0x7fd8ec0c0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.325+0000 7fd8eb59e640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd8ec0c0fa0 0x7fd8ec14fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.325+0000 7fd8eb59e640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fd8ec06e480 con 0x7fd8ec0c0fa0 2024-04-24T23:39:00.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.325+0000 7fd8eb59e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fd8ec135d50 con 0x7fd8ec0bdd60 2024-04-24T23:39:00.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.325+0000 7fd8eb59e640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fd8ec0bc5f0 con 0x7fd8ec135970 2024-04-24T23:39:00.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.329+0000 7fd8ea59c640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd8ec135970 0x7fd8ec06f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.329+0000 7fd8ead9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd8ec0c0fa0 0x7fd8ec14fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.329+0000 7fd8ead9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd8ec0c0fa0 0x7fd8ec14fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59958/0 (socket says 172.21.15.57:59958) 2024-04-24T23:39:00.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.329+0000 7fd8ead9d640 1 -- 172.21.15.57:0/3800901466 learned_addr learned my addr 172.21.15.57:0/3800901466 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:00.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.329+0000 7fd8e9d9b640 1 --2- 172.21.15.57:0/3800901466 >> v2:172.21.15.88:3300/0 conn(0x7fd8ec0bdd60 0x7fd8ec0c0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.329+0000 7fd8ea59c640 1 -- 172.21.15.57:0/3800901466 >> v2:172.21.15.88:3300/0 conn(0x7fd8ec0bdd60 msgr2=0x7fd8ec0c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:00.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.329+0000 7fd8ea59c640 1 --2- 172.21.15.57:0/3800901466 >> v2:172.21.15.88:3300/0 conn(0x7fd8ec0bdd60 0x7fd8ec0c0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.329+0000 7fd8ea59c640 1 -- 172.21.15.57:0/3800901466 >> v2:172.21.15.57:3300/0 conn(0x7fd8ec0c0fa0 msgr2=0x7fd8ec14fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:00.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.329+0000 7fd8ea59c640 1 --2- 172.21.15.57:0/3800901466 >> v2:172.21.15.57:3300/0 conn(0x7fd8ec0c0fa0 0x7fd8ec14fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.329+0000 7fd8ea59c640 1 -- 172.21.15.57:0/3800901466 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8ec0bc8d0 con 0x7fd8ec135970 2024-04-24T23:39:00.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.329+0000 7fd11b1c2640 1 Processor -- start 2024-04-24T23:39:00.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.329+0000 7fd11b1c2640 1 -- start start 2024-04-24T23:39:00.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.329+0000 7fecdf275640 1 Processor -- start 2024-04-24T23:39:00.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.329+0000 7fd11b1c2640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd11406ec70 0x7fd1140bd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.329+0000 7fd11b1c2640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd1140bdd40 0x7fd11414c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.329+0000 7fd11b1c2640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1140bc040 con 0x7fd1140bf3e0 2024-04-24T23:39:00.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.329+0000 7fd11b1c2640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fd1140bba60 con 0x7fd1140bdd40 2024-04-24T23:39:00.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.329+0000 7fd11b1c2640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fd1140bbdf0 con 0x7fd11406ec70 2024-04-24T23:39:00.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.329+0000 7f6e880d3640 1 Processor -- start 2024-04-24T23:39:00.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7f6e880d3640 1 -- start start 2024-04-24T23:39:00.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fd8ea59c640 1 --2- 172.21.15.57:0/3800901466 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd8ec135970 0x7fd8ec06f3b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec0703f0 tx=0x7fd8e4020d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57b8a5eb5848d927 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.329+0000 7fdc91944640 1 Processor -- start 2024-04-24T23:39:00.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.329+0000 7fecdf275640 1 -- start start 2024-04-24T23:39:00.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7f8249af0640 1 Processor -- start 2024-04-24T23:39:00.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.329+0000 7fd11975f640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd1140bdd40 0x7fd11414c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.329+0000 7fd113fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd11406ec70 0x7fd1140bd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.329+0000 7fd11975f640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd1140bdd40 0x7fd11414c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59962/0 (socket says 172.21.15.57:59962) 2024-04-24T23:39:00.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.329+0000 7fd11975f640 1 -- 172.21.15.57:0/3188457440 learned_addr learned my addr 172.21.15.57:0/3188457440 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:00.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fd11975f640 1 -- 172.21.15.57:0/3188457440 >> v2:172.21.15.88:3300/0 conn(0x7fd11406ec70 msgr2=0x7fd1140bd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:00.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fd11975f640 1 --2- 172.21.15.57:0/3188457440 >> v2:172.21.15.88:3300/0 conn(0x7fd11406ec70 0x7fd1140bd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fd11975f640 1 -- 172.21.15.57:0/3188457440 >> v1:172.21.15.88:6789/0 conn(0x7fd1140bf3e0 legacy=0x7fd114149bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fd11975f640 1 -- 172.21.15.57:0/3188457440 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1141505d0 con 0x7fd1140bdd40 2024-04-24T23:39:00.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7f8249af0640 1 -- start start 2024-04-24T23:39:00.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fecdf275640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fecd80bcf60 0x7fecd8154130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fecdf275640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecd8153c30 con 0x7fecd80c0cc0 2024-04-24T23:39:00.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fecdf275640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecd80bdaf0 con 0x7fecd814e020 2024-04-24T23:39:00.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fecdf275640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fecd80bd480 con 0x7fecd80bcf60 2024-04-24T23:39:00.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.329+0000 7fdc91944640 1 -- start start 2024-04-24T23:39:00.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7f7a460e3640 1 Processor -- start 2024-04-24T23:39:00.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fdc91944640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdc8c149fb0 0x7fdc8c14c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fdc91944640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc8c0bc040 con 0x7fdc8c06ec70 2024-04-24T23:39:00.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fdc91944640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc8c1505d0 con 0x7fdc8c149bd0 2024-04-24T23:39:00.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fdc91944640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fdc8c0bbdf0 con 0x7fdc8c149fb0 2024-04-24T23:39:00.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fdc8affd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdc8c149bd0 0x7fdc8c0bd800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.57:56042/0 (socket says 172.21.15.57:56042) 2024-04-24T23:39:00.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fdc8affd640 1 -- 172.21.15.57:0/1409167978 learned_addr learned my addr 172.21.15.57:0/1409167978 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:00.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fecde273640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fecd80c0cc0 0x7fecd814d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53006/0 (socket says 172.21.15.57:53006) 2024-04-24T23:39:00.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fecde273640 1 -- 172.21.15.57:0/3154714454 learned_addr learned my addr 172.21.15.57:0/3154714454 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:00.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fd8e959a640 1 -- 172.21.15.57:0/3800901466 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e40b6070 con 0x7fd8ec135970 2024-04-24T23:39:00.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fd8e959a640 1 -- 172.21.15.57:0/3800901466 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e40a9dc0 con 0x7fd8ec135970 2024-04-24T23:39:00.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fd8e959a640 1 -- 172.21.15.57:0/3800901466 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e40b1660 con 0x7fd8ec135970 2024-04-24T23:39:00.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fa11fdcd640 1 Processor -- start 2024-04-24T23:39:00.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fa11fdcd640 1 -- start start 2024-04-24T23:39:00.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fecdda72640 1 --2- 172.21.15.57:0/3154714454 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fecd80bcf60 0x7fecd8154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7f8249af0640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f82440a3230 0x7f82440c2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7f8249af0640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82441547d0 con 0x7f8244070c10 2024-04-24T23:39:00.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7f8249af0640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8244070180 con 0x7f8244154020 2024-04-24T23:39:00.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7f8249af0640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f8244154ab0 con 0x7f82440a3230 2024-04-24T23:39:00.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fecdd271640 1 -- 172.21.15.57:0/3154714454 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 791991533 0 0) 0x7fecd80bdaf0 con 0x7fecd814e020 2024-04-24T23:39:00.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fecdda72640 1 -- 172.21.15.57:0/3154714454 >> v1:172.21.15.88:6789/0 conn(0x7fecd814e020 legacy=0x7fecd815afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fecdda72640 1 -- 172.21.15.57:0/3154714454 >> v1:172.21.15.57:6789/0 conn(0x7fecd80c0cc0 legacy=0x7fecd814d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7f6e85e6f640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6e801520e0 0x7f6e800a79d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53022/0 (socket says 172.21.15.57:53022) 2024-04-24T23:39:00.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7f6e85e6f640 1 -- 172.21.15.57:0/4147884417 learned_addr learned my addr 172.21.15.57:0/4147884417 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:00.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fecdda72640 1 -- 172.21.15.57:0/3154714454 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd80bddd0 con 0x7fecd80bcf60 2024-04-24T23:39:00.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fa11fdcd640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa1180c3e10 0x7fa1180ab500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fa11fdcd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa1180b95c0 0x7fa1180aba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fa11fdcd640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa118151900 con 0x7fa11806cdc0 2024-04-24T23:39:00.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fa11fdcd640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fa118151400 con 0x7fa1180b95c0 2024-04-24T23:39:00.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fa11fdcd640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fa1180c57e0 con 0x7fa1180c3e10 2024-04-24T23:39:00.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7f8243fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f82440a3230 0x7f82440c2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7f6e880d3640 1 --2- 172.21.15.57:0/4147884417 >> v2:172.21.15.88:3300/0 conn(0x7f6e800bbbc0 0x7f6e801602e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7f6e880d3640 1 -- 172.21.15.57:0/4147884417 --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e80072700 con 0x7f6e801520e0 2024-04-24T23:39:00.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fd8eb59e640 1 -- 172.21.15.57:0/3800901466 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd8ec135970 msgr2=0x7fd8ec06f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fd8eb59e640 1 --2- 172.21.15.57:0/3800901466 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd8ec135970 0x7fd8ec06f3b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec0703f0 tx=0x7fd8e4020d30 comp rx=0 tx=0).stop 2024-04-24T23:39:00.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fd8eb59e640 1 -- 172.21.15.57:0/3800901466 shutdown_connections 2024-04-24T23:39:00.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fd8eb59e640 1 --2- 172.21.15.57:0/3800901466 >> v2:172.21.15.57:3300/0 conn(0x7fd8ec0c0fa0 0x7fd8ec14fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fd8eb59e640 1 --2- 172.21.15.57:0/3800901466 >> v2:172.21.15.88:3300/0 conn(0x7fd8ec0bdd60 0x7fd8ec0c0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fd8eb59e640 1 --2- 172.21.15.57:0/3800901466 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd8ec135970 0x7fd8ec06f3b0 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec0703f0 tx=0x7fd8e4020d30 comp rx=0 tx=0).stop 2024-04-24T23:39:00.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fd8eb59e640 1 -- 172.21.15.57:0/3800901466 >> 172.21.15.57:0/3800901466 conn(0x7fd8ec0be650 msgr2=0x7fd8ec0bea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:00.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fdc8a7fc640 1 --2- 172.21.15.57:0/1409167978 >> v2:172.21.15.88:3300/0 conn(0x7fdc8c149fb0 0x7fdc8c14c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fdc89ffb640 1 -- 172.21.15.57:0/1409167978 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3226832502 0 0) 0x7fdc8c0bc040 con 0x7fdc8c06ec70 2024-04-24T23:39:00.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fdc89ffb640 1 -- 172.21.15.57:0/1409167978 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc74003450 con 0x7fdc8c06ec70 2024-04-24T23:39:00.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fdc89ffb640 1 -- 172.21.15.57:0/1409167978 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1511667997 0 0) 0x7fdc8c1505d0 con 0x7fdc8c149bd0 2024-04-24T23:39:00.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fdc89ffb640 1 -- 172.21.15.57:0/1409167978 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc8c0bc040 con 0x7fdc8c149bd0 2024-04-24T23:39:00.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7f7a460e3640 1 -- start start 2024-04-24T23:39:00.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7f7a460e3640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7a4006ec70 0x7f7a4014cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7f7a460e3640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a400bc040 con 0x7f7a40149fb0 2024-04-24T23:39:00.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7f7a460e3640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a401505d0 con 0x7f7a40149bd0 2024-04-24T23:39:00.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7f7a460e3640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f7a400bbdf0 con 0x7f7a4006ec70 2024-04-24T23:39:00.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7f8248aee640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8244154020 0x7f8244150600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.57:56050/0 (socket says 172.21.15.57:56050) 2024-04-24T23:39:00.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7f8248aee640 1 -- 172.21.15.57:0/405873462 learned_addr learned my addr 172.21.15.57:0/405873462 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:00.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7f6e880d3640 1 -- 172.21.15.57:0/4147884417 --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e800bdf10 con 0x7f6e800bc150 2024-04-24T23:39:00.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fa11e36a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa1180b95c0 0x7fa1180aba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7f6e880d3640 1 -- 172.21.15.57:0/4147884417 --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f6e800721d0 con 0x7f6e800bbbc0 2024-04-24T23:39:00.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fa11db69640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa11806cdc0 0x7fa1180c0890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53028/0 (socket says 172.21.15.57:53028) 2024-04-24T23:39:00.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fa11db69640 1 -- 172.21.15.57:0/3989007383 learned_addr learned my addr 172.21.15.57:0/3989007383 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:00.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fa11d368640 1 --2- 172.21.15.57:0/3989007383 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa1180c3e10 0x7fa1180ab500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7f6e86670640 1 --2- 172.21.15.57:0/4147884417 >> v2:172.21.15.88:3300/0 conn(0x7f6e800bbbc0 0x7f6e801602e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fd8eb59e640 1 -- 172.21.15.57:0/3800901466 shutdown_connections 2024-04-24T23:39:00.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fdc89ffb640 1 -- 172.21.15.57:0/1409167978 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3415020352 0 0) 0x7fdc74003450 con 0x7fdc8c06ec70 2024-04-24T23:39:00.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fdc89ffb640 1 -- 172.21.15.57:0/1409167978 >> v2:172.21.15.88:3300/0 conn(0x7fdc8c149fb0 msgr2=0x7fdc8c14c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:00.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fdc89ffb640 1 --2- 172.21.15.57:0/1409167978 >> v2:172.21.15.88:3300/0 conn(0x7fdc8c149fb0 0x7fdc8c14c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fdc89ffb640 1 -- 172.21.15.57:0/1409167978 >> v1:172.21.15.88:6789/0 conn(0x7fdc8c149bd0 legacy=0x7fdc8c0bd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fdc89ffb640 1 -- 172.21.15.57:0/1409167978 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc8c14d2f0 con 0x7fdc8c06ec70 2024-04-24T23:39:00.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fdc89ffb640 1 -- 172.21.15.57:0/1409167978 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7fdc7c0015b0 con 0x7fdc8c06ec70 2024-04-24T23:39:00.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fdc89ffb640 1 -- 172.21.15.57:0/1409167978 >> v1:172.21.15.57:6789/0 conn(0x7fdc8c06ec70 legacy=0x7fdc8c14cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fdc89ffb640 1 --2- 172.21.15.57:0/1409167978 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc74003d70 0x7fdc74008860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fdc89ffb640 1 --2- 172.21.15.57:0/1409167978 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdc74008da0 0x7fdc7400b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fdc89ffb640 1 --2- 172.21.15.57:0/1409167978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc7400b720 0x7fdc7400dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fdc89ffb640 1 -- 172.21.15.57:0/1409167978 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8c0bbdf0 con 0x7fdc7400b720 2024-04-24T23:39:00.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fdc89ffb640 1 -- 172.21.15.57:0/1409167978 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7400e4c0 con 0x7fdc74003d70 2024-04-24T23:39:00.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fdc89ffb640 1 -- 172.21.15.57:0/1409167978 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fdc7400e6c0 con 0x7fdc74008da0 2024-04-24T23:39:00.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7f7a3effd640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7a40149fb0 0x7f7a4014c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53036/0 (socket says 172.21.15.57:53036) 2024-04-24T23:39:00.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7f7a3effd640 1 -- 172.21.15.57:0/4135967285 learned_addr learned my addr 172.21.15.57:0/4135967285 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:00.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fa11e36a640 1 -- 172.21.15.57:0/3989007383 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa1180c3e10 msgr2=0x7fa1180ab500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:00.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fa11e36a640 1 --2- 172.21.15.57:0/3989007383 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa1180c3e10 0x7fa1180ab500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fdc8b7fe640 1 --2- 172.21.15.57:0/1409167978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc7400b720 0x7fdc7400dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fd11975f640 1 --2- 172.21.15.57:0/3188457440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1140bdd40 0x7fd11414c6a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd11406c6b0 tx=0x7fd10c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a07191257e1c9575 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fa11e36a640 1 -- 172.21.15.57:0/3989007383 >> v1:172.21.15.57:6789/0 conn(0x7fa11806cdc0 legacy=0x7fa1180c0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fdc8affd640 1 --2- 172.21.15.57:0/1409167978 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc74003d70 0x7fdc74008860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7f6e84e6d640 1 -- 172.21.15.57:0/4147884417 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2706613852 0 0) 0x7f6e80072700 con 0x7f6e801520e0 2024-04-24T23:39:00.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7f6e84e6d640 1 -- 172.21.15.57:0/4147884417 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e6c003530 con 0x7f6e801520e0 2024-04-24T23:39:00.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fdc8a7fc640 1 --2- 172.21.15.57:0/1409167978 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdc74008da0 0x7fdc7400b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7f7a3ffff640 1 --2- 172.21.15.57:0/4135967285 >> v2:172.21.15.57:3300/0 conn(0x7f7a4006ec70 0x7f7a4014cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7f6e86670640 1 -- 172.21.15.57:0/4147884417 >> v1:172.21.15.88:6789/0 conn(0x7f6e800bc150 legacy=0x7f6e8006e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7f6e86670640 1 -- 172.21.15.57:0/4147884417 >> v1:172.21.15.57:6789/0 conn(0x7f6e801520e0 legacy=0x7f6e800a79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7f6e86670640 1 -- 172.21.15.57:0/4147884417 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e800be1f0 con 0x7f6e800bbbc0 2024-04-24T23:39:00.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fdc8b7fe640 1 -- 172.21.15.57:0/1409167978 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdc74008da0 msgr2=0x7fdc7400b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:00.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fdc8b7fe640 1 --2- 172.21.15.57:0/1409167978 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdc74008da0 0x7fdc7400b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fdc8b7fe640 1 -- 172.21.15.57:0/1409167978 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc74003d70 msgr2=0x7fdc74008860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:00.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fdc8b7fe640 1 --2- 172.21.15.57:0/1409167978 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc74003d70 0x7fdc74008860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fdc8b7fe640 1 -- 172.21.15.57:0/1409167978 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc8c14d2f0 con 0x7fdc7400b720 2024-04-24T23:39:00.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fa11e36a640 1 -- 172.21.15.57:0/3989007383 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1180c13f0 con 0x7fa1180b95c0 2024-04-24T23:39:00.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7f8243fff640 1 -- 172.21.15.57:0/405873462 >> v1:172.21.15.88:6789/0 conn(0x7f8244154020 legacy=0x7f8244150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7f8243fff640 1 -- 172.21.15.57:0/405873462 >> v1:172.21.15.57:6789/0 conn(0x7f8244070c10 legacy=0x7f82440c3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:00.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7f8243fff640 1 -- 172.21.15.57:0/405873462 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8244071080 con 0x7f82440a3230 2024-04-24T23:39:00.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.333+0000 7fd8eb59e640 1 -- 172.21.15.57:0/3800901466 wait complete. 2024-04-24T23:39:00.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7f7a3ffff640 1 -- 172.21.15.57:0/4135967285 >> v1:172.21.15.88:6789/0 conn(0x7f7a40149bd0 legacy=0x7f7a400bd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7f7a3e7fc640 1 -- 172.21.15.57:0/4135967285 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1367920457 0 0) 0x7f7a400bc040 con 0x7f7a40149fb0 2024-04-24T23:39:00.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fd8eb59e640 1 Processor -- start 2024-04-24T23:39:00.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fd1137fe640 1 -- 172.21.15.57:0/3188457440 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10c00b2d0 con 0x7fd1140bdd40 2024-04-24T23:39:00.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fd1137fe640 1 -- 172.21.15.57:0/3188457440 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd10c00b470 con 0x7fd1140bdd40 2024-04-24T23:39:00.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fd1137fe640 1 -- 172.21.15.57:0/3188457440 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10c0a58b0 con 0x7fd1140bdd40 2024-04-24T23:39:00.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7f7a3ffff640 1 -- 172.21.15.57:0/4135967285 >> v1:172.21.15.57:6789/0 conn(0x7f7a40149fb0 legacy=0x7f7a4014c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7f7a3ffff640 1 -- 172.21.15.57:0/4135967285 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a4014d2f0 con 0x7f7a4006ec70 2024-04-24T23:39:00.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fecdda72640 1 --2- 172.21.15.57:0/3154714454 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fecd80bcf60 0x7fecd8154130 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fecc80097f0 tx=0x7fecc801c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2af5921c14c13f75 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fecdd271640 1 -- 172.21.15.57:0/3154714454 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc80ab5f0 con 0x7fecd80bcf60 2024-04-24T23:39:00.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fecdd271640 1 -- 172.21.15.57:0/3154714454 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecc80b0070 con 0x7fecd80bcf60 2024-04-24T23:39:00.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fecdd271640 1 -- 172.21.15.57:0/3154714454 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc80ab9b0 con 0x7fecd80bcf60 2024-04-24T23:39:00.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fd11b1c2640 1 -- 172.21.15.57:0/3188457440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1140bdd40 msgr2=0x7fd11414c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fd11b1c2640 1 --2- 172.21.15.57:0/3188457440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1140bdd40 0x7fd11414c6a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd11406c6b0 tx=0x7fd10c01c9d0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fd11b1c2640 1 -- 172.21.15.57:0/3188457440 shutdown_connections 2024-04-24T23:39:00.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fd11b1c2640 1 --2- 172.21.15.57:0/3188457440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1140bdd40 0x7fd11414c6a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fd11b1c2640 1 --2- 172.21.15.57:0/3188457440 >> v2:172.21.15.88:3300/0 conn(0x7fd11406ec70 0x7fd1140bd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fd11b1c2640 1 -- 172.21.15.57:0/3188457440 >> 172.21.15.57:0/3188457440 conn(0x7fd1140be8f0 msgr2=0x7fd1140becd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:00.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fd8eb59e640 1 -- start start 2024-04-24T23:39:00.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fd8eb59e640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd8ec0bdd60 0x7fd8ec1338f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fd8eb59e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8ec0c0fa0 0x7fd8ec133e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fd8eb59e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8ec0b9490 0x7fd8ec1f9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fd8eb59e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec14ced0 con 0x7fd8ec0c0fa0 2024-04-24T23:39:00.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fd8eb59e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec1505c0 con 0x7fd8ec0b9490 2024-04-24T23:39:00.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fd8eb59e640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fd8ec14d050 con 0x7fd8ec0bdd60 2024-04-24T23:39:00.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fd8ead9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8ec0b9490 0x7fd8ec1f9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fd8ead9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8ec0b9490 0x7fd8ec1f9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.57:59974/0 (socket says 172.21.15.57:59974) 2024-04-24T23:39:00.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fd8ead9d640 1 -- 172.21.15.57:0/875605061 learned_addr learned my addr 172.21.15.57:0/875605061 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:00.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fd8ea59c640 1 --2- 172.21.15.57:0/875605061 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd8ec0bdd60 0x7fd8ec1338f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7f6e86670640 1 --2- 172.21.15.57:0/4147884417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e800bbbc0 0x7f6e801602e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6e80072350 tx=0x7f6e7801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6259162404167f88 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fecdf275640 1 -- 172.21.15.57:0/3154714454 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fecd80bcf60 msgr2=0x7fecd8154130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fdc8b7fe640 1 -- 172.21.15.57:0/1409167978 reap_dead start 2024-04-24T23:39:00.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fecdf275640 1 --2- 172.21.15.57:0/3154714454 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fecd80bcf60 0x7fecd8154130 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fecc80097f0 tx=0x7fecc801c500 comp rx=0 tx=0).stop 2024-04-24T23:39:00.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7f8243fff640 1 --2- 172.21.15.57:0/405873462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82440a3230 0x7f82440c2ea0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f82380097c0 tx=0x7f823801c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ea34477473d4ee6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7f6e84e6d640 1 -- 172.21.15.57:0/4147884417 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e780b2070 con 0x7f6e800bbbc0 2024-04-24T23:39:00.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7f6e84e6d640 1 -- 172.21.15.57:0/4147884417 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e780a5920 con 0x7f6e800bbbc0 2024-04-24T23:39:00.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7f6e84e6d640 1 -- 172.21.15.57:0/4147884417 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e780a5cf0 con 0x7f6e800bbbc0 2024-04-24T23:39:00.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7f6e880d3640 1 -- 172.21.15.57:0/4147884417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e800bbbc0 msgr2=0x7f6e801602e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7f6e880d3640 1 --2- 172.21.15.57:0/4147884417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e800bbbc0 0x7f6e801602e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6e80072350 tx=0x7f6e7801c950 comp rx=0 tx=0).stop 2024-04-24T23:39:00.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7f6e880d3640 1 -- 172.21.15.57:0/4147884417 shutdown_connections 2024-04-24T23:39:00.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7f6e880d3640 1 --2- 172.21.15.57:0/4147884417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e800bbbc0 0x7f6e801602e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7f6e880d3640 1 -- 172.21.15.57:0/4147884417 >> 172.21.15.57:0/4147884417 conn(0x7f6e800be8f0 msgr2=0x7f6e800becd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:00.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7f6e880d3640 1 -- 172.21.15.57:0/4147884417 shutdown_connections 2024-04-24T23:39:00.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fd8ead9d640 1 -- 172.21.15.57:0/875605061 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd8ec0bdd60 msgr2=0x7fd8ec1338f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fd8ead9d640 1 --2- 172.21.15.57:0/875605061 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd8ec0bdd60 0x7fd8ec1338f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fd8ead9d640 1 -- 172.21.15.57:0/875605061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8ec0c0fa0 msgr2=0x7fd8ec133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fd8ead9d640 1 --2- 172.21.15.57:0/875605061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8ec0c0fa0 0x7fd8ec133e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fd8ead9d640 1 -- 172.21.15.57:0/875605061 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8ec1345d0 con 0x7fd8ec0b9490 2024-04-24T23:39:00.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fd8ead9d640 1 --2- 172.21.15.57:0/875605061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8ec0b9490 0x7fd8ec1f9980 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc00aa00 tx=0x7fd8dc00aec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fd8daffd640 1 -- 172.21.15.57:0/875605061 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc01b070 con 0x7fd8ec0b9490 2024-04-24T23:39:00.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fdc8b7fe640 1 --2- 172.21.15.57:0/1409167978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc7400b720 0x7fdc7400dbe0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c007fa0 tx=0x7fdc7c01ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=199608d1abe25e9a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fdc89ffb640 1 -- 172.21.15.57:0/1409167978 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c007ba0 con 0x7fdc7400b720 2024-04-24T23:39:00.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fdc89ffb640 1 -- 172.21.15.57:0/1409167978 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc7c0a5880 con 0x7fdc7400b720 2024-04-24T23:39:00.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fdc89ffb640 1 -- 172.21.15.57:0/1409167978 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c0a5c70 con 0x7fdc7400b720 2024-04-24T23:39:00.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fecdf275640 1 -- 172.21.15.57:0/3154714454 shutdown_connections 2024-04-24T23:39:00.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fecdf275640 1 --2- 172.21.15.57:0/3154714454 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fecd80bcf60 0x7fecd8154130 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fecdf275640 1 -- 172.21.15.57:0/3154714454 >> 172.21.15.57:0/3154714454 conn(0x7fecd80be650 msgr2=0x7fecd80bea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:00.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fecdf275640 1 -- 172.21.15.57:0/3154714454 shutdown_connections 2024-04-24T23:39:00.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fecdf275640 1 -- 172.21.15.57:0/3154714454 wait complete. 2024-04-24T23:39:00.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fecdf275640 1 Processor -- start 2024-04-24T23:39:00.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fd11b1c2640 1 -- 172.21.15.57:0/3188457440 shutdown_connections 2024-04-24T23:39:00.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.337+0000 7fd11b1c2640 1 -- 172.21.15.57:0/3188457440 wait complete. 2024-04-24T23:39:00.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fa11e36a640 1 --2- 172.21.15.57:0/3989007383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1180b95c0 0x7fa1180aba40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa110009d90 tx=0x7fa11001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8834bae45b19a85 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7f82437fe640 1 -- 172.21.15.57:0/405873462 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82380b0070 con 0x7f82440a3230 2024-04-24T23:39:00.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7f82437fe640 1 -- 172.21.15.57:0/405873462 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82380ab600 con 0x7f82440a3230 2024-04-24T23:39:00.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7f82437fe640 1 -- 172.21.15.57:0/405873462 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82380ab9d0 con 0x7f82440a3230 2024-04-24T23:39:00.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7f8249af0640 1 -- 172.21.15.57:0/405873462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82440a3230 msgr2=0x7f82440c2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7f8249af0640 1 --2- 172.21.15.57:0/405873462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82440a3230 0x7f82440c2ea0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f82380097c0 tx=0x7f823801c460 comp rx=0 tx=0).stop 2024-04-24T23:39:00.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7f6e880d3640 1 -- 172.21.15.57:0/4147884417 wait complete. 2024-04-24T23:39:00.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fd8eb59e640 1 -- 172.21.15.57:0/875605061 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8ec0b9a80 con 0x7fd8ec0b9490 2024-04-24T23:39:00.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fd8eb59e640 1 -- 172.21.15.57:0/875605061 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8ec0bbed0 con 0x7fd8ec0b9490 2024-04-24T23:39:00.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fd8daffd640 1 -- 172.21.15.57:0/875605061 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8dc006b30 con 0x7fd8ec0b9490 2024-04-24T23:39:00.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fdc91944640 1 -- 172.21.15.57:0/1409167978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc7400b720 msgr2=0x7fdc7400dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fdc91944640 1 --2- 172.21.15.57:0/1409167978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc7400b720 0x7fdc7400dbe0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c007fa0 tx=0x7fdc7c01ca80 comp rx=0 tx=0).stop 2024-04-24T23:39:00.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fdc91944640 1 -- 172.21.15.57:0/1409167978 shutdown_connections 2024-04-24T23:39:00.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fdc91944640 1 --2- 172.21.15.57:0/1409167978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc7400b720 0x7fdc7400dbe0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fdc91944640 1 -- 172.21.15.57:0/1409167978 >> 172.21.15.57:0/1409167978 conn(0x7fdc8c0be8f0 msgr2=0x7fdc8c0becd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:00.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fecdf275640 1 -- start start 2024-04-24T23:39:00.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fd11b1c2640 1 Processor -- start 2024-04-24T23:39:00.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fd11b1c2640 1 -- start start 2024-04-24T23:39:00.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fa11cb67640 1 -- 172.21.15.57:0/3989007383 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1100b2070 con 0x7fa1180b95c0 2024-04-24T23:39:00.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fa11cb67640 1 -- 172.21.15.57:0/3989007383 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1100a5940 con 0x7fa1180b95c0 2024-04-24T23:39:00.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fa11cb67640 1 -- 172.21.15.57:0/3989007383 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1100a5d10 con 0x7fa1180b95c0 2024-04-24T23:39:00.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fdc91944640 1 -- 172.21.15.57:0/1409167978 shutdown_connections 2024-04-24T23:39:00.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fecdf275640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fecd80bcf60 0x7fecd8154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fecdf275640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fecd80c0cc0 0x7fecd80baa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fecdf275640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecd814e020 0x7fecd81f0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fecdf275640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fecd80c1220 con 0x7fecd80bcf60 2024-04-24T23:39:00.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fecdf275640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fecd80c10a0 con 0x7fecd814e020 2024-04-24T23:39:00.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fecdf275640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fecd815ef00 con 0x7fecd80c0cc0 2024-04-24T23:39:00.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7f8249af0640 1 -- 172.21.15.57:0/405873462 shutdown_connections 2024-04-24T23:39:00.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7f8249af0640 1 --2- 172.21.15.57:0/405873462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82440a3230 0x7f82440c2ea0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7f8249af0640 1 -- 172.21.15.57:0/405873462 >> 172.21.15.57:0/405873462 conn(0x7f824406b210 msgr2=0x7f824406b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:00.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7f6e880d3640 1 Processor -- start 2024-04-24T23:39:00.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7f8249af0640 1 -- 172.21.15.57:0/405873462 shutdown_connections 2024-04-24T23:39:00.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fd8daffd640 1 -- 172.21.15.57:0/875605061 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc016480 con 0x7fd8ec0b9490 2024-04-24T23:39:00.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fecde273640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fecd80bcf60 0x7fecd8154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fecde273640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fecd80bcf60 0x7fecd8154d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59986/0 (socket says 172.21.15.57:59986) 2024-04-24T23:39:00.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fecde273640 1 -- 172.21.15.57:0/2011736240 learned_addr learned my addr 172.21.15.57:0/2011736240 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:00.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fecdea74640 1 --2- 172.21.15.57:0/2011736240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecd814e020 0x7fecd81f0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fecdda72640 1 --2- 172.21.15.57:0/2011736240 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fecd80c0cc0 0x7fecd80baa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fa11fdcd640 1 -- 172.21.15.57:0/3989007383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1180b95c0 msgr2=0x7fa1180aba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fa11fdcd640 1 --2- 172.21.15.57:0/3989007383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1180b95c0 0x7fa1180aba40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa110009d90 tx=0x7fa11001c970 comp rx=0 tx=0).stop 2024-04-24T23:39:00.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7f8249af0640 1 -- 172.21.15.57:0/405873462 wait complete. 2024-04-24T23:39:00.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7f6e880d3640 1 -- start start 2024-04-24T23:39:00.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7f6e880d3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e800bbbc0 0x7f6e801f0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7f6e880d3640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e800bc150 0x7f6e8013f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7f6e880d3640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e801520e0 0x7f6e8013f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7f6e880d3640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6e80070fa0 con 0x7f6e800bc150 2024-04-24T23:39:00.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7f6e880d3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6e80070e20 con 0x7f6e800bbbc0 2024-04-24T23:39:00.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7f6e880d3640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f6e80163040 con 0x7f6e801520e0 2024-04-24T23:39:00.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fd8eb59e640 1 -- 172.21.15.57:0/875605061 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd8d0001040 con 0x7fd8ec0b9490 2024-04-24T23:39:00.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fdc91944640 1 -- 172.21.15.57:0/1409167978 wait complete. 2024-04-24T23:39:00.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fdc91944640 1 Processor -- start 2024-04-24T23:39:00.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fecdea74640 1 -- 172.21.15.57:0/2011736240 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fecd80c0cc0 msgr2=0x7fecd80baa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fecdea74640 1 --2- 172.21.15.57:0/2011736240 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fecd80c0cc0 0x7fecd80baa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fecdea74640 1 -- 172.21.15.57:0/2011736240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fecd80bcf60 msgr2=0x7fecd8154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fecdea74640 1 --2- 172.21.15.57:0/2011736240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fecd80bcf60 0x7fecd8154d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fecdea74640 1 -- 172.21.15.57:0/2011736240 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd80bafc0 con 0x7fecd814e020 2024-04-24T23:39:00.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fecde273640 1 --2- 172.21.15.57:0/2011736240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fecd80bcf60 0x7fecd8154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:39:00.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fecdea74640 1 --2- 172.21.15.57:0/2011736240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecd814e020 0x7fecd81f0c20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fecd400c3e0 tx=0x7fecd400c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fd11b1c2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd11406ec70 0x7fd1141e4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fd11b1c2640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd1140bdd40 0x7fd114149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fd11b1c2640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1140bf3e0 0x7fd11414eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fd11b1c2640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd114151210 con 0x7fd1140bf3e0 2024-04-24T23:39:00.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fd11b1c2640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd114151090 con 0x7fd11406ec70 2024-04-24T23:39:00.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fd11b1c2640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fd114151390 con 0x7fd1140bdd40 2024-04-24T23:39:00.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fd11975f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1140bf3e0 0x7fd11414eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fd11975f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1140bf3e0 0x7fd11414eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60002/0 (socket says 172.21.15.57:60002) 2024-04-24T23:39:00.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fd11975f640 1 -- 172.21.15.57:0/4224344237 learned_addr learned my addr 172.21.15.57:0/4224344237 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:00.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fd118f5e640 1 --2- 172.21.15.57:0/4224344237 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd11406ec70 0x7fd1141e4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fa11fdcd640 1 -- 172.21.15.57:0/3989007383 shutdown_connections 2024-04-24T23:39:00.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fa11fdcd640 1 --2- 172.21.15.57:0/3989007383 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa1180c3e10 0x7fa1180ab500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fa11fdcd640 1 --2- 172.21.15.57:0/3989007383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1180b95c0 0x7fa1180aba40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fa11fdcd640 1 -- 172.21.15.57:0/3989007383 >> 172.21.15.57:0/3989007383 conn(0x7fa1180c6310 msgr2=0x7fa1180c6720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:00.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fd11975f640 1 -- 172.21.15.57:0/4224344237 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd1140bdd40 msgr2=0x7fd114149e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fd11975f640 1 --2- 172.21.15.57:0/4224344237 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd1140bdd40 0x7fd114149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fd11975f640 1 -- 172.21.15.57:0/4224344237 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd11406ec70 msgr2=0x7fd1141e4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fd11975f640 1 --2- 172.21.15.57:0/4224344237 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd11406ec70 0x7fd1141e4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fd11975f640 1 -- 172.21.15.57:0/4224344237 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd11414f000 con 0x7fd1140bf3e0 2024-04-24T23:39:00.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fa11fdcd640 1 -- 172.21.15.57:0/3989007383 shutdown_connections 2024-04-24T23:39:00.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fecceffd640 1 -- 172.21.15.57:0/2011736240 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd4017070 con 0x7fecd814e020 2024-04-24T23:39:00.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fecceffd640 1 -- 172.21.15.57:0/2011736240 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecd4003600 con 0x7fecd814e020 2024-04-24T23:39:00.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fecceffd640 1 -- 172.21.15.57:0/2011736240 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd40039f0 con 0x7fecd814e020 2024-04-24T23:39:00.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fecdf275640 1 -- 172.21.15.57:0/2011736240 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecd81ee200 con 0x7fecd814e020 2024-04-24T23:39:00.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7f6e85e6f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e800bbbc0 0x7f6e801f0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7f6e85e6f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e800bbbc0 0x7f6e801f0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.57:59998/0 (socket says 172.21.15.57:59998) 2024-04-24T23:39:00.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7f6e85e6f640 1 -- 172.21.15.57:0/2818832722 learned_addr learned my addr 172.21.15.57:0/2818832722 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:00.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fd11975f640 1 --2- 172.21.15.57:0/4224344237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1140bf3e0 0x7fd11414eac0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd10c0af040 tx=0x7fd10c009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fecdf275640 1 -- 172.21.15.57:0/2011736240 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecd811c960 con 0x7fecd814e020 2024-04-24T23:39:00.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f8249af0640 1 Processor -- start 2024-04-24T23:39:00.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fd1117fa640 1 -- 172.21.15.57:0/4224344237 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10c009800 con 0x7fd1140bf3e0 2024-04-24T23:39:00.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fd1117fa640 1 -- 172.21.15.57:0/4224344237 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd10c0bc070 con 0x7fd1140bf3e0 2024-04-24T23:39:00.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fd1117fa640 1 -- 172.21.15.57:0/4224344237 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10c009c20 con 0x7fd1140bf3e0 2024-04-24T23:39:00.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fd11b1c2640 1 -- 172.21.15.57:0/4224344237 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1140b9670 con 0x7fd1140bf3e0 2024-04-24T23:39:00.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fd11b1c2640 1 -- 172.21.15.57:0/4224344237 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd114144440 con 0x7fd1140bf3e0 2024-04-24T23:39:00.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fdc91944640 1 -- start start 2024-04-24T23:39:00.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fdc91944640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc7400b720 0x7fdc8c147f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fdc91944640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdc8c1f16a0 0x7fdc8c143b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fdc91944640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc8c1484b0 0x7fdc8c1ed8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fdc91944640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8c0bdb90 con 0x7fdc8c1484b0 2024-04-24T23:39:00.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fdc91944640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8c0bda10 con 0x7fdc7400b720 2024-04-24T23:39:00.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fdc91944640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fdc8c0bdd10 con 0x7fdc8c1f16a0 2024-04-24T23:39:00.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fd8daffd640 1 -- 172.21.15.57:0/875605061 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd8dc01e070 con 0x7fd8ec0b9490 2024-04-24T23:39:00.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fd8daffd640 1 --2- 172.21.15.57:0/875605061 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd8cc0678c0 0x7fd8cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fd8daffd640 1 -- 172.21.15.57:0/875605061 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd8dc086890 con 0x7fd8ec0b9490 2024-04-24T23:39:00.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fd8daffd640 1 --2- 172.21.15.57:0/875605061 >> [v2:172.21.15.57:6808/3474703186,v1:172.21.15.57:6809/3474703186] conn(0x7fd8cc071040 0x7fd8cc073480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fd8daffd640 1 -- 172.21.15.57:0/875605061 --> [v2:172.21.15.57:6808/3474703186,v1:172.21.15.57:6809/3474703186] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd8dc021ec0 con 0x7fd8cc071040 2024-04-24T23:39:00.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fd8daffd640 1 -- 172.21.15.57:0/875605061 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd8dc086c80 con 0x7fd8ec0b9490 2024-04-24T23:39:00.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fdc8a7fc640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdc8c1f16a0 0x7fdc8c143b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fdc8a7fc640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdc8c1f16a0 0x7fdc8c143b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.57:60968/0 (socket says 172.21.15.57:60968) 2024-04-24T23:39:00.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fdc8a7fc640 1 -- 172.21.15.57:0/3194511365 learned_addr learned my addr 172.21.15.57:0/3194511365 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:00.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f6e85e6f640 1 -- 172.21.15.57:0/2818832722 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e801520e0 msgr2=0x7f6e8013f900 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-24T23:39:00.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f6e85e6f640 1 --2- 172.21.15.57:0/2818832722 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e801520e0 0x7f6e8013f900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f6e85e6f640 1 -- 172.21.15.57:0/2818832722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e800bc150 msgr2=0x7f6e8013f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f6e85e6f640 1 --2- 172.21.15.57:0/2818832722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e800bc150 0x7f6e8013f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f6e85e6f640 1 -- 172.21.15.57:0/2818832722 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e8014a590 con 0x7f6e800bbbc0 2024-04-24T23:39:00.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f8249af0640 1 -- start start 2024-04-24T23:39:00.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f8249af0640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8244070c10 0x7f82440a7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f8249af0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82440a3230 0x7f82440a4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f8249af0640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8244154020 0x7f82440a4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f8249af0640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f824415ea60 con 0x7f8244154020 2024-04-24T23:39:00.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f8249af0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f824415e8e0 con 0x7f82440a3230 2024-04-24T23:39:00.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f8249af0640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f824415ebe0 con 0x7f8244070c10 2024-04-24T23:39:00.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.341+0000 7fa11fdcd640 1 -- 172.21.15.57:0/3989007383 wait complete. 2024-04-24T23:39:00.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fd8e9d9b640 1 --2- 172.21.15.57:0/875605061 >> [v2:172.21.15.57:6808/3474703186,v1:172.21.15.57:6809/3474703186] conn(0x7fd8cc071040 0x7fd8cc073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fa11fdcd640 1 Processor -- start 2024-04-24T23:39:00.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fd8ea59c640 1 --2- 172.21.15.57:0/875605061 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd8cc0678c0 0x7fd8cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f82492ef640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8244154020 0x7f82440a4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f82492ef640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8244154020 0x7f82440a4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60034/0 (socket says 172.21.15.57:60034) 2024-04-24T23:39:00.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f82492ef640 1 -- 172.21.15.57:0/3202524425 learned_addr learned my addr 172.21.15.57:0/3202524425 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:00.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f8248aee640 1 --2- 172.21.15.57:0/3202524425 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8244070c10 0x7f82440a7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fdc8affd640 1 --2- 172.21.15.57:0/3194511365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc7400b720 0x7fdc8c147f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f6e85e6f640 1 --2- 172.21.15.57:0/2818832722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e800bbbc0 0x7f6e801f0900 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c00c4d0 tx=0x7f6e7c00c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f8243fff640 1 --2- 172.21.15.57:0/3202524425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82440a3230 0x7f82440a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f82492ef640 1 -- 172.21.15.57:0/3202524425 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8244070c10 msgr2=0x7f82440a7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f82492ef640 1 --2- 172.21.15.57:0/3202524425 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8244070c10 0x7f82440a7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f82492ef640 1 -- 172.21.15.57:0/3202524425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82440a3230 msgr2=0x7f82440a4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f82492ef640 1 --2- 172.21.15.57:0/3202524425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82440a3230 0x7f82440a4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fdc8a7fc640 1 -- 172.21.15.57:0/3194511365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc7400b720 msgr2=0x7fdc8c147f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fdc8a7fc640 1 --2- 172.21.15.57:0/3194511365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc7400b720 0x7fdc8c147f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fdc8a7fc640 1 -- 172.21.15.57:0/3194511365 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc8c1484b0 msgr2=0x7fdc8c1ed8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fdc8a7fc640 1 --2- 172.21.15.57:0/3194511365 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc8c1484b0 0x7fdc8c1ed8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fdc8a7fc640 1 -- 172.21.15.57:0/3194511365 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc8c0a3550 con 0x7fdc8c1f16a0 2024-04-24T23:39:00.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f7a3ffff640 1 --2- 172.21.15.57:0/4135967285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a4006ec70 0x7f7a4014cdb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7a34009740 tx=0x7f7a3401bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f857d60bbbefd458 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f82492ef640 1 -- 172.21.15.57:0/3202524425 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82440a82d0 con 0x7f8244154020 2024-04-24T23:39:00.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f6e767fc640 1 -- 172.21.15.57:0/2818832722 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c017070 con 0x7f6e800bbbc0 2024-04-24T23:39:00.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fd8e9d9b640 1 --2- 172.21.15.57:0/875605061 >> [v2:172.21.15.57:6808/3474703186,v1:172.21.15.57:6809/3474703186] conn(0x7fd8cc071040 0x7fd8cc073480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fa11fdcd640 1 -- start start 2024-04-24T23:39:00.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fdc8a7fc640 1 --2- 172.21.15.57:0/3194511365 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdc8c1f16a0 0x7fdc8c143b70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdc80011590 tx=0x7fdc80011a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f82492ef640 1 --2- 172.21.15.57:0/3202524425 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8244154020 0x7f82440a4970 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f823c00b9a0 tx=0x7f823c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fd8ea59c640 1 --2- 172.21.15.57:0/875605061 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd8cc0678c0 0x7fd8cc069d80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd8e40b3000 tx=0x7fd8e400d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f82417fa640 1 -- 172.21.15.57:0/3202524425 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c019070 con 0x7f8244154020 2024-04-24T23:39:00.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fdc73fff640 1 -- 172.21.15.57:0/3194511365 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc80015930 con 0x7fdc8c1f16a0 2024-04-24T23:39:00.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fdc73fff640 1 -- 172.21.15.57:0/3194511365 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc80015ad0 con 0x7fdc8c1f16a0 2024-04-24T23:39:00.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fdc73fff640 1 -- 172.21.15.57:0/3194511365 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8000f460 con 0x7fdc8c1f16a0 2024-04-24T23:39:00.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f82417fa640 1 -- 172.21.15.57:0/3202524425 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f823c00cba0 con 0x7f8244154020 2024-04-24T23:39:00.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f82417fa640 1 -- 172.21.15.57:0/3202524425 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c014440 con 0x7f8244154020 2024-04-24T23:39:00.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f6e880d3640 1 -- 172.21.15.57:0/2818832722 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e801529a0 con 0x7f6e800bbbc0 2024-04-24T23:39:00.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f6e880d3640 1 -- 172.21.15.57:0/2818832722 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e801f0e40 con 0x7f6e800bbbc0 2024-04-24T23:39:00.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f8249af0640 1 -- 172.21.15.57:0/3202524425 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82441f06e0 con 0x7f8244154020 2024-04-24T23:39:00.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f8249af0640 1 -- 172.21.15.57:0/3202524425 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8244150130 con 0x7f8244154020 2024-04-24T23:39:00.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f6e880d3640 1 -- 172.21.15.57:0/2818832722 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6e801f1530 con 0x7f6e800bbbc0 2024-04-24T23:39:00.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f6e767fc640 1 -- 172.21.15.57:0/2818832722 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e7c005cf0 con 0x7f6e800bbbc0 2024-04-24T23:39:00.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f6e767fc640 1 -- 172.21.15.57:0/2818832722 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c007270 con 0x7f6e800bbbc0 2024-04-24T23:39:00.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fdc91944640 1 -- 172.21.15.57:0/3194511365 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc8c0711b0 con 0x7fdc8c1f16a0 2024-04-24T23:39:00.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fdc91944640 1 -- 172.21.15.57:0/3194511365 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc8c0b8ef0 con 0x7fdc8c1f16a0 2024-04-24T23:39:00.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fdc91944640 1 -- 172.21.15.57:0/3194511365 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdc8c04f510 con 0x7fdc8c1f16a0 2024-04-24T23:39:00.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fecdf275640 1 -- 172.21.15.57:0/2011736240 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fecc0001040 con 0x7fecd814e020 2024-04-24T23:39:00.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fd1117fa640 1 -- 172.21.15.57:0/4224344237 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd10c0b6480 con 0x7fd1140bf3e0 2024-04-24T23:39:00.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fd1117fa640 1 --2- 172.21.15.57:0/4224344237 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd100067990 0x7fd100069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fd1117fa640 1 -- 172.21.15.57:0/4224344237 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd10c120e80 con 0x7fd1140bf3e0 2024-04-24T23:39:00.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fd11b1c2640 1 --2- 172.21.15.57:0/4224344237 >> [v2:172.21.15.88:6810/1782800372,v1:172.21.15.88:6812/1782800372] conn(0x7fd0f4001660 0x7fd0f4003b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fa11fdcd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa11806cdc0 0x7fa1180b99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fa11fdcd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1180b95c0 0x7fa1180bda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fa11fdcd640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa1180c3e10 0x7fa1180b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fa11fdcd640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa11815da40 con 0x7fa11806cdc0 2024-04-24T23:39:00.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fa11fdcd640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa1180c11b0 con 0x7fa1180b95c0 2024-04-24T23:39:00.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fa11fdcd640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fa11815dbc0 con 0x7fa1180c3e10 2024-04-24T23:39:00.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fa11db69640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa11806cdc0 0x7fa1180b99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fa11db69640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa11806cdc0 0x7fa1180b99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60040/0 (socket says 172.21.15.57:60040) 2024-04-24T23:39:00.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fa11db69640 1 -- 172.21.15.57:0/3992934727 learned_addr learned my addr 172.21.15.57:0/3992934727 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:00.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f7a3e7fc640 1 -- 172.21.15.57:0/4135967285 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a340a5660 con 0x7f7a4006ec70 2024-04-24T23:39:00.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f7a3e7fc640 1 -- 172.21.15.57:0/4135967285 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a340a5800 con 0x7f7a4006ec70 2024-04-24T23:39:00.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7f7a3e7fc640 1 -- 172.21.15.57:0/4135967285 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a340a5bd0 con 0x7f7a4006ec70 2024-04-24T23:39:00.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7f7a460e3640 1 -- 172.21.15.57:0/4135967285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a4006ec70 msgr2=0x7f7a4014cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7f7a460e3640 1 --2- 172.21.15.57:0/4135967285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a4006ec70 0x7f7a4014cdb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7a34009740 tx=0x7f7a3401bf20 comp rx=0 tx=0).stop 2024-04-24T23:39:00.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fd118f5e640 1 --2- 172.21.15.57:0/4224344237 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd100067990 0x7fd100069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fd11b1c2640 1 -- 172.21.15.57:0/4224344237 --> [v2:172.21.15.88:6810/1782800372,v1:172.21.15.88:6812/1782800372] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd0f4006bc0 con 0x7fd0f4001660 2024-04-24T23:39:00.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fa11e36a640 1 --2- 172.21.15.57:0/3992934727 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa1180c3e10 0x7fa1180b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fa11db69640 1 -- 172.21.15.57:0/3992934727 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa1180c3e10 msgr2=0x7fa1180b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fa11d368640 1 --2- 172.21.15.57:0/3992934727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1180b95c0 0x7fa1180bda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7f8249af0640 1 -- 172.21.15.57:0/3202524425 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f82441f1460 con 0x7f8244154020 2024-04-24T23:39:00.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fd113fff640 1 --2- 172.21.15.57:0/4224344237 >> [v2:172.21.15.88:6810/1782800372,v1:172.21.15.88:6812/1782800372] conn(0x7fd0f4001660 0x7fd0f4003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fa11db69640 1 --2- 172.21.15.57:0/3992934727 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa1180c3e10 0x7fa1180b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.345+0000 7fd8daffd640 1 -- 172.21.15.57:0/875605061 <== osd.3 v2:172.21.15.57:6808/3474703186 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd8dc021ec0 con 0x7fd8cc071040 2024-04-24T23:39:00.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fa11db69640 1 -- 172.21.15.57:0/3992934727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1180b95c0 msgr2=0x7fa1180bda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fa11db69640 1 --2- 172.21.15.57:0/3992934727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1180b95c0 0x7fa1180bda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fa11db69640 1 -- 172.21.15.57:0/3992934727 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1180be750 con 0x7fa11806cdc0 2024-04-24T23:39:00.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7f7a460e3640 1 -- 172.21.15.57:0/4135967285 shutdown_connections 2024-04-24T23:39:00.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7f7a460e3640 1 --2- 172.21.15.57:0/4135967285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a4006ec70 0x7f7a4014cdb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7f7a460e3640 1 -- 172.21.15.57:0/4135967285 >> 172.21.15.57:0/4135967285 conn(0x7f7a400be8f0 msgr2=0x7f7a400becd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:00.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fa11d368640 1 --2- 172.21.15.57:0/3992934727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1180b95c0 0x7fa1180bda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:39:00.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fa11e36a640 1 --2- 172.21.15.57:0/3992934727 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa1180c3e10 0x7fa1180b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:39:00.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fa11db69640 1 --2- 172.21.15.57:0/3992934727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa11806cdc0 0x7fa1180b99a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa11400c400 tx=0x7fa11400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7f7a460e3640 1 -- 172.21.15.57:0/4135967285 shutdown_connections 2024-04-24T23:39:00.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fecceffd640 1 -- 172.21.15.57:0/2011736240 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fecd4003b90 con 0x7fecd814e020 2024-04-24T23:39:00.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fa10e7fc640 1 -- 172.21.15.57:0/3992934727 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa114017070 con 0x7fa11806cdc0 2024-04-24T23:39:00.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fa10e7fc640 1 -- 172.21.15.57:0/3992934727 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa114005cf0 con 0x7fa11806cdc0 2024-04-24T23:39:00.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fa10e7fc640 1 -- 172.21.15.57:0/3992934727 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1140072d0 con 0x7fa11806cdc0 2024-04-24T23:39:00.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fa11fdcd640 1 -- 172.21.15.57:0/3992934727 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1180c5c20 con 0x7fa11806cdc0 2024-04-24T23:39:00.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fa11fdcd640 1 -- 172.21.15.57:0/3992934727 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1180bdfc0 con 0x7fa11806cdc0 2024-04-24T23:39:00.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7f7a460e3640 1 -- 172.21.15.57:0/4135967285 wait complete. 2024-04-24T23:39:00.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7f7a460e3640 1 Processor -- start 2024-04-24T23:39:00.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fecceffd640 1 --2- 172.21.15.57:0/2011736240 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fecbc067910 0x7fecbc069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fecceffd640 1 -- 172.21.15.57:0/2011736240 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fecd40853c0 con 0x7fecd814e020 2024-04-24T23:39:00.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fecceffd640 1 --2- 172.21.15.57:0/2011736240 >> [v2:172.21.15.88:6824/1752291242,v1:172.21.15.88:6825/1752291242] conn(0x7fecbc071090 0x7fecbc0734d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fecceffd640 1 -- 172.21.15.57:0/2011736240 --> [v2:172.21.15.88:6824/1752291242,v1:172.21.15.88:6825/1752291242] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fecbc073ba0 con 0x7fecbc071090 2024-04-24T23:39:00.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fecceffd640 1 -- 172.21.15.57:0/2011736240 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fecd40858a0 con 0x7fecd814e020 2024-04-24T23:39:00.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fd113fff640 1 --2- 172.21.15.57:0/4224344237 >> [v2:172.21.15.88:6810/1782800372,v1:172.21.15.88:6812/1782800372] conn(0x7fd0f4001660 0x7fd0f4003b20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fa11fdcd640 1 -- 172.21.15.57:0/3992934727 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa1180be920 con 0x7fa11806cdc0 2024-04-24T23:39:00.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7f82417fa640 1 -- 172.21.15.57:0/3202524425 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f823c01c070 con 0x7f8244154020 2024-04-24T23:39:00.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7f82417fa640 1 --2- 172.21.15.57:0/3202524425 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f82300678c0 0x7f8230069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7f82417fa640 1 -- 172.21.15.57:0/3202524425 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f823c086170 con 0x7f8244154020 2024-04-24T23:39:00.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7f82417fa640 1 --2- 172.21.15.57:0/3202524425 >> [v2:172.21.15.57:6800/2653552037,v1:172.21.15.57:6801/2653552037] conn(0x7f8230071040 0x7f8230073480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7f82417fa640 1 -- 172.21.15.57:0/3202524425 --> [v2:172.21.15.57:6800/2653552037,v1:172.21.15.57:6801/2653552037] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8230073b50 con 0x7f8230071040 2024-04-24T23:39:00.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7f82417fa640 1 -- 172.21.15.57:0/3202524425 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f823c086560 con 0x7f8244154020 2024-04-24T23:39:00.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7f7a460e3640 1 -- start start 2024-04-24T23:39:00.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7fecdda72640 1 --2- 172.21.15.57:0/2011736240 >> [v2:172.21.15.88:6824/1752291242,v1:172.21.15.88:6825/1752291242] conn(0x7fecbc071090 0x7fecbc0734d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7fecdda72640 1 --2- 172.21.15.57:0/2011736240 >> [v2:172.21.15.88:6824/1752291242,v1:172.21.15.88:6825/1752291242] conn(0x7fecbc071090 0x7fecbc0734d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7fecde273640 1 --2- 172.21.15.57:0/2011736240 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fecbc067910 0x7fecbc069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f8243fff640 1 --2- 172.21.15.57:0/3202524425 >> [v2:172.21.15.57:6800/2653552037,v1:172.21.15.57:6801/2653552037] conn(0x7f8230071040 0x7f8230073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7fd118f5e640 1 --2- 172.21.15.57:0/4224344237 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd100067990 0x7fd100069e50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd104007fd0 tx=0x7fd104009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f8248aee640 1 --2- 172.21.15.57:0/3202524425 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f82300678c0 0x7f8230069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.349+0000 7f6e767fc640 1 -- 172.21.15.57:0/2818832722 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6e7c01a070 con 0x7f6e800bbbc0 2024-04-24T23:39:00.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f6e767fc640 1 --2- 172.21.15.57:0/2818832722 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6e640678c0 0x7f6e64069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f6e767fc640 1 -- 172.21.15.57:0/2818832722 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6e7c085de0 con 0x7f6e800bbbc0 2024-04-24T23:39:00.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f8243fff640 1 --2- 172.21.15.57:0/3202524425 >> [v2:172.21.15.57:6800/2653552037,v1:172.21.15.57:6801/2653552037] conn(0x7f8230071040 0x7f8230073480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f6e767fc640 1 --2- 172.21.15.57:0/2818832722 >> [v2:172.21.15.57:6814/1565874109,v1:172.21.15.57:6816/1565874109] conn(0x7f6e64071040 0x7f6e64073480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f6e767fc640 1 -- 172.21.15.57:0/2818832722 --> [v2:172.21.15.57:6814/1565874109,v1:172.21.15.57:6816/1565874109] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6e7c016ec0 con 0x7f6e64071040 2024-04-24T23:39:00.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f6e767fc640 1 -- 172.21.15.57:0/2818832722 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6e7c0861d0 con 0x7f6e800bbbc0 2024-04-24T23:39:00.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f6e8566e640 1 --2- 172.21.15.57:0/2818832722 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6e640678c0 0x7f6e64069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f7a460e3640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a4006ec70 0x7f7a4014e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f7a460e3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a40149bd0 0x7f7a4013f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f7a460e3640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7a401482c0 0x7f7a401edd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f7a460e3640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4015af00 con 0x7f7a4006ec70 2024-04-24T23:39:00.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f7a460e3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7a400bf670 con 0x7f7a40149bd0 2024-04-24T23:39:00.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f7a460e3640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f7a4015b080 con 0x7f7a401482c0 2024-04-24T23:39:00.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f7a3f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a4006ec70 0x7f7a4014e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f7a3effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a40149bd0 0x7f7a4013f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f7a3f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a4006ec70 0x7f7a4014e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60054/0 (socket says 172.21.15.57:60054) 2024-04-24T23:39:00.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f7a3f7fe640 1 -- 172.21.15.57:0/986406192 learned_addr learned my addr 172.21.15.57:0/986406192 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:00.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7fecde273640 1 --2- 172.21.15.57:0/2011736240 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fecbc067910 0x7fecbc069dd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fecd0005c10 tx=0x7fecd0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7fa10e7fc640 1 -- 172.21.15.57:0/3992934727 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa11401a070 con 0x7fa11806cdc0 2024-04-24T23:39:00.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7fa10e7fc640 1 --2- 172.21.15.57:0/3992934727 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa0fc0678f0 0x7fa0fc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7fa10e7fc640 1 -- 172.21.15.57:0/3992934727 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa114085e40 con 0x7fa11806cdc0 2024-04-24T23:39:00.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7fa10e7fc640 1 --2- 172.21.15.57:0/3992934727 >> [v2:172.21.15.57:6824/671364028,v1:172.21.15.57:6825/671364028] conn(0x7fa0fc071060 0x7fa0fc0734a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7fa10e7fc640 1 -- 172.21.15.57:0/3992934727 --> [v2:172.21.15.57:6824/671364028,v1:172.21.15.57:6825/671364028] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa114013e50 con 0x7fa0fc071060 2024-04-24T23:39:00.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7fa10e7fc640 1 -- 172.21.15.57:0/3992934727 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa114086230 con 0x7fa11806cdc0 2024-04-24T23:39:00.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f8248aee640 1 --2- 172.21.15.57:0/3202524425 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f82300678c0 0x7f8230069d80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8234005890 tx=0x7f8234009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f7a3f7fe640 1 -- 172.21.15.57:0/986406192 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7a401482c0 msgr2=0x7f7a401edd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f7a3f7fe640 1 --2- 172.21.15.57:0/986406192 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7a401482c0 0x7f7a401edd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f7a3f7fe640 1 -- 172.21.15.57:0/986406192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a40149bd0 msgr2=0x7f7a4013f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f7a3f7fe640 1 --2- 172.21.15.57:0/986406192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a40149bd0 0x7f7a4013f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f7a3f7fe640 1 -- 172.21.15.57:0/986406192 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a4014ef30 con 0x7f7a4006ec70 2024-04-24T23:39:00.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7fdc73fff640 1 -- 172.21.15.57:0/3194511365 <== mon.2 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdc8000f600 con 0x7fdc8c1f16a0 2024-04-24T23:39:00.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7fdc73fff640 1 --2- 172.21.15.57:0/3194511365 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fdc78067910 0x7fdc78069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7fdc73fff640 1 -- 172.21.15.57:0/3194511365 <== mon.2 v2:172.21.15.88:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdc80086d50 con 0x7fdc8c1f16a0 2024-04-24T23:39:00.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7fdc73fff640 1 --2- 172.21.15.57:0/3194511365 >> [v2:172.21.15.88:6800/1271707713,v1:172.21.15.88:6801/1271707713] conn(0x7fdc78071090 0x7fdc780734d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7fdc73fff640 1 -- 172.21.15.57:0/3194511365 --> [v2:172.21.15.88:6800/1271707713,v1:172.21.15.88:6801/1271707713] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdc78073ba0 con 0x7fdc78071090 2024-04-24T23:39:00.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7fdc73fff640 1 -- 172.21.15.57:0/3194511365 <== mon.2 v2:172.21.15.88:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdc80087100 con 0x7fdc8c1f16a0 2024-04-24T23:39:00.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f6e8566e640 1 --2- 172.21.15.57:0/2818832722 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6e640678c0 0x7f6e64069d80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6e70000f70 tx=0x7f6e700079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7fa11e36a640 1 --2- 172.21.15.57:0/3992934727 >> [v2:172.21.15.57:6824/671364028,v1:172.21.15.57:6825/671364028] conn(0x7fa0fc071060 0x7fa0fc0734a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f6e86670640 1 --2- 172.21.15.57:0/2818832722 >> [v2:172.21.15.57:6814/1565874109,v1:172.21.15.57:6816/1565874109] conn(0x7f6e64071040 0x7f6e64073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7fa11d368640 1 --2- 172.21.15.57:0/3992934727 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa0fc0678f0 0x7fa0fc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f82417fa640 1 -- 172.21.15.57:0/3202524425 <== osd.1 v2:172.21.15.57:6800/2653552037 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8230073b50 con 0x7f8230071040 2024-04-24T23:39:00.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f7a3f7fe640 1 --2- 172.21.15.57:0/986406192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a4006ec70 0x7f7a4014e9f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7a3000c540 tx=0x7f7a3000ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7fd1117fa640 1 -- 172.21.15.57:0/4224344237 <== osd.7 v2:172.21.15.88:6810/1782800372 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd0f4006bc0 con 0x7fd0f4001660 2024-04-24T23:39:00.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7fa11e36a640 1 --2- 172.21.15.57:0/3992934727 >> [v2:172.21.15.57:6824/671364028,v1:172.21.15.57:6825/671364028] conn(0x7fa0fc071060 0x7fa0fc0734a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7fdc8b7fe640 1 --2- 172.21.15.57:0/3194511365 >> [v2:172.21.15.88:6800/1271707713,v1:172.21.15.88:6801/1271707713] conn(0x7fdc78071090 0x7fdc780734d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7fa10e7fc640 1 -- 172.21.15.57:0/3992934727 <== osd.0 v2:172.21.15.57:6824/671364028 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa114013e50 con 0x7fa0fc071060 2024-04-24T23:39:00.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7fdc8affd640 1 --2- 172.21.15.57:0/3194511365 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fdc78067910 0x7fdc78069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7fa11d368640 1 --2- 172.21.15.57:0/3992934727 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa0fc0678f0 0x7fa0fc069db0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa1180bb890 tx=0x7fa108008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.357+0000 7fdc8b7fe640 1 --2- 172.21.15.57:0/3194511365 >> [v2:172.21.15.88:6800/1271707713,v1:172.21.15.88:6801/1271707713] conn(0x7fdc78071090 0x7fdc780734d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f7a27fff640 1 -- 172.21.15.57:0/986406192 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a30017070 con 0x7f7a4006ec70 2024-04-24T23:39:00.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f7a27fff640 1 -- 172.21.15.57:0/986406192 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a30005480 con 0x7f7a4006ec70 2024-04-24T23:39:00.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f7a27fff640 1 -- 172.21.15.57:0/986406192 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a30003800 con 0x7f7a4006ec70 2024-04-24T23:39:00.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.357+0000 7f7a460e3640 1 -- 172.21.15.57:0/986406192 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a400bb080 con 0x7f7a4006ec70 2024-04-24T23:39:00.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.357+0000 7f7a460e3640 1 -- 172.21.15.57:0/986406192 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a4014f4b0 con 0x7f7a4006ec70 2024-04-24T23:39:00.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.357+0000 7f7a460e3640 1 -- 172.21.15.57:0/986406192 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7a400baed0 con 0x7f7a4006ec70 2024-04-24T23:39:00.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.357+0000 7fdc8affd640 1 --2- 172.21.15.57:0/3194511365 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fdc78067910 0x7fdc78069dd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdc84004c60 tx=0x7fdc84004bf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7f6e86670640 1 --2- 172.21.15.57:0/2818832722 >> [v2:172.21.15.57:6814/1565874109,v1:172.21.15.57:6816/1565874109] conn(0x7f6e64071040 0x7f6e64073480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.357+0000 7f6e767fc640 1 -- 172.21.15.57:0/2818832722 <== osd.2 v2:172.21.15.57:6814/1565874109 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6e7c016ec0 con 0x7f6e64071040 2024-04-24T23:39:00.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.357+0000 7fdc73fff640 1 -- 172.21.15.57:0/3194511365 <== osd.4 v2:172.21.15.88:6800/1271707713 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdc78073ba0 con 0x7fdc78071090 2024-04-24T23:39:00.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.357+0000 7f7a27fff640 1 -- 172.21.15.57:0/986406192 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7a3001a070 con 0x7f7a4006ec70 2024-04-24T23:39:00.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.357+0000 7f7a27fff640 1 --2- 172.21.15.57:0/986406192 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f7a2c067990 0x7f7a2c069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.357+0000 7f7a27fff640 1 -- 172.21.15.57:0/986406192 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7a300852a0 con 0x7f7a4006ec70 2024-04-24T23:39:00.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.357+0000 7f7a27fff640 1 --2- 172.21.15.57:0/986406192 >> [v2:172.21.15.88:6808/2035054888,v1:172.21.15.88:6809/2035054888] conn(0x7f7a2c071090 0x7f7a2c0734d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.357+0000 7f7a27fff640 1 -- 172.21.15.57:0/986406192 --> [v2:172.21.15.88:6808/2035054888,v1:172.21.15.88:6809/2035054888] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7a2c073ba0 con 0x7f7a2c071090 2024-04-24T23:39:00.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.357+0000 7f7a3ffff640 1 --2- 172.21.15.57:0/986406192 >> [v2:172.21.15.88:6808/2035054888,v1:172.21.15.88:6809/2035054888] conn(0x7f7a2c071090 0x7f7a2c0734d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.357+0000 7f7a3effd640 1 --2- 172.21.15.57:0/986406192 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f7a2c067990 0x7f7a2c069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.357+0000 7f7a27fff640 1 -- 172.21.15.57:0/986406192 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7a3008c050 con 0x7f7a4006ec70 2024-04-24T23:39:00.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.361+0000 7f7a3ffff640 1 --2- 172.21.15.57:0/986406192 >> [v2:172.21.15.88:6808/2035054888,v1:172.21.15.88:6809/2035054888] conn(0x7f7a2c071090 0x7f7a2c0734d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.361+0000 7f7a3effd640 1 --2- 172.21.15.57:0/986406192 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f7a2c067990 0x7f7a2c069e50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7a38007e50 tx=0x7f7a38005b80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.361+0000 7f7a27fff640 1 -- 172.21.15.57:0/986406192 <== osd.5 v2:172.21.15.88:6808/2035054888 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7a2c073ba0 con 0x7f7a2c071090 2024-04-24T23:39:00.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.353+0000 7fecceffd640 1 -- 172.21.15.57:0/2011736240 <== osd.6 v2:172.21.15.88:6824/1752291242 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fecbc073ba0 con 0x7fecbc071090 2024-04-24T23:39:00.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.377+0000 7fd8eb59e640 1 -- 172.21.15.57:0/875605061 --> [v2:172.21.15.57:6808/3474703186,v1:172.21.15.57:6809/3474703186] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd8d0002d60 con 0x7fd8cc071040 2024-04-24T23:39:00.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.377+0000 7fd8daffd640 1 -- 172.21.15.57:0/875605061 <== osd.3 v2:172.21.15.57:6808/3474703186 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd8d0002d60 con 0x7fd8cc071040 2024-04-24T23:39:00.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.377+0000 7fd8d8ff9640 1 -- 172.21.15.57:0/875605061 >> [v2:172.21.15.57:6808/3474703186,v1:172.21.15.57:6809/3474703186] conn(0x7fd8cc071040 msgr2=0x7fd8cc073480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.377+0000 7fd8d8ff9640 1 --2- 172.21.15.57:0/875605061 >> [v2:172.21.15.57:6808/3474703186,v1:172.21.15.57:6809/3474703186] conn(0x7fd8cc071040 0x7fd8cc073480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.381+0000 7fd8d8ff9640 1 -- 172.21.15.57:0/875605061 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd8cc0678c0 msgr2=0x7fd8cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.381+0000 7fd8d8ff9640 1 --2- 172.21.15.57:0/875605061 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd8cc0678c0 0x7fd8cc069d80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd8e40b3000 tx=0x7fd8e400d040 comp rx=0 tx=0).stop 2024-04-24T23:39:00.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.381+0000 7fd8d8ff9640 1 -- 172.21.15.57:0/875605061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8ec0b9490 msgr2=0x7fd8ec1f9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.381+0000 7fd8d8ff9640 1 --2- 172.21.15.57:0/875605061 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8ec0b9490 0x7fd8ec1f9980 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc00aa00 tx=0x7fd8dc00aec0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.381+0000 7fd8ead9d640 1 -- 172.21.15.57:0/875605061 reap_dead start 2024-04-24T23:39:00.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.381+0000 7fd8d8ff9640 1 -- 172.21.15.57:0/875605061 shutdown_connections 2024-04-24T23:39:00.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.381+0000 7fd8d8ff9640 1 -- 172.21.15.57:0/875605061 >> 172.21.15.57:0/875605061 conn(0x7fd8ec0be650 msgr2=0x7fd8ec0b7670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:00.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.381+0000 7fd8d8ff9640 1 -- 172.21.15.57:0/875605061 shutdown_connections 2024-04-24T23:39:00.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.381+0000 7fd8d8ff9640 1 -- 172.21.15.57:0/875605061 wait complete. 2024-04-24T23:39:00.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.381+0000 7fd11b1c2640 1 -- 172.21.15.57:0/4224344237 --> [v2:172.21.15.88:6810/1782800372,v1:172.21.15.88:6812/1782800372] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd0f4005ca0 con 0x7fd0f4001660 2024-04-24T23:39:00.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.381+0000 7fecdf275640 1 -- 172.21.15.57:0/2011736240 --> [v2:172.21.15.88:6824/1752291242,v1:172.21.15.88:6825/1752291242] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fecc0002de0 con 0x7fecbc071090 2024-04-24T23:39:00.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.381+0000 7f8249af0640 1 -- 172.21.15.57:0/3202524425 --> [v2:172.21.15.57:6800/2653552037,v1:172.21.15.57:6801/2653552037] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f824404f510 con 0x7f8230071040 2024-04-24T23:39:00.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.381+0000 7f6e880d3640 1 -- 172.21.15.57:0/2818832722 --> [v2:172.21.15.57:6814/1565874109,v1:172.21.15.57:6816/1565874109] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6e8004f510 con 0x7f6e64071040 2024-04-24T23:39:00.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fd1117fa640 1 -- 172.21.15.57:0/4224344237 <== osd.7 v2:172.21.15.88:6810/1782800372 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd0f4005ca0 con 0x7fd0f4001660 2024-04-24T23:39:00.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7f82417fa640 1 -- 172.21.15.57:0/3202524425 <== osd.1 v2:172.21.15.57:6800/2653552037 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f824404f510 con 0x7f8230071040 2024-04-24T23:39:00.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7f6e767fc640 1 -- 172.21.15.57:0/2818832722 <== osd.2 v2:172.21.15.57:6814/1565874109 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6e8004f510 con 0x7f6e64071040 2024-04-24T23:39:00.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fecceffd640 1 -- 172.21.15.57:0/2011736240 <== osd.6 v2:172.21.15.88:6824/1752291242 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fecc0002de0 con 0x7fecbc071090 2024-04-24T23:39:00.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fd11b1c2640 1 -- 172.21.15.57:0/4224344237 >> [v2:172.21.15.88:6810/1782800372,v1:172.21.15.88:6812/1782800372] conn(0x7fd0f4001660 msgr2=0x7fd0f4003b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fd11b1c2640 1 --2- 172.21.15.57:0/4224344237 >> [v2:172.21.15.88:6810/1782800372,v1:172.21.15.88:6812/1782800372] conn(0x7fd0f4001660 0x7fd0f4003b20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fd11b1c2640 1 -- 172.21.15.57:0/4224344237 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd100067990 msgr2=0x7fd100069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fd11b1c2640 1 --2- 172.21.15.57:0/4224344237 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd100067990 0x7fd100069e50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd104007fd0 tx=0x7fd104009040 comp rx=0 tx=0).stop 2024-04-24T23:39:00.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7f6e880d3640 1 -- 172.21.15.57:0/2818832722 >> [v2:172.21.15.57:6814/1565874109,v1:172.21.15.57:6816/1565874109] conn(0x7f6e64071040 msgr2=0x7f6e64073480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7f6e880d3640 1 --2- 172.21.15.57:0/2818832722 >> [v2:172.21.15.57:6814/1565874109,v1:172.21.15.57:6816/1565874109] conn(0x7f6e64071040 0x7f6e64073480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fd11b1c2640 1 -- 172.21.15.57:0/4224344237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1140bf3e0 msgr2=0x7fd11414eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fd11b1c2640 1 --2- 172.21.15.57:0/4224344237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1140bf3e0 0x7fd11414eac0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd10c0af040 tx=0x7fd10c009370 comp rx=0 tx=0).stop 2024-04-24T23:39:00.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7f8249af0640 1 -- 172.21.15.57:0/3202524425 >> [v2:172.21.15.57:6800/2653552037,v1:172.21.15.57:6801/2653552037] conn(0x7f8230071040 msgr2=0x7f8230073480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7f8249af0640 1 --2- 172.21.15.57:0/3202524425 >> [v2:172.21.15.57:6800/2653552037,v1:172.21.15.57:6801/2653552037] conn(0x7f8230071040 0x7f8230073480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7f6e880d3640 1 -- 172.21.15.57:0/2818832722 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6e640678c0 msgr2=0x7f6e64069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7f6e880d3640 1 --2- 172.21.15.57:0/2818832722 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6e640678c0 0x7f6e64069d80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6e70000f70 tx=0x7f6e700079c0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fd11975f640 1 -- 172.21.15.57:0/4224344237 reap_dead start 2024-04-24T23:39:00.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7f6e880d3640 1 -- 172.21.15.57:0/2818832722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e800bbbc0 msgr2=0x7f6e801f0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7f6e880d3640 1 --2- 172.21.15.57:0/2818832722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e800bbbc0 0x7f6e801f0900 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c00c4d0 tx=0x7f6e7c00c990 comp rx=0 tx=0).stop 2024-04-24T23:39:00.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7f6e86670640 1 -- 172.21.15.57:0/2818832722 reap_dead start 2024-04-24T23:39:00.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7f8249af0640 1 -- 172.21.15.57:0/3202524425 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f82300678c0 msgr2=0x7f8230069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7f8249af0640 1 --2- 172.21.15.57:0/3202524425 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f82300678c0 0x7f8230069d80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8234005890 tx=0x7f8234009040 comp rx=0 tx=0).stop 2024-04-24T23:39:00.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7f8249af0640 1 -- 172.21.15.57:0/3202524425 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8244154020 msgr2=0x7f82440a4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7f8249af0640 1 --2- 172.21.15.57:0/3202524425 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8244154020 0x7f82440a4970 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f823c00b9a0 tx=0x7f823c00be60 comp rx=0 tx=0).stop 2024-04-24T23:39:00.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7f82492ef640 1 -- 172.21.15.57:0/3202524425 reap_dead start 2024-04-24T23:39:00.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7f8249af0640 1 -- 172.21.15.57:0/3202524425 shutdown_connections 2024-04-24T23:39:00.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7f8249af0640 1 -- 172.21.15.57:0/3202524425 >> 172.21.15.57:0/3202524425 conn(0x7f824406b210 msgr2=0x7f824415b530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:00.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7f6e880d3640 1 -- 172.21.15.57:0/2818832722 shutdown_connections 2024-04-24T23:39:00.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7f6e880d3640 1 -- 172.21.15.57:0/2818832722 >> 172.21.15.57:0/2818832722 conn(0x7f6e800be8f0 msgr2=0x7f6e80155ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:00.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fd11b1c2640 1 -- 172.21.15.57:0/4224344237 shutdown_connections 2024-04-24T23:39:00.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fa11fdcd640 1 -- 172.21.15.57:0/3992934727 --> [v2:172.21.15.57:6824/671364028,v1:172.21.15.57:6825/671364028] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa1180be920 con 0x7fa0fc071060 2024-04-24T23:39:00.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7f6e880d3640 1 -- 172.21.15.57:0/2818832722 shutdown_connections 2024-04-24T23:39:00.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fdc91944640 1 -- 172.21.15.57:0/3194511365 --> [v2:172.21.15.88:6800/1271707713,v1:172.21.15.88:6801/1271707713] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdc8c144300 con 0x7fdc78071090 2024-04-24T23:39:00.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fecccff9640 1 -- 172.21.15.57:0/2011736240 >> [v2:172.21.15.88:6824/1752291242,v1:172.21.15.88:6825/1752291242] conn(0x7fecbc071090 msgr2=0x7fecbc0734d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7f6e880d3640 1 -- 172.21.15.57:0/2818832722 wait complete. 2024-04-24T23:39:00.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fecccff9640 1 --2- 172.21.15.57:0/2011736240 >> [v2:172.21.15.88:6824/1752291242,v1:172.21.15.88:6825/1752291242] conn(0x7fecbc071090 0x7fecbc0734d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7f8249af0640 1 -- 172.21.15.57:0/3202524425 shutdown_connections 2024-04-24T23:39:00.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fd11b1c2640 1 -- 172.21.15.57:0/4224344237 >> 172.21.15.57:0/4224344237 conn(0x7fd1140be8f0 msgr2=0x7fd1140bf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:00.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7f8249af0640 1 -- 172.21.15.57:0/3202524425 wait complete. 2024-04-24T23:39:00.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fecccff9640 1 -- 172.21.15.57:0/2011736240 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fecbc067910 msgr2=0x7fecbc069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fecccff9640 1 --2- 172.21.15.57:0/2011736240 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fecbc067910 0x7fecbc069dd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fecd0005c10 tx=0x7fecd0009040 comp rx=0 tx=0).stop 2024-04-24T23:39:00.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fecccff9640 1 -- 172.21.15.57:0/2011736240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecd814e020 msgr2=0x7fecd81f0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fecccff9640 1 --2- 172.21.15.57:0/2011736240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecd814e020 0x7fecd81f0c20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fecd400c3e0 tx=0x7fecd400c8a0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fecdea74640 1 -- 172.21.15.57:0/2011736240 reap_dead start 2024-04-24T23:39:00.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fecccff9640 1 -- 172.21.15.57:0/2011736240 shutdown_connections 2024-04-24T23:39:00.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fecccff9640 1 -- 172.21.15.57:0/2011736240 >> 172.21.15.57:0/2011736240 conn(0x7fecd80be650 msgr2=0x7fecd80744f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:00.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fd11b1c2640 1 -- 172.21.15.57:0/4224344237 shutdown_connections 2024-04-24T23:39:00.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fd11b1c2640 1 -- 172.21.15.57:0/4224344237 wait complete. 2024-04-24T23:39:00.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fa10e7fc640 1 -- 172.21.15.57:0/3992934727 <== osd.0 v2:172.21.15.57:6824/671364028 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa1180be920 con 0x7fa0fc071060 2024-04-24T23:39:00.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fecccff9640 1 -- 172.21.15.57:0/2011736240 shutdown_connections 2024-04-24T23:39:00.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fecccff9640 1 -- 172.21.15.57:0/2011736240 wait complete. 2024-04-24T23:39:00.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fdc73fff640 1 -- 172.21.15.57:0/3194511365 <== osd.4 v2:172.21.15.88:6800/1271707713 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdc8c144300 con 0x7fdc78071090 2024-04-24T23:39:00.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fa11fdcd640 1 -- 172.21.15.57:0/3992934727 >> [v2:172.21.15.57:6824/671364028,v1:172.21.15.57:6825/671364028] conn(0x7fa0fc071060 msgr2=0x7fa0fc0734a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fdc91944640 1 -- 172.21.15.57:0/3194511365 >> [v2:172.21.15.88:6800/1271707713,v1:172.21.15.88:6801/1271707713] conn(0x7fdc78071090 msgr2=0x7fdc780734d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fdc91944640 1 --2- 172.21.15.57:0/3194511365 >> [v2:172.21.15.88:6800/1271707713,v1:172.21.15.88:6801/1271707713] conn(0x7fdc78071090 0x7fdc780734d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fa11fdcd640 1 --2- 172.21.15.57:0/3992934727 >> [v2:172.21.15.57:6824/671364028,v1:172.21.15.57:6825/671364028] conn(0x7fa0fc071060 0x7fa0fc0734a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fdc91944640 1 -- 172.21.15.57:0/3194511365 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fdc78067910 msgr2=0x7fdc78069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fdc91944640 1 --2- 172.21.15.57:0/3194511365 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fdc78067910 0x7fdc78069dd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdc84004c60 tx=0x7fdc84004bf0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fdc91944640 1 -- 172.21.15.57:0/3194511365 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdc8c1f16a0 msgr2=0x7fdc8c143b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fdc91944640 1 --2- 172.21.15.57:0/3194511365 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdc8c1f16a0 0x7fdc8c143b70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdc80011590 tx=0x7fdc80011a50 comp rx=0 tx=0).stop 2024-04-24T23:39:00.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fdc8b7fe640 1 -- 172.21.15.57:0/3194511365 reap_dead start 2024-04-24T23:39:00.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fdc91944640 1 -- 172.21.15.57:0/3194511365 shutdown_connections 2024-04-24T23:39:00.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.385+0000 7fdc91944640 1 -- 172.21.15.57:0/3194511365 >> 172.21.15.57:0/3194511365 conn(0x7fdc8c0be8f0 msgr2=0x7fdc8c149300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:00.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.389+0000 7fdc91944640 1 -- 172.21.15.57:0/3194511365 shutdown_connections 2024-04-24T23:39:00.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.389+0000 7fdc91944640 1 -- 172.21.15.57:0/3194511365 wait complete. 2024-04-24T23:39:00.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.389+0000 7fa11fdcd640 1 -- 172.21.15.57:0/3992934727 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa0fc0678f0 msgr2=0x7fa0fc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.389+0000 7fa11fdcd640 1 --2- 172.21.15.57:0/3992934727 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa0fc0678f0 0x7fa0fc069db0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa1180bb890 tx=0x7fa108008040 comp rx=0 tx=0).stop 2024-04-24T23:39:00.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.389+0000 7fa11fdcd640 1 -- 172.21.15.57:0/3992934727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa11806cdc0 msgr2=0x7fa1180b99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.389+0000 7fa11fdcd640 1 --2- 172.21.15.57:0/3992934727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa11806cdc0 0x7fa1180b99a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa11400c400 tx=0x7fa11400c8c0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.393+0000 7fa11e36a640 1 -- 172.21.15.57:0/3992934727 reap_dead start 2024-04-24T23:39:00.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.393+0000 7f7a460e3640 1 -- 172.21.15.57:0/986406192 --> [v2:172.21.15.88:6808/2035054888,v1:172.21.15.88:6809/2035054888] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7a4004f510 con 0x7f7a2c071090 2024-04-24T23:39:00.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.393+0000 7fa11fdcd640 1 -- 172.21.15.57:0/3992934727 shutdown_connections 2024-04-24T23:39:00.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.393+0000 7fa11fdcd640 1 -- 172.21.15.57:0/3992934727 >> 172.21.15.57:0/3992934727 conn(0x7fa1180c6310 msgr2=0x7fa1180a6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:00.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.393+0000 7fa11fdcd640 1 -- 172.21.15.57:0/3992934727 shutdown_connections 2024-04-24T23:39:00.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.393+0000 7fa11fdcd640 1 -- 172.21.15.57:0/3992934727 wait complete. 2024-04-24T23:39:00.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.393+0000 7f7a27fff640 1 -- 172.21.15.57:0/986406192 <== osd.5 v2:172.21.15.88:6808/2035054888 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7a4004f510 con 0x7f7a2c071090 2024-04-24T23:39:00.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.393+0000 7f7a460e3640 1 -- 172.21.15.57:0/986406192 >> [v2:172.21.15.88:6808/2035054888,v1:172.21.15.88:6809/2035054888] conn(0x7f7a2c071090 msgr2=0x7f7a2c0734d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.393+0000 7f7a460e3640 1 --2- 172.21.15.57:0/986406192 >> [v2:172.21.15.88:6808/2035054888,v1:172.21.15.88:6809/2035054888] conn(0x7f7a2c071090 0x7f7a2c0734d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.393+0000 7f7a460e3640 1 -- 172.21.15.57:0/986406192 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f7a2c067990 msgr2=0x7f7a2c069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.393+0000 7f7a460e3640 1 --2- 172.21.15.57:0/986406192 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f7a2c067990 0x7f7a2c069e50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7a38007e50 tx=0x7f7a38005b80 comp rx=0 tx=0).stop 2024-04-24T23:39:00.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.393+0000 7f7a460e3640 1 -- 172.21.15.57:0/986406192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a4006ec70 msgr2=0x7f7a4014e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.393+0000 7f7a460e3640 1 --2- 172.21.15.57:0/986406192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a4006ec70 0x7f7a4014e9f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7a3000c540 tx=0x7f7a3000ca00 comp rx=0 tx=0).stop 2024-04-24T23:39:00.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.393+0000 7f7a3ffff640 1 -- 172.21.15.57:0/986406192 reap_dead start 2024-04-24T23:39:00.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.393+0000 7f7a460e3640 1 -- 172.21.15.57:0/986406192 shutdown_connections 2024-04-24T23:39:00.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.393+0000 7f7a460e3640 1 -- 172.21.15.57:0/986406192 >> 172.21.15.57:0/986406192 conn(0x7f7a400be8f0 msgr2=0x7f7a400bc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:00.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.397+0000 7f7a460e3640 1 -- 172.21.15.57:0/986406192 shutdown_connections 2024-04-24T23:39:00.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.397+0000 7f7a460e3640 1 -- 172.21.15.57:0/986406192 wait complete. 2024-04-24T23:39:00.452 INFO:teuthology.orchestra.run.smithi057.stdout:55834574857 2024-04-24T23:39:00.453 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-24T23:39:00.453 INFO:teuthology.orchestra.run.smithi057.stdout:55834574857 2024-04-24T23:39:00.454 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-24T23:39:00.455 INFO:teuthology.orchestra.run.smithi057.stdout:55834574858 2024-04-24T23:39:00.455 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-24T23:39:00.456 INFO:teuthology.orchestra.run.smithi057.stdout:55834574858 2024-04-24T23:39:00.456 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-24T23:39:00.457 INFO:teuthology.orchestra.run.smithi057.stdout:55834574857 2024-04-24T23:39:00.457 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-24T23:39:00.457 INFO:teuthology.orchestra.run.smithi057.stdout:55834574858 2024-04-24T23:39:00.458 INFO:teuthology.orchestra.run.smithi057.stdout:55834574858 2024-04-24T23:39:00.459 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-24T23:39:00.459 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-24T23:39:00.460 INFO:teuthology.orchestra.run.smithi057.stdout:55834574857 2024-04-24T23:39:00.460 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-24T23:39:00.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.669+0000 7f9a9c4c1640 1 Processor -- start 2024-04-24T23:39:00.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.669+0000 7f9a9c4c1640 1 -- start start 2024-04-24T23:39:00.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.669+0000 7f8d35b46640 1 Processor -- start 2024-04-24T23:39:00.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.669+0000 7f8d35b46640 1 -- start start 2024-04-24T23:39:00.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.669+0000 7f26a15c0640 1 Processor -- start 2024-04-24T23:39:00.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.669+0000 7f9a9c4c1640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9a940bbbc0 0x7f9a941602e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.669+0000 7f26a15c0640 1 -- start start 2024-04-24T23:39:00.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.669+0000 7f9a9c4c1640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a94072700 con 0x7f9a941520e0 2024-04-24T23:39:00.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.669+0000 7fcab7fff640 1 Processor -- start 2024-04-24T23:39:00.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.669+0000 7fa461527640 1 Processor -- start 2024-04-24T23:39:00.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.669+0000 7fcab7fff640 1 -- start start 2024-04-24T23:39:00.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.669+0000 7f9a9c4c1640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a940bdf10 con 0x7f9a940bc150 2024-04-24T23:39:00.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.669+0000 7f9a9a25d640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9a941520e0 0x7f9a940a79d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53050/0 (socket says 172.21.15.57:53050) 2024-04-24T23:39:00.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.669+0000 7f9a9a25d640 1 -- 172.21.15.57:0/4001828121 learned_addr learned my addr 172.21.15.57:0/4001828121 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:00.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.669+0000 7f9a9aa5e640 1 --2- 172.21.15.57:0/4001828121 >> v2:172.21.15.57:3300/0 conn(0x7f9a940bbbc0 0x7f9a941602e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.669+0000 7f8d35b46640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d300c0cc0 0x7f8d3014d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.669+0000 7f9a9c4c1640 1 -- 172.21.15.57:0/4001828121 --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f9a940721d0 con 0x7f9a940bbbc0 2024-04-24T23:39:00.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.669+0000 7f86ddef1640 1 Processor -- start 2024-04-24T23:39:00.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.669+0000 7f8d35b46640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8d300bcf60 0x7f8d3014de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.669+0000 7f8d34b44640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d300c0cc0 0x7f8d3014d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.669+0000 7f8d34b44640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d300c0cc0 0x7f8d3014d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.57:32790/0 (socket says 172.21.15.57:32790) 2024-04-24T23:39:00.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.669+0000 7f8d34b44640 1 -- 172.21.15.57:0/3425231173 learned_addr learned my addr 172.21.15.57:0/3425231173 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:00.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.669+0000 7f0f95779640 1 Processor -- start 2024-04-24T23:39:00.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.669+0000 7f8d2ffff640 1 --2- 172.21.15.57:0/3425231173 >> v2:172.21.15.57:3300/0 conn(0x7f8d300bcf60 0x7f8d3014de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.669+0000 7f0f95779640 1 -- start start 2024-04-24T23:39:00.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.669+0000 7f9a9925b640 1 -- 172.21.15.57:0/4001828121 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3073151153 0 0) 0x7f9a94072700 con 0x7f9a941520e0 2024-04-24T23:39:00.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f9a9925b640 1 -- 172.21.15.57:0/4001828121 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a80003530 con 0x7f9a941520e0 2024-04-24T23:39:00.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f9a9925b640 1 -- 172.21.15.57:0/4001828121 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2834542445 0 0) 0x7f9a940bdf10 con 0x7f9a940bc150 2024-04-24T23:39:00.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fe86f111640 1 Processor -- start 2024-04-24T23:39:00.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.669+0000 7fa461527640 1 -- start start 2024-04-24T23:39:00.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.669+0000 7fa461527640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa45c0724d0 0x7fa45c151e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.669+0000 7fa461527640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa45c06e4f0 0x7fa45c152390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fa461527640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa45c06ea30 con 0x7fa45c0bd9c0 2024-04-24T23:39:00.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fa461527640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fa45c0bc550 con 0x7fa45c06e4f0 2024-04-24T23:39:00.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fa461527640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fa45c06ed10 con 0x7fa45c0724d0 2024-04-24T23:39:00.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f26a15c0640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f269c072200 0x7f269c14d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f9a9925b640 1 -- 172.21.15.57:0/4001828121 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a94072700 con 0x7f9a940bc150 2024-04-24T23:39:00.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f26a15c0640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f269c06e520 0x7f269c0be8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f8d35b46640 1 -- 172.21.15.57:0/3425231173 --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d30153c30 con 0x7f8d300725c0 2024-04-24T23:39:00.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f9a9aa5e640 1 -- 172.21.15.57:0/4001828121 >> v1:172.21.15.88:6789/0 conn(0x7f9a940bc150 legacy=0x7f9a9406e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f9a9aa5e640 1 -- 172.21.15.57:0/4001828121 >> v1:172.21.15.57:6789/0 conn(0x7f9a941520e0 legacy=0x7f9a940a79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f9a9aa5e640 1 -- 172.21.15.57:0/4001828121 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a940be1f0 con 0x7f9a940bbbc0 2024-04-24T23:39:00.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fcab7fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcab806de80 0x7fcab80c0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fcab7fff640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcab8151320 con 0x7fcab80c4070 2024-04-24T23:39:00.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fcab7fff640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcab80c1450 con 0x7fcab806c820 2024-04-24T23:39:00.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f8d35b46640 1 -- 172.21.15.57:0/3425231173 --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f8d300bd480 con 0x7f8d300bcf60 2024-04-24T23:39:00.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f8d35b46640 1 -- 172.21.15.57:0/3425231173 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f8d300bdaf0 con 0x7f8d300c0cc0 2024-04-24T23:39:00.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.669+0000 7f86ddef1640 1 -- start start 2024-04-24T23:39:00.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f86ddef1640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f86d0047920 0x7f86d00441b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f86ddef1640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86d00dacd0 con 0x7f86d0046dd0 2024-04-24T23:39:00.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f86ddef1640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86d0006da0 con 0x7f86d00082b0 2024-04-24T23:39:00.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f86ddef1640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f86d0008e50 con 0x7f86d0047920 2024-04-24T23:39:00.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f269affd640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f269c072200 0x7f269c14d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f269affd640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f269c072200 0x7f269c14d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.57:32798/0 (socket says 172.21.15.57:32798) 2024-04-24T23:39:00.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fcab7fff640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fcab806e260 con 0x7fcab806de80 2024-04-24T23:39:00.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f269b7fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f269c0bf3a0 0x7f269c14a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53074/0 (socket says 172.21.15.57:53074) 2024-04-24T23:39:00.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fe86f111640 1 -- start start 2024-04-24T23:39:00.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fcab77fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fcab806c820 0x7fcab806cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.57:56102/0 (socket says 172.21.15.57:56102) 2024-04-24T23:39:00.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fcab77fe640 1 -- 172.21.15.57:0/4133870256 learned_addr learned my addr 172.21.15.57:0/4133870256 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:00.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fa460d26640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa45c0bd9c0 0x7fa45c0bc9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.57:56096/0 (socket says 172.21.15.57:56096) 2024-04-24T23:39:00.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fa460d26640 1 -- 172.21.15.57:0/3510520372 learned_addr learned my addr 172.21.15.57:0/3510520372 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:00.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f269a7fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f269c06e520 0x7f269c0be8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f269a7fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f269c06e520 0x7f269c0be8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.57:60052/0 (socket says 172.21.15.57:60052) 2024-04-24T23:39:00.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f269affd640 1 -- 172.21.15.57:0/2837057474 learned_addr learned my addr 172.21.15.57:0/2837057474 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:00.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fcab6ffd640 1 --2- 172.21.15.57:0/4133870256 >> v2:172.21.15.57:3300/0 conn(0x7fcab806de80 0x7fcab80c0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f26a15c0640 1 -- 172.21.15.57:0/2837057474 --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f269c0bd870 con 0x7f269c0bf3a0 2024-04-24T23:39:00.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f26a15c0640 1 -- 172.21.15.57:0/2837057474 --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f269c14e350 con 0x7f269c06e520 2024-04-24T23:39:00.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f26a15c0640 1 -- 172.21.15.57:0/2837057474 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f269c0be440 con 0x7f269c072200 2024-04-24T23:39:00.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f8d34b44640 1 -- 172.21.15.57:0/3425231173 >> v2:172.21.15.57:3300/0 conn(0x7f8d300bcf60 msgr2=0x7f8d3014de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:00.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f8d34b44640 1 --2- 172.21.15.57:0/3425231173 >> v2:172.21.15.57:3300/0 conn(0x7f8d300bcf60 0x7f8d3014de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f8d34b44640 1 -- 172.21.15.57:0/3425231173 >> v1:172.21.15.57:6789/0 conn(0x7f8d300725c0 legacy=0x7f8d30154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:00.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fe86f111640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe86806ec70 0x7fe86814cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fe86f111640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8680bc040 con 0x7fe868149fb0 2024-04-24T23:39:00.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fe86f111640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8681505d0 con 0x7fe868149bd0 2024-04-24T23:39:00.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fe86f111640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fe8680bbdf0 con 0x7fe86806ec70 2024-04-24T23:39:00.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fcab5ffb640 1 -- 172.21.15.57:0/4133870256 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2701668389 0 0) 0x7fcab80c1450 con 0x7fcab806c820 2024-04-24T23:39:00.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fcab5ffb640 1 -- 172.21.15.57:0/4133870256 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcaa0003530 con 0x7fcab806c820 2024-04-24T23:39:00.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fa45b7fe640 1 --2- 172.21.15.57:0/3510520372 >> v2:172.21.15.88:3300/0 conn(0x7fa45c06e4f0 0x7fa45c152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f86dceef640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f86d0047920 0x7f86d00441b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f86dceef640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f86d0047920 0x7f86d00441b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60078/0 (socket says 172.21.15.57:60078) 2024-04-24T23:39:00.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f86dceef640 1 -- 172.21.15.57:0/401443777 learned_addr learned my addr 172.21.15.57:0/401443777 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:00.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fe86cead640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe868149bd0 0x7fe8680bd800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.57:56128/0 (socket says 172.21.15.57:56128) 2024-04-24T23:39:00.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fe86cead640 1 -- 172.21.15.57:0/1335322255 learned_addr learned my addr 172.21.15.57:0/1335322255 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:00.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fa45affd640 1 -- 172.21.15.57:0/3510520372 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 12836926 0 0) 0x7fa45c06ea30 con 0x7fa45c0bd9c0 2024-04-24T23:39:00.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f86dceef640 1 -- 172.21.15.57:0/401443777 >> v1:172.21.15.88:6789/0 conn(0x7f86d00082b0 legacy=0x7f86d0008740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f86dceef640 1 -- 172.21.15.57:0/401443777 >> v1:172.21.15.57:6789/0 conn(0x7f86d0046dd0 legacy=0x7f86d00da5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:00.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f0f95779640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0f9006e520 0x7f0f9014d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f0f95779640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0f900bf3a0 0x7f0f9014a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f0f95779640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f900bd870 con 0x7f0f90072200 2024-04-24T23:39:00.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f0f95779640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f0f9014e350 con 0x7f0f9006e520 2024-04-24T23:39:00.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f0f95779640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f0f900be440 con 0x7f0f900bf3a0 2024-04-24T23:39:00.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f0f8effd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0f90072200 0x7f0f900be8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.57:56138/0 (socket says 172.21.15.57:56138) 2024-04-24T23:39:00.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f0f8effd640 1 -- 172.21.15.57:0/1543708151 learned_addr learned my addr 172.21.15.57:0/1543708151 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:00.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fcab6ffd640 1 -- 172.21.15.57:0/4133870256 >> v1:172.21.15.88:6789/0 conn(0x7fcab806c820 legacy=0x7fcab806cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fcab6ffd640 1 -- 172.21.15.57:0/4133870256 >> v1:172.21.15.57:6789/0 conn(0x7fcab80c4070 legacy=0x7fcab80c0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fcab6ffd640 1 -- 172.21.15.57:0/4133870256 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcab80c5b80 con 0x7fcab806de80 2024-04-24T23:39:00.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fe86d6ae640 1 --2- 172.21.15.57:0/1335322255 >> v2:172.21.15.88:3300/0 conn(0x7fe86806ec70 0x7fe86814cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fa45affd640 1 -- 172.21.15.57:0/3510520372 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa444003530 con 0x7fa45c0bd9c0 2024-04-24T23:39:00.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fa45bfff640 1 --2- 172.21.15.57:0/3510520372 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa45c0724d0 0x7fa45c151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fa45b7fe640 1 -- 172.21.15.57:0/3510520372 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa45c0724d0 msgr2=0x7fa45c151e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:00.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fa45b7fe640 1 --2- 172.21.15.57:0/3510520372 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa45c0724d0 0x7fa45c151e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fa45b7fe640 1 -- 172.21.15.57:0/3510520372 >> v1:172.21.15.88:6789/0 conn(0x7fa45c0bd9c0 legacy=0x7fa45c0bc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fa45b7fe640 1 -- 172.21.15.57:0/3510520372 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa45c06eff0 con 0x7fa45c06e4f0 2024-04-24T23:39:00.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fa45bfff640 1 --2- 172.21.15.57:0/3510520372 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa45c0724d0 0x7fa45c151e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:39:00.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f0f8e7fc640 1 --2- 172.21.15.57:0/1543708151 >> v2:172.21.15.57:3300/0 conn(0x7f0f9006e520 0x7f0f9014d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f0f8dffb640 1 -- 172.21.15.57:0/1543708151 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1036799004 0 0) 0x7f0f900bd870 con 0x7f0f90072200 2024-04-24T23:39:00.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f0f8dffb640 1 -- 172.21.15.57:0/1543708151 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f78003530 con 0x7f0f90072200 2024-04-24T23:39:00.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f0f8e7fc640 1 -- 172.21.15.57:0/1543708151 >> v2:172.21.15.88:3300/0 conn(0x7f0f900bf3a0 msgr2=0x7f0f9014a500 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-24T23:39:00.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f0f8e7fc640 1 --2- 172.21.15.57:0/1543708151 >> v2:172.21.15.88:3300/0 conn(0x7f0f900bf3a0 0x7f0f9014a500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f0f8e7fc640 1 -- 172.21.15.57:0/1543708151 >> v1:172.21.15.88:6789/0 conn(0x7f0f90072200 legacy=0x7f0f900be8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f0f8e7fc640 1 -- 172.21.15.57:0/1543708151 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f900bdb10 con 0x7f0f9006e520 2024-04-24T23:39:00.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f86dceef640 1 -- 172.21.15.57:0/401443777 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d0007080 con 0x7f86d0047920 2024-04-24T23:39:00.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fe8677fe640 1 -- 172.21.15.57:0/1335322255 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1810488096 0 0) 0x7fe8681505d0 con 0x7fe868149bd0 2024-04-24T23:39:00.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fe8677fe640 1 -- 172.21.15.57:0/1335322255 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe850003450 con 0x7fe868149bd0 2024-04-24T23:39:00.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fe8677fe640 1 -- 172.21.15.57:0/1335322255 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1837378174 0 0) 0x7fe850003450 con 0x7fe868149bd0 2024-04-24T23:39:00.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fe8677fe640 1 -- 172.21.15.57:0/1335322255 >> v2:172.21.15.88:3300/0 conn(0x7fe86806ec70 msgr2=0x7fe86814cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:00.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fe8677fe640 1 --2- 172.21.15.57:0/1335322255 >> v2:172.21.15.88:3300/0 conn(0x7fe86806ec70 0x7fe86814cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fe8677fe640 1 -- 172.21.15.57:0/1335322255 >> v1:172.21.15.57:6789/0 conn(0x7fe868149fb0 legacy=0x7fe86814c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fe8677fe640 1 -- 172.21.15.57:0/1335322255 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86814d2f0 con 0x7fe868149bd0 2024-04-24T23:39:00.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fe8677fe640 1 -- 172.21.15.57:0/1335322255 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7fe860005060 con 0x7fe868149bd0 2024-04-24T23:39:00.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fe8677fe640 1 -- 172.21.15.57:0/1335322255 >> v1:172.21.15.88:6789/0 conn(0x7fe868149bd0 legacy=0x7fe8680bd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fe8677fe640 1 --2- 172.21.15.57:0/1335322255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe850003c30 0x7fe85000ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fe8677fe640 1 --2- 172.21.15.57:0/1335322255 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe85000f3a0 0x7fe850011790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fe8677fe640 1 --2- 172.21.15.57:0/1335322255 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe850011e60 0x7fe850014300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fe8677fe640 1 -- 172.21.15.57:0/1335322255 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe8680bbdf0 con 0x7fe850011e60 2024-04-24T23:39:00.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fe8677fe640 1 -- 172.21.15.57:0/1335322255 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe8500048a0 con 0x7fe850003c30 2024-04-24T23:39:00.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fe8677fe640 1 -- 172.21.15.57:0/1335322255 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fe850004aa0 con 0x7fe85000f3a0 2024-04-24T23:39:00.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7fe867fff640 1 --2- 172.21.15.57:0/1335322255 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe85000f3a0 0x7fe850011790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fe86cead640 1 --2- 172.21.15.57:0/1335322255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe850003c30 0x7fe85000ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fe86d6ae640 1 --2- 172.21.15.57:0/1335322255 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe850011e60 0x7fe850014300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f8d34b44640 1 -- 172.21.15.57:0/3425231173 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d300bddd0 con 0x7f8d300c0cc0 2024-04-24T23:39:00.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f2699ffb640 1 -- 172.21.15.57:0/2837057474 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3323781126 0 0) 0x7f269c0bd870 con 0x7f269c0bf3a0 2024-04-24T23:39:00.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f2699ffb640 1 -- 172.21.15.57:0/2837057474 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2684003530 con 0x7f269c0bf3a0 2024-04-24T23:39:00.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f269affd640 1 -- 172.21.15.57:0/2837057474 >> v2:172.21.15.88:3300/0 conn(0x7f269c06e520 msgr2=0x7f269c0be8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:00.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f269affd640 1 --2- 172.21.15.57:0/2837057474 >> v2:172.21.15.88:3300/0 conn(0x7f269c06e520 0x7f269c0be8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f269affd640 1 -- 172.21.15.57:0/2837057474 >> v1:172.21.15.57:6789/0 conn(0x7f269c0bf3a0 legacy=0x7f269c14a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.673+0000 7f269affd640 1 -- 172.21.15.57:0/2837057474 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f269c0bdb10 con 0x7f269c072200 2024-04-24T23:39:00.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fe86cead640 1 -- 172.21.15.57:0/1335322255 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe85000f3a0 msgr2=0x7fe850011790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:00.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fe86cead640 1 --2- 172.21.15.57:0/1335322255 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe85000f3a0 0x7fe850011790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fe86cead640 1 -- 172.21.15.57:0/1335322255 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe850011e60 msgr2=0x7fe850014300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:00.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fe86cead640 1 --2- 172.21.15.57:0/1335322255 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe850011e60 0x7fe850014300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fe86cead640 1 -- 172.21.15.57:0/1335322255 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe850003450 con 0x7fe850003c30 2024-04-24T23:39:00.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fe86d6ae640 1 --2- 172.21.15.57:0/1335322255 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe850011e60 0x7fe850014300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:39:00.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fe86d6ae640 1 -- 172.21.15.57:0/1335322255 reap_dead start 2024-04-24T23:39:00.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fe867fff640 1 --2- 172.21.15.57:0/1335322255 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe85000f3a0 0x7fe850011790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:39:00.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f8d34b44640 1 --2- 172.21.15.57:0/3425231173 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d300c0cc0 0x7f8d3014d910 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8d24009870 tx=0x7f8d2401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8658a592329493e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f9a9aa5e640 1 --2- 172.21.15.57:0/4001828121 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a940bbbc0 0x7f9a941602e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9a94072350 tx=0x7f9a8401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e9de93327fd31a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f8d2f7fe640 1 -- 172.21.15.57:0/3425231173 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d240ab610 con 0x7f8d300c0cc0 2024-04-24T23:39:00.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fcab6ffd640 1 --2- 172.21.15.57:0/4133870256 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcab806de80 0x7fcab80c0800 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcaa80097c0 tx=0x7fcaa801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6649ec59e551cf89 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f8d2f7fe640 1 -- 172.21.15.57:0/3425231173 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d240b0070 con 0x7f8d300c0cc0 2024-04-24T23:39:00.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f8d2f7fe640 1 -- 172.21.15.57:0/3425231173 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d240aba10 con 0x7f8d300c0cc0 2024-04-24T23:39:00.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f9a9925b640 1 -- 172.21.15.57:0/4001828121 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a840b1070 con 0x7f9a940bbbc0 2024-04-24T23:39:00.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f9a9925b640 1 -- 172.21.15.57:0/4001828121 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a840ac410 con 0x7f9a940bbbc0 2024-04-24T23:39:00.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f269affd640 1 --2- 172.21.15.57:0/2837057474 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f269c072200 0x7f269c14d3a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f268c0098a0 tx=0x7f268c01ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aeebf5dc4f07a7db server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f9a9925b640 1 -- 172.21.15.57:0/4001828121 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a840ac7e0 con 0x7f9a940bbbc0 2024-04-24T23:39:00.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f86dceef640 1 --2- 172.21.15.57:0/401443777 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86d0047920 0x7f86d00441b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f86cc009870 tx=0x7f86cc01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce9dcc967953da5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fcab5ffb640 1 -- 172.21.15.57:0/4133870256 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa80b0070 con 0x7fcab806de80 2024-04-24T23:39:00.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f2699ffb640 1 -- 172.21.15.57:0/2837057474 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268c0b5070 con 0x7f269c072200 2024-04-24T23:39:00.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fcab5ffb640 1 -- 172.21.15.57:0/4133870256 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaa80ab600 con 0x7fcab806de80 2024-04-24T23:39:00.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fcab5ffb640 1 -- 172.21.15.57:0/4133870256 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa80ab9d0 con 0x7fcab806de80 2024-04-24T23:39:00.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fa45b7fe640 1 --2- 172.21.15.57:0/3510520372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa45c06e4f0 0x7fa45c152390 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa4500097c0 tx=0x7fa45001ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a0f90f4dfae9863 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f8d35b46640 1 -- 172.21.15.57:0/3425231173 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d300c0cc0 msgr2=0x7f8d3014d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f8d35b46640 1 --2- 172.21.15.57:0/3425231173 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d300c0cc0 0x7f8d3014d910 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8d24009870 tx=0x7f8d2401c540 comp rx=0 tx=0).stop 2024-04-24T23:39:00.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f2699ffb640 1 -- 172.21.15.57:0/2837057474 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f268c0a8a30 con 0x7f269c072200 2024-04-24T23:39:00.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f2699ffb640 1 -- 172.21.15.57:0/2837057474 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268c0a8e00 con 0x7f269c072200 2024-04-24T23:39:00.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f8d35b46640 1 -- 172.21.15.57:0/3425231173 shutdown_connections 2024-04-24T23:39:00.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f8d35b46640 1 --2- 172.21.15.57:0/3425231173 >> v2:172.21.15.57:3300/0 conn(0x7f8d300bcf60 0x7f8d3014de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f8d35b46640 1 --2- 172.21.15.57:0/3425231173 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d300c0cc0 0x7f8d3014d910 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f8d35b46640 1 -- 172.21.15.57:0/3425231173 >> 172.21.15.57:0/3425231173 conn(0x7f8d300be650 msgr2=0x7f8d300bea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:00.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fa45affd640 1 -- 172.21.15.57:0/3510520372 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4500b5070 con 0x7fa45c06e4f0 2024-04-24T23:39:00.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fa45affd640 1 -- 172.21.15.57:0/3510520372 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4500a8990 con 0x7fa45c06e4f0 2024-04-24T23:39:00.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fa45affd640 1 -- 172.21.15.57:0/3510520372 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4500b5070 con 0x7fa45c06e4f0 2024-04-24T23:39:00.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f0f8e7fc640 1 --2- 172.21.15.57:0/1543708151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f9006e520 0x7f0f9014d3a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0f900c3bb0 tx=0x7f0f8801f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e42e6aefb63a2df server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f9a9c4c1640 1 -- 172.21.15.57:0/4001828121 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a940bbbc0 msgr2=0x7f9a941602e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f9a9c4c1640 1 --2- 172.21.15.57:0/4001828121 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a940bbbc0 0x7f9a941602e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9a94072350 tx=0x7f9a8401c4e0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f9a9c4c1640 1 -- 172.21.15.57:0/4001828121 shutdown_connections 2024-04-24T23:39:00.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f9a9c4c1640 1 --2- 172.21.15.57:0/4001828121 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a940bbbc0 0x7f9a941602e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f9a9c4c1640 1 -- 172.21.15.57:0/4001828121 >> 172.21.15.57:0/4001828121 conn(0x7f9a940be8f0 msgr2=0x7f9a940becd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:00.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f86d77fe640 1 -- 172.21.15.57:0/401443777 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc0b5070 con 0x7f86d0047920 2024-04-24T23:39:00.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f86d77fe640 1 -- 172.21.15.57:0/401443777 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86cc0a8a50 con 0x7f86d0047920 2024-04-24T23:39:00.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f86d77fe640 1 -- 172.21.15.57:0/401443777 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc0a8e20 con 0x7f86d0047920 2024-04-24T23:39:00.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f8d35b46640 1 -- 172.21.15.57:0/3425231173 shutdown_connections 2024-04-24T23:39:00.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f8d35b46640 1 -- 172.21.15.57:0/3425231173 wait complete. 2024-04-24T23:39:00.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f0f8dffb640 1 -- 172.21.15.57:0/1543708151 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f880b4070 con 0x7f0f9006e520 2024-04-24T23:39:00.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f0f8dffb640 1 -- 172.21.15.57:0/1543708151 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f880af600 con 0x7f0f9006e520 2024-04-24T23:39:00.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f0f8dffb640 1 -- 172.21.15.57:0/1543708151 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f880af9d0 con 0x7f0f9006e520 2024-04-24T23:39:00.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f9a9c4c1640 1 -- 172.21.15.57:0/4001828121 shutdown_connections 2024-04-24T23:39:00.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f86ddef1640 1 -- 172.21.15.57:0/401443777 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86d0047920 msgr2=0x7f86d00441b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f86ddef1640 1 --2- 172.21.15.57:0/401443777 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86d0047920 0x7f86d00441b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f86cc009870 tx=0x7f86cc01ed50 comp rx=0 tx=0).stop 2024-04-24T23:39:00.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fcab7fff640 1 -- 172.21.15.57:0/4133870256 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcab806de80 msgr2=0x7fcab80c0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fcab7fff640 1 --2- 172.21.15.57:0/4133870256 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcab806de80 0x7fcab80c0800 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcaa80097c0 tx=0x7fcaa801c380 comp rx=0 tx=0).stop 2024-04-24T23:39:00.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f26a15c0640 1 -- 172.21.15.57:0/2837057474 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f269c072200 msgr2=0x7f269c14d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fcab7fff640 1 -- 172.21.15.57:0/4133870256 shutdown_connections 2024-04-24T23:39:00.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fcab7fff640 1 --2- 172.21.15.57:0/4133870256 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcab806de80 0x7fcab80c0800 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fcab7fff640 1 -- 172.21.15.57:0/4133870256 >> 172.21.15.57:0/4133870256 conn(0x7fcab80c5e80 msgr2=0x7fcab80c6290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:00.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f26a15c0640 1 --2- 172.21.15.57:0/2837057474 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f269c072200 0x7f269c14d3a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f268c0098a0 tx=0x7f268c01ed70 comp rx=0 tx=0).stop 2024-04-24T23:39:00.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fa461527640 1 -- 172.21.15.57:0/3510520372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa45c06e4f0 msgr2=0x7fa45c152390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fa461527640 1 --2- 172.21.15.57:0/3510520372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa45c06e4f0 0x7fa45c152390 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa4500097c0 tx=0x7fa45001ec90 comp rx=0 tx=0).stop 2024-04-24T23:39:00.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f86ddef1640 1 -- 172.21.15.57:0/401443777 shutdown_connections 2024-04-24T23:39:00.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f86ddef1640 1 --2- 172.21.15.57:0/401443777 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86d0047920 0x7f86d00441b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f86ddef1640 1 -- 172.21.15.57:0/401443777 >> 172.21.15.57:0/401443777 conn(0x7f86d0007790 msgr2=0x7f86d0007ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:00.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fcab7fff640 1 -- 172.21.15.57:0/4133870256 shutdown_connections 2024-04-24T23:39:00.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fcab7fff640 1 -- 172.21.15.57:0/4133870256 wait complete. 2024-04-24T23:39:00.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fa461527640 1 -- 172.21.15.57:0/3510520372 shutdown_connections 2024-04-24T23:39:00.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fa461527640 1 --2- 172.21.15.57:0/3510520372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa45c06e4f0 0x7fa45c152390 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa4500097c0 tx=0x7fa45001ec90 comp rx=0 tx=0).stop 2024-04-24T23:39:00.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fa461527640 1 --2- 172.21.15.57:0/3510520372 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa45c0724d0 0x7fa45c151e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fa461527640 1 -- 172.21.15.57:0/3510520372 >> 172.21.15.57:0/3510520372 conn(0x7fa45c0be650 msgr2=0x7fa45c0bea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:00.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f86ddef1640 1 -- 172.21.15.57:0/401443777 shutdown_connections 2024-04-24T23:39:00.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7fe86cead640 1 --2- 172.21.15.57:0/1335322255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe850003c30 0x7fe85000ee60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe860001620 tx=0x7fe86001cf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39f7c2e78a5b8c2d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f0f95779640 1 -- 172.21.15.57:0/1543708151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f9006e520 msgr2=0x7f0f9014d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f9a9c4c1640 1 -- 172.21.15.57:0/4001828121 wait complete. 2024-04-24T23:39:00.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f0f95779640 1 --2- 172.21.15.57:0/1543708151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f9006e520 0x7f0f9014d3a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0f900c3bb0 tx=0x7f0f8801f130 comp rx=0 tx=0).stop 2024-04-24T23:39:00.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.677+0000 7f86ddef1640 1 -- 172.21.15.57:0/401443777 wait complete. 2024-04-24T23:39:00.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fe8677fe640 1 -- 172.21.15.57:0/1335322255 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe860008ca0 con 0x7fe850003c30 2024-04-24T23:39:00.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fe8677fe640 1 -- 172.21.15.57:0/1335322255 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8600a9070 con 0x7fe850003c30 2024-04-24T23:39:00.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fe8677fe640 1 -- 172.21.15.57:0/1335322255 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8600a5b30 con 0x7fe850003c30 2024-04-24T23:39:00.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f0f95779640 1 -- 172.21.15.57:0/1543708151 shutdown_connections 2024-04-24T23:39:00.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f0f95779640 1 --2- 172.21.15.57:0/1543708151 >> v2:172.21.15.88:3300/0 conn(0x7f0f900bf3a0 0x7f0f9014a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fa461527640 1 -- 172.21.15.57:0/3510520372 shutdown_connections 2024-04-24T23:39:00.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f0f95779640 1 --2- 172.21.15.57:0/1543708151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f9006e520 0x7f0f9014d3a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f0f95779640 1 -- 172.21.15.57:0/1543708151 >> 172.21.15.57:0/1543708151 conn(0x7f0f900c2e70 msgr2=0x7f0f900c3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:00.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f9a9c4c1640 1 Processor -- start 2024-04-24T23:39:00.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fa461527640 1 -- 172.21.15.57:0/3510520372 wait complete. 2024-04-24T23:39:00.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f26a15c0640 1 -- 172.21.15.57:0/2837057474 shutdown_connections 2024-04-24T23:39:00.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f26a15c0640 1 --2- 172.21.15.57:0/2837057474 >> v2:172.21.15.88:3300/0 conn(0x7f269c06e520 0x7f269c0be8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f26a15c0640 1 --2- 172.21.15.57:0/2837057474 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f269c072200 0x7f269c14d3a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f26a15c0640 1 -- 172.21.15.57:0/2837057474 >> 172.21.15.57:0/2837057474 conn(0x7f269c0c2e70 msgr2=0x7f269c0c3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:00.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f9a9c4c1640 1 -- start start 2024-04-24T23:39:00.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f0f95779640 1 -- 172.21.15.57:0/1543708151 shutdown_connections 2024-04-24T23:39:00.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f8d35b46640 1 Processor -- start 2024-04-24T23:39:00.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f8d35b46640 1 -- start start 2024-04-24T23:39:00.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fcab7fff640 1 Processor -- start 2024-04-24T23:39:00.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f9a9c4c1640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9a940bbbc0 0x7f9a940b77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f26a15c0640 1 -- 172.21.15.57:0/2837057474 shutdown_connections 2024-04-24T23:39:00.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f86ddef1640 1 Processor -- start 2024-04-24T23:39:00.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f9a9c4c1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a940bc150 0x7f9a941539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f9a9a25d640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9a940bbbc0 0x7f9a940b77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f9a9a25d640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9a940bbbc0 0x7f9a940b77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.57:32832/0 (socket says 172.21.15.57:32832) 2024-04-24T23:39:00.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f9a9a25d640 1 -- 172.21.15.57:0/1168763149 learned_addr learned my addr 172.21.15.57:0/1168763149 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:00.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f9a9c4c1640 1 --2- 172.21.15.57:0/1168763149 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a941520e0 0x7f9a94153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fe86f111640 1 -- 172.21.15.57:0/1335322255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe850003c30 msgr2=0x7fe85000ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fe86f111640 1 --2- 172.21.15.57:0/1335322255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe850003c30 0x7fe85000ee60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe860001620 tx=0x7fe86001cf40 comp rx=0 tx=0).stop 2024-04-24T23:39:00.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fe86f111640 1 -- 172.21.15.57:0/1335322255 shutdown_connections 2024-04-24T23:39:00.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fe86f111640 1 --2- 172.21.15.57:0/1335322255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe850003c30 0x7fe85000ee60 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe860001620 tx=0x7fe86001cf40 comp rx=0 tx=0).stop 2024-04-24T23:39:00.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fe86f111640 1 -- 172.21.15.57:0/1335322255 >> 172.21.15.57:0/1335322255 conn(0x7fe8680be8f0 msgr2=0x7fe8680becd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:00.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f8d35b46640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d300725c0 0x7f8d301518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f0f95779640 1 -- 172.21.15.57:0/1543708151 wait complete. 2024-04-24T23:39:00.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fa461527640 1 Processor -- start 2024-04-24T23:39:00.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f8d35b46640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d300bcf60 0x7f8d300bb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fcab7fff640 1 -- start start 2024-04-24T23:39:00.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f9a99a5c640 1 --2- 172.21.15.57:0/1168763149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a940bc150 0x7f9a941539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f26a15c0640 1 -- 172.21.15.57:0/2837057474 wait complete. 2024-04-24T23:39:00.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f0f95779640 1 Processor -- start 2024-04-24T23:39:00.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fa461527640 1 -- start start 2024-04-24T23:39:00.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fcab7fff640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcab806c820 0x7fcab814a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fcab7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcab806de80 0x7fcab81540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fcab7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcab80c4070 0x7fcab8154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fcab7fff640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fcab806d4e0 con 0x7fcab80c4070 2024-04-24T23:39:00.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fcab7fff640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fcab806d360 con 0x7fcab806de80 2024-04-24T23:39:00.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fcab7fff640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fcab815e840 con 0x7fcab806c820 2024-04-24T23:39:00.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fe86f111640 1 -- 172.21.15.57:0/1335322255 shutdown_connections 2024-04-24T23:39:00.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f8d34b44640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d300725c0 0x7f8d301518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f8d34b44640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d300725c0 0x7f8d301518c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.57:32834/0 (socket says 172.21.15.57:32834) 2024-04-24T23:39:00.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fcab6ffd640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcab806c820 0x7fcab814a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fcab67fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcab806de80 0x7fcab81540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fcab6ffd640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcab806c820 0x7fcab814a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.57:32842/0 (socket says 172.21.15.57:32842) 2024-04-24T23:39:00.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fcab6ffd640 1 -- 172.21.15.57:0/3500571491 learned_addr learned my addr 172.21.15.57:0/3500571491 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:00.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fcab77fe640 1 --2- 172.21.15.57:0/3500571491 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcab80c4070 0x7fcab8154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fcab67fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcab806de80 0x7fcab81540f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.57:60078/0 (socket says 172.21.15.57:60078) 2024-04-24T23:39:00.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f8d2ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d300bcf60 0x7f8d300bb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f8d2ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d300bcf60 0x7f8d300bb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60128/0 (socket says 172.21.15.57:60128) 2024-04-24T23:39:00.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f86ddef1640 1 -- start start 2024-04-24T23:39:00.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f86ddef1640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f86d00082b0 0x7f86d003da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f26a15c0640 1 Processor -- start 2024-04-24T23:39:00.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f86ddef1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86d0046dd0 0x7f86d00cf840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f86ddef1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86d0047920 0x7f86d00cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f86ddef1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f86d0047d00 con 0x7f86d0047920 2024-04-24T23:39:00.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f86ddef1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f86d00da130 con 0x7f86d0046dd0 2024-04-24T23:39:00.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f86ddef1640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f86d000c8d0 con 0x7f86d00082b0 2024-04-24T23:39:00.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f86d7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86d0046dd0 0x7f86d00cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f86dceef640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f86d00082b0 0x7f86d003da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fa461527640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa45c0724d0 0x7fa45c11dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f26a15c0640 1 -- start start 2024-04-24T23:39:00.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fa461527640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa45c0bd9c0 0x7fa45c136250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fa461527640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa45c11e270 0x7fa45c136790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fa461527640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa45c072f00 con 0x7fa45c0724d0 2024-04-24T23:39:00.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fa461527640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa45c072d80 con 0x7fa45c11e270 2024-04-24T23:39:00.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fa461527640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fa45c0728b0 con 0x7fa45c0bd9c0 2024-04-24T23:39:00.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f8d34b44640 1 -- 172.21.15.57:0/3769860415 learned_addr learned my addr 172.21.15.57:0/3769860415 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:00.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f86d7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86d0046dd0 0x7f86d00cf840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.57:60084/0 (socket says 172.21.15.57:60084) 2024-04-24T23:39:00.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f86d7fff640 1 -- 172.21.15.57:0/4047580537 learned_addr learned my addr 172.21.15.57:0/4047580537 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:00.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f8d35b46640 1 --2- 172.21.15.57:0/3769860415 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d300c0cc0 0x7f8d300bbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f8d35b46640 1 -- 172.21.15.57:0/3769860415 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3015d960 con 0x7f8d300bcf60 2024-04-24T23:39:00.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fa460d26640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa45c11e270 0x7fa45c136790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fa460d26640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa45c11e270 0x7fa45c136790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.57:60096/0 (socket says 172.21.15.57:60096) 2024-04-24T23:39:00.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fa460d26640 1 -- 172.21.15.57:0/908832412 learned_addr learned my addr 172.21.15.57:0/908832412 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:00.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fa45b7fe640 1 --2- 172.21.15.57:0/908832412 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa45c0bd9c0 0x7fa45c136250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fcab77fe640 1 -- 172.21.15.57:0/3500571491 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcab806c820 msgr2=0x7fcab814a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fcab77fe640 1 --2- 172.21.15.57:0/3500571491 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcab806c820 0x7fcab814a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f86dd6f0640 1 --2- 172.21.15.57:0/4047580537 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86d0047920 0x7f86d00cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f0f95779640 1 -- start start 2024-04-24T23:39:00.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f0f95779640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0f9006e520 0x7f0f901f5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f0f95779640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f90072200 0x7f0f9015a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f0f95779640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f900bf3a0 0x7f0f901e5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f0f95779640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0f900725e0 con 0x7f0f900bf3a0 2024-04-24T23:39:00.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fcab77fe640 1 -- 172.21.15.57:0/3500571491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcab806de80 msgr2=0x7fcab81540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fcab77fe640 1 --2- 172.21.15.57:0/3500571491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcab806de80 0x7fcab81540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fcab77fe640 1 -- 172.21.15.57:0/3500571491 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcab81e9bd0 con 0x7fcab80c4070 2024-04-24T23:39:00.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f0f95779640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0f900be0d0 con 0x7f0f90072200 2024-04-24T23:39:00.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f0f95779640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f0f90072760 con 0x7f0f9006e520 2024-04-24T23:39:00.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f8d35b46640 1 -- 172.21.15.57:0/3769860415 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3015d7e0 con 0x7f8d300c0cc0 2024-04-24T23:39:00.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f8d35b46640 1 -- 172.21.15.57:0/3769860415 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f8d3015dae0 con 0x7f8d300725c0 2024-04-24T23:39:00.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fa45bfff640 1 --2- 172.21.15.57:0/908832412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa45c0724d0 0x7fa45c11dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f86dceef640 1 -- 172.21.15.57:0/4047580537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86d0046dd0 msgr2=0x7f86d00cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f86dceef640 1 --2- 172.21.15.57:0/4047580537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86d0046dd0 0x7f86d00cf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f86dceef640 1 -- 172.21.15.57:0/4047580537 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86d0047920 msgr2=0x7f86d00cfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f86dceef640 1 --2- 172.21.15.57:0/4047580537 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86d0047920 0x7f86d00cfd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f86dceef640 1 -- 172.21.15.57:0/4047580537 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d003df90 con 0x7f86d00082b0 2024-04-24T23:39:00.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f86dceef640 1 --2- 172.21.15.57:0/4047580537 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f86d00082b0 0x7f86d003da50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f86cc0af000 tx=0x7f86cc01baf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7f0f8effd640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0f9006e520 0x7f0f901f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f0f8f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f900bf3a0 0x7f0f901e5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f0f8f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f900bf3a0 0x7f0f901e5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60158/0 (socket says 172.21.15.57:60158) 2024-04-24T23:39:00.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f0f8f7fe640 1 -- 172.21.15.57:0/644767708 learned_addr learned my addr 172.21.15.57:0/644767708 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:00.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f0f8e7fc640 1 --2- 172.21.15.57:0/644767708 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f90072200 0x7f0f9015a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f0f8effd640 1 -- 172.21.15.57:0/644767708 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f90072200 msgr2=0x7f0f9015a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f0f8effd640 1 --2- 172.21.15.57:0/644767708 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f90072200 0x7f0f9015a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f0f8effd640 1 -- 172.21.15.57:0/644767708 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f900bf3a0 msgr2=0x7f0f901e5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f0f8effd640 1 --2- 172.21.15.57:0/644767708 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f900bf3a0 0x7f0f901e5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f0f8effd640 1 -- 172.21.15.57:0/644767708 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f901464c0 con 0x7f0f9006e520 2024-04-24T23:39:00.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fcab77fe640 1 --2- 172.21.15.57:0/3500571491 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcab80c4070 0x7fcab8154630 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcaac00c310 tx=0x7fcaac00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fca9ffff640 1 -- 172.21.15.57:0/3500571491 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaac017070 con 0x7fcab80c4070 2024-04-24T23:39:00.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fca9ffff640 1 -- 172.21.15.57:0/3500571491 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaac005cf0 con 0x7fcab80c4070 2024-04-24T23:39:00.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fca9ffff640 1 -- 172.21.15.57:0/3500571491 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaac0072f0 con 0x7fcab80c4070 2024-04-24T23:39:00.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fcab7fff640 1 -- 172.21.15.57:0/3500571491 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcab80bb510 con 0x7fcab80c4070 2024-04-24T23:39:00.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fcab7fff640 1 -- 172.21.15.57:0/3500571491 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcab80bc830 con 0x7fcab80c4070 2024-04-24T23:39:00.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.681+0000 7fe86f111640 1 -- 172.21.15.57:0/1335322255 wait complete. 2024-04-24T23:39:00.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fe86f111640 1 Processor -- start 2024-04-24T23:39:00.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fe86f111640 1 -- start start 2024-04-24T23:39:00.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fe86f111640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8681da020 0x7fe8681e8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fe86f111640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8681e4ee0 0x7fe8681e8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fe86f111640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe868150b90 0x7fe868151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fe86f111640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe8680bd800 con 0x7fe8681da020 2024-04-24T23:39:00.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fe86f111640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe86814d0a0 con 0x7fe8681e4ee0 2024-04-24T23:39:00.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fe86f111640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fe8680bd980 con 0x7fe868150b90 2024-04-24T23:39:00.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fa45bfff640 1 -- 172.21.15.57:0/908832412 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa45c0bd9c0 msgr2=0x7fa45c136250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fa45bfff640 1 --2- 172.21.15.57:0/908832412 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa45c0bd9c0 0x7fa45c136250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fa45bfff640 1 -- 172.21.15.57:0/908832412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa45c11e270 msgr2=0x7fa45c136790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fa45bfff640 1 --2- 172.21.15.57:0/908832412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa45c11e270 0x7fa45c136790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fa45bfff640 1 -- 172.21.15.57:0/908832412 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa45c152f00 con 0x7fa45c0724d0 2024-04-24T23:39:00.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fa45bfff640 1 --2- 172.21.15.57:0/908832412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa45c0724d0 0x7fa45c11dd30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa44c00c770 tx=0x7fa44c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fa458ff9640 1 -- 172.21.15.57:0/908832412 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44c0079d0 con 0x7fa45c0724d0 2024-04-24T23:39:00.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fa458ff9640 1 -- 172.21.15.57:0/908832412 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa44c007b70 con 0x7fa45c0724d0 2024-04-24T23:39:00.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fa458ff9640 1 -- 172.21.15.57:0/908832412 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44c0113f0 con 0x7fa45c0724d0 2024-04-24T23:39:00.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fa461527640 1 -- 172.21.15.57:0/908832412 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa45c140090 con 0x7fa45c0724d0 2024-04-24T23:39:00.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fa461527640 1 -- 172.21.15.57:0/908832412 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa45c0b85f0 con 0x7fa45c0724d0 2024-04-24T23:39:00.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f8d2ffff640 1 -- 172.21.15.57:0/3769860415 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d300725c0 msgr2=0x7f8d301518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f8d2ffff640 1 --2- 172.21.15.57:0/3769860415 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d300725c0 0x7f8d301518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f8d2ffff640 1 -- 172.21.15.57:0/3769860415 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d300c0cc0 msgr2=0x7f8d300bbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f8d2ffff640 1 --2- 172.21.15.57:0/3769860415 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d300c0cc0 0x7f8d300bbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f8d2ffff640 1 -- 172.21.15.57:0/3769860415 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d300bc970 con 0x7f8d300bcf60 2024-04-24T23:39:00.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f26a15c0640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f269c06e520 0x7f269c0bb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f26a15c0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f269c072200 0x7f269c151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f26a15c0640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f269c0bf3a0 0x7f269c147080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f26a15c0640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f269c0725e0 con 0x7f269c06e520 2024-04-24T23:39:00.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f26a15c0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f269c0be0d0 con 0x7f269c072200 2024-04-24T23:39:00.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f26a15c0640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f269c072760 con 0x7f269c0bf3a0 2024-04-24T23:39:00.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f269affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f269c06e520 0x7f269c0bb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f269affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f269c06e520 0x7f269c0bb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60168/0 (socket says 172.21.15.57:60168) 2024-04-24T23:39:00.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f269affd640 1 -- 172.21.15.57:0/941370618 learned_addr learned my addr 172.21.15.57:0/941370618 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:00.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f0f8effd640 1 --2- 172.21.15.57:0/644767708 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0f9006e520 0x7f0f901f5f10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0f8000c400 tx=0x7f0f8000c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fe86cead640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8681da020 0x7fe8681e8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fe86cead640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8681da020 0x7fe8681e8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60182/0 (socket says 172.21.15.57:60182) 2024-04-24T23:39:00.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fe86cead640 1 -- 172.21.15.57:0/1124563735 learned_addr learned my addr 172.21.15.57:0/1124563735 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:00.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f269b7fe640 1 --2- 172.21.15.57:0/941370618 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f269c0bf3a0 0x7f269c147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fcab7fff640 1 -- 172.21.15.57:0/3500571491 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcab804f510 con 0x7fcab80c4070 2024-04-24T23:39:00.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fe867fff640 1 --2- 172.21.15.57:0/1124563735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8681e4ee0 0x7fe8681e8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fe86d6ae640 1 --2- 172.21.15.57:0/1124563735 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe868150b90 0x7fe868151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f269affd640 1 -- 172.21.15.57:0/941370618 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f269c0bf3a0 msgr2=0x7f269c147080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f269affd640 1 --2- 172.21.15.57:0/941370618 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f269c0bf3a0 0x7f269c147080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f269affd640 1 -- 172.21.15.57:0/941370618 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f269c072200 msgr2=0x7f269c151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f269affd640 1 --2- 172.21.15.57:0/941370618 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f269c072200 0x7f269c151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f269affd640 1 -- 172.21.15.57:0/941370618 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f269c1490a0 con 0x7f269c06e520 2024-04-24T23:39:00.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fe86cead640 1 -- 172.21.15.57:0/1124563735 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe868150b90 msgr2=0x7fe868151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fe86cead640 1 --2- 172.21.15.57:0/1124563735 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe868150b90 0x7fe868151040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fe86cead640 1 -- 172.21.15.57:0/1124563735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8681e4ee0 msgr2=0x7fe8681e8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fe86cead640 1 --2- 172.21.15.57:0/1124563735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8681e4ee0 0x7fe8681e8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fe86cead640 1 -- 172.21.15.57:0/1124563735 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86814d9b0 con 0x7fe8681da020 2024-04-24T23:39:00.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f0f777fe640 1 -- 172.21.15.57:0/644767708 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f80017070 con 0x7f0f9006e520 2024-04-24T23:39:00.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fa461527640 1 -- 172.21.15.57:0/908832412 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa45c04f510 con 0x7fa45c0724d0 2024-04-24T23:39:00.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f269affd640 1 --2- 172.21.15.57:0/941370618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f269c06e520 0x7f269c0bb640 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f268c0b3040 tx=0x7f268c01bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f0f95779640 1 -- 172.21.15.57:0/644767708 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f901f6450 con 0x7f0f9006e520 2024-04-24T23:39:00.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f0f95779640 1 -- 172.21.15.57:0/644767708 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f90147770 con 0x7f0f9006e520 2024-04-24T23:39:00.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fca9ffff640 1 -- 172.21.15.57:0/3500571491 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcaac01a070 con 0x7fcab80c4070 2024-04-24T23:39:00.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fe86cead640 1 --2- 172.21.15.57:0/1124563735 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8681da020 0x7fe8681e8aa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe86001cd70 tx=0x7fe850003740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f0f777fe640 1 -- 172.21.15.57:0/644767708 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f80005cf0 con 0x7f0f9006e520 2024-04-24T23:39:00.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f86d57fa640 1 -- 172.21.15.57:0/4047580537 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc0c0070 con 0x7f86d00082b0 2024-04-24T23:39:00.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f86d57fa640 1 -- 172.21.15.57:0/4047580537 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86cc0b1e10 con 0x7f86d00082b0 2024-04-24T23:39:00.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f86d57fa640 1 -- 172.21.15.57:0/4047580537 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc0b5040 con 0x7f86d00082b0 2024-04-24T23:39:00.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f26837fe640 1 -- 172.21.15.57:0/941370618 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268c0b5070 con 0x7f269c06e520 2024-04-24T23:39:00.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fca9ffff640 1 --2- 172.21.15.57:0/3500571491 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fcaa40678c0 0x7fcaa4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fca9ffff640 1 -- 172.21.15.57:0/3500571491 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcaac085280 con 0x7fcab80c4070 2024-04-24T23:39:00.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fcab6ffd640 1 --2- 172.21.15.57:0/3500571491 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fcaa40678c0 0x7fcaa4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f86ddef1640 1 -- 172.21.15.57:0/4047580537 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86d0165cd0 con 0x7f86d00082b0 2024-04-24T23:39:00.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f86ddef1640 1 -- 172.21.15.57:0/4047580537 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f86d00dde50 con 0x7f86d00082b0 2024-04-24T23:39:00.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fe8657fa640 1 -- 172.21.15.57:0/1124563735 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe860008ca0 con 0x7fe8681da020 2024-04-24T23:39:00.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fe8657fa640 1 -- 172.21.15.57:0/1124563735 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe860004da0 con 0x7fe8681da020 2024-04-24T23:39:00.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7fe8657fa640 1 -- 172.21.15.57:0/1124563735 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8600a5b30 con 0x7fe8681da020 2024-04-24T23:39:00.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7f0f777fe640 1 -- 172.21.15.57:0/644767708 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f800072d0 con 0x7f0f9006e520 2024-04-24T23:39:00.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7fe86f111640 1 -- 172.21.15.57:0/1124563735 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe868152050 con 0x7fe8681da020 2024-04-24T23:39:00.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7fe86f111640 1 -- 172.21.15.57:0/1124563735 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8681e8580 con 0x7fe8681da020 2024-04-24T23:39:00.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7f8d2ffff640 1 --2- 172.21.15.57:0/3769860415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d300bcf60 0x7f8d300bb6a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00d5f0 tx=0x7f8d1c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7f9a9c4c1640 1 -- 172.21.15.57:0/1168763149 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9a94070fa0 con 0x7f9a941520e0 2024-04-24T23:39:00.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7f9a9c4c1640 1 -- 172.21.15.57:0/1168763149 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9a94070e20 con 0x7f9a940bc150 2024-04-24T23:39:00.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7f9a9c4c1640 1 -- 172.21.15.57:0/1168763149 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f9a94163450 con 0x7f9a940bbbc0 2024-04-24T23:39:00.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f9a9aa5e640 1 --2- 172.21.15.57:0/1168763149 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a941520e0 0x7f9a94153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f26a15c0640 1 -- 172.21.15.57:0/941370618 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f269c0bbb80 con 0x7f269c06e520 2024-04-24T23:39:00.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.685+0000 7f26a15c0640 1 -- 172.21.15.57:0/941370618 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f269c1424f0 con 0x7f269c06e520 2024-04-24T23:39:00.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7f26a15c0640 1 -- 172.21.15.57:0/941370618 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f269c1422e0 con 0x7f269c06e520 2024-04-24T23:39:00.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7f26837fe640 1 -- 172.21.15.57:0/941370618 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f268c0b0cc0 con 0x7f269c06e520 2024-04-24T23:39:00.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7f26837fe640 1 -- 172.21.15.57:0/941370618 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268c0bb650 con 0x7f269c06e520 2024-04-24T23:39:00.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7f9a9aa5e640 1 -- 172.21.15.57:0/1168763149 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9a940bbbc0 msgr2=0x7f9a940b77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7f9a9aa5e640 1 --2- 172.21.15.57:0/1168763149 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9a940bbbc0 0x7f9a940b77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7f9a9aa5e640 1 -- 172.21.15.57:0/1168763149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a940bc150 msgr2=0x7f9a941539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7f9a9aa5e640 1 --2- 172.21.15.57:0/1168763149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a940bc150 0x7f9a941539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7f9a9aa5e640 1 -- 172.21.15.57:0/1168763149 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a94151070 con 0x7f9a941520e0 2024-04-24T23:39:00.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7fcab6ffd640 1 --2- 172.21.15.57:0/3500571491 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fcaa40678c0 0x7fcaa4069d80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcaa801c3c0 tx=0x7fcaa80a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7f9a9aa5e640 1 --2- 172.21.15.57:0/1168763149 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a941520e0 0x7f9a94153f10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9a840ac000 tx=0x7f9a84019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7f0f95779640 1 -- 172.21.15.57:0/644767708 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f700052a0 con 0x7f0f9006e520 2024-04-24T23:39:00.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7f0f777fe640 1 -- 172.21.15.57:0/644767708 <== mon.2 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0f8001a070 con 0x7f0f9006e520 2024-04-24T23:39:00.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7f86ddef1640 1 -- 172.21.15.57:0/4047580537 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86b80052a0 con 0x7f86d00082b0 2024-04-24T23:39:00.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7f0f777fe640 1 --2- 172.21.15.57:0/644767708 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f0f7c0679c0 0x7f0f7c069e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7fe86f111640 1 -- 172.21.15.57:0/1124563735 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe86804f510 con 0x7fe8681da020 2024-04-24T23:39:00.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7f0f777fe640 1 -- 172.21.15.57:0/644767708 <== mon.2 v2:172.21.15.88:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0f80085440 con 0x7f0f9006e520 2024-04-24T23:39:00.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7f0f8e7fc640 1 --2- 172.21.15.57:0/644767708 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f0f7c0679c0 0x7f0f7c069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7f26837fe640 1 -- 172.21.15.57:0/941370618 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f268c0c2060 con 0x7f269c06e520 2024-04-24T23:39:00.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7f86d57fa640 1 -- 172.21.15.57:0/4047580537 <== mon.2 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f86cc0c3070 con 0x7f86d00082b0 2024-04-24T23:39:00.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7f26837fe640 1 --2- 172.21.15.57:0/941370618 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f26880679c0 0x7f2688069e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7f26837fe640 1 -- 172.21.15.57:0/941370618 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f268c123340 con 0x7f269c06e520 2024-04-24T23:39:00.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7f86d57fa640 1 --2- 172.21.15.57:0/4047580537 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f86bc067940 0x7f86bc069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7f86d57fa640 1 -- 172.21.15.57:0/4047580537 <== mon.2 v2:172.21.15.88:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f86cc123420 con 0x7f86d00082b0 2024-04-24T23:39:00.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7f269a7fc640 1 --2- 172.21.15.57:0/941370618 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f26880679c0 0x7f2688069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7f0f8e7fc640 1 --2- 172.21.15.57:0/644767708 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f0f7c0679c0 0x7f0f7c069e80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0f880b1000 tx=0x7f0f880aa000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.689+0000 7f86d7fff640 1 --2- 172.21.15.57:0/4047580537 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f86bc067940 0x7f86bc069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.693+0000 7f269a7fc640 1 --2- 172.21.15.57:0/941370618 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f26880679c0 0x7f2688069e80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f269c142d80 tx=0x7f26900095c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.693+0000 7f86d7fff640 1 --2- 172.21.15.57:0/4047580537 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f86bc067940 0x7f86bc069e00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f86d00dba30 tx=0x7f86c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.693+0000 7fca9ffff640 1 -- 172.21.15.57:0/3500571491 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fcaac055410 con 0x7fcab80c4070 2024-04-24T23:39:00.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.693+0000 7fa458ff9640 1 -- 172.21.15.57:0/908832412 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa44c011590 con 0x7fa45c0724d0 2024-04-24T23:39:00.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.693+0000 7fa458ff9640 1 --2- 172.21.15.57:0/908832412 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa448067910 0x7fa448069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.697+0000 7fa45b7fe640 1 --2- 172.21.15.57:0/908832412 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa448067910 0x7fa448069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.697+0000 7fa45b7fe640 1 --2- 172.21.15.57:0/908832412 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa448067910 0x7fa448069dd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa4500b2000 tx=0x7fa4500aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.697+0000 7f26837fe640 1 -- 172.21.15.57:0/941370618 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f269c0bbb80 con 0x7f269c06e520 2024-04-24T23:39:00.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.697+0000 7fa458ff9640 1 -- 172.21.15.57:0/908832412 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa44c054850 con 0x7fa45c0724d0 2024-04-24T23:39:00.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.697+0000 7f8d2d7fa640 1 -- 172.21.15.57:0/3769860415 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c0125f0 con 0x7f8d300bcf60 2024-04-24T23:39:00.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.697+0000 7f8d35b46640 1 -- 172.21.15.57:0/3769860415 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d30152160 con 0x7f8d300bcf60 2024-04-24T23:39:00.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.701+0000 7f8d35b46640 1 -- 172.21.15.57:0/3769860415 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d30151e00 con 0x7f8d300bcf60 2024-04-24T23:39:00.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.701+0000 7f8d2d7fa640 1 -- 172.21.15.57:0/3769860415 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d1c019070 con 0x7f8d300bcf60 2024-04-24T23:39:00.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.701+0000 7f8d2d7fa640 1 -- 172.21.15.57:0/3769860415 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c0129b0 con 0x7f8d300bcf60 2024-04-24T23:39:00.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.701+0000 7f9a8affd640 1 -- 172.21.15.57:0/1168763149 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a840b1040 con 0x7f9a941520e0 2024-04-24T23:39:00.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.701+0000 7f9a8affd640 1 -- 172.21.15.57:0/1168763149 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a840ba070 con 0x7f9a941520e0 2024-04-24T23:39:00.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.701+0000 7f9a8affd640 1 -- 172.21.15.57:0/1168763149 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a840b5430 con 0x7f9a941520e0 2024-04-24T23:39:00.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.701+0000 7f9a9c4c1640 1 -- 172.21.15.57:0/1168763149 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a940b89f0 con 0x7f9a941520e0 2024-04-24T23:39:00.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.701+0000 7f9a9c4c1640 1 -- 172.21.15.57:0/1168763149 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a94154450 con 0x7f9a941520e0 2024-04-24T23:39:00.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.701+0000 7fe8657fa640 1 -- 172.21.15.57:0/1124563735 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe8600b6030 con 0x7fe8681da020 2024-04-24T23:39:00.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.701+0000 7fe8657fa640 1 --2- 172.21.15.57:0/1124563735 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fe8540679c0 0x7fe854069e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.701+0000 7f8d35b46640 1 -- 172.21.15.57:0/3769860415 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d100052a0 con 0x7f8d300bcf60 2024-04-24T23:39:00.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.701+0000 7fe8657fa640 1 -- 172.21.15.57:0/1124563735 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe86011f8b0 con 0x7fe8681da020 2024-04-24T23:39:00.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.701+0000 7f9a9c4c1640 1 -- 172.21.15.57:0/1168763149 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a7c0052a0 con 0x7f9a941520e0 2024-04-24T23:39:00.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.701+0000 7fe867fff640 1 --2- 172.21.15.57:0/1124563735 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fe8540679c0 0x7fe854069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.701+0000 7fe867fff640 1 --2- 172.21.15.57:0/1124563735 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fe8540679c0 0x7fe854069e80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe868152cd0 tx=0x7fe85c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.705+0000 7f0f777fe640 1 -- 172.21.15.57:0/644767708 <== mon.2 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f0f901f6450 con 0x7f0f9006e520 2024-04-24T23:39:00.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.709+0000 7fa458ff9640 1 -- 172.21.15.57:0/908832412 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fa44c015020 con 0x7fa45c0724d0 2024-04-24T23:39:00.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.717+0000 7f86d57fa640 1 -- 172.21.15.57:0/4047580537 <== mon.2 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f86d003df90 con 0x7f86d00082b0 2024-04-24T23:39:00.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.717+0000 7fe8657fa640 1 -- 172.21.15.57:0/1124563735 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fe8600bd030 con 0x7fe8681da020 2024-04-24T23:39:00.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.721+0000 7f9a8affd640 1 -- 172.21.15.57:0/1168763149 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9a840b55d0 con 0x7f9a941520e0 2024-04-24T23:39:00.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.725+0000 7f9a8affd640 1 --2- 172.21.15.57:0/1168763149 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f9a78067940 0x7f9a78069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.725+0000 7f9a9a25d640 1 --2- 172.21.15.57:0/1168763149 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f9a78067940 0x7f9a78069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.725+0000 7f8d2d7fa640 1 -- 172.21.15.57:0/3769860415 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8d1c012b50 con 0x7f8d300bcf60 2024-04-24T23:39:00.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.725+0000 7f8d2d7fa640 1 --2- 172.21.15.57:0/3769860415 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f8d140678c0 0x7f8d14069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:00.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.725+0000 7f8d34b44640 1 --2- 172.21.15.57:0/3769860415 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f8d140678c0 0x7f8d14069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:00.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.725+0000 7f9a9a25d640 1 --2- 172.21.15.57:0/1168763149 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f9a78067940 0x7f9a78069e00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9a90007fd0 tx=0x7f9a90009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.725+0000 7f8d34b44640 1 --2- 172.21.15.57:0/3769860415 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f8d140678c0 0x7f8d14069d80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8d24000c10 tx=0x7f8d240a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:00.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.725+0000 7f9a8affd640 1 -- 172.21.15.57:0/1168763149 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9a840ee3c0 con 0x7f9a941520e0 2024-04-24T23:39:00.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.725+0000 7f8d2d7fa640 1 -- 172.21.15.57:0/3769860415 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8d1c012e40 con 0x7f8d300bcf60 2024-04-24T23:39:00.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.737+0000 7f9a8affd640 1 -- 172.21.15.57:0/1168763149 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f9a840160d0 con 0x7f9a941520e0 2024-04-24T23:39:00.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.749+0000 7f8d2d7fa640 1 -- 172.21.15.57:0/3769860415 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f8d300bc970 con 0x7f8d300bcf60 2024-04-24T23:39:00.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.977+0000 7fcab7fff640 1 -- 172.21.15.57:0/3500571491 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fcab80b9a40 con 0x7fcab80c4070 2024-04-24T23:39:00.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.977+0000 7fca9ffff640 1 -- 172.21.15.57:0/3500571491 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcaac059710 con 0x7fcab80c4070 2024-04-24T23:39:00.980 INFO:teuthology.orchestra.run.smithi057.stdout:55834574857 2024-04-24T23:39:00.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.981+0000 7fca9dffb640 1 -- 172.21.15.57:0/3500571491 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fcaa40678c0 msgr2=0x7fcaa4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.981+0000 7fca9dffb640 1 --2- 172.21.15.57:0/3500571491 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fcaa40678c0 0x7fcaa4069d80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcaa801c3c0 tx=0x7fcaa80a6000 comp rx=0 tx=0).stop 2024-04-24T23:39:00.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.981+0000 7fca9dffb640 1 -- 172.21.15.57:0/3500571491 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcab80c4070 msgr2=0x7fcab8154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:00.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.981+0000 7fca9dffb640 1 --2- 172.21.15.57:0/3500571491 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcab80c4070 0x7fcab8154630 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcaac00c310 tx=0x7fcaac00c7d0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.981+0000 7fca9dffb640 1 -- 172.21.15.57:0/3500571491 shutdown_connections 2024-04-24T23:39:00.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.981+0000 7fca9dffb640 1 --2- 172.21.15.57:0/3500571491 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fcaa40678c0 0x7fcaa4069d80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.981+0000 7fca9dffb640 1 --2- 172.21.15.57:0/3500571491 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcab80c4070 0x7fcab8154630 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.981+0000 7fca9dffb640 1 --2- 172.21.15.57:0/3500571491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcab806de80 0x7fcab81540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.981+0000 7fca9dffb640 1 --2- 172.21.15.57:0/3500571491 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcab806c820 0x7fcab814a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:00.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.981+0000 7fca9dffb640 1 -- 172.21.15.57:0/3500571491 >> 172.21.15.57:0/3500571491 conn(0x7fcab80c5e80 msgr2=0x7fcab815b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:00.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.981+0000 7fca9dffb640 1 -- 172.21.15.57:0/3500571491 shutdown_connections 2024-04-24T23:39:00.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:00.981+0000 7fca9dffb640 1 -- 172.21.15.57:0/3500571491 wait complete. 2024-04-24T23:39:01.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2024-04-24T23:39:01.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.021+0000 7f26a15c0640 1 -- 172.21.15.57:0/941370618 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f269c06f0c0 con 0x7f269c06e520 2024-04-24T23:39:01.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.021+0000 7f26837fe640 1 -- 172.21.15.57:0/941370618 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f268c0188d0 con 0x7f269c06e520 2024-04-24T23:39:01.022 INFO:teuthology.orchestra.run.smithi057.stdout:55834574856 2024-04-24T23:39:01.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.025+0000 7f26a15c0640 1 -- 172.21.15.57:0/941370618 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f26880679c0 msgr2=0x7f2688069e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:01.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.025+0000 7f26a15c0640 1 --2- 172.21.15.57:0/941370618 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f26880679c0 0x7f2688069e80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f269c142d80 tx=0x7f26900095c0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.025+0000 7f26a15c0640 1 -- 172.21.15.57:0/941370618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f269c06e520 msgr2=0x7f269c0bb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:01.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.025+0000 7f26a15c0640 1 --2- 172.21.15.57:0/941370618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f269c06e520 0x7f269c0bb640 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f268c0b3040 tx=0x7f268c01bb10 comp rx=0 tx=0).stop 2024-04-24T23:39:01.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.025+0000 7f26a15c0640 1 -- 172.21.15.57:0/941370618 shutdown_connections 2024-04-24T23:39:01.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.025+0000 7f26a15c0640 1 --2- 172.21.15.57:0/941370618 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f26880679c0 0x7f2688069e80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.025+0000 7f26a15c0640 1 --2- 172.21.15.57:0/941370618 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f269c0bf3a0 0x7f269c147080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.025+0000 7f26a15c0640 1 --2- 172.21.15.57:0/941370618 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f269c072200 0x7f269c151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.025+0000 7f26a15c0640 1 --2- 172.21.15.57:0/941370618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f269c06e520 0x7f269c0bb640 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.025+0000 7f26a15c0640 1 -- 172.21.15.57:0/941370618 >> 172.21.15.57:0/941370618 conn(0x7f269c0c2e70 msgr2=0x7f269c0be8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:01.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.025+0000 7f26a15c0640 1 -- 172.21.15.57:0/941370618 shutdown_connections 2024-04-24T23:39:01.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.025+0000 7f26a15c0640 1 -- 172.21.15.57:0/941370618 wait complete. 2024-04-24T23:39:01.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.029+0000 7fa461527640 1 -- 172.21.15.57:0/908832412 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fa45c0bcdf0 con 0x7fa45c0724d0 2024-04-24T23:39:01.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.029+0000 7fa458ff9640 1 -- 172.21.15.57:0/908832412 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa44c0567b0 con 0x7fa45c0724d0 2024-04-24T23:39:01.031 INFO:teuthology.orchestra.run.smithi057.stdout:55834574857 2024-04-24T23:39:01.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.033+0000 7fa461527640 1 -- 172.21.15.57:0/908832412 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa448067910 msgr2=0x7fa448069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:01.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.033+0000 7fa461527640 1 --2- 172.21.15.57:0/908832412 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa448067910 0x7fa448069dd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa4500b2000 tx=0x7fa4500aa070 comp rx=0 tx=0).stop 2024-04-24T23:39:01.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.033+0000 7fa461527640 1 -- 172.21.15.57:0/908832412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa45c0724d0 msgr2=0x7fa45c11dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:01.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.033+0000 7fa461527640 1 --2- 172.21.15.57:0/908832412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa45c0724d0 0x7fa45c11dd30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa44c00c770 tx=0x7fa44c00cc30 comp rx=0 tx=0).stop 2024-04-24T23:39:01.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.033+0000 7fa461527640 1 -- 172.21.15.57:0/908832412 shutdown_connections 2024-04-24T23:39:01.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.033+0000 7fa461527640 1 --2- 172.21.15.57:0/908832412 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa448067910 0x7fa448069dd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.033+0000 7fa461527640 1 --2- 172.21.15.57:0/908832412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa45c11e270 0x7fa45c136790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.033+0000 7fa461527640 1 --2- 172.21.15.57:0/908832412 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa45c0bd9c0 0x7fa45c136250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.033+0000 7fa461527640 1 --2- 172.21.15.57:0/908832412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa45c0724d0 0x7fa45c11dd30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.033+0000 7fa461527640 1 -- 172.21.15.57:0/908832412 >> 172.21.15.57:0/908832412 conn(0x7fa45c0be650 msgr2=0x7fa45c0c0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:01.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.033+0000 7fa461527640 1 -- 172.21.15.57:0/908832412 shutdown_connections 2024-04-24T23:39:01.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.033+0000 7fa461527640 1 -- 172.21.15.57:0/908832412 wait complete. 2024-04-24T23:39:01.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.037+0000 7f9a9c4c1640 1 -- 172.21.15.57:0/1168763149 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f9a7c005860 con 0x7f9a941520e0 2024-04-24T23:39:01.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.037+0000 7f9a8affd640 1 -- 172.21.15.57:0/1168763149 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9a840f0320 con 0x7f9a941520e0 2024-04-24T23:39:01.038 INFO:teuthology.orchestra.run.smithi057.stdout:55834574856 2024-04-24T23:39:01.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.037+0000 7f0f95779640 1 -- 172.21.15.57:0/644767708 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f0f70005860 con 0x7f0f9006e520 2024-04-24T23:39:01.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.037+0000 7f9a9c4c1640 1 -- 172.21.15.57:0/1168763149 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f9a78067940 msgr2=0x7f9a78069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:01.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.037+0000 7f9a9c4c1640 1 --2- 172.21.15.57:0/1168763149 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f9a78067940 0x7f9a78069e00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9a90007fd0 tx=0x7f9a90009040 comp rx=0 tx=0).stop 2024-04-24T23:39:01.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.037+0000 7f9a9c4c1640 1 -- 172.21.15.57:0/1168763149 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a941520e0 msgr2=0x7f9a94153f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:01.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.037+0000 7f9a9c4c1640 1 --2- 172.21.15.57:0/1168763149 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a941520e0 0x7f9a94153f10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9a840ac000 tx=0x7f9a84019280 comp rx=0 tx=0).stop 2024-04-24T23:39:01.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.037+0000 7f9a9c4c1640 1 -- 172.21.15.57:0/1168763149 shutdown_connections 2024-04-24T23:39:01.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.037+0000 7f9a9c4c1640 1 --2- 172.21.15.57:0/1168763149 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f9a78067940 0x7f9a78069e00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.037+0000 7f9a9c4c1640 1 --2- 172.21.15.57:0/1168763149 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a941520e0 0x7f9a94153f10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.037+0000 7f9a9c4c1640 1 --2- 172.21.15.57:0/1168763149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a940bc150 0x7f9a941539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.037+0000 7f9a9c4c1640 1 --2- 172.21.15.57:0/1168763149 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9a940bbbc0 0x7f9a940b77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.037+0000 7f9a9c4c1640 1 -- 172.21.15.57:0/1168763149 >> 172.21.15.57:0/1168763149 conn(0x7f9a940be8f0 msgr2=0x7f9a940bc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:01.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.037+0000 7f9a9c4c1640 1 -- 172.21.15.57:0/1168763149 shutdown_connections 2024-04-24T23:39:01.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.037+0000 7f9a9c4c1640 1 -- 172.21.15.57:0/1168763149 wait complete. 2024-04-24T23:39:01.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.037+0000 7f0f777fe640 1 -- 172.21.15.57:0/644767708 <== mon.2 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0f80055660 con 0x7f0f9006e520 2024-04-24T23:39:01.043 INFO:teuthology.orchestra.run.smithi057.stdout:55834574857 2024-04-24T23:39:01.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.041+0000 7f86ddef1640 1 -- 172.21.15.57:0/4047580537 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f86b8005860 con 0x7f86d00082b0 2024-04-24T23:39:01.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.041+0000 7f86d57fa640 1 -- 172.21.15.57:0/4047580537 <== mon.2 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f86cc0188b0 con 0x7f86d00082b0 2024-04-24T23:39:01.044 INFO:teuthology.orchestra.run.smithi057.stdout:55834574856 2024-04-24T23:39:01.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.041+0000 7f0f95779640 1 -- 172.21.15.57:0/644767708 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f0f7c0679c0 msgr2=0x7f0f7c069e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:01.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.041+0000 7f0f95779640 1 --2- 172.21.15.57:0/644767708 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f0f7c0679c0 0x7f0f7c069e80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0f880b1000 tx=0x7f0f880aa000 comp rx=0 tx=0).stop 2024-04-24T23:39:01.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.041+0000 7f0f95779640 1 -- 172.21.15.57:0/644767708 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0f9006e520 msgr2=0x7f0f901f5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:01.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.041+0000 7f0f95779640 1 --2- 172.21.15.57:0/644767708 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0f9006e520 0x7f0f901f5f10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0f8000c400 tx=0x7f0f8000c8c0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.041+0000 7f0f95779640 1 -- 172.21.15.57:0/644767708 shutdown_connections 2024-04-24T23:39:01.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.041+0000 7f0f95779640 1 --2- 172.21.15.57:0/644767708 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f0f7c0679c0 0x7f0f7c069e80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.041+0000 7f0f95779640 1 --2- 172.21.15.57:0/644767708 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f900bf3a0 0x7f0f901e5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.041+0000 7f0f95779640 1 --2- 172.21.15.57:0/644767708 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f90072200 0x7f0f9015a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.041+0000 7f0f95779640 1 --2- 172.21.15.57:0/644767708 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0f9006e520 0x7f0f901f5f10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.041+0000 7f0f95779640 1 -- 172.21.15.57:0/644767708 >> 172.21.15.57:0/644767708 conn(0x7f0f900c2e70 msgr2=0x7f0f9006eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:01.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.041+0000 7f0f95779640 1 -- 172.21.15.57:0/644767708 shutdown_connections 2024-04-24T23:39:01.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.041+0000 7f0f95779640 1 -- 172.21.15.57:0/644767708 wait complete. 2024-04-24T23:39:01.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.045+0000 7f86ddef1640 1 -- 172.21.15.57:0/4047580537 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f86bc067940 msgr2=0x7f86bc069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:01.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.045+0000 7f86ddef1640 1 --2- 172.21.15.57:0/4047580537 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f86bc067940 0x7f86bc069e00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f86d00dba30 tx=0x7f86c4009040 comp rx=0 tx=0).stop 2024-04-24T23:39:01.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.045+0000 7f86ddef1640 1 -- 172.21.15.57:0/4047580537 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f86d00082b0 msgr2=0x7f86d003da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:01.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.045+0000 7f86ddef1640 1 --2- 172.21.15.57:0/4047580537 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f86d00082b0 0x7f86d003da50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f86cc0af000 tx=0x7f86cc01baf0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.045+0000 7f86ddef1640 1 -- 172.21.15.57:0/4047580537 shutdown_connections 2024-04-24T23:39:01.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.045+0000 7f86ddef1640 1 --2- 172.21.15.57:0/4047580537 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f86bc067940 0x7f86bc069e00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.045+0000 7f86ddef1640 1 --2- 172.21.15.57:0/4047580537 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86d0047920 0x7f86d00cfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.045+0000 7f86ddef1640 1 --2- 172.21.15.57:0/4047580537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86d0046dd0 0x7f86d00cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.045+0000 7f86ddef1640 1 --2- 172.21.15.57:0/4047580537 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f86d00082b0 0x7f86d003da50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.045+0000 7f86ddef1640 1 -- 172.21.15.57:0/4047580537 >> 172.21.15.57:0/4047580537 conn(0x7f86d0007790 msgr2=0x7f86d00435f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:01.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.045+0000 7f86ddef1640 1 -- 172.21.15.57:0/4047580537 shutdown_connections 2024-04-24T23:39:01.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.045+0000 7f86ddef1640 1 -- 172.21.15.57:0/4047580537 wait complete. 2024-04-24T23:39:01.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.049+0000 7fe86f111640 1 -- 172.21.15.57:0/1124563735 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fe86814de90 con 0x7fe8681da020 2024-04-24T23:39:01.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.049+0000 7fe8657fa640 1 -- 172.21.15.57:0/1124563735 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe860016c50 con 0x7fe8681da020 2024-04-24T23:39:01.053 INFO:teuthology.orchestra.run.smithi057.stdout:55834574856 2024-04-24T23:39:01.055 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2024-04-24T23:39:01.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.053+0000 7fe86f111640 1 -- 172.21.15.57:0/1124563735 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fe8540679c0 msgr2=0x7fe854069e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:01.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.053+0000 7fe86f111640 1 --2- 172.21.15.57:0/1124563735 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fe8540679c0 0x7fe854069e80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe868152cd0 tx=0x7fe85c009040 comp rx=0 tx=0).stop 2024-04-24T23:39:01.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.053+0000 7fe86f111640 1 -- 172.21.15.57:0/1124563735 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8681da020 msgr2=0x7fe8681e8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:01.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.053+0000 7fe86f111640 1 --2- 172.21.15.57:0/1124563735 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8681da020 0x7fe8681e8aa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe86001cd70 tx=0x7fe850003740 comp rx=0 tx=0).stop 2024-04-24T23:39:01.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.053+0000 7fe86f111640 1 -- 172.21.15.57:0/1124563735 shutdown_connections 2024-04-24T23:39:01.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.053+0000 7fe86f111640 1 --2- 172.21.15.57:0/1124563735 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fe8540679c0 0x7fe854069e80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.053+0000 7fe86f111640 1 --2- 172.21.15.57:0/1124563735 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe868150b90 0x7fe868151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.053+0000 7fe86f111640 1 --2- 172.21.15.57:0/1124563735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8681e4ee0 0x7fe8681e8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.053+0000 7fe86f111640 1 --2- 172.21.15.57:0/1124563735 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8681da020 0x7fe8681e8aa0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.053+0000 7fe86f111640 1 -- 172.21.15.57:0/1124563735 >> 172.21.15.57:0/1124563735 conn(0x7fe8680be8f0 msgr2=0x7fe868148d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:01.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.053+0000 7fe86f111640 1 -- 172.21.15.57:0/1124563735 shutdown_connections 2024-04-24T23:39:01.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.053+0000 7fe86f111640 1 -- 172.21.15.57:0/1124563735 wait complete. 2024-04-24T23:39:01.066 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.5 2024-04-24T23:39:01.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.065+0000 7f8d35b46640 1 -- 172.21.15.57:0/3769860415 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8d10005860 con 0x7f8d300bcf60 2024-04-24T23:39:01.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.065+0000 7f8d2d7fa640 1 -- 172.21.15.57:0/3769860415 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8d1c057670 con 0x7f8d300bcf60 2024-04-24T23:39:01.068 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.3 2024-04-24T23:39:01.068 INFO:teuthology.orchestra.run.smithi057.stdout:55834574857 2024-04-24T23:39:01.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.069+0000 7f8d35b46640 1 -- 172.21.15.57:0/3769860415 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f8d140678c0 msgr2=0x7f8d14069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:01.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.069+0000 7f8d35b46640 1 --2- 172.21.15.57:0/3769860415 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f8d140678c0 0x7f8d14069d80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8d24000c10 tx=0x7f8d240a7000 comp rx=0 tx=0).stop 2024-04-24T23:39:01.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.069+0000 7f8d35b46640 1 -- 172.21.15.57:0/3769860415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d300bcf60 msgr2=0x7f8d300bb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:01.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.069+0000 7f8d35b46640 1 --2- 172.21.15.57:0/3769860415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d300bcf60 0x7f8d300bb6a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00d5f0 tx=0x7f8d1c00dab0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.069+0000 7f8d35b46640 1 -- 172.21.15.57:0/3769860415 shutdown_connections 2024-04-24T23:39:01.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.069+0000 7f8d35b46640 1 --2- 172.21.15.57:0/3769860415 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f8d140678c0 0x7f8d14069d80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.069+0000 7f8d35b46640 1 --2- 172.21.15.57:0/3769860415 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d300c0cc0 0x7f8d300bbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.069+0000 7f8d35b46640 1 --2- 172.21.15.57:0/3769860415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d300bcf60 0x7f8d300bb6a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.069+0000 7f8d35b46640 1 --2- 172.21.15.57:0/3769860415 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d300725c0 0x7f8d301518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:01.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.069+0000 7f8d35b46640 1 -- 172.21.15.57:0/3769860415 >> 172.21.15.57:0/3769860415 conn(0x7f8d300be650 msgr2=0x7f8d3014d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:01.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.069+0000 7f8d35b46640 1 -- 172.21.15.57:0/3769860415 shutdown_connections 2024-04-24T23:39:01.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:01.069+0000 7f8d35b46640 1 -- 172.21.15.57:0/3769860415 wait complete. 2024-04-24T23:39:01.076 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.2 2024-04-24T23:39:01.076 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2024-04-24T23:39:01.082 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.1 2024-04-24T23:39:01.086 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.0 2024-04-24T23:39:02.006 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-24T23:39:02.056 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-24T23:39:02.067 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-24T23:39:02.069 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-24T23:39:02.076 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-24T23:39:02.077 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-24T23:39:02.083 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-24T23:39:02.087 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-24T23:39:02.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.161+0000 7f5e61bdd640 1 Processor -- start 2024-04-24T23:39:02.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.161+0000 7f5e61bdd640 1 -- start start 2024-04-24T23:39:02.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.165+0000 7f5e61bdd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5e5c149fb0 0x7f5e5c14c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.165+0000 7f5e61bdd640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e5c06ec70 0x7f5e5c14cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.165+0000 7f5e61bdd640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e5c0bc040 con 0x7f5e5c149bd0 2024-04-24T23:39:02.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.165+0000 7f5e61bdd640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f5e5c0bbdf0 con 0x7f5e5c149fb0 2024-04-24T23:39:02.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.165+0000 7f5e61bdd640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f5e5c1505d0 con 0x7f5e5c06ec70 2024-04-24T23:39:02.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.165+0000 7f5e5affd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5e5c149fb0 0x7f5e5c14c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.165+0000 7f5e5affd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5e5c149fb0 0x7f5e5c14c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60196/0 (socket says 172.21.15.57:60196) 2024-04-24T23:39:02.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.165+0000 7f5e5affd640 1 -- 172.21.15.57:0/3085049414 learned_addr learned my addr 172.21.15.57:0/3085049414 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:02.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.165+0000 7f5e5bfff640 1 --2- 172.21.15.57:0/3085049414 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e5c06ec70 0x7f5e5c14cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.165+0000 7f5e5affd640 1 -- 172.21.15.57:0/3085049414 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e5c06ec70 msgr2=0x7f5e5c14cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:02.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.165+0000 7f5e5affd640 1 --2- 172.21.15.57:0/3085049414 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e5c06ec70 0x7f5e5c14cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.165+0000 7f5e5affd640 1 -- 172.21.15.57:0/3085049414 >> v1:172.21.15.88:6789/0 conn(0x7f5e5c149bd0 legacy=0x7f5e5c0bd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:02.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.165+0000 7f5e5affd640 1 -- 172.21.15.57:0/3085049414 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e5c0bdf10 con 0x7f5e5c149fb0 2024-04-24T23:39:02.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.169+0000 7f5e5affd640 1 --2- 172.21.15.57:0/3085049414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e5c149fb0 0x7f5e5c14c6a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5e54009bd0 tx=0x7f5e5401de00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e16008b34ac40f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:02.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.169+0000 7f5e5a7fc640 1 -- 172.21.15.57:0/3085049414 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e540a6a40 con 0x7f5e5c149fb0 2024-04-24T23:39:02.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.169+0000 7f5e5a7fc640 1 -- 172.21.15.57:0/3085049414 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e540a6be0 con 0x7f5e5c149fb0 2024-04-24T23:39:02.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.169+0000 7f5e61bdd640 1 -- 172.21.15.57:0/3085049414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e5c149fb0 msgr2=0x7f5e5c14c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.169+0000 7f5e61bdd640 1 --2- 172.21.15.57:0/3085049414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e5c149fb0 0x7f5e5c14c6a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5e54009bd0 tx=0x7f5e5401de00 comp rx=0 tx=0).stop 2024-04-24T23:39:02.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.169+0000 7f5e61bdd640 1 -- 172.21.15.57:0/3085049414 shutdown_connections 2024-04-24T23:39:02.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.169+0000 7f5e61bdd640 1 --2- 172.21.15.57:0/3085049414 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e5c06ec70 0x7f5e5c14cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.169+0000 7f5e61bdd640 1 --2- 172.21.15.57:0/3085049414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e5c149fb0 0x7f5e5c14c6a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.169+0000 7f5e61bdd640 1 -- 172.21.15.57:0/3085049414 >> 172.21.15.57:0/3085049414 conn(0x7f5e5c0be8f0 msgr2=0x7f5e5c0becd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:02.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.169+0000 7f5e61bdd640 1 -- 172.21.15.57:0/3085049414 shutdown_connections 2024-04-24T23:39:02.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.169+0000 7f5e61bdd640 1 -- 172.21.15.57:0/3085049414 wait complete. 2024-04-24T23:39:02.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.173+0000 7f5e61bdd640 1 Processor -- start 2024-04-24T23:39:02.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.173+0000 7f5e61bdd640 1 -- start start 2024-04-24T23:39:02.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.173+0000 7f5e61bdd640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e5c06ec70 0x7f5e5c15b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.173+0000 7f5e61bdd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e5c149bd0 0x7f5e5c148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.173+0000 7f5e61bdd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e5c14f840 0x7f5e5c0c0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.173+0000 7f5e61bdd640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5c1596d0 con 0x7f5e5c149bd0 2024-04-24T23:39:02.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.173+0000 7f5e61bdd640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5c06e970 con 0x7f5e5c14f840 2024-04-24T23:39:02.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.173+0000 7f5e61bdd640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f5e5c159850 con 0x7f5e5c06ec70 2024-04-24T23:39:02.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.173+0000 7f5e5b7fe640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e5c06ec70 0x7f5e5c15b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.173+0000 7f5e5affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e5c149bd0 0x7f5e5c148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.173+0000 7f5e5b7fe640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e5c06ec70 0x7f5e5c15b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.57:32920/0 (socket says 172.21.15.57:32920) 2024-04-24T23:39:02.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.173+0000 7f5e5b7fe640 1 -- 172.21.15.57:0/112819632 learned_addr learned my addr 172.21.15.57:0/112819632 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:02.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.173+0000 7f5e5affd640 1 -- 172.21.15.57:0/112819632 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e5c06ec70 msgr2=0x7f5e5c15b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.173+0000 7f5e5affd640 1 --2- 172.21.15.57:0/112819632 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e5c06ec70 0x7f5e5c15b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.173+0000 7f5e5affd640 1 -- 172.21.15.57:0/112819632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e5c14f840 msgr2=0x7f5e5c0c0b00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-24T23:39:02.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.173+0000 7f5e5affd640 1 --2- 172.21.15.57:0/112819632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e5c14f840 0x7f5e5c0c0b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.173+0000 7f5e5affd640 1 -- 172.21.15.57:0/112819632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e5c1485a0 con 0x7f5e5c149bd0 2024-04-24T23:39:02.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.173+0000 7f5e5affd640 1 --2- 172.21.15.57:0/112819632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e5c149bd0 0x7f5e5c148060 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5e540ac000 tx=0x7f5e5401aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:02.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.177+0000 7f5e4bfff640 1 -- 172.21.15.57:0/112819632 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e540bd070 con 0x7f5e5c149bd0 2024-04-24T23:39:02.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.177+0000 7f5e61bdd640 1 -- 172.21.15.57:0/112819632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e5c14f3f0 con 0x7f5e5c149bd0 2024-04-24T23:39:02.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.177+0000 7f5e61bdd640 1 -- 172.21.15.57:0/112819632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e5c0c1040 con 0x7f5e5c149bd0 2024-04-24T23:39:02.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.177+0000 7f5e4bfff640 1 -- 172.21.15.57:0/112819632 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e540aea60 con 0x7f5e5c149bd0 2024-04-24T23:39:02.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.177+0000 7f5e4bfff640 1 -- 172.21.15.57:0/112819632 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e540aee50 con 0x7f5e5c149bd0 2024-04-24T23:39:02.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.177+0000 7f5e4bfff640 1 -- 172.21.15.57:0/112819632 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5e540a6b00 con 0x7f5e5c149bd0 2024-04-24T23:39:02.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.181+0000 7f5e4bfff640 1 --2- 172.21.15.57:0/112819632 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f5e44067cb0 0x7f5e4406a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.181+0000 7f5e4bfff640 1 -- 172.21.15.57:0/112819632 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5e54120860 con 0x7f5e5c149bd0 2024-04-24T23:39:02.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.181+0000 7f5e5b7fe640 1 --2- 172.21.15.57:0/112819632 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f5e44067cb0 0x7f5e4406a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.181+0000 7f5e61bdd640 1 -- 172.21.15.57:0/112819632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e380052a0 con 0x7f5e5c149bd0 2024-04-24T23:39:02.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.181+0000 7f5e5b7fe640 1 --2- 172.21.15.57:0/112819632 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f5e44067cb0 0x7f5e4406a170 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c0050b0 tx=0x7f5e4c003700 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:02.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.189+0000 7f5e4bfff640 1 -- 172.21.15.57:0/112819632 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f5e5c1485a0 con 0x7f5e5c149bd0 2024-04-24T23:39:02.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.237+0000 7fa558149640 1 Processor -- start 2024-04-24T23:39:02.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.237+0000 7fa558149640 1 -- start start 2024-04-24T23:39:02.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.241+0000 7fa558149640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa5500bf3e0 0x7fa550149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.241+0000 7fa558149640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa55006ec70 0x7fa5500bd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.241+0000 7fa558149640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5500bc040 con 0x7fa5500bdd40 2024-04-24T23:39:02.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.241+0000 7fa558149640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fa5500bba60 con 0x7fa5500bf3e0 2024-04-24T23:39:02.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.241+0000 7fa558149640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fa5500bbdf0 con 0x7fa55006ec70 2024-04-24T23:39:02.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.241+0000 7fa555ee5640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa5500bf3e0 0x7fa550149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.241+0000 7fa5556e4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa55006ec70 0x7fa5500bd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.241+0000 7fa5556e4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa55006ec70 0x7fa5500bd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.57:60142/0 (socket says 172.21.15.57:60142) 2024-04-24T23:39:02.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.241+0000 7fa5556e4640 1 -- 172.21.15.57:0/2347427807 learned_addr learned my addr 172.21.15.57:0/2347427807 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:02.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.241+0000 7fa5556e4640 1 -- 172.21.15.57:0/2347427807 >> v2:172.21.15.57:3300/0 conn(0x7fa5500bf3e0 msgr2=0x7fa550149bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:02.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.241+0000 7fa5556e4640 1 --2- 172.21.15.57:0/2347427807 >> v2:172.21.15.57:3300/0 conn(0x7fa5500bf3e0 0x7fa550149bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.241+0000 7fa5556e4640 1 -- 172.21.15.57:0/2347427807 >> v1:172.21.15.57:6789/0 conn(0x7fa5500bdd40 legacy=0x7fa55014c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.241+0000 7fa5556e4640 1 -- 172.21.15.57:0/2347427807 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5501505d0 con 0x7fa55006ec70 2024-04-24T23:39:02.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.245+0000 7fa555ee5640 1 --2- 172.21.15.57:0/2347427807 >> v2:172.21.15.57:3300/0 conn(0x7fa5500bf3e0 0x7fa550149bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:39:02.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.245+0000 7fa5556e4640 1 --2- 172.21.15.57:0/2347427807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa55006ec70 0x7fa5500bd800 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa55006c6b0 tx=0x7fa54801c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfe5c1a58a84be04 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:02.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.245+0000 7fa554ee3640 1 -- 172.21.15.57:0/2347427807 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5480090d0 con 0x7fa55006ec70 2024-04-24T23:39:02.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.245+0000 7fa554ee3640 1 -- 172.21.15.57:0/2347427807 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5480a5770 con 0x7fa55006ec70 2024-04-24T23:39:02.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.245+0000 7fa558149640 1 -- 172.21.15.57:0/2347427807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa55006ec70 msgr2=0x7fa5500bd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.245+0000 7fa558149640 1 --2- 172.21.15.57:0/2347427807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa55006ec70 0x7fa5500bd800 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa55006c6b0 tx=0x7fa54801c9a0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.245+0000 7fa558149640 1 -- 172.21.15.57:0/2347427807 shutdown_connections 2024-04-24T23:39:02.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.245+0000 7fa558149640 1 --2- 172.21.15.57:0/2347427807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa55006ec70 0x7fa5500bd800 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.245+0000 7fa558149640 1 --2- 172.21.15.57:0/2347427807 >> v2:172.21.15.57:3300/0 conn(0x7fa5500bf3e0 0x7fa550149bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.245+0000 7fa558149640 1 -- 172.21.15.57:0/2347427807 >> 172.21.15.57:0/2347427807 conn(0x7fa5500be8f0 msgr2=0x7fa5500becd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:02.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.245+0000 7fa558149640 1 -- 172.21.15.57:0/2347427807 shutdown_connections 2024-04-24T23:39:02.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.245+0000 7fa558149640 1 -- 172.21.15.57:0/2347427807 wait complete. 2024-04-24T23:39:02.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.249+0000 7fa558149640 1 Processor -- start 2024-04-24T23:39:02.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.249+0000 7fa558149640 1 -- start start 2024-04-24T23:39:02.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.249+0000 7fa558149640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa5500bdd40 0x7fa550141f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.249+0000 7fa558149640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5500bf3e0 0x7fa5500c0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.249+0000 7fa558149640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa55014ef30 0x7fa5500c1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.249+0000 7fa558149640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa550151000 con 0x7fa55014ef30 2024-04-24T23:39:02.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.249+0000 7fa558149640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa550150e80 con 0x7fa5500bf3e0 2024-04-24T23:39:02.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.249+0000 7fa558149640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fa550151180 con 0x7fa5500bdd40 2024-04-24T23:39:02.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.249+0000 7fa5556e4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5500bf3e0 0x7fa5500c0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.249+0000 7fa5556e4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5500bf3e0 0x7fa5500c0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.57:60154/0 (socket says 172.21.15.57:60154) 2024-04-24T23:39:02.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.249+0000 7fa5556e4640 1 -- 172.21.15.57:0/4089202602 learned_addr learned my addr 172.21.15.57:0/4089202602 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:02.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.249+0000 7fa555ee5640 1 --2- 172.21.15.57:0/4089202602 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa5500bdd40 0x7fa550141f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.253+0000 7fa5566e6640 1 --2- 172.21.15.57:0/4089202602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa55014ef30 0x7fa5500c1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.253+0000 7fa5556e4640 1 -- 172.21.15.57:0/4089202602 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa5500bdd40 msgr2=0x7fa550141f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.253+0000 7fa5556e4640 1 --2- 172.21.15.57:0/4089202602 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa5500bdd40 0x7fa550141f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.253+0000 7fa5556e4640 1 -- 172.21.15.57:0/4089202602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa55014ef30 msgr2=0x7fa5500c1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.253+0000 7fa5556e4640 1 --2- 172.21.15.57:0/4089202602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa55014ef30 0x7fa5500c1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.253+0000 7fa5556e4640 1 -- 172.21.15.57:0/4089202602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa550142480 con 0x7fa5500bf3e0 2024-04-24T23:39:02.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.253+0000 7fa5556e4640 1 --2- 172.21.15.57:0/4089202602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5500bf3e0 0x7fa5500c0b00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa54801c9e0 tx=0x7fa548019740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:02.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.253+0000 7fa5467fc640 1 -- 172.21.15.57:0/4089202602 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5480bc020 con 0x7fa5500bf3e0 2024-04-24T23:39:02.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.253+0000 7fa558149640 1 -- 172.21.15.57:0/4089202602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa550141980 con 0x7fa5500bf3e0 2024-04-24T23:39:02.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.253+0000 7fa558149640 1 -- 172.21.15.57:0/4089202602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa55014f800 con 0x7fa5500bf3e0 2024-04-24T23:39:02.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.253+0000 7fa5467fc640 1 -- 172.21.15.57:0/4089202602 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa548003db0 con 0x7fa5500bf3e0 2024-04-24T23:39:02.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.253+0000 7fa5467fc640 1 -- 172.21.15.57:0/4089202602 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa548004260 con 0x7fa5500bf3e0 2024-04-24T23:39:02.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.257+0000 7fa5467fc640 1 -- 172.21.15.57:0/4089202602 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa5480bf020 con 0x7fa5500bf3e0 2024-04-24T23:39:02.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.257+0000 7fa5467fc640 1 --2- 172.21.15.57:0/4089202602 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa534067990 0x7fa534069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.257+0000 7fa5467fc640 1 -- 172.21.15.57:0/4089202602 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa548120e20 con 0x7fa5500bf3e0 2024-04-24T23:39:02.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.257+0000 7fa555ee5640 1 --2- 172.21.15.57:0/4089202602 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa534067990 0x7fa534069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.257+0000 7fa558149640 1 -- 172.21.15.57:0/4089202602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5380052a0 con 0x7fa5500bf3e0 2024-04-24T23:39:02.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.261+0000 7fa555ee5640 1 --2- 172.21.15.57:0/4089202602 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa534067990 0x7fa534069e50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa54c009580 tx=0x7fa54c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:02.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.273+0000 7fa5467fc640 1 -- 172.21.15.57:0/4089202602 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fa5480c6030 con 0x7fa5500bf3e0 2024-04-24T23:39:02.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.281+0000 7f0c81f2f640 1 Processor -- start 2024-04-24T23:39:02.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.281+0000 7f0c81f2f640 1 -- start start 2024-04-24T23:39:02.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.281+0000 7f0c81f2f640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0c7c072200 0x7f0c7c14d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.281+0000 7f0c81f2f640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c7c0bd870 con 0x7f0c7c0bf3a0 2024-04-24T23:39:02.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.281+0000 7f0c81f2f640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c7c0bdb10 con 0x7f0c7c06e520 2024-04-24T23:39:02.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.281+0000 7f0c81f2f640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f0c7c14e350 con 0x7f0c7c072200 2024-04-24T23:39:02.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.281+0000 7f0c7bfff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0c7c0bf3a0 0x7f0c7c14a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53102/0 (socket says 172.21.15.57:53102) 2024-04-24T23:39:02.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.281+0000 7f0c7bfff640 1 -- 172.21.15.57:0/3134637105 learned_addr learned my addr 172.21.15.57:0/3134637105 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:02.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.281+0000 7f0c7b7fe640 1 --2- 172.21.15.57:0/3134637105 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0c7c072200 0x7f0c7c14d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7fb3aa9ec640 1 Processor -- start 2024-04-24T23:39:02.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f0c7a7fc640 1 -- 172.21.15.57:0/3134637105 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 498169119 0 0) 0x7f0c7c0bd870 con 0x7f0c7c0bf3a0 2024-04-24T23:39:02.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f0c7a7fc640 1 -- 172.21.15.57:0/3134637105 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c64003530 con 0x7f0c7c0bf3a0 2024-04-24T23:39:02.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.281+0000 7f81ca23d640 1 Processor -- start 2024-04-24T23:39:02.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.281+0000 7f81ca23d640 1 -- start start 2024-04-24T23:39:02.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7fb3aa9ec640 1 -- start start 2024-04-24T23:39:02.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f0c7b7fe640 1 -- 172.21.15.57:0/3134637105 >> v1:172.21.15.88:6789/0 conn(0x7f0c7c06e520 legacy=0x7f0c7c0be8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f0c7b7fe640 1 -- 172.21.15.57:0/3134637105 >> v1:172.21.15.57:6789/0 conn(0x7f0c7c0bf3a0 legacy=0x7f0c7c14a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f0c7b7fe640 1 -- 172.21.15.57:0/3134637105 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c7c0bddf0 con 0x7f0c7c072200 2024-04-24T23:39:02.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81ca23d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f81c406f200 0x7f81c40bd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81ca23d640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f81c40bdcb0 0x7f81c40bae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81ca23d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81c40721f0 con 0x7f81c40bb3b0 2024-04-24T23:39:02.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81ca23d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f81c4072560 con 0x7f81c406f200 2024-04-24T23:39:02.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81ca23d640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f81c408ab50 con 0x7f81c40bdcb0 2024-04-24T23:39:02.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7fb3aa9ec640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb3a40bf3e0 0x7fb3a4149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7fb3aa9ec640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb3a406ec70 0x7fb3a40bd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7fb3aa9ec640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3a40bc040 con 0x7fb3a40bdd40 2024-04-24T23:39:02.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7fb3aa9ec640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fb3a40bbdf0 con 0x7fb3a406ec70 2024-04-24T23:39:02.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7fb3aa9ec640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fb3a41505d0 con 0x7fb3a40bf3e0 2024-04-24T23:39:02.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81c923b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f81c406f200 0x7f81c40bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81c923b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f81c406f200 0x7f81c40bd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60224/0 (socket says 172.21.15.57:60224) 2024-04-24T23:39:02.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81c923b640 1 -- 172.21.15.57:0/160806462 learned_addr learned my addr 172.21.15.57:0/160806462 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:02.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81c8a3a640 1 --2- 172.21.15.57:0/160806462 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f81c40bdcb0 0x7f81c40bae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7fb3a3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb3a40bf3e0 0x7fb3a4149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7fb3a8f89640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb3a40bdd40 0x7fb3a414c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53104/0 (socket says 172.21.15.57:53104) 2024-04-24T23:39:02.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7fb3a8f89640 1 -- 172.21.15.57:0/1037529583 learned_addr learned my addr 172.21.15.57:0/1037529583 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:02.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7fb3a37fe640 1 --2- 172.21.15.57:0/1037529583 >> v2:172.21.15.57:3300/0 conn(0x7fb3a406ec70 0x7fb3a40bd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81bbfff640 1 -- 172.21.15.57:0/160806462 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3042325291 0 0) 0x7f81c40721f0 con 0x7f81c40bb3b0 2024-04-24T23:39:02.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81bbfff640 1 -- 172.21.15.57:0/160806462 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81b0003530 con 0x7f81c40bb3b0 2024-04-24T23:39:02.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f380007c640 1 Processor -- start 2024-04-24T23:39:02.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7fb3a3fff640 1 -- 172.21.15.57:0/1037529583 >> v2:172.21.15.57:3300/0 conn(0x7fb3a406ec70 msgr2=0x7fb3a40bd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:02.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7fb3a3fff640 1 --2- 172.21.15.57:0/1037529583 >> v2:172.21.15.57:3300/0 conn(0x7fb3a406ec70 0x7fb3a40bd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7fb3a3fff640 1 -- 172.21.15.57:0/1037529583 >> v1:172.21.15.57:6789/0 conn(0x7fb3a40bdd40 legacy=0x7fb3a414c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:02.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7fb3a3fff640 1 -- 172.21.15.57:0/1037529583 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a414a110 con 0x7fb3a40bf3e0 2024-04-24T23:39:02.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f380007c640 1 -- start start 2024-04-24T23:39:02.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81bbfff640 1 -- 172.21.15.57:0/160806462 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 627581260 0 0) 0x7f81b0003530 con 0x7f81c40bb3b0 2024-04-24T23:39:02.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81bbfff640 1 -- 172.21.15.57:0/160806462 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f81c40bdcb0 msgr2=0x7f81c40bae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:02.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81bbfff640 1 --2- 172.21.15.57:0/160806462 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f81c40bdcb0 0x7f81c40bae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81bbfff640 1 -- 172.21.15.57:0/160806462 >> v2:172.21.15.57:3300/0 conn(0x7f81c406f200 msgr2=0x7f81c40bd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:02.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81bbfff640 1 --2- 172.21.15.57:0/160806462 >> v2:172.21.15.57:3300/0 conn(0x7f81c406f200 0x7f81c40bd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81bbfff640 1 -- 172.21.15.57:0/160806462 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c408ad00 con 0x7f81c40bb3b0 2024-04-24T23:39:02.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81bbfff640 1 -- 172.21.15.57:0/160806462 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7f81bc001a00 con 0x7f81c40bb3b0 2024-04-24T23:39:02.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81bbfff640 1 -- 172.21.15.57:0/160806462 >> v1:172.21.15.88:6789/0 conn(0x7f81c40bb3b0 legacy=0x7f81c4160be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81bbfff640 1 --2- 172.21.15.57:0/160806462 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f81b0003aa0 0x7f81b0003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81bbfff640 1 --2- 172.21.15.57:0/160806462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81b0004810 0x7f81b0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81bbfff640 1 --2- 172.21.15.57:0/160806462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81b00051d0 0x7f81b000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81bbfff640 1 -- 172.21.15.57:0/160806462 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f81c4072560 con 0x7f81b0004810 2024-04-24T23:39:02.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81bbfff640 1 -- 172.21.15.57:0/160806462 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f81c408ab50 con 0x7f81b00051d0 2024-04-24T23:39:02.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81bbfff640 1 -- 172.21.15.57:0/160806462 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f81b000c010 con 0x7f81b0003aa0 2024-04-24T23:39:02.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81c8a3a640 1 --2- 172.21.15.57:0/160806462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81b0004810 0x7f81b0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81c9a3c640 1 --2- 172.21.15.57:0/160806462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81b00051d0 0x7f81b000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81c923b640 1 --2- 172.21.15.57:0/160806462 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f81b0003aa0 0x7f81b0003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81c8a3a640 1 -- 172.21.15.57:0/160806462 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f81b0003aa0 msgr2=0x7f81b0003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:02.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81c8a3a640 1 --2- 172.21.15.57:0/160806462 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f81b0003aa0 0x7f81b0003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81c8a3a640 1 -- 172.21.15.57:0/160806462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81b00051d0 msgr2=0x7f81b000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:02.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81c8a3a640 1 --2- 172.21.15.57:0/160806462 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81b00051d0 0x7f81b000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7ff31216f640 1 Processor -- start 2024-04-24T23:39:02.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7ff31216f640 1 -- start start 2024-04-24T23:39:02.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7ff31216f640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff30c06ef30 0x7ff30c158370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7ff31216f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff30c06dcd0 0x7ff30c1588b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7ff31216f640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff30c06e1f0 con 0x7ff30c152350 2024-04-24T23:39:02.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7ff31216f640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7ff30c071930 con 0x7ff30c06ef30 2024-04-24T23:39:02.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7ff31216f640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7ff30c06e590 con 0x7ff30c06dcd0 2024-04-24T23:39:02.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f0c7b7fe640 1 --2- 172.21.15.57:0/3134637105 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0c7c072200 0x7f0c7c14d3a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0c70009820 tx=0x7f0c7001ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50c3e9bc993e5f6e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:02.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7f0c7a7fc640 1 -- 172.21.15.57:0/3134637105 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c700b5070 con 0x7f0c7c072200 2024-04-24T23:39:02.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7f0c7a7fc640 1 -- 172.21.15.57:0/3134637105 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c700a8970 con 0x7f0c7c072200 2024-04-24T23:39:02.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7f0c7a7fc640 1 -- 172.21.15.57:0/3134637105 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c700a8d20 con 0x7f0c7c072200 2024-04-24T23:39:02.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7f0c81f2f640 1 -- 172.21.15.57:0/3134637105 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0c7c072200 msgr2=0x7f0c7c14d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7f0c81f2f640 1 --2- 172.21.15.57:0/3134637105 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0c7c072200 0x7f0c7c14d3a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0c70009820 tx=0x7f0c7001ec70 comp rx=0 tx=0).stop 2024-04-24T23:39:02.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f380007c640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37f80ba3d0 0x7f37f814db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7f0c81f2f640 1 -- 172.21.15.57:0/3134637105 shutdown_connections 2024-04-24T23:39:02.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7f0c81f2f640 1 --2- 172.21.15.57:0/3134637105 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0c7c072200 0x7f0c7c14d3a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7f0c81f2f640 1 -- 172.21.15.57:0/3134637105 >> 172.21.15.57:0/3134637105 conn(0x7f0c7c0c2e70 msgr2=0x7f0c7c0c3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:02.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7ff303fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff30c06ef30 0x7ff30c158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7f37fde18640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37f80ba3d0 0x7f37f814db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7f380007c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f37f814e050 0x7f37f80b9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7f37fde18640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37f80ba3d0 0x7f37f814db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.57:32960/0 (socket says 172.21.15.57:32960) 2024-04-24T23:39:02.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7f37fd617640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f37f80b85d0 0x7f37f80b8c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53112/0 (socket says 172.21.15.57:53112) 2024-04-24T23:39:02.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7ff303fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff30c06ef30 0x7ff30c158370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60244/0 (socket says 172.21.15.57:60244) 2024-04-24T23:39:02.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7ff303fff640 1 -- 172.21.15.57:0/3068912905 learned_addr learned my addr 172.21.15.57:0/3068912905 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:02.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7ff30bfff640 1 --2- 172.21.15.57:0/3068912905 >> v2:172.21.15.88:3300/0 conn(0x7ff30c06dcd0 0x7ff30c1588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7f380007c640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37f80c2770 con 0x7f37f80b85d0 2024-04-24T23:39:02.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7fb3a3fff640 1 --2- 172.21.15.57:0/1037529583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3a40bf3e0 0x7fb3a4149bd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb3a406c6b0 tx=0x7fb39401c300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6a68dd546bcace2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:02.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7f380007c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f37f8151720 con 0x7f37f814e050 2024-04-24T23:39:02.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.285+0000 7f81c8a3a640 1 -- 172.21.15.57:0/160806462 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b0003530 con 0x7f81b0004810 2024-04-24T23:39:02.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7f380007c640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f37f80c2a10 con 0x7f37f80ba3d0 2024-04-24T23:39:02.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7f37fde18640 1 -- 172.21.15.57:0/4243878916 learned_addr learned my addr 172.21.15.57:0/4243878916 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:02.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7f0c81f2f640 1 -- 172.21.15.57:0/3134637105 shutdown_connections 2024-04-24T23:39:02.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7f37fe619640 1 --2- 172.21.15.57:0/4243878916 >> v2:172.21.15.88:3300/0 conn(0x7f37f814e050 0x7f37f80b9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7ff303fff640 1 -- 172.21.15.57:0/3068912905 >> v2:172.21.15.88:3300/0 conn(0x7ff30c06dcd0 msgr2=0x7ff30c1588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:02.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7ff303fff640 1 --2- 172.21.15.57:0/3068912905 >> v2:172.21.15.88:3300/0 conn(0x7ff30c06dcd0 0x7ff30c1588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7ff303fff640 1 -- 172.21.15.57:0/3068912905 >> v1:172.21.15.88:6789/0 conn(0x7ff30c152350 legacy=0x7ff30c071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:02.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7ff303fff640 1 -- 172.21.15.57:0/3068912905 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30c06e830 con 0x7ff30c06ef30 2024-04-24T23:39:02.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7f37fce16640 1 -- 172.21.15.57:0/4243878916 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3038981160 0 0) 0x7f37f80c2770 con 0x7f37f80b85d0 2024-04-24T23:39:02.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7f37fce16640 1 -- 172.21.15.57:0/4243878916 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37e4003530 con 0x7f37f80b85d0 2024-04-24T23:39:02.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7f37fde18640 1 -- 172.21.15.57:0/4243878916 >> v2:172.21.15.88:3300/0 conn(0x7f37f814e050 msgr2=0x7f37f80b9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:02.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7f37fde18640 1 --2- 172.21.15.57:0/4243878916 >> v2:172.21.15.88:3300/0 conn(0x7f37f814e050 0x7f37f80b9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7f37fde18640 1 -- 172.21.15.57:0/4243878916 >> v1:172.21.15.57:6789/0 conn(0x7f37f80b85d0 legacy=0x7f37f80b8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7f37fde18640 1 -- 172.21.15.57:0/4243878916 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37f80c2cf0 con 0x7f37f80ba3d0 2024-04-24T23:39:02.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7f0c81f2f640 1 -- 172.21.15.57:0/3134637105 wait complete. 2024-04-24T23:39:02.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7f81c8a3a640 1 --2- 172.21.15.57:0/160806462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81b0004810 0x7f81b0004c90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f81c0016fb0 tx=0x7f81c0025190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59038ba28bb5160 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:02.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7f81bbfff640 1 -- 172.21.15.57:0/160806462 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c00ba070 con 0x7f81b0004810 2024-04-24T23:39:02.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7f81bbfff640 1 -- 172.21.15.57:0/160806462 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c00adc70 con 0x7f81b0004810 2024-04-24T23:39:02.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.289+0000 7f81bbfff640 1 -- 172.21.15.57:0/160806462 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c0016a20 con 0x7f81b0004810 2024-04-24T23:39:02.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7fb3a2ffd640 1 -- 172.21.15.57:0/1037529583 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3940b0070 con 0x7fb3a40bf3e0 2024-04-24T23:39:02.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f81ca23d640 1 -- 172.21.15.57:0/160806462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81b0004810 msgr2=0x7f81b0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f81ca23d640 1 --2- 172.21.15.57:0/160806462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81b0004810 0x7f81b0004c90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f81c0016fb0 tx=0x7f81c0025190 comp rx=0 tx=0).stop 2024-04-24T23:39:02.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f81c9a3c640 1 -- 172.21.15.57:0/160806462 reap_dead start 2024-04-24T23:39:02.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7fb3a2ffd640 1 -- 172.21.15.57:0/1037529583 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3940ab600 con 0x7fb3a40bf3e0 2024-04-24T23:39:02.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7fb3a2ffd640 1 -- 172.21.15.57:0/1037529583 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3940aba10 con 0x7fb3a40bf3e0 2024-04-24T23:39:02.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7fb3aa9ec640 1 -- 172.21.15.57:0/1037529583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3a40bf3e0 msgr2=0x7fb3a4149bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7fb3aa9ec640 1 --2- 172.21.15.57:0/1037529583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3a40bf3e0 0x7fb3a4149bd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb3a406c6b0 tx=0x7fb39401c300 comp rx=0 tx=0).stop 2024-04-24T23:39:02.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7ff303fff640 1 --2- 172.21.15.57:0/3068912905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff30c06ef30 0x7ff30c158370 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff30c0be130 tx=0x7ff2f401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3245821c19aca6f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:02.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7ff30affd640 1 -- 172.21.15.57:0/3068912905 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f40b0070 con 0x7ff30c06ef30 2024-04-24T23:39:02.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7ff30affd640 1 -- 172.21.15.57:0/3068912905 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f40ab600 con 0x7ff30c06ef30 2024-04-24T23:39:02.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7ff30affd640 1 -- 172.21.15.57:0/3068912905 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f40ab9d0 con 0x7ff30c06ef30 2024-04-24T23:39:02.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f0c81f2f640 1 Processor -- start 2024-04-24T23:39:02.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f0c81f2f640 1 -- start start 2024-04-24T23:39:02.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f81ca23d640 1 -- 172.21.15.57:0/160806462 shutdown_connections 2024-04-24T23:39:02.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f81ca23d640 1 -- 172.21.15.57:0/160806462 >> 172.21.15.57:0/160806462 conn(0x7f81c40be860 msgr2=0x7f81c40bec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:02.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7fb3aa9ec640 1 -- 172.21.15.57:0/1037529583 shutdown_connections 2024-04-24T23:39:02.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7fb3aa9ec640 1 --2- 172.21.15.57:0/1037529583 >> v2:172.21.15.57:3300/0 conn(0x7fb3a406ec70 0x7fb3a40bd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7fb3aa9ec640 1 --2- 172.21.15.57:0/1037529583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3a40bf3e0 0x7fb3a4149bd0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7fb3aa9ec640 1 -- 172.21.15.57:0/1037529583 >> 172.21.15.57:0/1037529583 conn(0x7fb3a40be8f0 msgr2=0x7fb3a40becd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:02.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7fb3aa9ec640 1 -- 172.21.15.57:0/1037529583 shutdown_connections 2024-04-24T23:39:02.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f0c81f2f640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0c7c06e520 0x7f0c7c0babd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f32040ac640 1 Processor -- start 2024-04-24T23:39:02.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f32040ac640 1 -- start start 2024-04-24T23:39:02.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f81ca23d640 1 -- 172.21.15.57:0/160806462 shutdown_connections 2024-04-24T23:39:02.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f0c81f2f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c7c072200 0x7f0c7c1511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f0c81f2f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c7c0bf3a0 0x7f0c7c134730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f0c81f2f640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7c0725e0 con 0x7f0c7c072200 2024-04-24T23:39:02.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f0c81f2f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7c0be440 con 0x7f0c7c0bf3a0 2024-04-24T23:39:02.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f0c81f2f640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f0c7c072760 con 0x7f0c7c06e520 2024-04-24T23:39:02.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f37fde18640 1 --2- 172.21.15.57:0/4243878916 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37f80ba3d0 0x7f37f814db10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009870 tx=0x7f37f401c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11367ae75aa450ba server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:02.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7ff31216f640 1 -- 172.21.15.57:0/3068912905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff30c06ef30 msgr2=0x7ff30c158370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7ff31216f640 1 --2- 172.21.15.57:0/3068912905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff30c06ef30 0x7ff30c158370 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff30c0be130 tx=0x7ff2f401c470 comp rx=0 tx=0).stop 2024-04-24T23:39:02.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f0c7affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c7c072200 0x7f0c7c1511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f0c7bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c7c0bf3a0 0x7f0c7c134730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f0c7affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c7c072200 0x7f0c7c1511b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60248/0 (socket says 172.21.15.57:60248) 2024-04-24T23:39:02.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f0c7affd640 1 -- 172.21.15.57:0/4275981732 learned_addr learned my addr 172.21.15.57:0/4275981732 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:02.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f0c7b7fe640 1 --2- 172.21.15.57:0/4275981732 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0c7c06e520 0x7f0c7c0babd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7ff31216f640 1 -- 172.21.15.57:0/3068912905 shutdown_connections 2024-04-24T23:39:02.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7ff31216f640 1 --2- 172.21.15.57:0/3068912905 >> v2:172.21.15.88:3300/0 conn(0x7ff30c06dcd0 0x7ff30c1588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7ff31216f640 1 --2- 172.21.15.57:0/3068912905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff30c06ef30 0x7ff30c158370 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7ff31216f640 1 -- 172.21.15.57:0/3068912905 >> 172.21.15.57:0/3068912905 conn(0x7ff30c0be8f0 msgr2=0x7ff30c0bed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:02.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f37fce16640 1 -- 172.21.15.57:0/4243878916 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f40b0070 con 0x7f37f80ba3d0 2024-04-24T23:39:02.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f37fce16640 1 -- 172.21.15.57:0/4243878916 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f40ab600 con 0x7f37f80ba3d0 2024-04-24T23:39:02.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f37fce16640 1 -- 172.21.15.57:0/4243878916 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f40ab9d0 con 0x7f37f80ba3d0 2024-04-24T23:39:02.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7ff31216f640 1 -- 172.21.15.57:0/3068912905 shutdown_connections 2024-04-24T23:39:02.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7ff31216f640 1 -- 172.21.15.57:0/3068912905 wait complete. 2024-04-24T23:39:02.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f81ca23d640 1 -- 172.21.15.57:0/160806462 wait complete. 2024-04-24T23:39:02.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f0c7affd640 1 -- 172.21.15.57:0/4275981732 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0c7c06e520 msgr2=0x7f0c7c0babd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f0c7affd640 1 --2- 172.21.15.57:0/4275981732 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0c7c06e520 0x7f0c7c0babd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f0c7affd640 1 -- 172.21.15.57:0/4275981732 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c7c0bf3a0 msgr2=0x7f0c7c134730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f0c7affd640 1 --2- 172.21.15.57:0/4275981732 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c7c0bf3a0 0x7f0c7c134730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f0c7affd640 1 -- 172.21.15.57:0/4275981732 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c7c12e730 con 0x7f0c7c072200 2024-04-24T23:39:02.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f0c7affd640 1 --2- 172.21.15.57:0/4275981732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c7c072200 0x7f0c7c1511b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c00c500 tx=0x7f0c6c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:02.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7fb3aa9ec640 1 -- 172.21.15.57:0/1037529583 wait complete. 2024-04-24T23:39:02.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7fb3aa9ec640 1 Processor -- start 2024-04-24T23:39:02.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7fb3aa9ec640 1 -- start start 2024-04-24T23:39:02.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7fb3aa9ec640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3a406ec70 0x7fb3a414b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7fb3aa9ec640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb3a40bdd40 0x7fb3a413e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7fb3aa9ec640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3a40bf3e0 0x7fb3a4144d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7fb3aa9ec640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a4151a20 con 0x7fb3a406ec70 2024-04-24T23:39:02.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7fb3aa9ec640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a41518a0 con 0x7fb3a40bf3e0 2024-04-24T23:39:02.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7fb3aa9ec640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fb3a4151ba0 con 0x7fb3a40bdd40 2024-04-24T23:39:02.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7ff31216f640 1 Processor -- start 2024-04-24T23:39:02.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f0c63fff640 1 -- 172.21.15.57:0/4275981732 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c0052d0 con 0x7f0c7c072200 2024-04-24T23:39:02.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f0c81f2f640 1 -- 172.21.15.57:0/4275981732 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c7c14cd90 con 0x7f0c7c072200 2024-04-24T23:39:02.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f0c81f2f640 1 -- 172.21.15.57:0/4275981732 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c7c14d350 con 0x7f0c7c072200 2024-04-24T23:39:02.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f32040ac640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f31f40d2210 0x7f31f40dd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f32040ac640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31f400a9d0 con 0x7f31f40cf2a0 2024-04-24T23:39:02.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f32040ac640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31f400acb0 con 0x7f31f4042320 2024-04-24T23:39:02.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f32040ac640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f31f4009f80 con 0x7f31f40d2210 2024-04-24T23:39:02.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f3201e48640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f31f40cf2a0 0x7f31f4043110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53114/0 (socket says 172.21.15.57:53114) 2024-04-24T23:39:02.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f3201e48640 1 -- 172.21.15.57:0/107059770 learned_addr learned my addr 172.21.15.57:0/107059770 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:02.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f81ca23d640 1 Processor -- start 2024-04-24T23:39:02.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f380007c640 1 -- 172.21.15.57:0/4243878916 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37f80ba3d0 msgr2=0x7f37f814db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f380007c640 1 --2- 172.21.15.57:0/4243878916 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37f80ba3d0 0x7f37f814db10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009870 tx=0x7f37f401c520 comp rx=0 tx=0).stop 2024-04-24T23:39:02.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f380007c640 1 -- 172.21.15.57:0/4243878916 shutdown_connections 2024-04-24T23:39:02.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f380007c640 1 --2- 172.21.15.57:0/4243878916 >> v2:172.21.15.88:3300/0 conn(0x7f37f814e050 0x7f37f80b9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f380007c640 1 --2- 172.21.15.57:0/4243878916 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37f80ba3d0 0x7f37f814db10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f380007c640 1 -- 172.21.15.57:0/4243878916 >> 172.21.15.57:0/4243878916 conn(0x7f37f8066f50 msgr2=0x7f37f8067360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:02.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f3202649640 1 --2- 172.21.15.57:0/107059770 >> v2:172.21.15.57:3300/0 conn(0x7f31f40d2210 0x7f31f40dd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7ff31216f640 1 -- start start 2024-04-24T23:39:02.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7fb3a37fe640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb3a40bdd40 0x7fb3a413e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7fb3a8f89640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3a40bf3e0 0x7fb3a4144d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7fb3a37fe640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb3a40bdd40 0x7fb3a413e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.57:32980/0 (socket says 172.21.15.57:32980) 2024-04-24T23:39:02.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7fb3a37fe640 1 -- 172.21.15.57:0/2438559370 learned_addr learned my addr 172.21.15.57:0/2438559370 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:02.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f380007c640 1 -- 172.21.15.57:0/4243878916 shutdown_connections 2024-04-24T23:39:02.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f380007c640 1 -- 172.21.15.57:0/4243878916 wait complete. 2024-04-24T23:39:02.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7fb3a3fff640 1 --2- 172.21.15.57:0/2438559370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3a406ec70 0x7fb3a414b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.293+0000 7f81ca23d640 1 -- start start 2024-04-24T23:39:02.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f81ca23d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81b0004810 0x7f81c4088ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f81ca23d640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f81c4159e80 0x7f81c415a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f81ca23d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81c415b200 0x7f81c415b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f81ca23d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f81c41616c0 con 0x7f81c415b200 2024-04-24T23:39:02.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f81ca23d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f81c4161540 con 0x7f81b0004810 2024-04-24T23:39:02.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f81ca23d640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f81c4162410 con 0x7f81c4159e80 2024-04-24T23:39:02.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f81c8a3a640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f81c4159e80 0x7f81c415a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f81c8a3a640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f81c4159e80 0x7f81c415a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.57:32988/0 (socket says 172.21.15.57:32988) 2024-04-24T23:39:02.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f81c8a3a640 1 -- 172.21.15.57:0/2140872480 learned_addr learned my addr 172.21.15.57:0/2140872480 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:02.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f81c923b640 1 --2- 172.21.15.57:0/2140872480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81b0004810 0x7f81c4088ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7ff31216f640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff30c06dcd0 0x7ff30c14a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7ff31216f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff30c06ef30 0x7ff30c157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7ff31216f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff30c152350 0x7ff30c14b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7ff31216f640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff30c160090 con 0x7ff30c06ef30 2024-04-24T23:39:02.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7ff31216f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff30c15ff10 con 0x7ff30c152350 2024-04-24T23:39:02.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7ff31216f640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7ff30c160210 con 0x7ff30c06dcd0 2024-04-24T23:39:02.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f3202649640 1 -- 172.21.15.57:0/107059770 >> v1:172.21.15.88:6789/0 conn(0x7f31f4042320 legacy=0x7f31f40d1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:02.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f3202649640 1 -- 172.21.15.57:0/107059770 >> v1:172.21.15.57:6789/0 conn(0x7f31f40cf2a0 legacy=0x7f31f4043110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f3202649640 1 -- 172.21.15.57:0/107059770 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f4043820 con 0x7f31f40d2210 2024-04-24T23:39:02.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7fb3a37fe640 1 -- 172.21.15.57:0/2438559370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3a40bf3e0 msgr2=0x7fb3a4144d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7fb3a37fe640 1 --2- 172.21.15.57:0/2438559370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3a40bf3e0 0x7fb3a4144d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7fb3a37fe640 1 -- 172.21.15.57:0/2438559370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3a406ec70 msgr2=0x7fb3a414b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7fb3a37fe640 1 --2- 172.21.15.57:0/2438559370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3a406ec70 0x7fb3a414b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7fb3a37fe640 1 -- 172.21.15.57:0/2438559370 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a414bdb0 con 0x7fb3a40bdd40 2024-04-24T23:39:02.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7ff303fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff30c06ef30 0x7ff30c157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7ff303fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff30c06ef30 0x7ff30c157440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60276/0 (socket says 172.21.15.57:60276) 2024-04-24T23:39:02.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7ff303fff640 1 -- 172.21.15.57:0/2371260966 learned_addr learned my addr 172.21.15.57:0/2371260966 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:02.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f81c923b640 1 -- 172.21.15.57:0/2140872480 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f81c4159e80 msgr2=0x7f81c415a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f81c923b640 1 --2- 172.21.15.57:0/2140872480 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f81c4159e80 0x7f81c415a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f81c923b640 1 -- 172.21.15.57:0/2140872480 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81c415b200 msgr2=0x7f81c415b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f81c923b640 1 --2- 172.21.15.57:0/2140872480 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81c415b200 0x7f81c415b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f81c923b640 1 -- 172.21.15.57:0/2140872480 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c4088ff0 con 0x7f81b0004810 2024-04-24T23:39:02.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7ff303fff640 1 -- 172.21.15.57:0/2371260966 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff30c06dcd0 msgr2=0x7ff30c14a9d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-24T23:39:02.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7ff303fff640 1 --2- 172.21.15.57:0/2371260966 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff30c06dcd0 0x7ff30c14a9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7ff303fff640 1 -- 172.21.15.57:0/2371260966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff30c152350 msgr2=0x7ff30c14b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7ff303fff640 1 --2- 172.21.15.57:0/2371260966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff30c152350 0x7ff30c14b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7ff303fff640 1 -- 172.21.15.57:0/2371260966 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30c14a070 con 0x7ff30c06ef30 2024-04-24T23:39:02.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f0c81f2f640 1 -- 172.21.15.57:0/4275981732 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c7c068930 con 0x7f0c7c072200 2024-04-24T23:39:02.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f81c923b640 1 --2- 172.21.15.57:0/2140872480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81b0004810 0x7f81c4088ab0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f81b4011910 tx=0x7f81b4011dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:02.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f380007c640 1 Processor -- start 2024-04-24T23:39:02.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f0c63fff640 1 -- 172.21.15.57:0/4275981732 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c6c005470 con 0x7f0c7c072200 2024-04-24T23:39:02.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f0c63fff640 1 -- 172.21.15.57:0/4275981732 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c012830 con 0x7f0c7c072200 2024-04-24T23:39:02.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f0c63fff640 1 -- 172.21.15.57:0/4275981732 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0c6c012a10 con 0x7f0c7c072200 2024-04-24T23:39:02.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f81b9ffb640 1 -- 172.21.15.57:0/2140872480 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4019070 con 0x7f81b0004810 2024-04-24T23:39:02.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f81ca23d640 1 -- 172.21.15.57:0/2140872480 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81c40ba030 con 0x7f81b0004810 2024-04-24T23:39:02.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f81ca23d640 1 -- 172.21.15.57:0/2140872480 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81c415f760 con 0x7f81b0004810 2024-04-24T23:39:02.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f81b9ffb640 1 -- 172.21.15.57:0/2140872480 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b4004240 con 0x7f81b0004810 2024-04-24T23:39:02.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f81b9ffb640 1 -- 172.21.15.57:0/2140872480 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b400f820 con 0x7f81b0004810 2024-04-24T23:39:02.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f380007c640 1 -- start start 2024-04-24T23:39:02.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f380007c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37f80b85d0 0x7f37f8143d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f380007c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37f80ba3d0 0x7f37f81f0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f380007c640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37f814e050 0x7f37f813c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f380007c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f37f815da00 con 0x7f37f80b85d0 2024-04-24T23:39:02.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f380007c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f37f815d880 con 0x7f37f80ba3d0 2024-04-24T23:39:02.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f380007c640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f37f815db80 con 0x7f37f814e050 2024-04-24T23:39:02.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f37fde18640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37f80b85d0 0x7f37f8143d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f37fde18640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37f80b85d0 0x7f37f8143d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60282/0 (socket says 172.21.15.57:60282) 2024-04-24T23:39:02.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f37fde18640 1 -- 172.21.15.57:0/2988547976 learned_addr learned my addr 172.21.15.57:0/2988547976 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:02.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f37fe619640 1 --2- 172.21.15.57:0/2988547976 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37f814e050 0x7f37f813c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7fb3a37fe640 1 --2- 172.21.15.57:0/2438559370 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb3a40bdd40 0x7fb3a413e390 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb39c00efc0 tx=0x7fb39c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:02.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f3202649640 1 --2- 172.21.15.57:0/107059770 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31f40d2210 0x7f31f40dd410 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f31f400a100 tx=0x7f31ec021160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c2368f7c0f39e34 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:02.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f37fde18640 1 -- 172.21.15.57:0/2988547976 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37f814e050 msgr2=0x7f37f813c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f37fde18640 1 --2- 172.21.15.57:0/2988547976 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37f814e050 0x7f37f813c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.297+0000 7f37fde18640 1 -- 172.21.15.57:0/2988547976 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37f80ba3d0 msgr2=0x7f37f81f0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.301+0000 7f37fde18640 1 --2- 172.21.15.57:0/2988547976 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37f80ba3d0 0x7f37f81f0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.301+0000 7f37fde18640 1 -- 172.21.15.57:0/2988547976 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37f8146730 con 0x7f37f80b85d0 2024-04-24T23:39:02.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.301+0000 7f0c63fff640 1 --2- 172.21.15.57:0/4275981732 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f0c680679f0 0x7f0c68069eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.301+0000 7fb3a0ff9640 1 -- 172.21.15.57:0/2438559370 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c018020 con 0x7fb3a40bdd40 2024-04-24T23:39:02.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.301+0000 7fb3a0ff9640 1 -- 172.21.15.57:0/2438559370 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb39c014480 con 0x7fb3a40bdd40 2024-04-24T23:39:02.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.301+0000 7fb3a0ff9640 1 -- 172.21.15.57:0/2438559370 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c014850 con 0x7fb3a40bdd40 2024-04-24T23:39:02.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.301+0000 7fb3aa9ec640 1 -- 172.21.15.57:0/2438559370 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a40c19e0 con 0x7fb3a40bdd40 2024-04-24T23:39:02.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.301+0000 7fb3aa9ec640 1 -- 172.21.15.57:0/2438559370 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a40c1320 con 0x7fb3a40bdd40 2024-04-24T23:39:02.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.301+0000 7f37fde18640 1 --2- 172.21.15.57:0/2988547976 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37f80b85d0 0x7f37f8143d00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f37f40ae040 tx=0x7f37f40192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:02.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.301+0000 7f0c7b7fe640 1 --2- 172.21.15.57:0/4275981732 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f0c680679f0 0x7f0c68069eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.301+0000 7f0c63fff640 1 -- 172.21.15.57:0/4275981732 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0c6c085ba0 con 0x7f0c7c072200 2024-04-24T23:39:02.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.301+0000 7f0c7b7fe640 1 --2- 172.21.15.57:0/4275981732 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f0c680679f0 0x7f0c68069eb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0c700b2000 tx=0x7f0c700be040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:02.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.301+0000 7fb3aa9ec640 1 -- 172.21.15.57:0/2438559370 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3a40bffe0 con 0x7fb3a40bdd40 2024-04-24T23:39:02.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.301+0000 7f81ca23d640 1 -- 172.21.15.57:0/2140872480 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81a40052a0 con 0x7f81b0004810 2024-04-24T23:39:02.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.301+0000 7fb3a0ff9640 1 -- 172.21.15.57:0/2438559370 <== mon.2 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb39c01b020 con 0x7fb3a40bdd40 2024-04-24T23:39:02.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.305+0000 7ff303fff640 1 --2- 172.21.15.57:0/2371260966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff30c06ef30 0x7ff30c157440 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff2f401a0a0 tx=0x7ff2f4019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:02.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.301+0000 7fb3a0ff9640 1 --2- 172.21.15.57:0/2438559370 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fb390067910 0x7fb390069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.301+0000 7fb3a0ff9640 1 -- 172.21.15.57:0/2438559370 <== mon.2 v2:172.21.15.88:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb39c087220 con 0x7fb3a40bdd40 2024-04-24T23:39:02.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.305+0000 7fb3a3fff640 1 --2- 172.21.15.57:0/2438559370 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fb390067910 0x7fb390069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.305+0000 7f81b9ffb640 1 -- 172.21.15.57:0/2140872480 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f81b401c070 con 0x7f81b0004810 2024-04-24T23:39:02.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.305+0000 7fb3a3fff640 1 --2- 172.21.15.57:0/2438559370 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fb390067910 0x7fb390069dd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb3940ad000 tx=0x7fb3940a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:02.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.305+0000 7f81b9ffb640 1 --2- 172.21.15.57:0/2140872480 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f81a80678c0 0x7f81a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.305+0000 7f81b9ffb640 1 -- 172.21.15.57:0/2140872480 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f81b4086460 con 0x7f81b0004810 2024-04-24T23:39:02.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.305+0000 7f81c8a3a640 1 --2- 172.21.15.57:0/2140872480 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f81a80678c0 0x7f81a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.305+0000 7f81c8a3a640 1 --2- 172.21.15.57:0/2140872480 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f81a80678c0 0x7f81a8069d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f81c0000c10 tx=0x7f81c00046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:02.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.305+0000 7f3200e46640 1 -- 172.21.15.57:0/107059770 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ec0b8070 con 0x7f31f40d2210 2024-04-24T23:39:02.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.305+0000 7ff308ff9640 1 -- 172.21.15.57:0/2371260966 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f40b9070 con 0x7ff30c06ef30 2024-04-24T23:39:02.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.305+0000 7ff31216f640 1 -- 172.21.15.57:0/2371260966 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff30c157980 con 0x7ff30c06ef30 2024-04-24T23:39:02.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.305+0000 7ff31216f640 1 -- 172.21.15.57:0/2371260966 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff30c14b0b0 con 0x7ff30c06ef30 2024-04-24T23:39:02.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.309+0000 7ff308ff9640 1 -- 172.21.15.57:0/2371260966 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f40ab600 con 0x7ff30c06ef30 2024-04-24T23:39:02.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.309+0000 7ff308ff9640 1 -- 172.21.15.57:0/2371260966 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f40c3060 con 0x7ff30c06ef30 2024-04-24T23:39:02.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.305+0000 7f0c63fff640 1 -- 172.21.15.57:0/4275981732 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f0c6c056410 con 0x7f0c7c072200 2024-04-24T23:39:02.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.305+0000 7f3200e46640 1 -- 172.21.15.57:0/107059770 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31ec0b3410 con 0x7f31f40d2210 2024-04-24T23:39:02.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.305+0000 7f3200e46640 1 -- 172.21.15.57:0/107059770 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ec0b37e0 con 0x7f31f40d2210 2024-04-24T23:39:02.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.309+0000 7f32040ac640 1 -- 172.21.15.57:0/107059770 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31f40d2210 msgr2=0x7f31f40dd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.309+0000 7f32040ac640 1 --2- 172.21.15.57:0/107059770 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31f40d2210 0x7f31f40dd410 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f31f400a100 tx=0x7f31ec021160 comp rx=0 tx=0).stop 2024-04-24T23:39:02.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.309+0000 7f32040ac640 1 -- 172.21.15.57:0/107059770 shutdown_connections 2024-04-24T23:39:02.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.309+0000 7f32040ac640 1 --2- 172.21.15.57:0/107059770 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31f40d2210 0x7f31f40dd410 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.309+0000 7f32040ac640 1 -- 172.21.15.57:0/107059770 >> 172.21.15.57:0/107059770 conn(0x7f31f4006340 msgr2=0x7f31f4006750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:02.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.309+0000 7f32040ac640 1 -- 172.21.15.57:0/107059770 shutdown_connections 2024-04-24T23:39:02.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.309+0000 7f32040ac640 1 -- 172.21.15.57:0/107059770 wait complete. 2024-04-24T23:39:02.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.305+0000 7f37ee7fc640 1 -- 172.21.15.57:0/2988547976 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f40b0040 con 0x7f37f80b85d0 2024-04-24T23:39:02.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.305+0000 7f380007c640 1 -- 172.21.15.57:0/2988547976 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37f81f14e0 con 0x7f37f80b85d0 2024-04-24T23:39:02.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.305+0000 7f380007c640 1 -- 172.21.15.57:0/2988547976 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37f813fff0 con 0x7f37f80b85d0 2024-04-24T23:39:02.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.309+0000 7f380007c640 1 -- 172.21.15.57:0/2988547976 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37f8068930 con 0x7f37f80b85d0 2024-04-24T23:39:02.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.309+0000 7f37ee7fc640 1 -- 172.21.15.57:0/2988547976 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f40ab600 con 0x7f37f80b85d0 2024-04-24T23:39:02.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.309+0000 7f37ee7fc640 1 -- 172.21.15.57:0/2988547976 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f40b4620 con 0x7f37f80b85d0 2024-04-24T23:39:02.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.309+0000 7f32040ac640 1 Processor -- start 2024-04-24T23:39:02.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.313+0000 7ff308ff9640 1 -- 172.21.15.57:0/2371260966 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff2f40bc070 con 0x7ff30c06ef30 2024-04-24T23:39:02.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.309+0000 7f32040ac640 1 -- start start 2024-04-24T23:39:02.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.309+0000 7f32040ac640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31f4042320 0x7f31f403e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.309+0000 7f32040ac640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f31f40cf2a0 0x7f31f40ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.309+0000 7f32040ac640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31f40d2210 0x7f31f403ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.309+0000 7f32040ac640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f31f4042870 con 0x7f31f40d2210 2024-04-24T23:39:02.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.309+0000 7f32040ac640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f31f40d2640 con 0x7f31f4042320 2024-04-24T23:39:02.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.309+0000 7f32040ac640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f31f40429f0 con 0x7f31f40cf2a0 2024-04-24T23:39:02.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.309+0000 7f3201e48640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31f4042320 0x7f31f403e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.309+0000 7f3201647640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f31f40cf2a0 0x7f31f40ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.309+0000 7f3201e48640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31f4042320 0x7f31f403e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.57:60236/0 (socket says 172.21.15.57:60236) 2024-04-24T23:39:02.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.309+0000 7f3201e48640 1 -- 172.21.15.57:0/2538555385 learned_addr learned my addr 172.21.15.57:0/2538555385 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:02.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.313+0000 7ff308ff9640 1 --2- 172.21.15.57:0/2371260966 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ff2ec0678c0 0x7ff2ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.313+0000 7f3201e48640 1 -- 172.21.15.57:0/2538555385 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f31f40cf2a0 msgr2=0x7f31f40ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.313+0000 7f3201e48640 1 --2- 172.21.15.57:0/2538555385 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f31f40cf2a0 0x7f31f40ca780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.313+0000 7f3201e48640 1 -- 172.21.15.57:0/2538555385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31f40d2210 msgr2=0x7f31f403ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.313+0000 7f3201e48640 1 --2- 172.21.15.57:0/2538555385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31f40d2210 0x7f31f403ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.313+0000 7f3201e48640 1 -- 172.21.15.57:0/2538555385 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f403f4f0 con 0x7f31f4042320 2024-04-24T23:39:02.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.313+0000 7f3201e48640 1 --2- 172.21.15.57:0/2538555385 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31f4042320 0x7f31f403e310 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f31f800c500 tx=0x7f31f800c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:02.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.313+0000 7f37ee7fc640 1 -- 172.21.15.57:0/2988547976 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f37f40b47c0 con 0x7f37f80b85d0 2024-04-24T23:39:02.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.313+0000 7ff30b7fe640 1 --2- 172.21.15.57:0/2371260966 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ff2ec0678c0 0x7ff2ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.313+0000 7f37ee7fc640 1 --2- 172.21.15.57:0/2988547976 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f37dc0678c0 0x7f37dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.313+0000 7f37ee7fc640 1 -- 172.21.15.57:0/2988547976 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f37f41206b0 con 0x7f37f80b85d0 2024-04-24T23:39:02.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.313+0000 7ff308ff9640 1 -- 172.21.15.57:0/2371260966 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff2f411f080 con 0x7ff30c06ef30 2024-04-24T23:39:02.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.313+0000 7f37fd617640 1 --2- 172.21.15.57:0/2988547976 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f37dc0678c0 0x7f37dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.313+0000 7ff30b7fe640 1 --2- 172.21.15.57:0/2371260966 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ff2ec0678c0 0x7ff2ec069d80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc009690 tx=0x7ff2fc006b60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:02.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.313+0000 7f37fd617640 1 --2- 172.21.15.57:0/2988547976 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f37dc0678c0 0x7f37dc069d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f37e8000c10 tx=0x7f37e8007950 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:02.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.317+0000 7ff31216f640 1 -- 172.21.15.57:0/2371260966 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2f00052a0 con 0x7ff30c06ef30 2024-04-24T23:39:02.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.317+0000 7fb3a0ff9640 1 -- 172.21.15.57:0/2438559370 <== mon.2 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fb3a40bffe0 con 0x7fb3a40bdd40 2024-04-24T23:39:02.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.317+0000 7f31f27fc640 1 -- 172.21.15.57:0/2538555385 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f8017070 con 0x7f31f4042320 2024-04-24T23:39:02.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.317+0000 7f32040ac640 1 -- 172.21.15.57:0/2538555385 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31f4174130 con 0x7f31f4042320 2024-04-24T23:39:02.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.317+0000 7f32040ac640 1 -- 172.21.15.57:0/2538555385 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31f402cdc0 con 0x7f31f4042320 2024-04-24T23:39:02.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.317+0000 7f81b9ffb640 1 -- 172.21.15.57:0/2140872480 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f81c4088ff0 con 0x7f81b0004810 2024-04-24T23:39:02.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.317+0000 7f31f27fc640 1 -- 172.21.15.57:0/2538555385 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31f8005cf0 con 0x7f31f4042320 2024-04-24T23:39:02.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.321+0000 7f31f27fc640 1 -- 172.21.15.57:0/2538555385 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f80072f0 con 0x7f31f4042320 2024-04-24T23:39:02.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.321+0000 7f32040ac640 1 -- 172.21.15.57:0/2538555385 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31f4005720 con 0x7f31f4042320 2024-04-24T23:39:02.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.321+0000 7f31f27fc640 1 -- 172.21.15.57:0/2538555385 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f31f801a070 con 0x7f31f4042320 2024-04-24T23:39:02.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.321+0000 7f31f27fc640 1 --2- 172.21.15.57:0/2538555385 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f31e0067940 0x7f31e0069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.321+0000 7f31f27fc640 1 -- 172.21.15.57:0/2538555385 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f31f8085230 con 0x7f31f4042320 2024-04-24T23:39:02.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.321+0000 7f3201647640 1 --2- 172.21.15.57:0/2538555385 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f31e0067940 0x7f31e0069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.321+0000 7f3201647640 1 --2- 172.21.15.57:0/2538555385 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f31e0067940 0x7f31e0069e00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f31fc069ba0 tx=0x7f31fc072040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:02.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.321+0000 7f37ee7fc640 1 -- 172.21.15.57:0/2988547976 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f37f4016110 con 0x7f37f80b85d0 2024-04-24T23:39:02.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.333+0000 7ff308ff9640 1 -- 172.21.15.57:0/2371260966 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7ff30c157980 con 0x7ff30c06ef30 2024-04-24T23:39:02.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.333+0000 7f31f27fc640 1 -- 172.21.15.57:0/2538555385 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f31f80554d0 con 0x7f31f4042320 2024-04-24T23:39:02.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.525+0000 7f5e61bdd640 1 -- 172.21.15.57:0/112819632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f5e38005590 con 0x7f5e5c149bd0 2024-04-24T23:39:02.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.525+0000 7f5e4bfff640 1 -- 172.21.15.57:0/112819632 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5e54017b10 con 0x7f5e5c149bd0 2024-04-24T23:39:02.530 INFO:teuthology.orchestra.run.smithi057.stdout:55834574858 2024-04-24T23:39:02.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.533+0000 7f5e49ffb640 1 -- 172.21.15.57:0/112819632 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f5e44067cb0 msgr2=0x7f5e4406a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.533+0000 7f5e49ffb640 1 --2- 172.21.15.57:0/112819632 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f5e44067cb0 0x7f5e4406a170 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c0050b0 tx=0x7f5e4c003700 comp rx=0 tx=0).stop 2024-04-24T23:39:02.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.533+0000 7f5e49ffb640 1 -- 172.21.15.57:0/112819632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e5c149bd0 msgr2=0x7f5e5c148060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.533+0000 7f5e49ffb640 1 --2- 172.21.15.57:0/112819632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e5c149bd0 0x7f5e5c148060 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5e540ac000 tx=0x7f5e5401aba0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.533+0000 7f5e49ffb640 1 -- 172.21.15.57:0/112819632 shutdown_connections 2024-04-24T23:39:02.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.533+0000 7f5e49ffb640 1 --2- 172.21.15.57:0/112819632 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f5e44067cb0 0x7f5e4406a170 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.533+0000 7f5e49ffb640 1 --2- 172.21.15.57:0/112819632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e5c14f840 0x7f5e5c0c0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.533+0000 7f5e49ffb640 1 --2- 172.21.15.57:0/112819632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e5c149bd0 0x7f5e5c148060 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.533+0000 7f5e49ffb640 1 --2- 172.21.15.57:0/112819632 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e5c06ec70 0x7f5e5c15b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.533+0000 7f5e49ffb640 1 -- 172.21.15.57:0/112819632 >> 172.21.15.57:0/112819632 conn(0x7f5e5c0be8f0 msgr2=0x7f5e5c06d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:02.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.533+0000 7f5e49ffb640 1 -- 172.21.15.57:0/112819632 shutdown_connections 2024-04-24T23:39:02.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.533+0000 7f5e49ffb640 1 -- 172.21.15.57:0/112819632 wait complete. 2024-04-24T23:39:02.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2024-04-24T23:39:02.556 DEBUG:teuthology.parallel:result is None 2024-04-24T23:39:02.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.577+0000 7fa558149640 1 -- 172.21.15.57:0/4089202602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fa538005590 con 0x7fa5500bf3e0 2024-04-24T23:39:02.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.577+0000 7fa5467fc640 1 -- 172.21.15.57:0/4089202602 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa550142480 con 0x7fa5500bf3e0 2024-04-24T23:39:02.580 INFO:teuthology.orchestra.run.smithi057.stdout:55834574857 2024-04-24T23:39:02.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.581+0000 7fa558149640 1 -- 172.21.15.57:0/4089202602 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa534067990 msgr2=0x7fa534069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.581+0000 7fa558149640 1 --2- 172.21.15.57:0/4089202602 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa534067990 0x7fa534069e50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa54c009580 tx=0x7fa54c009190 comp rx=0 tx=0).stop 2024-04-24T23:39:02.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.581+0000 7fa558149640 1 -- 172.21.15.57:0/4089202602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5500bf3e0 msgr2=0x7fa5500c0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.581+0000 7fa558149640 1 --2- 172.21.15.57:0/4089202602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5500bf3e0 0x7fa5500c0b00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa54801c9e0 tx=0x7fa548019740 comp rx=0 tx=0).stop 2024-04-24T23:39:02.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.581+0000 7fa558149640 1 -- 172.21.15.57:0/4089202602 shutdown_connections 2024-04-24T23:39:02.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.581+0000 7fa558149640 1 --2- 172.21.15.57:0/4089202602 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa534067990 0x7fa534069e50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.581+0000 7fa558149640 1 --2- 172.21.15.57:0/4089202602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa55014ef30 0x7fa5500c1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.581+0000 7fa558149640 1 --2- 172.21.15.57:0/4089202602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5500bf3e0 0x7fa5500c0b00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.581+0000 7fa558149640 1 --2- 172.21.15.57:0/4089202602 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa5500bdd40 0x7fa550141f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.581+0000 7fa558149640 1 -- 172.21.15.57:0/4089202602 >> 172.21.15.57:0/4089202602 conn(0x7fa5500be8f0 msgr2=0x7fa55014c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:02.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.581+0000 7fa558149640 1 -- 172.21.15.57:0/4089202602 shutdown_connections 2024-04-24T23:39:02.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.581+0000 7fa558149640 1 -- 172.21.15.57:0/4089202602 wait complete. 2024-04-24T23:39:02.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.597+0000 7fb3aa9ec640 1 -- 172.21.15.57:0/2438559370 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fb3a413fef0 con 0x7fb3a40bdd40 2024-04-24T23:39:02.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.597+0000 7fb3a0ff9640 1 -- 172.21.15.57:0/2438559370 <== mon.2 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb3a413fef0 con 0x7fb3a40bdd40 2024-04-24T23:39:02.599 INFO:teuthology.orchestra.run.smithi057.stdout:55834574858 2024-04-24T23:39:02.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.601+0000 7fb3aa9ec640 1 -- 172.21.15.57:0/2438559370 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fb390067910 msgr2=0x7fb390069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.601+0000 7fb3aa9ec640 1 --2- 172.21.15.57:0/2438559370 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fb390067910 0x7fb390069dd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb3940ad000 tx=0x7fb3940a6000 comp rx=0 tx=0).stop 2024-04-24T23:39:02.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.601+0000 7fb3aa9ec640 1 -- 172.21.15.57:0/2438559370 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb3a40bdd40 msgr2=0x7fb3a413e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.601+0000 7fb3aa9ec640 1 --2- 172.21.15.57:0/2438559370 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb3a40bdd40 0x7fb3a413e390 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb39c00efc0 tx=0x7fb39c00c490 comp rx=0 tx=0).stop 2024-04-24T23:39:02.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.601+0000 7fb3aa9ec640 1 -- 172.21.15.57:0/2438559370 shutdown_connections 2024-04-24T23:39:02.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.601+0000 7fb3aa9ec640 1 --2- 172.21.15.57:0/2438559370 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fb390067910 0x7fb390069dd0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.601+0000 7fb3aa9ec640 1 --2- 172.21.15.57:0/2438559370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3a40bf3e0 0x7fb3a4144d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.601+0000 7fb3aa9ec640 1 --2- 172.21.15.57:0/2438559370 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb3a40bdd40 0x7fb3a413e390 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.601+0000 7fb3aa9ec640 1 --2- 172.21.15.57:0/2438559370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3a406ec70 0x7fb3a414b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.601+0000 7fb3aa9ec640 1 -- 172.21.15.57:0/2438559370 >> 172.21.15.57:0/2438559370 conn(0x7fb3a40be8f0 msgr2=0x7fb3a414c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:02.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.601+0000 7fb3aa9ec640 1 -- 172.21.15.57:0/2438559370 shutdown_connections 2024-04-24T23:39:02.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.601+0000 7fb3aa9ec640 1 -- 172.21.15.57:0/2438559370 wait complete. 2024-04-24T23:39:02.607 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2024-04-24T23:39:02.607 DEBUG:teuthology.parallel:result is None 2024-04-24T23:39:02.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2024-04-24T23:39:02.618 DEBUG:teuthology.parallel:result is None 2024-04-24T23:39:02.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.629+0000 7ff31216f640 1 -- 172.21.15.57:0/2371260966 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff2f0005860 con 0x7ff30c06ef30 2024-04-24T23:39:02.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.629+0000 7ff308ff9640 1 -- 172.21.15.57:0/2371260966 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff30c14a070 con 0x7ff30c06ef30 2024-04-24T23:39:02.632 INFO:teuthology.orchestra.run.smithi057.stdout:55834574857 2024-04-24T23:39:02.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.633+0000 7f0c81f2f640 1 -- 172.21.15.57:0/4275981732 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f0c7c0c28d0 con 0x7f0c7c072200 2024-04-24T23:39:02.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.633+0000 7f0c63fff640 1 -- 172.21.15.57:0/4275981732 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0c6c055d10 con 0x7f0c7c072200 2024-04-24T23:39:02.633 INFO:teuthology.orchestra.run.smithi057.stdout:55834574858 2024-04-24T23:39:02.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.633+0000 7ff31216f640 1 -- 172.21.15.57:0/2371260966 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ff2ec0678c0 msgr2=0x7ff2ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.633+0000 7ff31216f640 1 --2- 172.21.15.57:0/2371260966 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ff2ec0678c0 0x7ff2ec069d80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc009690 tx=0x7ff2fc006b60 comp rx=0 tx=0).stop 2024-04-24T23:39:02.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.633+0000 7ff31216f640 1 -- 172.21.15.57:0/2371260966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff30c06ef30 msgr2=0x7ff30c157440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.633+0000 7ff31216f640 1 --2- 172.21.15.57:0/2371260966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff30c06ef30 0x7ff30c157440 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff2f401a0a0 tx=0x7ff2f4019210 comp rx=0 tx=0).stop 2024-04-24T23:39:02.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.633+0000 7ff31216f640 1 -- 172.21.15.57:0/2371260966 shutdown_connections 2024-04-24T23:39:02.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.633+0000 7ff31216f640 1 --2- 172.21.15.57:0/2371260966 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ff2ec0678c0 0x7ff2ec069d80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.633+0000 7ff31216f640 1 --2- 172.21.15.57:0/2371260966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff30c152350 0x7ff30c14b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.633+0000 7ff31216f640 1 --2- 172.21.15.57:0/2371260966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff30c06ef30 0x7ff30c157440 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.633+0000 7ff31216f640 1 --2- 172.21.15.57:0/2371260966 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff30c06dcd0 0x7ff30c14a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.633+0000 7ff31216f640 1 -- 172.21.15.57:0/2371260966 >> 172.21.15.57:0/2371260966 conn(0x7ff30c0be8f0 msgr2=0x7ff30c071050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:02.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.633+0000 7ff31216f640 1 -- 172.21.15.57:0/2371260966 shutdown_connections 2024-04-24T23:39:02.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.633+0000 7ff31216f640 1 -- 172.21.15.57:0/2371260966 wait complete. 2024-04-24T23:39:02.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.633+0000 7f0c81f2f640 1 -- 172.21.15.57:0/4275981732 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f0c680679f0 msgr2=0x7f0c68069eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.633+0000 7f0c81f2f640 1 --2- 172.21.15.57:0/4275981732 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f0c680679f0 0x7f0c68069eb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0c700b2000 tx=0x7f0c700be040 comp rx=0 tx=0).stop 2024-04-24T23:39:02.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.633+0000 7f0c81f2f640 1 -- 172.21.15.57:0/4275981732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c7c072200 msgr2=0x7f0c7c1511b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.633+0000 7f0c81f2f640 1 --2- 172.21.15.57:0/4275981732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c7c072200 0x7f0c7c1511b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c00c500 tx=0x7f0c6c00c9c0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.633+0000 7f0c81f2f640 1 -- 172.21.15.57:0/4275981732 shutdown_connections 2024-04-24T23:39:02.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.633+0000 7f0c81f2f640 1 --2- 172.21.15.57:0/4275981732 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f0c680679f0 0x7f0c68069eb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.633+0000 7f0c81f2f640 1 --2- 172.21.15.57:0/4275981732 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c7c0bf3a0 0x7f0c7c134730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.633+0000 7f0c81f2f640 1 --2- 172.21.15.57:0/4275981732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c7c072200 0x7f0c7c1511b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.633+0000 7f0c81f2f640 1 --2- 172.21.15.57:0/4275981732 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0c7c06e520 0x7f0c7c0babd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.633+0000 7f0c81f2f640 1 -- 172.21.15.57:0/4275981732 >> 172.21.15.57:0/4275981732 conn(0x7f0c7c0c2e70 msgr2=0x7f0c7c06e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:02.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.633+0000 7f0c81f2f640 1 -- 172.21.15.57:0/4275981732 shutdown_connections 2024-04-24T23:39:02.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.633+0000 7f0c81f2f640 1 -- 172.21.15.57:0/4275981732 wait complete. 2024-04-24T23:39:02.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.649+0000 7f81ca23d640 1 -- 172.21.15.57:0/2140872480 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f81a4005860 con 0x7f81b0004810 2024-04-24T23:39:02.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.3 2024-04-24T23:39:02.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.649+0000 7f81b9ffb640 1 -- 172.21.15.57:0/2140872480 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f81b4056680 con 0x7f81b0004810 2024-04-24T23:39:02.653 INFO:teuthology.orchestra.run.smithi057.stdout:55834574857 2024-04-24T23:39:02.653 DEBUG:teuthology.parallel:result is None 2024-04-24T23:39:02.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.653+0000 7f81ca23d640 1 -- 172.21.15.57:0/2140872480 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f81a80678c0 msgr2=0x7f81a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.653+0000 7f81ca23d640 1 --2- 172.21.15.57:0/2140872480 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f81a80678c0 0x7f81a8069d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f81c0000c10 tx=0x7f81c00046d0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.653+0000 7f81ca23d640 1 -- 172.21.15.57:0/2140872480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81b0004810 msgr2=0x7f81c4088ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.653+0000 7f81ca23d640 1 --2- 172.21.15.57:0/2140872480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81b0004810 0x7f81c4088ab0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f81b4011910 tx=0x7f81b4011dd0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.653+0000 7f81ca23d640 1 -- 172.21.15.57:0/2140872480 shutdown_connections 2024-04-24T23:39:02.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.653+0000 7f81ca23d640 1 --2- 172.21.15.57:0/2140872480 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f81a80678c0 0x7f81a8069d80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.653+0000 7f81ca23d640 1 --2- 172.21.15.57:0/2140872480 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81c415b200 0x7f81c415b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.653+0000 7f81ca23d640 1 --2- 172.21.15.57:0/2140872480 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f81c4159e80 0x7f81c415a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.653+0000 7f81ca23d640 1 --2- 172.21.15.57:0/2140872480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81b0004810 0x7f81c4088ab0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.653+0000 7f81ca23d640 1 -- 172.21.15.57:0/2140872480 >> 172.21.15.57:0/2140872480 conn(0x7f81c40be860 msgr2=0x7f81c40863a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:02.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.653+0000 7f81ca23d640 1 -- 172.21.15.57:0/2140872480 shutdown_connections 2024-04-24T23:39:02.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.653+0000 7f81ca23d640 1 -- 172.21.15.57:0/2140872480 wait complete. 2024-04-24T23:39:02.660 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2024-04-24T23:39:02.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.657+0000 7f380007c640 1 -- 172.21.15.57:0/2988547976 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f37f806b900 con 0x7f37f80b85d0 2024-04-24T23:39:02.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.661+0000 7f37ee7fc640 1 -- 172.21.15.57:0/2988547976 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f37f40f0f20 con 0x7f37f80b85d0 2024-04-24T23:39:02.661 DEBUG:teuthology.parallel:result is None 2024-04-24T23:39:02.661 INFO:teuthology.orchestra.run.smithi057.stdout:55834574858 2024-04-24T23:39:02.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.661+0000 7f32040ac640 1 -- 172.21.15.57:0/2538555385 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f31f4041ec0 con 0x7f31f4042320 2024-04-24T23:39:02.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.661+0000 7f31f27fc640 1 -- 172.21.15.57:0/2538555385 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f31f80597d0 con 0x7f31f4042320 2024-04-24T23:39:02.663 INFO:teuthology.orchestra.run.smithi057.stdout:55834574857 2024-04-24T23:39:02.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.661+0000 7f380007c640 1 -- 172.21.15.57:0/2988547976 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f37dc0678c0 msgr2=0x7f37dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.661+0000 7f380007c640 1 --2- 172.21.15.57:0/2988547976 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f37dc0678c0 0x7f37dc069d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f37e8000c10 tx=0x7f37e8007950 comp rx=0 tx=0).stop 2024-04-24T23:39:02.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.661+0000 7f380007c640 1 -- 172.21.15.57:0/2988547976 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37f80b85d0 msgr2=0x7f37f8143d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.661+0000 7f380007c640 1 --2- 172.21.15.57:0/2988547976 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37f80b85d0 0x7f37f8143d00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f37f40ae040 tx=0x7f37f40192c0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.661+0000 7f380007c640 1 -- 172.21.15.57:0/2988547976 shutdown_connections 2024-04-24T23:39:02.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.661+0000 7f380007c640 1 --2- 172.21.15.57:0/2988547976 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f37dc0678c0 0x7f37dc069d80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.661+0000 7f380007c640 1 --2- 172.21.15.57:0/2988547976 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37f814e050 0x7f37f813c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.661+0000 7f380007c640 1 --2- 172.21.15.57:0/2988547976 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37f80ba3d0 0x7f37f81f0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.661+0000 7f380007c640 1 --2- 172.21.15.57:0/2988547976 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37f80b85d0 0x7f37f8143d00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.661+0000 7f380007c640 1 -- 172.21.15.57:0/2988547976 >> 172.21.15.57:0/2988547976 conn(0x7f37f8066f50 msgr2=0x7f37f8149170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:02.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.661+0000 7f380007c640 1 -- 172.21.15.57:0/2988547976 shutdown_connections 2024-04-24T23:39:02.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.661+0000 7f380007c640 1 -- 172.21.15.57:0/2988547976 wait complete. 2024-04-24T23:39:02.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.665+0000 7f32040ac640 1 -- 172.21.15.57:0/2538555385 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f31e0067940 msgr2=0x7f31e0069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.665+0000 7f32040ac640 1 --2- 172.21.15.57:0/2538555385 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f31e0067940 0x7f31e0069e00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f31fc069ba0 tx=0x7f31fc072040 comp rx=0 tx=0).stop 2024-04-24T23:39:02.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.665+0000 7f32040ac640 1 -- 172.21.15.57:0/2538555385 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31f4042320 msgr2=0x7f31f403e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.665+0000 7f32040ac640 1 --2- 172.21.15.57:0/2538555385 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31f4042320 0x7f31f403e310 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f31f800c500 tx=0x7f31f800c9c0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.665+0000 7f32040ac640 1 -- 172.21.15.57:0/2538555385 shutdown_connections 2024-04-24T23:39:02.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.665+0000 7f32040ac640 1 --2- 172.21.15.57:0/2538555385 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f31e0067940 0x7f31e0069e00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.665+0000 7f32040ac640 1 --2- 172.21.15.57:0/2538555385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31f40d2210 0x7f31f403ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.665+0000 7f32040ac640 1 --2- 172.21.15.57:0/2538555385 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f31f40cf2a0 0x7f31f40ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.665+0000 7f32040ac640 1 --2- 172.21.15.57:0/2538555385 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31f4042320 0x7f31f403e310 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.665+0000 7f32040ac640 1 -- 172.21.15.57:0/2538555385 >> 172.21.15.57:0/2538555385 conn(0x7f31f4006340 msgr2=0x7f31f4046960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:02.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.665+0000 7f32040ac640 1 -- 172.21.15.57:0/2538555385 shutdown_connections 2024-04-24T23:39:02.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.665+0000 7f32040ac640 1 -- 172.21.15.57:0/2538555385 wait complete. 2024-04-24T23:39:02.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2024-04-24T23:39:02.682 DEBUG:teuthology.parallel:result is None 2024-04-24T23:39:02.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2024-04-24T23:39:02.683 DEBUG:teuthology.parallel:result is None 2024-04-24T23:39:02.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.0 2024-04-24T23:39:02.687 DEBUG:teuthology.parallel:result is None 2024-04-24T23:39:02.687 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-24T23:39:02.687 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:39:02.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.829+0000 7fb35ce45640 1 Processor -- start 2024-04-24T23:39:02.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.829+0000 7fb35ce45640 1 -- start start 2024-04-24T23:39:02.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.833+0000 7fb35ce45640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb3580c32d0 0x7fb35814d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.833+0000 7fb35ce45640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb3580c1080 0x7fb358150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.833+0000 7fb35ce45640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3580bd6c0 con 0x7fb35814dea0 2024-04-24T23:39:02.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.833+0000 7fb35ce45640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fb3580bf4a0 con 0x7fb3580c32d0 2024-04-24T23:39:02.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.833+0000 7fb35ce45640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fb3580bd470 con 0x7fb3580c1080 2024-04-24T23:39:02.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.833+0000 7fb35659c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb3580c32d0 0x7fb35814d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.833+0000 7fb35659c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb3580c32d0 0x7fb35814d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60302/0 (socket says 172.21.15.57:60302) 2024-04-24T23:39:02.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.833+0000 7fb35659c640 1 -- 172.21.15.57:0/2455296619 learned_addr learned my addr 172.21.15.57:0/2455296619 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:02.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.833+0000 7fb355d9b640 1 --2- 172.21.15.57:0/2455296619 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb3580c1080 0x7fb358150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.833+0000 7fb35659c640 1 -- 172.21.15.57:0/2455296619 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb3580c1080 msgr2=0x7fb358150bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:02.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.833+0000 7fb35659c640 1 --2- 172.21.15.57:0/2455296619 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb3580c1080 0x7fb358150bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.833+0000 7fb35659c640 1 -- 172.21.15.57:0/2455296619 >> v1:172.21.15.88:6789/0 conn(0x7fb35814dea0 legacy=0x7fb358151130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:02.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.833+0000 7fb35659c640 1 -- 172.21.15.57:0/2455296619 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3580bd9a0 con 0x7fb3580c32d0 2024-04-24T23:39:02.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.833+0000 7fb355d9b640 1 --2- 172.21.15.57:0/2455296619 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb3580c1080 0x7fb358150bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:39:02.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.833+0000 7fb35659c640 1 --2- 172.21.15.57:0/2455296619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3580c32d0 0x7fb35814d960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb348009870 tx=0x7fb34801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c477e7a026332e44 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:02.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.833+0000 7fb35559a640 1 -- 172.21.15.57:0/2455296619 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3480b0070 con 0x7fb3580c32d0 2024-04-24T23:39:02.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.833+0000 7fb35559a640 1 -- 172.21.15.57:0/2455296619 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3480ab600 con 0x7fb3580c32d0 2024-04-24T23:39:02.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.833+0000 7fb35559a640 1 -- 172.21.15.57:0/2455296619 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3480ab9d0 con 0x7fb3580c32d0 2024-04-24T23:39:02.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.833+0000 7fb35ce45640 1 -- 172.21.15.57:0/2455296619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3580c32d0 msgr2=0x7fb35814d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.833+0000 7fb35ce45640 1 --2- 172.21.15.57:0/2455296619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3580c32d0 0x7fb35814d960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb348009870 tx=0x7fb34801c490 comp rx=0 tx=0).stop 2024-04-24T23:39:02.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.833+0000 7fb35ce45640 1 -- 172.21.15.57:0/2455296619 shutdown_connections 2024-04-24T23:39:02.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.833+0000 7fb35ce45640 1 --2- 172.21.15.57:0/2455296619 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb3580c1080 0x7fb358150bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.837+0000 7fb35ce45640 1 --2- 172.21.15.57:0/2455296619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3580c32d0 0x7fb35814d960 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.837+0000 7fb35ce45640 1 -- 172.21.15.57:0/2455296619 >> 172.21.15.57:0/2455296619 conn(0x7fb358067350 msgr2=0x7fb358067760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:02.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.837+0000 7fb35ce45640 1 -- 172.21.15.57:0/2455296619 shutdown_connections 2024-04-24T23:39:02.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.837+0000 7fb35ce45640 1 -- 172.21.15.57:0/2455296619 wait complete. 2024-04-24T23:39:02.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.837+0000 7fb35ce45640 1 Processor -- start 2024-04-24T23:39:02.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.837+0000 7fb35ce45640 1 -- start start 2024-04-24T23:39:02.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.837+0000 7fb35ce45640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3580c1080 0x7fb35813e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.837+0000 7fb35ce45640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3580c32d0 0x7fb358142910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.837+0000 7fb35ce45640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb35814dea0 0x7fb35814e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.837+0000 7fb35ce45640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb3580c1760 con 0x7fb3580c32d0 2024-04-24T23:39:02.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.837+0000 7fb35ce45640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb3580c15e0 con 0x7fb3580c1080 2024-04-24T23:39:02.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.837+0000 7fb35ce45640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fb35815d940 con 0x7fb35814dea0 2024-04-24T23:39:02.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.837+0000 7fb355d9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3580c32d0 0x7fb358142910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.837+0000 7fb355d9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3580c32d0 0x7fb358142910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60316/0 (socket says 172.21.15.57:60316) 2024-04-24T23:39:02.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.837+0000 7fb355d9b640 1 -- 172.21.15.57:0/703982771 learned_addr learned my addr 172.21.15.57:0/703982771 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:02.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.837+0000 7fb35659c640 1 --2- 172.21.15.57:0/703982771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3580c1080 0x7fb35813e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.837+0000 7fb356d9d640 1 --2- 172.21.15.57:0/703982771 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb35814dea0 0x7fb35814e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.837+0000 7fb355d9b640 1 -- 172.21.15.57:0/703982771 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb35814dea0 msgr2=0x7fb35814e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.837+0000 7fb355d9b640 1 --2- 172.21.15.57:0/703982771 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb35814dea0 0x7fb35814e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.837+0000 7fb355d9b640 1 -- 172.21.15.57:0/703982771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3580c1080 msgr2=0x7fb35813e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:02.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.837+0000 7fb355d9b640 1 --2- 172.21.15.57:0/703982771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3580c1080 0x7fb35813e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:02.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.837+0000 7fb355d9b640 1 -- 172.21.15.57:0/703982771 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb35813ea10 con 0x7fb3580c32d0 2024-04-24T23:39:02.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.837+0000 7fb35659c640 1 --2- 172.21.15.57:0/703982771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3580c1080 0x7fb35813e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:39:02.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.837+0000 7fb355d9b640 1 --2- 172.21.15.57:0/703982771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3580c32d0 0x7fb358142910 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb34c00c7f0 tx=0x7fb34c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:02.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.837+0000 7fb346ffd640 1 -- 172.21.15.57:0/703982771 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb34c015070 con 0x7fb3580c32d0 2024-04-24T23:39:02.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.837+0000 7fb346ffd640 1 -- 172.21.15.57:0/703982771 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb34c0077c0 con 0x7fb3580c32d0 2024-04-24T23:39:02.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.837+0000 7fb35ce45640 1 -- 172.21.15.57:0/703982771 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb358145980 con 0x7fb3580c32d0 2024-04-24T23:39:02.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.837+0000 7fb346ffd640 1 -- 172.21.15.57:0/703982771 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb34c007bb0 con 0x7fb3580c32d0 2024-04-24T23:39:02.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.837+0000 7fb35ce45640 1 -- 172.21.15.57:0/703982771 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb358141290 con 0x7fb3580c32d0 2024-04-24T23:39:02.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.837+0000 7fb35ce45640 1 -- 172.21.15.57:0/703982771 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb358068220 con 0x7fb3580c32d0 2024-04-24T23:39:02.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.841+0000 7fb346ffd640 1 -- 172.21.15.57:0/703982771 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb34c018070 con 0x7fb3580c32d0 2024-04-24T23:39:02.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.841+0000 7fb346ffd640 1 --2- 172.21.15.57:0/703982771 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fb3380678f0 0x7fb338069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:02.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.841+0000 7fb346ffd640 1 -- 172.21.15.57:0/703982771 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb34c086030 con 0x7fb3580c32d0 2024-04-24T23:39:02.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.841+0000 7fb35659c640 1 --2- 172.21.15.57:0/703982771 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fb3380678f0 0x7fb338069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:02.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.841+0000 7fb35659c640 1 --2- 172.21.15.57:0/703982771 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fb3380678f0 0x7fb338069db0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb3480ad000 tx=0x7fb348008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:02.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.845+0000 7fb346ffd640 1 -- 172.21.15.57:0/703982771 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fb34c0568c0 con 0x7fb3580c32d0 2024-04-24T23:39:02.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:02.997+0000 7fb35ce45640 1 -- 172.21.15.57:0/703982771 --> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb35814c460 con 0x7fb3380678f0 2024-04-24T23:39:03.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.017+0000 7fb346ffd640 1 -- 172.21.15.57:0/703982771 <== mgr.4105 v2:172.21.15.88:6832/3931748276 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332610 (secure 0 0 0) 0x7fb35814c460 con 0x7fb3380678f0 2024-04-24T23:39:03.024 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:39:03.026 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-24T23:39:03.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.025+0000 7fb35ce45640 1 -- 172.21.15.57:0/703982771 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fb3380678f0 msgr2=0x7fb338069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:03.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.025+0000 7fb35ce45640 1 --2- 172.21.15.57:0/703982771 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fb3380678f0 0x7fb338069db0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb3480ad000 tx=0x7fb348008040 comp rx=0 tx=0).stop 2024-04-24T23:39:03.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.025+0000 7fb35ce45640 1 -- 172.21.15.57:0/703982771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3580c32d0 msgr2=0x7fb358142910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:03.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.025+0000 7fb35ce45640 1 --2- 172.21.15.57:0/703982771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3580c32d0 0x7fb358142910 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb34c00c7f0 tx=0x7fb34c00ccb0 comp rx=0 tx=0).stop 2024-04-24T23:39:03.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.025+0000 7fb35ce45640 1 -- 172.21.15.57:0/703982771 shutdown_connections 2024-04-24T23:39:03.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.025+0000 7fb35ce45640 1 --2- 172.21.15.57:0/703982771 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fb3380678f0 0x7fb338069db0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:03.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.025+0000 7fb35ce45640 1 --2- 172.21.15.57:0/703982771 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb35814dea0 0x7fb35814e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:03.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.025+0000 7fb35ce45640 1 --2- 172.21.15.57:0/703982771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3580c32d0 0x7fb358142910 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:03.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.025+0000 7fb35ce45640 1 --2- 172.21.15.57:0/703982771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3580c1080 0x7fb35813e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:03.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.025+0000 7fb35ce45640 1 -- 172.21.15.57:0/703982771 >> 172.21.15.57:0/703982771 conn(0x7fb358067350 msgr2=0x7fb3580b85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:03.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.025+0000 7fb35ce45640 1 -- 172.21.15.57:0/703982771 shutdown_connections 2024-04-24T23:39:03.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.025+0000 7fb35ce45640 1 -- 172.21.15.57:0/703982771 wait complete. 2024-04-24T23:39:03.041 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-04-24T23:39:01.549954+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234996,"kb_used_data":2176,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739724,"statfs":{"total":773094113280,"available":772853477376,"internally_reserved":0,"allocated":2228224,"data_stored":1992064,"data_compressed":67594,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005381"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373865+0000","last_change":"2024-04-24T23:38:33.135015+0000","last_active":"2024-04-24T23:38:39.373865+0000","last_peered":"2024-04-24T23:38:39.373865+0000","last_clean":"2024-04-24T23:38:39.373865+0000","last_became_active":"2024-04-24T23:38:33.134584+0000","last_became_peered":"2024-04-24T23:38:33.134584+0000","last_unstale":"2024-04-24T23:38:39.373865+0000","last_undegraded":"2024-04-24T23:38:39.373865+0000","last_fullsized":"2024-04-24T23:38:39.373865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:21.418436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370791+0000","last_change":"2024-04-24T23:38:34.164655+0000","last_active":"2024-04-24T23:38:39.370791+0000","last_peered":"2024-04-24T23:38:39.370791+0000","last_clean":"2024-04-24T23:38:39.370791+0000","last_became_active":"2024-04-24T23:38:34.162093+0000","last_became_peered":"2024-04-24T23:38:34.162093+0000","last_unstale":"2024-04-24T23:38:39.370791+0000","last_undegraded":"2024-04-24T23:38:39.370791+0000","last_fullsized":"2024-04-24T23:38:39.370791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370307+0000","last_change":"2024-04-24T23:38:38.252169+0000","last_active":"2024-04-24T23:38:39.370307+0000","last_peered":"2024-04-24T23:38:39.370307+0000","last_clean":"2024-04-24T23:38:39.370307+0000","last_became_active":"2024-04-24T23:38:38.251653+0000","last_became_peered":"2024-04-24T23:38:38.251653+0000","last_unstale":"2024-04-24T23:38:39.370307+0000","last_undegraded":"2024-04-24T23:38:39.370307+0000","last_fullsized":"2024-04-24T23:38:39.370307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:57.651551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371463+0000","last_change":"2024-04-24T23:38:33.124025+0000","last_active":"2024-04-24T23:38:39.371463+0000","last_peered":"2024-04-24T23:38:39.371463+0000","last_clean":"2024-04-24T23:38:39.371463+0000","last_became_active":"2024-04-24T23:38:33.123681+0000","last_became_peered":"2024-04-24T23:38:33.123681+0000","last_unstale":"2024-04-24T23:38:39.371463+0000","last_undegraded":"2024-04-24T23:38:39.371463+0000","last_fullsized":"2024-04-24T23:38:39.371463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:27:41.421732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373542+0000","last_change":"2024-04-24T23:38:34.169793+0000","last_active":"2024-04-24T23:38:39.373542+0000","last_peered":"2024-04-24T23:38:39.373542+0000","last_clean":"2024-04-24T23:38:39.373542+0000","last_became_active":"2024-04-24T23:38:34.169115+0000","last_became_peered":"2024-04-24T23:38:34.169115+0000","last_unstale":"2024-04-24T23:38:39.373542+0000","last_undegraded":"2024-04-24T23:38:39.373542+0000","last_fullsized":"2024-04-24T23:38:39.373542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:39.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.234391+0000","last_change":"2024-04-24T23:38:38.221580+0000","last_active":"2024-04-24T23:38:39.234391+0000","last_peered":"2024-04-24T23:38:39.234391+0000","last_clean":"2024-04-24T23:38:39.234391+0000","last_became_active":"2024-04-24T23:38:38.220392+0000","last_became_peered":"2024-04-24T23:38:38.220392+0000","last_unstale":"2024-04-24T23:38:39.234391+0000","last_undegraded":"2024-04-24T23:38:39.234391+0000","last_fullsized":"2024-04-24T23:38:39.234391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:16:01.852170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372470+0000","last_change":"2024-04-24T23:38:33.144231+0000","last_active":"2024-04-24T23:38:39.372470+0000","last_peered":"2024-04-24T23:38:39.372470+0000","last_clean":"2024-04-24T23:38:39.372470+0000","last_became_active":"2024-04-24T23:38:33.143542+0000","last_became_peered":"2024-04-24T23:38:33.143542+0000","last_unstale":"2024-04-24T23:38:39.372470+0000","last_undegraded":"2024-04-24T23:38:39.372470+0000","last_fullsized":"2024-04-24T23:38:39.372470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:09.575181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371937+0000","last_change":"2024-04-24T23:38:34.170796+0000","last_active":"2024-04-24T23:38:39.371937+0000","last_peered":"2024-04-24T23:38:39.371937+0000","last_clean":"2024-04-24T23:38:39.371937+0000","last_became_active":"2024-04-24T23:38:34.169908+0000","last_became_peered":"2024-04-24T23:38:34.169908+0000","last_unstale":"2024-04-24T23:38:39.371937+0000","last_undegraded":"2024-04-24T23:38:39.371937+0000","last_fullsized":"2024-04-24T23:38:39.371937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:17:07.009163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.234557+0000","last_change":"2024-04-24T23:38:38.218416+0000","last_active":"2024-04-24T23:38:39.234557+0000","last_peered":"2024-04-24T23:38:39.234557+0000","last_clean":"2024-04-24T23:38:39.234557+0000","last_became_active":"2024-04-24T23:38:38.217390+0000","last_became_peered":"2024-04-24T23:38:38.217390+0000","last_unstale":"2024-04-24T23:38:39.234557+0000","last_undegraded":"2024-04-24T23:38:39.234557+0000","last_fullsized":"2024-04-24T23:38:39.234557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:31.231780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371812+0000","last_change":"2024-04-24T23:38:33.149114+0000","last_active":"2024-04-24T23:38:39.371812+0000","last_peered":"2024-04-24T23:38:39.371812+0000","last_clean":"2024-04-24T23:38:39.371812+0000","last_became_active":"2024-04-24T23:38:33.148510+0000","last_became_peered":"2024-04-24T23:38:33.148510+0000","last_unstale":"2024-04-24T23:38:39.371812+0000","last_undegraded":"2024-04-24T23:38:39.371812+0000","last_fullsized":"2024-04-24T23:38:39.371812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:39.396571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373009+0000","last_change":"2024-04-24T23:38:34.153747+0000","last_active":"2024-04-24T23:38:39.373009+0000","last_peered":"2024-04-24T23:38:39.373009+0000","last_clean":"2024-04-24T23:38:39.373009+0000","last_became_active":"2024-04-24T23:38:34.152984+0000","last_became_peered":"2024-04-24T23:38:34.152984+0000","last_unstale":"2024-04-24T23:38:39.373009+0000","last_undegraded":"2024-04-24T23:38:39.373009+0000","last_fullsized":"2024-04-24T23:38:39.373009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:54.469544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233889+0000","last_change":"2024-04-24T23:38:38.222542+0000","last_active":"2024-04-24T23:38:39.233889+0000","last_peered":"2024-04-24T23:38:39.233889+0000","last_clean":"2024-04-24T23:38:39.233889+0000","last_became_active":"2024-04-24T23:38:38.220601+0000","last_became_peered":"2024-04-24T23:38:38.220601+0000","last_unstale":"2024-04-24T23:38:39.233889+0000","last_undegraded":"2024-04-24T23:38:39.233889+0000","last_fullsized":"2024-04-24T23:38:39.233889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:32.372869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233089+0000","last_change":"2024-04-24T23:38:34.142429+0000","last_active":"2024-04-24T23:38:39.233089+0000","last_peered":"2024-04-24T23:38:39.233089+0000","last_clean":"2024-04-24T23:38:39.233089+0000","last_became_active":"2024-04-24T23:38:34.141681+0000","last_became_peered":"2024-04-24T23:38:34.141681+0000","last_unstale":"2024-04-24T23:38:39.233089+0000","last_undegraded":"2024-04-24T23:38:39.233089+0000","last_fullsized":"2024-04-24T23:38:39.233089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:57:25.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371592+0000","last_change":"2024-04-24T23:38:33.140585+0000","last_active":"2024-04-24T23:38:39.371592+0000","last_peered":"2024-04-24T23:38:39.371592+0000","last_clean":"2024-04-24T23:38:39.371592+0000","last_became_active":"2024-04-24T23:38:33.139303+0000","last_became_peered":"2024-04-24T23:38:33.139303+0000","last_unstale":"2024-04-24T23:38:39.371592+0000","last_undegraded":"2024-04-24T23:38:39.371592+0000","last_fullsized":"2024-04-24T23:38:39.371592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:23.343617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.237020+0000","last_change":"2024-04-24T23:38:38.216184+0000","last_active":"2024-04-24T23:38:39.237020+0000","last_peered":"2024-04-24T23:38:39.237020+0000","last_clean":"2024-04-24T23:38:39.237020+0000","last_became_active":"2024-04-24T23:38:38.214813+0000","last_became_peered":"2024-04-24T23:38:38.214813+0000","last_unstale":"2024-04-24T23:38:39.237020+0000","last_undegraded":"2024-04-24T23:38:39.237020+0000","last_fullsized":"2024-04-24T23:38:39.237020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:58.553943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371206+0000","last_change":"2024-04-24T23:38:34.174790+0000","last_active":"2024-04-24T23:38:39.371206+0000","last_peered":"2024-04-24T23:38:39.371206+0000","last_clean":"2024-04-24T23:38:39.371206+0000","last_became_active":"2024-04-24T23:38:34.174504+0000","last_became_peered":"2024-04-24T23:38:34.174504+0000","last_unstale":"2024-04-24T23:38:39.371206+0000","last_undegraded":"2024-04-24T23:38:39.371206+0000","last_fullsized":"2024-04-24T23:38:39.371206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:27.147380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.368995+0000","last_change":"2024-04-24T23:38:33.125559+0000","last_active":"2024-04-24T23:38:39.368995+0000","last_peered":"2024-04-24T23:38:39.368995+0000","last_clean":"2024-04-24T23:38:39.368995+0000","last_became_active":"2024-04-24T23:38:33.125115+0000","last_became_peered":"2024-04-24T23:38:33.125115+0000","last_unstale":"2024-04-24T23:38:39.368995+0000","last_undegraded":"2024-04-24T23:38:39.368995+0000","last_fullsized":"2024-04-24T23:38:39.368995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:07.598128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.236267+0000","last_change":"2024-04-24T23:38:38.221669+0000","last_active":"2024-04-24T23:38:39.236267+0000","last_peered":"2024-04-24T23:38:39.236267+0000","last_clean":"2024-04-24T23:38:39.236267+0000","last_became_active":"2024-04-24T23:38:38.219797+0000","last_became_peered":"2024-04-24T23:38:38.219797+0000","last_unstale":"2024-04-24T23:38:39.236267+0000","last_undegraded":"2024-04-24T23:38:39.236267+0000","last_fullsized":"2024-04-24T23:38:39.236267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:04.091622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370565+0000","last_change":"2024-04-24T23:38:34.163966+0000","last_active":"2024-04-24T23:38:39.370565+0000","last_peered":"2024-04-24T23:38:39.370565+0000","last_clean":"2024-04-24T23:38:39.370565+0000","last_became_active":"2024-04-24T23:38:34.163291+0000","last_became_peered":"2024-04-24T23:38:34.163291+0000","last_unstale":"2024-04-24T23:38:39.370565+0000","last_undegraded":"2024-04-24T23:38:39.370565+0000","last_fullsized":"2024-04-24T23:38:39.370565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:34.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.368689+0000","last_change":"2024-04-24T23:38:33.119549+0000","last_active":"2024-04-24T23:38:39.368689+0000","last_peered":"2024-04-24T23:38:39.368689+0000","last_clean":"2024-04-24T23:38:39.368689+0000","last_became_active":"2024-04-24T23:38:33.119052+0000","last_became_peered":"2024-04-24T23:38:33.119052+0000","last_unstale":"2024-04-24T23:38:39.368689+0000","last_undegraded":"2024-04-24T23:38:39.368689+0000","last_fullsized":"2024-04-24T23:38:39.368689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369506+0000","last_change":"2024-04-24T23:38:38.252720+0000","last_active":"2024-04-24T23:38:39.369506+0000","last_peered":"2024-04-24T23:38:39.369506+0000","last_clean":"2024-04-24T23:38:39.369506+0000","last_became_active":"2024-04-24T23:38:38.252138+0000","last_became_peered":"2024-04-24T23:38:38.252138+0000","last_unstale":"2024-04-24T23:38:39.369506+0000","last_undegraded":"2024-04-24T23:38:39.369506+0000","last_fullsized":"2024-04-24T23:38:39.369506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:18.964372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.234166+0000","last_change":"2024-04-24T23:38:34.157008+0000","last_active":"2024-04-24T23:38:39.234166+0000","last_peered":"2024-04-24T23:38:39.234166+0000","last_clean":"2024-04-24T23:38:39.234166+0000","last_became_active":"2024-04-24T23:38:34.152682+0000","last_became_peered":"2024-04-24T23:38:34.152682+0000","last_unstale":"2024-04-24T23:38:39.234166+0000","last_undegraded":"2024-04-24T23:38:39.234166+0000","last_fullsized":"2024-04-24T23:38:39.234166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:48.697457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370213+0000","last_change":"2024-04-24T23:38:33.139819+0000","last_active":"2024-04-24T23:38:39.370213+0000","last_peered":"2024-04-24T23:38:39.370213+0000","last_clean":"2024-04-24T23:38:39.370213+0000","last_became_active":"2024-04-24T23:38:33.139175+0000","last_became_peered":"2024-04-24T23:38:33.139175+0000","last_unstale":"2024-04-24T23:38:39.370213+0000","last_undegraded":"2024-04-24T23:38:39.370213+0000","last_fullsized":"2024-04-24T23:38:39.370213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:52.007425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.236331+0000","last_change":"2024-04-24T23:38:38.217726+0000","last_active":"2024-04-24T23:38:39.236331+0000","last_peered":"2024-04-24T23:38:39.236331+0000","last_clean":"2024-04-24T23:38:39.236331+0000","last_became_active":"2024-04-24T23:38:38.216742+0000","last_became_peered":"2024-04-24T23:38:38.216742+0000","last_unstale":"2024-04-24T23:38:39.236331+0000","last_undegraded":"2024-04-24T23:38:39.236331+0000","last_fullsized":"2024-04-24T23:38:39.236331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:09:48.267004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.374038+0000","last_change":"2024-04-24T23:38:34.154755+0000","last_active":"2024-04-24T23:38:39.374038+0000","last_peered":"2024-04-24T23:38:39.374038+0000","last_clean":"2024-04-24T23:38:39.374038+0000","last_became_active":"2024-04-24T23:38:34.153967+0000","last_became_peered":"2024-04-24T23:38:34.153967+0000","last_unstale":"2024-04-24T23:38:39.374038+0000","last_undegraded":"2024-04-24T23:38:39.374038+0000","last_fullsized":"2024-04-24T23:38:39.374038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.236385+0000","last_change":"2024-04-24T23:38:33.135885+0000","last_active":"2024-04-24T23:38:39.236385+0000","last_peered":"2024-04-24T23:38:39.236385+0000","last_clean":"2024-04-24T23:38:39.236385+0000","last_became_active":"2024-04-24T23:38:33.135225+0000","last_became_peered":"2024-04-24T23:38:33.135225+0000","last_unstale":"2024-04-24T23:38:39.236385+0000","last_undegraded":"2024-04-24T23:38:39.236385+0000","last_fullsized":"2024-04-24T23:38:39.236385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:52.007425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233734+0000","last_change":"2024-04-24T23:38:38.252002+0000","last_active":"2024-04-24T23:38:39.233734+0000","last_peered":"2024-04-24T23:38:39.233734+0000","last_clean":"2024-04-24T23:38:39.233734+0000","last_became_active":"2024-04-24T23:38:38.251057+0000","last_became_peered":"2024-04-24T23:38:38.251057+0000","last_unstale":"2024-04-24T23:38:39.233734+0000","last_undegraded":"2024-04-24T23:38:39.233734+0000","last_fullsized":"2024-04-24T23:38:39.233734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:49.920273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372125+0000","last_change":"2024-04-24T23:38:34.197959+0000","last_active":"2024-04-24T23:38:39.372125+0000","last_peered":"2024-04-24T23:38:39.372125+0000","last_clean":"2024-04-24T23:38:39.372125+0000","last_became_active":"2024-04-24T23:38:34.197702+0000","last_became_peered":"2024-04-24T23:38:34.197702+0000","last_unstale":"2024-04-24T23:38:39.372125+0000","last_undegraded":"2024-04-24T23:38:39.372125+0000","last_fullsized":"2024-04-24T23:38:39.372125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:56.049789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369618+0000","last_change":"2024-04-24T23:38:33.115409+0000","last_active":"2024-04-24T23:38:39.369618+0000","last_peered":"2024-04-24T23:38:39.369618+0000","last_clean":"2024-04-24T23:38:39.369618+0000","last_became_active":"2024-04-24T23:38:33.115039+0000","last_became_peered":"2024-04-24T23:38:33.115039+0000","last_unstale":"2024-04-24T23:38:39.369618+0000","last_undegraded":"2024-04-24T23:38:39.369618+0000","last_fullsized":"2024-04-24T23:38:39.369618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:52.007425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370020+0000","last_change":"2024-04-24T23:38:38.246602+0000","last_active":"2024-04-24T23:38:39.370020+0000","last_peered":"2024-04-24T23:38:39.370020+0000","last_clean":"2024-04-24T23:38:39.370020+0000","last_became_active":"2024-04-24T23:38:38.245775+0000","last_became_peered":"2024-04-24T23:38:38.245775+0000","last_unstale":"2024-04-24T23:38:39.370020+0000","last_undegraded":"2024-04-24T23:38:39.370020+0000","last_fullsized":"2024-04-24T23:38:39.370020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:29.684133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371153+0000","last_change":"2024-04-24T23:38:34.149008+0000","last_active":"2024-04-24T23:38:39.371153+0000","last_peered":"2024-04-24T23:38:39.371153+0000","last_clean":"2024-04-24T23:38:39.371153+0000","last_became_active":"2024-04-24T23:38:34.148122+0000","last_became_peered":"2024-04-24T23:38:34.148122+0000","last_unstale":"2024-04-24T23:38:39.371153+0000","last_undegraded":"2024-04-24T23:38:39.371153+0000","last_fullsized":"2024-04-24T23:38:39.371153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:39.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372690+0000","last_change":"2024-04-24T23:38:33.142490+0000","last_active":"2024-04-24T23:38:39.372690+0000","last_peered":"2024-04-24T23:38:39.372690+0000","last_clean":"2024-04-24T23:38:39.372690+0000","last_became_active":"2024-04-24T23:38:33.140003+0000","last_became_peered":"2024-04-24T23:38:33.140003+0000","last_unstale":"2024-04-24T23:38:39.372690+0000","last_undegraded":"2024-04-24T23:38:39.372690+0000","last_fullsized":"2024-04-24T23:38:39.372690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:45:12.216173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373352+0000","last_change":"2024-04-24T23:38:38.246291+0000","last_active":"2024-04-24T23:38:39.373352+0000","last_peered":"2024-04-24T23:38:39.373352+0000","last_clean":"2024-04-24T23:38:39.373352+0000","last_became_active":"2024-04-24T23:38:38.245611+0000","last_became_peered":"2024-04-24T23:38:38.245611+0000","last_unstale":"2024-04-24T23:38:39.373352+0000","last_undegraded":"2024-04-24T23:38:39.373352+0000","last_fullsized":"2024-04-24T23:38:39.373352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:47.898644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373130+0000","last_change":"2024-04-24T23:38:34.186285+0000","last_active":"2024-04-24T23:38:39.373130+0000","last_peered":"2024-04-24T23:38:39.373130+0000","last_clean":"2024-04-24T23:38:39.373130+0000","last_became_active":"2024-04-24T23:38:34.185023+0000","last_became_peered":"2024-04-24T23:38:34.185023+0000","last_unstale":"2024-04-24T23:38:39.373130+0000","last_undegraded":"2024-04-24T23:38:39.373130+0000","last_fullsized":"2024-04-24T23:38:39.373130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:56.947423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371300+0000","last_change":"2024-04-24T23:38:33.108447+0000","last_active":"2024-04-24T23:38:39.371300+0000","last_peered":"2024-04-24T23:38:39.371300+0000","last_clean":"2024-04-24T23:38:39.371300+0000","last_became_active":"2024-04-24T23:38:33.108102+0000","last_became_peered":"2024-04-24T23:38:33.108102+0000","last_unstale":"2024-04-24T23:38:39.371300+0000","last_undegraded":"2024-04-24T23:38:39.371300+0000","last_fullsized":"2024-04-24T23:38:39.371300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:47.686974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.368678+0000","last_change":"2024-04-24T23:38:38.213425+0000","last_active":"2024-04-24T23:38:39.368678+0000","last_peered":"2024-04-24T23:38:39.368678+0000","last_clean":"2024-04-24T23:38:39.368678+0000","last_became_active":"2024-04-24T23:38:38.212691+0000","last_became_peered":"2024-04-24T23:38:38.212691+0000","last_unstale":"2024-04-24T23:38:39.368678+0000","last_undegraded":"2024-04-24T23:38:39.368678+0000","last_fullsized":"2024-04-24T23:38:39.368678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:01.031822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.235941+0000","last_change":"2024-04-24T23:38:34.154178+0000","last_active":"2024-04-24T23:38:39.235941+0000","last_peered":"2024-04-24T23:38:39.235941+0000","last_clean":"2024-04-24T23:38:39.235941+0000","last_became_active":"2024-04-24T23:38:34.153372+0000","last_became_peered":"2024-04-24T23:38:34.153372+0000","last_unstale":"2024-04-24T23:38:39.235941+0000","last_undegraded":"2024-04-24T23:38:39.235941+0000","last_fullsized":"2024-04-24T23:38:39.235941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:10.585665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370977+0000","last_change":"2024-04-24T23:38:33.140060+0000","last_active":"2024-04-24T23:38:39.370977+0000","last_peered":"2024-04-24T23:38:39.370977+0000","last_clean":"2024-04-24T23:38:39.370977+0000","last_became_active":"2024-04-24T23:38:33.139012+0000","last_became_peered":"2024-04-24T23:38:33.139012+0000","last_unstale":"2024-04-24T23:38:39.370977+0000","last_undegraded":"2024-04-24T23:38:39.370977+0000","last_fullsized":"2024-04-24T23:38:39.370977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371155+0000","last_change":"2024-04-24T23:38:38.209741+0000","last_active":"2024-04-24T23:38:39.371155+0000","last_peered":"2024-04-24T23:38:39.371155+0000","last_clean":"2024-04-24T23:38:39.371155+0000","last_became_active":"2024-04-24T23:38:38.209117+0000","last_became_peered":"2024-04-24T23:38:38.209117+0000","last_unstale":"2024-04-24T23:38:39.371155+0000","last_undegraded":"2024-04-24T23:38:39.371155+0000","last_fullsized":"2024-04-24T23:38:39.371155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:57.246661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369969+0000","last_change":"2024-04-24T23:38:34.152846+0000","last_active":"2024-04-24T23:38:39.369969+0000","last_peered":"2024-04-24T23:38:39.369969+0000","last_clean":"2024-04-24T23:38:39.369969+0000","last_became_active":"2024-04-24T23:38:34.151917+0000","last_became_peered":"2024-04-24T23:38:34.151917+0000","last_unstale":"2024-04-24T23:38:39.369969+0000","last_undegraded":"2024-04-24T23:38:39.369969+0000","last_fullsized":"2024-04-24T23:38:39.369969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:34.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233390+0000","last_change":"2024-04-24T23:38:33.124295+0000","last_active":"2024-04-24T23:38:39.233390+0000","last_peered":"2024-04-24T23:38:39.233390+0000","last_clean":"2024-04-24T23:38:39.233390+0000","last_became_active":"2024-04-24T23:38:33.123674+0000","last_became_peered":"2024-04-24T23:38:33.123674+0000","last_unstale":"2024-04-24T23:38:39.233390+0000","last_undegraded":"2024-04-24T23:38:39.233390+0000","last_fullsized":"2024-04-24T23:38:39.233390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369687+0000","last_change":"2024-04-24T23:38:38.214721+0000","last_active":"2024-04-24T23:38:39.369687+0000","last_peered":"2024-04-24T23:38:39.369687+0000","last_clean":"2024-04-24T23:38:39.369687+0000","last_became_active":"2024-04-24T23:38:38.214005+0000","last_became_peered":"2024-04-24T23:38:38.214005+0000","last_unstale":"2024-04-24T23:38:39.369687+0000","last_undegraded":"2024-04-24T23:38:39.369687+0000","last_fullsized":"2024-04-24T23:38:39.369687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:29:56.066046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371950+0000","last_change":"2024-04-24T23:38:34.139551+0000","last_active":"2024-04-24T23:38:39.371950+0000","last_peered":"2024-04-24T23:38:39.371950+0000","last_clean":"2024-04-24T23:38:39.371950+0000","last_became_active":"2024-04-24T23:38:34.138681+0000","last_became_peered":"2024-04-24T23:38:34.138681+0000","last_unstale":"2024-04-24T23:38:39.371950+0000","last_undegraded":"2024-04-24T23:38:39.371950+0000","last_fullsized":"2024-04-24T23:38:39.371950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:47.556651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370480+0000","last_change":"2024-04-24T23:38:33.141279+0000","last_active":"2024-04-24T23:38:39.370480+0000","last_peered":"2024-04-24T23:38:39.370480+0000","last_clean":"2024-04-24T23:38:39.370480+0000","last_became_active":"2024-04-24T23:38:33.140618+0000","last_became_peered":"2024-04-24T23:38:33.140618+0000","last_unstale":"2024-04-24T23:38:39.370480+0000","last_undegraded":"2024-04-24T23:38:39.370480+0000","last_fullsized":"2024-04-24T23:38:39.370480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373893+0000","last_change":"2024-04-24T23:38:38.250074+0000","last_active":"2024-04-24T23:38:39.373893+0000","last_peered":"2024-04-24T23:38:39.373893+0000","last_clean":"2024-04-24T23:38:39.373893+0000","last_became_active":"2024-04-24T23:38:38.249402+0000","last_became_peered":"2024-04-24T23:38:38.249402+0000","last_unstale":"2024-04-24T23:38:39.373893+0000","last_undegraded":"2024-04-24T23:38:39.373893+0000","last_fullsized":"2024-04-24T23:38:39.373893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:57.246661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370993+0000","last_change":"2024-04-24T23:38:34.187980+0000","last_active":"2024-04-24T23:38:39.370993+0000","last_peered":"2024-04-24T23:38:39.370993+0000","last_clean":"2024-04-24T23:38:39.370993+0000","last_became_active":"2024-04-24T23:38:34.187655+0000","last_became_peered":"2024-04-24T23:38:34.187655+0000","last_unstale":"2024-04-24T23:38:39.370993+0000","last_undegraded":"2024-04-24T23:38:39.370993+0000","last_fullsized":"2024-04-24T23:38:39.370993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:39.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371342+0000","last_change":"2024-04-24T23:38:33.125255+0000","last_active":"2024-04-24T23:38:39.371342+0000","last_peered":"2024-04-24T23:38:39.371342+0000","last_clean":"2024-04-24T23:38:39.371342+0000","last_became_active":"2024-04-24T23:38:33.115926+0000","last_became_peered":"2024-04-24T23:38:33.115926+0000","last_unstale":"2024-04-24T23:38:39.371342+0000","last_undegraded":"2024-04-24T23:38:39.371342+0000","last_fullsized":"2024-04-24T23:38:39.371342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:42.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370492+0000","last_change":"2024-04-24T23:38:29.564705+0000","last_active":"2024-04-24T23:38:39.370492+0000","last_peered":"2024-04-24T23:38:39.370492+0000","last_clean":"2024-04-24T23:38:39.370492+0000","last_became_active":"2024-04-24T23:38:29.562027+0000","last_became_peered":"2024-04-24T23:38:29.562027+0000","last_unstale":"2024-04-24T23:38:39.370492+0000","last_undegraded":"2024-04-24T23:38:39.370492+0000","last_fullsized":"2024-04-24T23:38:39.370492+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:27.959678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:27.959678+0000","last_clean_scrub_stamp":"2024-04-24T23:38:27.959678+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:40.724497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.234993+0000","last_change":"2024-04-24T23:38:38.254846+0000","last_active":"2024-04-24T23:38:39.234993+0000","last_peered":"2024-04-24T23:38:39.234993+0000","last_clean":"2024-04-24T23:38:39.234993+0000","last_became_active":"2024-04-24T23:38:38.253792+0000","last_became_peered":"2024-04-24T23:38:38.253792+0000","last_unstale":"2024-04-24T23:38:39.234993+0000","last_undegraded":"2024-04-24T23:38:39.234993+0000","last_fullsized":"2024-04-24T23:38:39.234993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:17:11.093562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372209+0000","last_change":"2024-04-24T23:38:34.195003+0000","last_active":"2024-04-24T23:38:39.372209+0000","last_peered":"2024-04-24T23:38:39.372209+0000","last_clean":"2024-04-24T23:38:39.372209+0000","last_became_active":"2024-04-24T23:38:34.194530+0000","last_became_peered":"2024-04-24T23:38:34.194530+0000","last_unstale":"2024-04-24T23:38:39.372209+0000","last_undegraded":"2024-04-24T23:38:39.372209+0000","last_fullsized":"2024-04-24T23:38:39.372209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:00.007223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233847+0000","last_change":"2024-04-24T23:38:33.130165+0000","last_active":"2024-04-24T23:38:39.233847+0000","last_peered":"2024-04-24T23:38:39.233847+0000","last_clean":"2024-04-24T23:38:39.233847+0000","last_became_active":"2024-04-24T23:38:33.129888+0000","last_became_peered":"2024-04-24T23:38:33.129888+0000","last_unstale":"2024-04-24T23:38:39.233847+0000","last_undegraded":"2024-04-24T23:38:39.233847+0000","last_fullsized":"2024-04-24T23:38:39.233847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:27:41.421732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233796+0000","last_change":"2024-04-24T23:38:38.253780+0000","last_active":"2024-04-24T23:38:39.233796+0000","last_peered":"2024-04-24T23:38:39.233796+0000","last_clean":"2024-04-24T23:38:39.233796+0000","last_became_active":"2024-04-24T23:38:38.252899+0000","last_became_peered":"2024-04-24T23:38:38.252899+0000","last_unstale":"2024-04-24T23:38:39.233796+0000","last_undegraded":"2024-04-24T23:38:39.233796+0000","last_fullsized":"2024-04-24T23:38:39.233796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:58.553943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372148+0000","last_change":"2024-04-24T23:38:34.187942+0000","last_active":"2024-04-24T23:38:39.372148+0000","last_peered":"2024-04-24T23:38:39.372148+0000","last_clean":"2024-04-24T23:38:39.372148+0000","last_became_active":"2024-04-24T23:38:34.184929+0000","last_became_peered":"2024-04-24T23:38:34.184929+0000","last_unstale":"2024-04-24T23:38:39.372148+0000","last_undegraded":"2024-04-24T23:38:39.372148+0000","last_fullsized":"2024-04-24T23:38:39.372148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:43.814245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369941+0000","last_change":"2024-04-24T23:38:33.120289+0000","last_active":"2024-04-24T23:38:39.369941+0000","last_peered":"2024-04-24T23:38:39.369941+0000","last_clean":"2024-04-24T23:38:39.369941+0000","last_became_active":"2024-04-24T23:38:33.119790+0000","last_became_peered":"2024-04-24T23:38:33.119790+0000","last_unstale":"2024-04-24T23:38:39.369941+0000","last_undegraded":"2024-04-24T23:38:39.369941+0000","last_fullsized":"2024-04-24T23:38:39.369941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373416+0000","last_change":"2024-04-24T23:38:38.216064+0000","last_active":"2024-04-24T23:38:39.373416+0000","last_peered":"2024-04-24T23:38:39.373416+0000","last_clean":"2024-04-24T23:38:39.373416+0000","last_became_active":"2024-04-24T23:38:38.215599+0000","last_became_peered":"2024-04-24T23:38:38.215599+0000","last_unstale":"2024-04-24T23:38:39.373416+0000","last_undegraded":"2024-04-24T23:38:39.373416+0000","last_fullsized":"2024-04-24T23:38:39.373416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:01.031822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373089+0000","last_change":"2024-04-24T23:38:34.194305+0000","last_active":"2024-04-24T23:38:39.373089+0000","last_peered":"2024-04-24T23:38:39.373089+0000","last_clean":"2024-04-24T23:38:39.373089+0000","last_became_active":"2024-04-24T23:38:34.188815+0000","last_became_peered":"2024-04-24T23:38:34.188815+0000","last_unstale":"2024-04-24T23:38:39.373089+0000","last_undegraded":"2024-04-24T23:38:39.373089+0000","last_fullsized":"2024-04-24T23:38:39.373089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:25.599734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233801+0000","last_change":"2024-04-24T23:38:33.125221+0000","last_active":"2024-04-24T23:38:39.233801+0000","last_peered":"2024-04-24T23:38:39.233801+0000","last_clean":"2024-04-24T23:38:39.233801+0000","last_became_active":"2024-04-24T23:38:33.124849+0000","last_became_peered":"2024-04-24T23:38:33.124849+0000","last_unstale":"2024-04-24T23:38:39.233801+0000","last_undegraded":"2024-04-24T23:38:39.233801+0000","last_fullsized":"2024-04-24T23:38:39.233801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:42.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369725+0000","last_change":"2024-04-24T23:38:38.250618+0000","last_active":"2024-04-24T23:38:39.369725+0000","last_peered":"2024-04-24T23:38:39.369725+0000","last_clean":"2024-04-24T23:38:39.369725+0000","last_became_active":"2024-04-24T23:38:38.249521+0000","last_became_peered":"2024-04-24T23:38:38.249521+0000","last_unstale":"2024-04-24T23:38:39.369725+0000","last_undegraded":"2024-04-24T23:38:39.369725+0000","last_fullsized":"2024-04-24T23:38:39.369725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:57.651551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372769+0000","last_change":"2024-04-24T23:38:34.166018+0000","last_active":"2024-04-24T23:38:39.372769+0000","last_peered":"2024-04-24T23:38:39.372769+0000","last_clean":"2024-04-24T23:38:39.372769+0000","last_became_active":"2024-04-24T23:38:34.165229+0000","last_became_peered":"2024-04-24T23:38:34.165229+0000","last_unstale":"2024-04-24T23:38:39.372769+0000","last_undegraded":"2024-04-24T23:38:39.372769+0000","last_fullsized":"2024-04-24T23:38:39.372769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:56.947423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.236714+0000","last_change":"2024-04-24T23:38:33.109771+0000","last_active":"2024-04-24T23:38:39.236714+0000","last_peered":"2024-04-24T23:38:39.236714+0000","last_clean":"2024-04-24T23:38:39.236714+0000","last_became_active":"2024-04-24T23:38:33.108928+0000","last_became_peered":"2024-04-24T23:38:33.108928+0000","last_unstale":"2024-04-24T23:38:39.236714+0000","last_undegraded":"2024-04-24T23:38:39.236714+0000","last_fullsized":"2024-04-24T23:38:39.236714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:44.838533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233300+0000","last_change":"2024-04-24T23:38:38.221186+0000","last_active":"2024-04-24T23:38:39.233300+0000","last_peered":"2024-04-24T23:38:39.233300+0000","last_clean":"2024-04-24T23:38:39.233300+0000","last_became_active":"2024-04-24T23:38:38.219780+0000","last_became_peered":"2024-04-24T23:38:38.219780+0000","last_unstale":"2024-04-24T23:38:39.233300+0000","last_undegraded":"2024-04-24T23:38:39.233300+0000","last_fullsized":"2024-04-24T23:38:39.233300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:43.959509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370916+0000","last_change":"2024-04-24T23:38:34.188981+0000","last_active":"2024-04-24T23:38:39.370916+0000","last_peered":"2024-04-24T23:38:39.370916+0000","last_clean":"2024-04-24T23:38:39.370916+0000","last_became_active":"2024-04-24T23:38:34.188416+0000","last_became_peered":"2024-04-24T23:38:34.188416+0000","last_unstale":"2024-04-24T23:38:39.370916+0000","last_undegraded":"2024-04-24T23:38:39.370916+0000","last_fullsized":"2024-04-24T23:38:39.370916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:17:07.009163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.232834+0000","last_change":"2024-04-24T23:38:33.100912+0000","last_active":"2024-04-24T23:38:39.232834+0000","last_peered":"2024-04-24T23:38:39.232834+0000","last_clean":"2024-04-24T23:38:39.232834+0000","last_became_active":"2024-04-24T23:38:33.100464+0000","last_became_peered":"2024-04-24T23:38:33.100464+0000","last_unstale":"2024-04-24T23:38:39.232834+0000","last_undegraded":"2024-04-24T23:38:39.232834+0000","last_fullsized":"2024-04-24T23:38:39.232834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:47:27.107958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373806+0000","last_change":"2024-04-24T23:38:38.207627+0000","last_active":"2024-04-24T23:38:39.373806+0000","last_peered":"2024-04-24T23:38:39.373806+0000","last_clean":"2024-04-24T23:38:39.373806+0000","last_became_active":"2024-04-24T23:38:38.207049+0000","last_became_peered":"2024-04-24T23:38:38.207049+0000","last_unstale":"2024-04-24T23:38:39.373806+0000","last_undegraded":"2024-04-24T23:38:39.373806+0000","last_fullsized":"2024-04-24T23:38:39.373806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:29:56.066046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233320+0000","last_change":"2024-04-24T23:38:34.161654+0000","last_active":"2024-04-24T23:38:39.233320+0000","last_peered":"2024-04-24T23:38:39.233320+0000","last_clean":"2024-04-24T23:38:39.233320+0000","last_became_active":"2024-04-24T23:38:34.158756+0000","last_became_peered":"2024-04-24T23:38:34.158756+0000","last_unstale":"2024-04-24T23:38:39.233320+0000","last_undegraded":"2024-04-24T23:38:39.233320+0000","last_fullsized":"2024-04-24T23:38:39.233320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:29.660159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233535+0000","last_change":"2024-04-24T23:38:33.116071+0000","last_active":"2024-04-24T23:38:39.233535+0000","last_peered":"2024-04-24T23:38:39.233535+0000","last_clean":"2024-04-24T23:38:39.233535+0000","last_became_active":"2024-04-24T23:38:33.115472+0000","last_became_peered":"2024-04-24T23:38:33.115472+0000","last_unstale":"2024-04-24T23:38:39.233535+0000","last_undegraded":"2024-04-24T23:38:39.233535+0000","last_fullsized":"2024-04-24T23:38:39.233535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:47.686974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372026+0000","last_change":"2024-04-24T23:38:38.248841+0000","last_active":"2024-04-24T23:38:39.372026+0000","last_peered":"2024-04-24T23:38:39.372026+0000","last_clean":"2024-04-24T23:38:39.372026+0000","last_became_active":"2024-04-24T23:38:38.248311+0000","last_became_peered":"2024-04-24T23:38:38.248311+0000","last_unstale":"2024-04-24T23:38:39.372026+0000","last_undegraded":"2024-04-24T23:38:39.372026+0000","last_fullsized":"2024-04-24T23:38:39.372026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:22.798878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371400+0000","last_change":"2024-04-24T23:38:34.189772+0000","last_active":"2024-04-24T23:38:39.371400+0000","last_peered":"2024-04-24T23:38:39.371400+0000","last_clean":"2024-04-24T23:38:39.371400+0000","last_became_active":"2024-04-24T23:38:34.179801+0000","last_became_peered":"2024-04-24T23:38:34.179801+0000","last_unstale":"2024-04-24T23:38:39.371400+0000","last_undegraded":"2024-04-24T23:38:39.371400+0000","last_fullsized":"2024-04-24T23:38:39.371400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:54.469544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370810+0000","last_change":"2024-04-24T23:38:33.146611+0000","last_active":"2024-04-24T23:38:39.370810+0000","last_peered":"2024-04-24T23:38:39.370810+0000","last_clean":"2024-04-24T23:38:39.370810+0000","last_became_active":"2024-04-24T23:38:33.145896+0000","last_became_peered":"2024-04-24T23:38:33.145896+0000","last_unstale":"2024-04-24T23:38:39.370810+0000","last_undegraded":"2024-04-24T23:38:39.370810+0000","last_fullsized":"2024-04-24T23:38:39.370810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:47.686974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371670+0000","last_change":"2024-04-24T23:38:38.252023+0000","last_active":"2024-04-24T23:38:39.371670+0000","last_peered":"2024-04-24T23:38:39.371670+0000","last_clean":"2024-04-24T23:38:39.371670+0000","last_became_active":"2024-04-24T23:38:38.251541+0000","last_became_peered":"2024-04-24T23:38:38.251541+0000","last_unstale":"2024-04-24T23:38:39.371670+0000","last_undegraded":"2024-04-24T23:38:39.371670+0000","last_fullsized":"2024-04-24T23:38:39.371670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:25:30.720742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372969+0000","last_change":"2024-04-24T23:38:34.164658+0000","last_active":"2024-04-24T23:38:39.372969+0000","last_peered":"2024-04-24T23:38:39.372969+0000","last_clean":"2024-04-24T23:38:39.372969+0000","last_became_active":"2024-04-24T23:38:34.164024+0000","last_became_peered":"2024-04-24T23:38:34.164024+0000","last_unstale":"2024-04-24T23:38:39.372969+0000","last_undegraded":"2024-04-24T23:38:39.372969+0000","last_fullsized":"2024-04-24T23:38:39.372969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:47.516208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373646+0000","last_change":"2024-04-24T23:38:33.111314+0000","last_active":"2024-04-24T23:38:39.373646+0000","last_peered":"2024-04-24T23:38:39.373646+0000","last_clean":"2024-04-24T23:38:39.373646+0000","last_became_active":"2024-04-24T23:38:33.109819+0000","last_became_peered":"2024-04-24T23:38:33.109819+0000","last_unstale":"2024-04-24T23:38:39.373646+0000","last_undegraded":"2024-04-24T23:38:39.373646+0000","last_fullsized":"2024-04-24T23:38:39.373646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:21:39.944505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372849+0000","last_change":"2024-04-24T23:38:38.247323+0000","last_active":"2024-04-24T23:38:39.372849+0000","last_peered":"2024-04-24T23:38:39.372849+0000","last_clean":"2024-04-24T23:38:39.372849+0000","last_became_active":"2024-04-24T23:38:38.246172+0000","last_became_peered":"2024-04-24T23:38:38.246172+0000","last_unstale":"2024-04-24T23:38:39.372849+0000","last_undegraded":"2024-04-24T23:38:39.372849+0000","last_fullsized":"2024-04-24T23:38:39.372849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:32.771055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371920+0000","last_change":"2024-04-24T23:38:34.189746+0000","last_active":"2024-04-24T23:38:39.371920+0000","last_peered":"2024-04-24T23:38:39.371920+0000","last_clean":"2024-04-24T23:38:39.371920+0000","last_became_active":"2024-04-24T23:38:34.179433+0000","last_became_peered":"2024-04-24T23:38:34.179433+0000","last_unstale":"2024-04-24T23:38:39.371920+0000","last_undegraded":"2024-04-24T23:38:39.371920+0000","last_fullsized":"2024-04-24T23:38:39.371920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:56.049789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:44.751455+0000","last_change":"2024-04-24T23:38:33.127637+0000","last_active":"2024-04-24T23:38:44.751455+0000","last_peered":"2024-04-24T23:38:44.751455+0000","last_clean":"2024-04-24T23:38:44.751455+0000","last_became_active":"2024-04-24T23:38:33.127122+0000","last_became_peered":"2024-04-24T23:38:33.127122+0000","last_unstale":"2024-04-24T23:38:44.751455+0000","last_undegraded":"2024-04-24T23:38:44.751455+0000","last_fullsized":"2024-04-24T23:38:44.751455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.368989+0000","last_change":"2024-04-24T23:38:38.216781+0000","last_active":"2024-04-24T23:38:39.368989+0000","last_peered":"2024-04-24T23:38:39.368989+0000","last_clean":"2024-04-24T23:38:39.368989+0000","last_became_active":"2024-04-24T23:38:38.215741+0000","last_became_peered":"2024-04-24T23:38:38.215741+0000","last_unstale":"2024-04-24T23:38:39.368989+0000","last_undegraded":"2024-04-24T23:38:39.368989+0000","last_fullsized":"2024-04-24T23:38:39.368989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:47.898644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.236646+0000","last_change":"2024-04-24T23:38:34.167424+0000","last_active":"2024-04-24T23:38:39.236646+0000","last_peered":"2024-04-24T23:38:39.236646+0000","last_clean":"2024-04-24T23:38:39.236646+0000","last_became_active":"2024-04-24T23:38:34.166602+0000","last_became_peered":"2024-04-24T23:38:34.166602+0000","last_unstale":"2024-04-24T23:38:39.236646+0000","last_undegraded":"2024-04-24T23:38:39.236646+0000","last_fullsized":"2024-04-24T23:38:39.236646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:31.033906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369922+0000","last_change":"2024-04-24T23:38:33.146758+0000","last_active":"2024-04-24T23:38:39.369922+0000","last_peered":"2024-04-24T23:38:39.369922+0000","last_clean":"2024-04-24T23:38:39.369922+0000","last_became_active":"2024-04-24T23:38:33.146311+0000","last_became_peered":"2024-04-24T23:38:33.146311+0000","last_unstale":"2024-04-24T23:38:39.369922+0000","last_undegraded":"2024-04-24T23:38:39.369922+0000","last_fullsized":"2024-04-24T23:38:39.369922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:09.575181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.235128+0000","last_change":"2024-04-24T23:38:38.221177+0000","last_active":"2024-04-24T23:38:39.235128+0000","last_peered":"2024-04-24T23:38:39.235128+0000","last_clean":"2024-04-24T23:38:39.235128+0000","last_became_active":"2024-04-24T23:38:38.219482+0000","last_became_peered":"2024-04-24T23:38:38.219482+0000","last_unstale":"2024-04-24T23:38:39.235128+0000","last_undegraded":"2024-04-24T23:38:39.235128+0000","last_fullsized":"2024-04-24T23:38:39.235128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:00.134189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373742+0000","last_change":"2024-04-24T23:38:34.170044+0000","last_active":"2024-04-24T23:38:39.373742+0000","last_peered":"2024-04-24T23:38:39.373742+0000","last_clean":"2024-04-24T23:38:39.373742+0000","last_became_active":"2024-04-24T23:38:34.169512+0000","last_became_peered":"2024-04-24T23:38:34.169512+0000","last_unstale":"2024-04-24T23:38:39.373742+0000","last_undegraded":"2024-04-24T23:38:39.373742+0000","last_fullsized":"2024-04-24T23:38:39.373742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373445+0000","last_change":"2024-04-24T23:38:33.131079+0000","last_active":"2024-04-24T23:38:39.373445+0000","last_peered":"2024-04-24T23:38:39.373445+0000","last_clean":"2024-04-24T23:38:39.373445+0000","last_became_active":"2024-04-24T23:38:33.130150+0000","last_became_peered":"2024-04-24T23:38:33.130150+0000","last_unstale":"2024-04-24T23:38:39.373445+0000","last_undegraded":"2024-04-24T23:38:39.373445+0000","last_fullsized":"2024-04-24T23:38:39.373445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:07.598128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370359+0000","last_change":"2024-04-24T23:38:38.212241+0000","last_active":"2024-04-24T23:38:39.370359+0000","last_peered":"2024-04-24T23:38:39.370359+0000","last_clean":"2024-04-24T23:38:39.370359+0000","last_became_active":"2024-04-24T23:38:38.208130+0000","last_became_peered":"2024-04-24T23:38:38.208130+0000","last_unstale":"2024-04-24T23:38:39.370359+0000","last_undegraded":"2024-04-24T23:38:39.370359+0000","last_fullsized":"2024-04-24T23:38:39.370359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:32.771055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372578+0000","last_change":"2024-04-24T23:38:34.199814+0000","last_active":"2024-04-24T23:38:39.372578+0000","last_peered":"2024-04-24T23:38:39.372578+0000","last_clean":"2024-04-24T23:38:39.372578+0000","last_became_active":"2024-04-24T23:38:34.199311+0000","last_became_peered":"2024-04-24T23:38:34.199311+0000","last_unstale":"2024-04-24T23:38:39.372578+0000","last_undegraded":"2024-04-24T23:38:39.372578+0000","last_fullsized":"2024-04-24T23:38:39.372578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:09:44.182605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.235904+0000","last_change":"2024-04-24T23:38:33.140029+0000","last_active":"2024-04-24T23:38:39.235904+0000","last_peered":"2024-04-24T23:38:39.235904+0000","last_clean":"2024-04-24T23:38:39.235904+0000","last_became_active":"2024-04-24T23:38:33.139325+0000","last_became_peered":"2024-04-24T23:38:33.139325+0000","last_unstale":"2024-04-24T23:38:39.235904+0000","last_undegraded":"2024-04-24T23:38:39.235904+0000","last_fullsized":"2024-04-24T23:38:39.235904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:07.598128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370490+0000","last_change":"2024-04-24T23:38:38.246245+0000","last_active":"2024-04-24T23:38:39.370490+0000","last_peered":"2024-04-24T23:38:39.370490+0000","last_clean":"2024-04-24T23:38:39.370490+0000","last_became_active":"2024-04-24T23:38:38.245657+0000","last_became_peered":"2024-04-24T23:38:38.245657+0000","last_unstale":"2024-04-24T23:38:39.370490+0000","last_undegraded":"2024-04-24T23:38:39.370490+0000","last_fullsized":"2024-04-24T23:38:39.370490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:45.297412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373571+0000","last_change":"2024-04-24T23:38:38.251308+0000","last_active":"2024-04-24T23:38:39.373571+0000","last_peered":"2024-04-24T23:38:39.373571+0000","last_clean":"2024-04-24T23:38:39.373571+0000","last_became_active":"2024-04-24T23:38:38.250718+0000","last_became_peered":"2024-04-24T23:38:38.250718+0000","last_unstale":"2024-04-24T23:38:39.373571+0000","last_undegraded":"2024-04-24T23:38:39.373571+0000","last_fullsized":"2024-04-24T23:38:39.373571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:18.964372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.368478+0000","last_change":"2024-04-24T23:38:34.174658+0000","last_active":"2024-04-24T23:38:39.368478+0000","last_peered":"2024-04-24T23:38:39.368478+0000","last_clean":"2024-04-24T23:38:39.368478+0000","last_became_active":"2024-04-24T23:38:34.174289+0000","last_became_peered":"2024-04-24T23:38:34.174289+0000","last_unstale":"2024-04-24T23:38:39.368478+0000","last_undegraded":"2024-04-24T23:38:39.368478+0000","last_fullsized":"2024-04-24T23:38:39.368478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:29.660159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370081+0000","last_change":"2024-04-24T23:38:33.131171+0000","last_active":"2024-04-24T23:38:39.370081+0000","last_peered":"2024-04-24T23:38:39.370081+0000","last_clean":"2024-04-24T23:38:39.370081+0000","last_became_active":"2024-04-24T23:38:33.130621+0000","last_became_peered":"2024-04-24T23:38:33.130621+0000","last_unstale":"2024-04-24T23:38:39.370081+0000","last_undegraded":"2024-04-24T23:38:39.370081+0000","last_fullsized":"2024-04-24T23:38:39.370081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.237281+0000","last_change":"2024-04-24T23:38:38.214392+0000","last_active":"2024-04-24T23:38:39.237281+0000","last_peered":"2024-04-24T23:38:39.237281+0000","last_clean":"2024-04-24T23:38:39.237281+0000","last_became_active":"2024-04-24T23:38:38.213249+0000","last_became_peered":"2024-04-24T23:38:38.213249+0000","last_unstale":"2024-04-24T23:38:39.237281+0000","last_undegraded":"2024-04-24T23:38:39.237281+0000","last_fullsized":"2024-04-24T23:38:39.237281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:01.031822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370465+0000","last_change":"2024-04-24T23:38:34.164231+0000","last_active":"2024-04-24T23:38:39.370465+0000","last_peered":"2024-04-24T23:38:39.370465+0000","last_clean":"2024-04-24T23:38:39.370465+0000","last_became_active":"2024-04-24T23:38:34.163685+0000","last_became_peered":"2024-04-24T23:38:34.163685+0000","last_unstale":"2024-04-24T23:38:39.370465+0000","last_undegraded":"2024-04-24T23:38:39.370465+0000","last_fullsized":"2024-04-24T23:38:39.370465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:29.660159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370805+0000","last_change":"2024-04-24T23:38:33.116249+0000","last_active":"2024-04-24T23:38:39.370805+0000","last_peered":"2024-04-24T23:38:39.370805+0000","last_clean":"2024-04-24T23:38:39.370805+0000","last_became_active":"2024-04-24T23:38:33.113333+0000","last_became_peered":"2024-04-24T23:38:33.113333+0000","last_unstale":"2024-04-24T23:38:39.370805+0000","last_undegraded":"2024-04-24T23:38:39.370805+0000","last_fullsized":"2024-04-24T23:38:39.370805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:47:27.107958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.234325+0000","last_change":"2024-04-24T23:38:33.111080+0000","last_active":"2024-04-24T23:38:39.234325+0000","last_peered":"2024-04-24T23:38:39.234325+0000","last_clean":"2024-04-24T23:38:39.234325+0000","last_became_active":"2024-04-24T23:38:33.110315+0000","last_became_peered":"2024-04-24T23:38:33.110315+0000","last_unstale":"2024-04-24T23:38:39.234325+0000","last_undegraded":"2024-04-24T23:38:39.234325+0000","last_fullsized":"2024-04-24T23:38:39.234325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373627+0000","last_change":"2024-04-24T23:38:34.148734+0000","last_active":"2024-04-24T23:38:39.373627+0000","last_peered":"2024-04-24T23:38:39.373627+0000","last_clean":"2024-04-24T23:38:39.373627+0000","last_became_active":"2024-04-24T23:38:34.146909+0000","last_became_peered":"2024-04-24T23:38:34.146909+0000","last_unstale":"2024-04-24T23:38:39.373627+0000","last_undegraded":"2024-04-24T23:38:39.373627+0000","last_fullsized":"2024-04-24T23:38:39.373627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:57:25.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233481+0000","last_change":"2024-04-24T23:38:38.215787+0000","last_active":"2024-04-24T23:38:39.233481+0000","last_peered":"2024-04-24T23:38:39.233481+0000","last_clean":"2024-04-24T23:38:39.233481+0000","last_became_active":"2024-04-24T23:38:38.215395+0000","last_became_peered":"2024-04-24T23:38:38.215395+0000","last_unstale":"2024-04-24T23:38:39.233481+0000","last_undegraded":"2024-04-24T23:38:39.233481+0000","last_fullsized":"2024-04-24T23:38:39.233481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:51.641050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371303+0000","last_change":"2024-04-24T23:38:33.131735+0000","last_active":"2024-04-24T23:38:39.371303+0000","last_peered":"2024-04-24T23:38:39.371303+0000","last_clean":"2024-04-24T23:38:39.371303+0000","last_became_active":"2024-04-24T23:38:33.131314+0000","last_became_peered":"2024-04-24T23:38:33.131314+0000","last_unstale":"2024-04-24T23:38:39.371303+0000","last_undegraded":"2024-04-24T23:38:39.371303+0000","last_fullsized":"2024-04-24T23:38:39.371303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:42.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.234423+0000","last_change":"2024-04-24T23:38:34.150894+0000","last_active":"2024-04-24T23:38:39.234423+0000","last_peered":"2024-04-24T23:38:39.234423+0000","last_clean":"2024-04-24T23:38:39.234423+0000","last_became_active":"2024-04-24T23:38:34.149910+0000","last_became_peered":"2024-04-24T23:38:34.149910+0000","last_unstale":"2024-04-24T23:38:39.234423+0000","last_undegraded":"2024-04-24T23:38:39.234423+0000","last_fullsized":"2024-04-24T23:38:39.234423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:08.608611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370852+0000","last_change":"2024-04-24T23:38:38.219498+0000","last_active":"2024-04-24T23:38:39.370852+0000","last_peered":"2024-04-24T23:38:39.370852+0000","last_clean":"2024-04-24T23:38:39.370852+0000","last_became_active":"2024-04-24T23:38:38.219100+0000","last_became_peered":"2024-04-24T23:38:38.219100+0000","last_unstale":"2024-04-24T23:38:39.370852+0000","last_undegraded":"2024-04-24T23:38:39.370852+0000","last_fullsized":"2024-04-24T23:38:39.370852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:17.585261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.234025+0000","last_change":"2024-04-24T23:38:34.162139+0000","last_active":"2024-04-24T23:38:39.234025+0000","last_peered":"2024-04-24T23:38:39.234025+0000","last_clean":"2024-04-24T23:38:39.234025+0000","last_became_active":"2024-04-24T23:38:34.159701+0000","last_became_peered":"2024-04-24T23:38:34.159701+0000","last_unstale":"2024-04-24T23:38:39.234025+0000","last_undegraded":"2024-04-24T23:38:39.234025+0000","last_fullsized":"2024-04-24T23:38:39.234025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:34.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.232917+0000","last_change":"2024-04-24T23:38:34.156925+0000","last_active":"2024-04-24T23:38:39.232917+0000","last_peered":"2024-04-24T23:38:39.232917+0000","last_clean":"2024-04-24T23:38:39.232917+0000","last_became_active":"2024-04-24T23:38:34.155969+0000","last_became_peered":"2024-04-24T23:38:34.155969+0000","last_unstale":"2024-04-24T23:38:39.232917+0000","last_undegraded":"2024-04-24T23:38:39.232917+0000","last_fullsized":"2024-04-24T23:38:39.232917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:31.033906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370758+0000","last_change":"2024-04-24T23:38:34.188234+0000","last_active":"2024-04-24T23:38:39.370758+0000","last_peered":"2024-04-24T23:38:39.370758+0000","last_clean":"2024-04-24T23:38:39.370758+0000","last_became_active":"2024-04-24T23:38:34.186332+0000","last_became_peered":"2024-04-24T23:38:34.186332+0000","last_unstale":"2024-04-24T23:38:39.370758+0000","last_undegraded":"2024-04-24T23:38:39.370758+0000","last_fullsized":"2024-04-24T23:38:39.370758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:56.049789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373534+0000","last_change":"2024-04-24T23:38:34.154728+0000","last_active":"2024-04-24T23:38:39.373534+0000","last_peered":"2024-04-24T23:38:39.373534+0000","last_clean":"2024-04-24T23:38:39.373534+0000","last_became_active":"2024-04-24T23:38:34.147038+0000","last_became_peered":"2024-04-24T23:38:34.147038+0000","last_unstale":"2024-04-24T23:38:39.373534+0000","last_undegraded":"2024-04-24T23:38:39.373534+0000","last_fullsized":"2024-04-24T23:38:39.373534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:34.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371833+0000","last_change":"2024-04-24T23:38:34.164080+0000","last_active":"2024-04-24T23:38:39.371833+0000","last_peered":"2024-04-24T23:38:39.371833+0000","last_clean":"2024-04-24T23:38:39.371833+0000","last_became_active":"2024-04-24T23:38:34.163761+0000","last_became_peered":"2024-04-24T23:38:34.163761+0000","last_unstale":"2024-04-24T23:38:39.371833+0000","last_undegraded":"2024-04-24T23:38:39.371833+0000","last_fullsized":"2024-04-24T23:38:39.371833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:00.007223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369406+0000","last_change":"2024-04-24T23:38:34.166482+0000","last_active":"2024-04-24T23:38:39.369406+0000","last_peered":"2024-04-24T23:38:39.369406+0000","last_clean":"2024-04-24T23:38:39.369406+0000","last_became_active":"2024-04-24T23:38:34.166059+0000","last_became_peered":"2024-04-24T23:38:34.166059+0000","last_unstale":"2024-04-24T23:38:39.369406+0000","last_undegraded":"2024-04-24T23:38:39.369406+0000","last_fullsized":"2024-04-24T23:38:39.369406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.235851+0000","last_change":"2024-04-24T23:38:34.179301+0000","last_active":"2024-04-24T23:38:39.235851+0000","last_peered":"2024-04-24T23:38:39.235851+0000","last_clean":"2024-04-24T23:38:39.235851+0000","last_became_active":"2024-04-24T23:38:34.178651+0000","last_became_peered":"2024-04-24T23:38:34.178651+0000","last_unstale":"2024-04-24T23:38:39.235851+0000","last_undegraded":"2024-04-24T23:38:39.235851+0000","last_fullsized":"2024-04-24T23:38:39.235851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:57.767771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372076+0000","last_change":"2024-04-24T23:38:34.162572+0000","last_active":"2024-04-24T23:38:39.372076+0000","last_peered":"2024-04-24T23:38:39.372076+0000","last_clean":"2024-04-24T23:38:39.372076+0000","last_became_active":"2024-04-24T23:38:34.162156+0000","last_became_peered":"2024-04-24T23:38:34.162156+0000","last_unstale":"2024-04-24T23:38:39.372076+0000","last_undegraded":"2024-04-24T23:38:39.372076+0000","last_fullsized":"2024-04-24T23:38:39.372076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:57.767771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370006+0000","last_change":"2024-04-24T23:38:34.187429+0000","last_active":"2024-04-24T23:38:39.370006+0000","last_peered":"2024-04-24T23:38:39.370006+0000","last_clean":"2024-04-24T23:38:39.370006+0000","last_became_active":"2024-04-24T23:38:34.184827+0000","last_became_peered":"2024-04-24T23:38:34.184827+0000","last_unstale":"2024-04-24T23:38:39.370006+0000","last_undegraded":"2024-04-24T23:38:39.370006+0000","last_fullsized":"2024-04-24T23:38:39.370006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370651+0000","last_change":"2024-04-24T23:38:34.165830+0000","last_active":"2024-04-24T23:38:39.370651+0000","last_peered":"2024-04-24T23:38:39.370651+0000","last_clean":"2024-04-24T23:38:39.370651+0000","last_became_active":"2024-04-24T23:38:34.165531+0000","last_became_peered":"2024-04-24T23:38:34.165531+0000","last_unstale":"2024-04-24T23:38:39.370651+0000","last_undegraded":"2024-04-24T23:38:39.370651+0000","last_fullsized":"2024-04-24T23:38:39.370651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:57:25.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370515+0000","last_change":"2024-04-24T23:38:34.199810+0000","last_active":"2024-04-24T23:38:39.370515+0000","last_peered":"2024-04-24T23:38:39.370515+0000","last_clean":"2024-04-24T23:38:39.370515+0000","last_became_active":"2024-04-24T23:38:34.199173+0000","last_became_peered":"2024-04-24T23:38:34.199173+0000","last_unstale":"2024-04-24T23:38:39.370515+0000","last_undegraded":"2024-04-24T23:38:39.370515+0000","last_fullsized":"2024-04-24T23:38:39.370515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:27.147380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373229+0000","last_change":"2024-04-24T23:38:34.165276+0000","last_active":"2024-04-24T23:38:39.373229+0000","last_peered":"2024-04-24T23:38:39.373229+0000","last_clean":"2024-04-24T23:38:39.373229+0000","last_became_active":"2024-04-24T23:38:34.165000+0000","last_became_peered":"2024-04-24T23:38:34.165000+0000","last_unstale":"2024-04-24T23:38:39.373229+0000","last_undegraded":"2024-04-24T23:38:39.373229+0000","last_fullsized":"2024-04-24T23:38:39.373229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:30:58.955608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.235067+0000","last_change":"2024-04-24T23:38:34.146904+0000","last_active":"2024-04-24T23:38:39.235067+0000","last_peered":"2024-04-24T23:38:39.235067+0000","last_clean":"2024-04-24T23:38:39.235067+0000","last_became_active":"2024-04-24T23:38:34.146096+0000","last_became_peered":"2024-04-24T23:38:34.146096+0000","last_unstale":"2024-04-24T23:38:39.235067+0000","last_undegraded":"2024-04-24T23:38:39.235067+0000","last_fullsized":"2024-04-24T23:38:39.235067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:39.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372502+0000","last_change":"2024-04-24T23:38:34.178750+0000","last_active":"2024-04-24T23:38:39.372502+0000","last_peered":"2024-04-24T23:38:39.372502+0000","last_clean":"2024-04-24T23:38:39.372502+0000","last_became_active":"2024-04-24T23:38:34.177451+0000","last_became_peered":"2024-04-24T23:38:34.177451+0000","last_unstale":"2024-04-24T23:38:39.372502+0000","last_undegraded":"2024-04-24T23:38:39.372502+0000","last_fullsized":"2024-04-24T23:38:39.372502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:43.814245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233777+0000","last_change":"2024-04-24T23:38:34.160937+0000","last_active":"2024-04-24T23:38:39.233777+0000","last_peered":"2024-04-24T23:38:39.233777+0000","last_clean":"2024-04-24T23:38:39.233777+0000","last_became_active":"2024-04-24T23:38:34.159252+0000","last_became_peered":"2024-04-24T23:38:34.159252+0000","last_unstale":"2024-04-24T23:38:39.233777+0000","last_undegraded":"2024-04-24T23:38:39.233777+0000","last_fullsized":"2024-04-24T23:38:39.233777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:10.585665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373731+0000","last_change":"2024-04-24T23:38:34.199973+0000","last_active":"2024-04-24T23:38:39.373731+0000","last_peered":"2024-04-24T23:38:39.373731+0000","last_clean":"2024-04-24T23:38:39.373731+0000","last_became_active":"2024-04-24T23:38:34.199464+0000","last_became_peered":"2024-04-24T23:38:34.199464+0000","last_unstale":"2024-04-24T23:38:39.373731+0000","last_undegraded":"2024-04-24T23:38:39.373731+0000","last_fullsized":"2024-04-24T23:38:39.373731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:14.879972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369776+0000","last_change":"2024-04-24T23:38:34.182144+0000","last_active":"2024-04-24T23:38:39.369776+0000","last_peered":"2024-04-24T23:38:39.369776+0000","last_clean":"2024-04-24T23:38:39.369776+0000","last_became_active":"2024-04-24T23:38:34.181459+0000","last_became_peered":"2024-04-24T23:38:34.181459+0000","last_unstale":"2024-04-24T23:38:39.369776+0000","last_undegraded":"2024-04-24T23:38:39.369776+0000","last_fullsized":"2024-04-24T23:38:39.369776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.368577+0000","last_change":"2024-04-24T23:38:34.150090+0000","last_active":"2024-04-24T23:38:39.368577+0000","last_peered":"2024-04-24T23:38:39.368577+0000","last_clean":"2024-04-24T23:38:39.368577+0000","last_became_active":"2024-04-24T23:38:34.149272+0000","last_became_peered":"2024-04-24T23:38:34.149272+0000","last_unstale":"2024-04-24T23:38:39.368577+0000","last_undegraded":"2024-04-24T23:38:39.368577+0000","last_fullsized":"2024-04-24T23:38:39.368577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:57:25.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372819+0000","last_change":"2024-04-24T23:38:34.155641+0000","last_active":"2024-04-24T23:38:39.372819+0000","last_peered":"2024-04-24T23:38:39.372819+0000","last_clean":"2024-04-24T23:38:39.372819+0000","last_became_active":"2024-04-24T23:38:34.153683+0000","last_became_peered":"2024-04-24T23:38:34.153683+0000","last_unstale":"2024-04-24T23:38:39.372819+0000","last_undegraded":"2024-04-24T23:38:39.372819+0000","last_fullsized":"2024-04-24T23:38:39.372819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:24.354101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371146+0000","last_change":"2024-04-24T23:38:34.173601+0000","last_active":"2024-04-24T23:38:39.371146+0000","last_peered":"2024-04-24T23:38:39.371146+0000","last_clean":"2024-04-24T23:38:39.371146+0000","last_became_active":"2024-04-24T23:38:34.165764+0000","last_became_peered":"2024-04-24T23:38:34.165764+0000","last_unstale":"2024-04-24T23:38:39.371146+0000","last_undegraded":"2024-04-24T23:38:39.371146+0000","last_fullsized":"2024-04-24T23:38:39.371146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.236674+0000","last_change":"2024-04-24T23:38:34.142409+0000","last_active":"2024-04-24T23:38:39.236674+0000","last_peered":"2024-04-24T23:38:39.236674+0000","last_clean":"2024-04-24T23:38:39.236674+0000","last_became_active":"2024-04-24T23:38:34.141699+0000","last_became_peered":"2024-04-24T23:38:34.141699+0000","last_unstale":"2024-04-24T23:38:39.236674+0000","last_undegraded":"2024-04-24T23:38:39.236674+0000","last_fullsized":"2024-04-24T23:38:39.236674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:53.017909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.235416+0000","last_change":"2024-04-24T23:38:34.155964+0000","last_active":"2024-04-24T23:38:39.235416+0000","last_peered":"2024-04-24T23:38:39.235416+0000","last_clean":"2024-04-24T23:38:39.235416+0000","last_became_active":"2024-04-24T23:38:34.155106+0000","last_became_peered":"2024-04-24T23:38:34.155106+0000","last_unstale":"2024-04-24T23:38:39.235416+0000","last_undegraded":"2024-04-24T23:38:39.235416+0000","last_fullsized":"2024-04-24T23:38:39.235416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.236714+0000","last_change":"2024-04-24T23:38:34.157245+0000","last_active":"2024-04-24T23:38:39.236714+0000","last_peered":"2024-04-24T23:38:39.236714+0000","last_clean":"2024-04-24T23:38:39.236714+0000","last_became_active":"2024-04-24T23:38:34.156452+0000","last_became_peered":"2024-04-24T23:38:34.156452+0000","last_unstale":"2024-04-24T23:38:39.236714+0000","last_undegraded":"2024-04-24T23:38:39.236714+0000","last_fullsized":"2024-04-24T23:38:39.236714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372998+0000","last_change":"2024-04-24T23:38:34.195530+0000","last_active":"2024-04-24T23:38:39.372998+0000","last_peered":"2024-04-24T23:38:39.372998+0000","last_clean":"2024-04-24T23:38:39.372998+0000","last_became_active":"2024-04-24T23:38:34.194908+0000","last_became_peered":"2024-04-24T23:38:34.194908+0000","last_unstale":"2024-04-24T23:38:39.372998+0000","last_undegraded":"2024-04-24T23:38:39.372998+0000","last_fullsized":"2024-04-24T23:38:39.372998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:53.162262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370190+0000","last_change":"2024-04-24T23:38:34.184693+0000","last_active":"2024-04-24T23:38:39.370190+0000","last_peered":"2024-04-24T23:38:39.370190+0000","last_clean":"2024-04-24T23:38:39.370190+0000","last_became_active":"2024-04-24T23:38:34.184367+0000","last_became_peered":"2024-04-24T23:38:34.184367+0000","last_unstale":"2024-04-24T23:38:39.370190+0000","last_undegraded":"2024-04-24T23:38:39.370190+0000","last_fullsized":"2024-04-24T23:38:39.370190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:30:58.955608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370659+0000","last_change":"2024-04-24T23:38:34.176406+0000","last_active":"2024-04-24T23:38:39.370659+0000","last_peered":"2024-04-24T23:38:39.370659+0000","last_clean":"2024-04-24T23:38:39.370659+0000","last_became_active":"2024-04-24T23:38:34.165882+0000","last_became_peered":"2024-04-24T23:38:34.165882+0000","last_unstale":"2024-04-24T23:38:39.370659+0000","last_undegraded":"2024-04-24T23:38:39.370659+0000","last_fullsized":"2024-04-24T23:38:39.370659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:09:44.182605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370261+0000","last_change":"2024-04-24T23:38:34.184368+0000","last_active":"2024-04-24T23:38:39.370261+0000","last_peered":"2024-04-24T23:38:39.370261+0000","last_clean":"2024-04-24T23:38:39.370261+0000","last_became_active":"2024-04-24T23:38:34.183652+0000","last_became_peered":"2024-04-24T23:38:34.183652+0000","last_unstale":"2024-04-24T23:38:39.370261+0000","last_undegraded":"2024-04-24T23:38:39.370261+0000","last_fullsized":"2024-04-24T23:38:39.370261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:57.767771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371091+0000","last_change":"2024-04-24T23:38:34.176656+0000","last_active":"2024-04-24T23:38:39.371091+0000","last_peered":"2024-04-24T23:38:39.371091+0000","last_clean":"2024-04-24T23:38:39.371091+0000","last_became_active":"2024-04-24T23:38:34.165931+0000","last_became_peered":"2024-04-24T23:38:34.165931+0000","last_unstale":"2024-04-24T23:38:39.371091+0000","last_undegraded":"2024-04-24T23:38:39.371091+0000","last_fullsized":"2024-04-24T23:38:39.371091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:14.879972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371772+0000","last_change":"2024-04-24T23:38:34.187001+0000","last_active":"2024-04-24T23:38:39.371772+0000","last_peered":"2024-04-24T23:38:39.371772+0000","last_clean":"2024-04-24T23:38:39.371772+0000","last_became_active":"2024-04-24T23:38:34.186251+0000","last_became_peered":"2024-04-24T23:38:34.186251+0000","last_unstale":"2024-04-24T23:38:39.371772+0000","last_undegraded":"2024-04-24T23:38:39.371772+0000","last_fullsized":"2024-04-24T23:38:39.371772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:00.007223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373733+0000","last_change":"2024-04-24T23:38:34.150280+0000","last_active":"2024-04-24T23:38:39.373733+0000","last_peered":"2024-04-24T23:38:39.373733+0000","last_clean":"2024-04-24T23:38:39.373733+0000","last_became_active":"2024-04-24T23:38:34.148402+0000","last_became_peered":"2024-04-24T23:38:34.148402+0000","last_unstale":"2024-04-24T23:38:39.373733+0000","last_undegraded":"2024-04-24T23:38:39.373733+0000","last_fullsized":"2024-04-24T23:38:39.373733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:29.660159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369506+0000","last_change":"2024-04-24T23:38:34.151749+0000","last_active":"2024-04-24T23:38:39.369506+0000","last_peered":"2024-04-24T23:38:39.369506+0000","last_clean":"2024-04-24T23:38:39.369506+0000","last_became_active":"2024-04-24T23:38:34.150987+0000","last_became_peered":"2024-04-24T23:38:34.150987+0000","last_unstale":"2024-04-24T23:38:39.369506+0000","last_undegraded":"2024-04-24T23:38:39.369506+0000","last_fullsized":"2024-04-24T23:38:39.369506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372849+0000","last_change":"2024-04-24T23:38:34.194857+0000","last_active":"2024-04-24T23:38:39.372849+0000","last_peered":"2024-04-24T23:38:39.372849+0000","last_clean":"2024-04-24T23:38:39.372849+0000","last_became_active":"2024-04-24T23:38:34.194195+0000","last_became_peered":"2024-04-24T23:38:34.194195+0000","last_unstale":"2024-04-24T23:38:39.372849+0000","last_undegraded":"2024-04-24T23:38:39.372849+0000","last_fullsized":"2024-04-24T23:38:39.372849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:29:51.981646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67594,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":691206,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":331776,"data_stored":691262,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:39:03.049 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:39:03.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b03eb6640 1 Processor -- start 2024-04-24T23:39:03.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b03eb6640 1 -- start start 2024-04-24T23:39:03.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b03eb6640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3afc0c32d0 0x7f3afc14d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:03.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b03eb6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3afc14dea0 0x7f3afc151300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:03.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b03eb6640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3afc0bd6c0 con 0x7f3afc0c1080 2024-04-24T23:39:03.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b03eb6640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f3afc0bf4a0 con 0x7f3afc14dea0 2024-04-24T23:39:03.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b03eb6640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f3afc0bd470 con 0x7f3afc0c32d0 2024-04-24T23:39:03.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b01451640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3afc0c1080 0x7f3afc150bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53122/0 (socket says 172.21.15.57:53122) 2024-04-24T23:39:03.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b01451640 1 -- 172.21.15.57:0/3596841127 learned_addr learned my addr 172.21.15.57:0/3596841127 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:03.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b02453640 1 --2- 172.21.15.57:0/3596841127 >> v2:172.21.15.88:3300/0 conn(0x7f3afc14dea0 0x7f3afc151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:03.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b01c52640 1 --2- 172.21.15.57:0/3596841127 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3afc0c32d0 0x7f3afc14d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:03.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b00c50640 1 -- 172.21.15.57:0/3596841127 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3136112207 0 0) 0x7f3afc0bd6c0 con 0x7f3afc0c1080 2024-04-24T23:39:03.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b00c50640 1 -- 172.21.15.57:0/3596841127 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ae8003530 con 0x7f3afc0c1080 2024-04-24T23:39:03.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b00c50640 1 -- 172.21.15.57:0/3596841127 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1001246396 0 0) 0x7f3ae8003530 con 0x7f3afc0c1080 2024-04-24T23:39:03.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b00c50640 1 -- 172.21.15.57:0/3596841127 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3afc0c32d0 msgr2=0x7f3afc14d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:03.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b00c50640 1 --2- 172.21.15.57:0/3596841127 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3afc0c32d0 0x7f3afc14d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:03.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b00c50640 1 -- 172.21.15.57:0/3596841127 >> v2:172.21.15.88:3300/0 conn(0x7f3afc14dea0 msgr2=0x7f3afc151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:03.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b00c50640 1 --2- 172.21.15.57:0/3596841127 >> v2:172.21.15.88:3300/0 conn(0x7f3afc14dea0 0x7f3afc151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:03.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b00c50640 1 -- 172.21.15.57:0/3596841127 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3afc0bd9a0 con 0x7f3afc0c1080 2024-04-24T23:39:03.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b00c50640 1 -- 172.21.15.57:0/3596841127 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7f3aec001680 con 0x7f3afc0c1080 2024-04-24T23:39:03.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b00c50640 1 -- 172.21.15.57:0/3596841127 >> v1:172.21.15.57:6789/0 conn(0x7f3afc0c1080 legacy=0x7f3afc150bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:03.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b00c50640 1 --2- 172.21.15.57:0/3596841127 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ae80039c0 0x7f3ae8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:03.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b00c50640 1 --2- 172.21.15.57:0/3596841127 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3afc0c32d0 0x7f3ae8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:03.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b00c50640 1 --2- 172.21.15.57:0/3596841127 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ae8004d50 0x7f3ae80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:03.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b00c50640 1 -- 172.21.15.57:0/3596841127 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3afc0bf4a0 con 0x7f3ae8004d50 2024-04-24T23:39:03.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b00c50640 1 -- 172.21.15.57:0/3596841127 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f3afc0bd470 con 0x7f3ae80039c0 2024-04-24T23:39:03.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b00c50640 1 -- 172.21.15.57:0/3596841127 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f3ae800b9d0 con 0x7f3afc0c32d0 2024-04-24T23:39:03.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b02453640 1 --2- 172.21.15.57:0/3596841127 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ae8004d50 0x7f3ae80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:03.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b01c52640 1 --2- 172.21.15.57:0/3596841127 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ae80039c0 0x7f3ae8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:03.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b01451640 1 --2- 172.21.15.57:0/3596841127 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3afc0c32d0 0x7f3ae8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:03.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b02453640 1 -- 172.21.15.57:0/3596841127 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3afc0c32d0 msgr2=0x7f3ae8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:03.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b02453640 1 --2- 172.21.15.57:0/3596841127 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3afc0c32d0 0x7f3ae8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:03.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b02453640 1 -- 172.21.15.57:0/3596841127 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ae80039c0 msgr2=0x7f3ae8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:03.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b02453640 1 --2- 172.21.15.57:0/3596841127 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ae80039c0 0x7f3ae8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:03.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b02453640 1 -- 172.21.15.57:0/3596841127 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae8003530 con 0x7f3ae8004d50 2024-04-24T23:39:03.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.209+0000 7f3b01451640 1 --2- 172.21.15.57:0/3596841127 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3afc0c32d0 0x7f3ae8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:39:03.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.213+0000 7f3b02453640 1 --2- 172.21.15.57:0/3596841127 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ae8004d50 0x7f3ae80051d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3af4009fc0 tx=0x7f3af401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc85643960dbc766 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:03.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.213+0000 7f3b00c50640 1 -- 172.21.15.57:0/3596841127 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af40b2070 con 0x7f3ae8004d50 2024-04-24T23:39:03.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.213+0000 7f3b00c50640 1 -- 172.21.15.57:0/3596841127 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af40a5cd0 con 0x7f3ae8004d50 2024-04-24T23:39:03.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.213+0000 7f3b00c50640 1 -- 172.21.15.57:0/3596841127 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af4009c10 con 0x7f3ae8004d50 2024-04-24T23:39:03.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.213+0000 7f3b03eb6640 1 -- 172.21.15.57:0/3596841127 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ae8004d50 msgr2=0x7f3ae80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:03.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.213+0000 7f3b03eb6640 1 --2- 172.21.15.57:0/3596841127 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ae8004d50 0x7f3ae80051d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3af4009fc0 tx=0x7f3af401ccc0 comp rx=0 tx=0).stop 2024-04-24T23:39:03.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.213+0000 7f3b02453640 1 -- 172.21.15.57:0/3596841127 reap_dead start 2024-04-24T23:39:03.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.213+0000 7f3b03eb6640 1 -- 172.21.15.57:0/3596841127 shutdown_connections 2024-04-24T23:39:03.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.213+0000 7f3b03eb6640 1 -- 172.21.15.57:0/3596841127 >> 172.21.15.57:0/3596841127 conn(0x7f3afc067350 msgr2=0x7f3afc067760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:03.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.213+0000 7f3b03eb6640 1 -- 172.21.15.57:0/3596841127 shutdown_connections 2024-04-24T23:39:03.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.213+0000 7f3b03eb6640 1 -- 172.21.15.57:0/3596841127 wait complete. 2024-04-24T23:39:03.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.213+0000 7f3b03eb6640 1 Processor -- start 2024-04-24T23:39:03.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.213+0000 7f3b03eb6640 1 -- start start 2024-04-24T23:39:03.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.217+0000 7f3b03eb6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3afc14f9f0 0x7f3afc1e6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:03.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.217+0000 7f3b03eb6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc14a8e0 0x7f3afc142740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:03.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.217+0000 7f3b03eb6640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3afc1e6560 0x7f3afc142c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:03.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.217+0000 7f3b03eb6640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3afc0c36b0 con 0x7f3afc14f9f0 2024-04-24T23:39:03.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.217+0000 7f3b03eb6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f3afc0c2800 con 0x7f3afc14a8e0 2024-04-24T23:39:03.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.217+0000 7f3b03eb6640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f3afc0c3830 con 0x7f3afc1e6560 2024-04-24T23:39:03.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.217+0000 7f3b01c52640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3afc14f9f0 0x7f3afc1e6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:03.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.217+0000 7f3b01c52640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3afc14f9f0 0x7f3afc1e6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60338/0 (socket says 172.21.15.57:60338) 2024-04-24T23:39:03.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.217+0000 7f3b01c52640 1 -- 172.21.15.57:0/729119853 learned_addr learned my addr 172.21.15.57:0/729119853 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:03.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.217+0000 7f3b01451640 1 --2- 172.21.15.57:0/729119853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc14a8e0 0x7f3afc142740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:03.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.217+0000 7f3b02453640 1 --2- 172.21.15.57:0/729119853 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3afc1e6560 0x7f3afc142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:03.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.217+0000 7f3b01c52640 1 -- 172.21.15.57:0/729119853 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3afc1e6560 msgr2=0x7f3afc142c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:03.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.217+0000 7f3b01c52640 1 --2- 172.21.15.57:0/729119853 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3afc1e6560 0x7f3afc142c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:03.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.217+0000 7f3b01c52640 1 -- 172.21.15.57:0/729119853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc14a8e0 msgr2=0x7f3afc142740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:03.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.217+0000 7f3b01c52640 1 --2- 172.21.15.57:0/729119853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc14a8e0 0x7f3afc142740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:03.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.217+0000 7f3b01c52640 1 -- 172.21.15.57:0/729119853 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3afc1e98c0 con 0x7f3afc14f9f0 2024-04-24T23:39:03.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.217+0000 7f3b01c52640 1 --2- 172.21.15.57:0/729119853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3afc14f9f0 0x7f3afc1e6020 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3af80115e0 tx=0x7f3af8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:03.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.217+0000 7f3af27fc640 1 -- 172.21.15.57:0/729119853 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af800f8f0 con 0x7f3afc14f9f0 2024-04-24T23:39:03.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.217+0000 7f3af27fc640 1 -- 172.21.15.57:0/729119853 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af800fa90 con 0x7f3afc14f9f0 2024-04-24T23:39:03.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.217+0000 7f3b03eb6640 1 -- 172.21.15.57:0/729119853 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3afc1e9b60 con 0x7f3afc14f9f0 2024-04-24T23:39:03.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.217+0000 7f3af27fc640 1 -- 172.21.15.57:0/729119853 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af800fe40 con 0x7f3afc14f9f0 2024-04-24T23:39:03.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.217+0000 7f3b03eb6640 1 -- 172.21.15.57:0/729119853 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3afc14fdd0 con 0x7f3afc14f9f0 2024-04-24T23:39:03.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.217+0000 7f3b03eb6640 1 -- 172.21.15.57:0/729119853 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3afc1e5910 con 0x7f3afc14f9f0 2024-04-24T23:39:03.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.217+0000 7f3af27fc640 1 -- 172.21.15.57:0/729119853 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3af8015460 con 0x7f3afc14f9f0 2024-04-24T23:39:03.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.217+0000 7f3af27fc640 1 --2- 172.21.15.57:0/729119853 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f3ae00678c0 0x7f3ae0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:03.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.217+0000 7f3af27fc640 1 -- 172.21.15.57:0/729119853 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3af8086960 con 0x7f3afc14f9f0 2024-04-24T23:39:03.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.217+0000 7f3b01451640 1 --2- 172.21.15.57:0/729119853 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f3ae00678c0 0x7f3ae0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:03.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.221+0000 7f3b01451640 1 --2- 172.21.15.57:0/729119853 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f3ae00678c0 0x7f3ae0069d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3afc1529f0 tx=0x7f3aec000f60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:03.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.221+0000 7f3af27fc640 1 -- 172.21.15.57:0/729119853 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f3af8019030 con 0x7f3afc14f9f0 2024-04-24T23:39:03.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.373+0000 7f3b03eb6640 1 -- 172.21.15.57:0/729119853 --> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3afc068220 con 0x7f3ae00678c0 2024-04-24T23:39:03.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.397+0000 7f3af27fc640 1 -- 172.21.15.57:0/729119853 <== mgr.4105 v2:172.21.15.88:6832/3931748276 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332610 (secure 0 0 0) 0x7f3afc068220 con 0x7f3ae00678c0 2024-04-24T23:39:03.403 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:39:03.405 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-24T23:39:03.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.401+0000 7f3b03eb6640 1 -- 172.21.15.57:0/729119853 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f3ae00678c0 msgr2=0x7f3ae0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:03.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.401+0000 7f3b03eb6640 1 --2- 172.21.15.57:0/729119853 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f3ae00678c0 0x7f3ae0069d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3afc1529f0 tx=0x7f3aec000f60 comp rx=0 tx=0).stop 2024-04-24T23:39:03.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.401+0000 7f3b03eb6640 1 -- 172.21.15.57:0/729119853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3afc14f9f0 msgr2=0x7f3afc1e6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:03.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.401+0000 7f3b03eb6640 1 --2- 172.21.15.57:0/729119853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3afc14f9f0 0x7f3afc1e6020 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3af80115e0 tx=0x7f3af8011aa0 comp rx=0 tx=0).stop 2024-04-24T23:39:03.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.401+0000 7f3b03eb6640 1 -- 172.21.15.57:0/729119853 shutdown_connections 2024-04-24T23:39:03.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.401+0000 7f3b03eb6640 1 --2- 172.21.15.57:0/729119853 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f3ae00678c0 0x7f3ae0069d80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:03.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.401+0000 7f3b03eb6640 1 --2- 172.21.15.57:0/729119853 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3afc1e6560 0x7f3afc142c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:03.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.401+0000 7f3b03eb6640 1 --2- 172.21.15.57:0/729119853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3afc14a8e0 0x7f3afc142740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:03.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.401+0000 7f3b03eb6640 1 --2- 172.21.15.57:0/729119853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3afc14f9f0 0x7f3afc1e6020 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:03.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.401+0000 7f3b03eb6640 1 -- 172.21.15.57:0/729119853 >> 172.21.15.57:0/729119853 conn(0x7f3afc067350 msgr2=0x7f3afc0c19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:03.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.401+0000 7f3b03eb6640 1 -- 172.21.15.57:0/729119853 shutdown_connections 2024-04-24T23:39:03.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.401+0000 7f3b03eb6640 1 -- 172.21.15.57:0/729119853 wait complete. 2024-04-24T23:39:03.420 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-04-24T23:39:01.549954+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234996,"kb_used_data":2176,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739724,"statfs":{"total":773094113280,"available":772853477376,"internally_reserved":0,"allocated":2228224,"data_stored":1992064,"data_compressed":67594,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005381"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373865+0000","last_change":"2024-04-24T23:38:33.135015+0000","last_active":"2024-04-24T23:38:39.373865+0000","last_peered":"2024-04-24T23:38:39.373865+0000","last_clean":"2024-04-24T23:38:39.373865+0000","last_became_active":"2024-04-24T23:38:33.134584+0000","last_became_peered":"2024-04-24T23:38:33.134584+0000","last_unstale":"2024-04-24T23:38:39.373865+0000","last_undegraded":"2024-04-24T23:38:39.373865+0000","last_fullsized":"2024-04-24T23:38:39.373865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:21.418436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370791+0000","last_change":"2024-04-24T23:38:34.164655+0000","last_active":"2024-04-24T23:38:39.370791+0000","last_peered":"2024-04-24T23:38:39.370791+0000","last_clean":"2024-04-24T23:38:39.370791+0000","last_became_active":"2024-04-24T23:38:34.162093+0000","last_became_peered":"2024-04-24T23:38:34.162093+0000","last_unstale":"2024-04-24T23:38:39.370791+0000","last_undegraded":"2024-04-24T23:38:39.370791+0000","last_fullsized":"2024-04-24T23:38:39.370791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370307+0000","last_change":"2024-04-24T23:38:38.252169+0000","last_active":"2024-04-24T23:38:39.370307+0000","last_peered":"2024-04-24T23:38:39.370307+0000","last_clean":"2024-04-24T23:38:39.370307+0000","last_became_active":"2024-04-24T23:38:38.251653+0000","last_became_peered":"2024-04-24T23:38:38.251653+0000","last_unstale":"2024-04-24T23:38:39.370307+0000","last_undegraded":"2024-04-24T23:38:39.370307+0000","last_fullsized":"2024-04-24T23:38:39.370307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:57.651551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371463+0000","last_change":"2024-04-24T23:38:33.124025+0000","last_active":"2024-04-24T23:38:39.371463+0000","last_peered":"2024-04-24T23:38:39.371463+0000","last_clean":"2024-04-24T23:38:39.371463+0000","last_became_active":"2024-04-24T23:38:33.123681+0000","last_became_peered":"2024-04-24T23:38:33.123681+0000","last_unstale":"2024-04-24T23:38:39.371463+0000","last_undegraded":"2024-04-24T23:38:39.371463+0000","last_fullsized":"2024-04-24T23:38:39.371463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:27:41.421732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373542+0000","last_change":"2024-04-24T23:38:34.169793+0000","last_active":"2024-04-24T23:38:39.373542+0000","last_peered":"2024-04-24T23:38:39.373542+0000","last_clean":"2024-04-24T23:38:39.373542+0000","last_became_active":"2024-04-24T23:38:34.169115+0000","last_became_peered":"2024-04-24T23:38:34.169115+0000","last_unstale":"2024-04-24T23:38:39.373542+0000","last_undegraded":"2024-04-24T23:38:39.373542+0000","last_fullsized":"2024-04-24T23:38:39.373542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:39.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.234391+0000","last_change":"2024-04-24T23:38:38.221580+0000","last_active":"2024-04-24T23:38:39.234391+0000","last_peered":"2024-04-24T23:38:39.234391+0000","last_clean":"2024-04-24T23:38:39.234391+0000","last_became_active":"2024-04-24T23:38:38.220392+0000","last_became_peered":"2024-04-24T23:38:38.220392+0000","last_unstale":"2024-04-24T23:38:39.234391+0000","last_undegraded":"2024-04-24T23:38:39.234391+0000","last_fullsized":"2024-04-24T23:38:39.234391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:16:01.852170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372470+0000","last_change":"2024-04-24T23:38:33.144231+0000","last_active":"2024-04-24T23:38:39.372470+0000","last_peered":"2024-04-24T23:38:39.372470+0000","last_clean":"2024-04-24T23:38:39.372470+0000","last_became_active":"2024-04-24T23:38:33.143542+0000","last_became_peered":"2024-04-24T23:38:33.143542+0000","last_unstale":"2024-04-24T23:38:39.372470+0000","last_undegraded":"2024-04-24T23:38:39.372470+0000","last_fullsized":"2024-04-24T23:38:39.372470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:09.575181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371937+0000","last_change":"2024-04-24T23:38:34.170796+0000","last_active":"2024-04-24T23:38:39.371937+0000","last_peered":"2024-04-24T23:38:39.371937+0000","last_clean":"2024-04-24T23:38:39.371937+0000","last_became_active":"2024-04-24T23:38:34.169908+0000","last_became_peered":"2024-04-24T23:38:34.169908+0000","last_unstale":"2024-04-24T23:38:39.371937+0000","last_undegraded":"2024-04-24T23:38:39.371937+0000","last_fullsized":"2024-04-24T23:38:39.371937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:17:07.009163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.234557+0000","last_change":"2024-04-24T23:38:38.218416+0000","last_active":"2024-04-24T23:38:39.234557+0000","last_peered":"2024-04-24T23:38:39.234557+0000","last_clean":"2024-04-24T23:38:39.234557+0000","last_became_active":"2024-04-24T23:38:38.217390+0000","last_became_peered":"2024-04-24T23:38:38.217390+0000","last_unstale":"2024-04-24T23:38:39.234557+0000","last_undegraded":"2024-04-24T23:38:39.234557+0000","last_fullsized":"2024-04-24T23:38:39.234557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:31.231780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371812+0000","last_change":"2024-04-24T23:38:33.149114+0000","last_active":"2024-04-24T23:38:39.371812+0000","last_peered":"2024-04-24T23:38:39.371812+0000","last_clean":"2024-04-24T23:38:39.371812+0000","last_became_active":"2024-04-24T23:38:33.148510+0000","last_became_peered":"2024-04-24T23:38:33.148510+0000","last_unstale":"2024-04-24T23:38:39.371812+0000","last_undegraded":"2024-04-24T23:38:39.371812+0000","last_fullsized":"2024-04-24T23:38:39.371812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:39.396571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373009+0000","last_change":"2024-04-24T23:38:34.153747+0000","last_active":"2024-04-24T23:38:39.373009+0000","last_peered":"2024-04-24T23:38:39.373009+0000","last_clean":"2024-04-24T23:38:39.373009+0000","last_became_active":"2024-04-24T23:38:34.152984+0000","last_became_peered":"2024-04-24T23:38:34.152984+0000","last_unstale":"2024-04-24T23:38:39.373009+0000","last_undegraded":"2024-04-24T23:38:39.373009+0000","last_fullsized":"2024-04-24T23:38:39.373009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:54.469544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233889+0000","last_change":"2024-04-24T23:38:38.222542+0000","last_active":"2024-04-24T23:38:39.233889+0000","last_peered":"2024-04-24T23:38:39.233889+0000","last_clean":"2024-04-24T23:38:39.233889+0000","last_became_active":"2024-04-24T23:38:38.220601+0000","last_became_peered":"2024-04-24T23:38:38.220601+0000","last_unstale":"2024-04-24T23:38:39.233889+0000","last_undegraded":"2024-04-24T23:38:39.233889+0000","last_fullsized":"2024-04-24T23:38:39.233889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:32.372869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233089+0000","last_change":"2024-04-24T23:38:34.142429+0000","last_active":"2024-04-24T23:38:39.233089+0000","last_peered":"2024-04-24T23:38:39.233089+0000","last_clean":"2024-04-24T23:38:39.233089+0000","last_became_active":"2024-04-24T23:38:34.141681+0000","last_became_peered":"2024-04-24T23:38:34.141681+0000","last_unstale":"2024-04-24T23:38:39.233089+0000","last_undegraded":"2024-04-24T23:38:39.233089+0000","last_fullsized":"2024-04-24T23:38:39.233089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:57:25.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371592+0000","last_change":"2024-04-24T23:38:33.140585+0000","last_active":"2024-04-24T23:38:39.371592+0000","last_peered":"2024-04-24T23:38:39.371592+0000","last_clean":"2024-04-24T23:38:39.371592+0000","last_became_active":"2024-04-24T23:38:33.139303+0000","last_became_peered":"2024-04-24T23:38:33.139303+0000","last_unstale":"2024-04-24T23:38:39.371592+0000","last_undegraded":"2024-04-24T23:38:39.371592+0000","last_fullsized":"2024-04-24T23:38:39.371592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:23.343617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.237020+0000","last_change":"2024-04-24T23:38:38.216184+0000","last_active":"2024-04-24T23:38:39.237020+0000","last_peered":"2024-04-24T23:38:39.237020+0000","last_clean":"2024-04-24T23:38:39.237020+0000","last_became_active":"2024-04-24T23:38:38.214813+0000","last_became_peered":"2024-04-24T23:38:38.214813+0000","last_unstale":"2024-04-24T23:38:39.237020+0000","last_undegraded":"2024-04-24T23:38:39.237020+0000","last_fullsized":"2024-04-24T23:38:39.237020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:58.553943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371206+0000","last_change":"2024-04-24T23:38:34.174790+0000","last_active":"2024-04-24T23:38:39.371206+0000","last_peered":"2024-04-24T23:38:39.371206+0000","last_clean":"2024-04-24T23:38:39.371206+0000","last_became_active":"2024-04-24T23:38:34.174504+0000","last_became_peered":"2024-04-24T23:38:34.174504+0000","last_unstale":"2024-04-24T23:38:39.371206+0000","last_undegraded":"2024-04-24T23:38:39.371206+0000","last_fullsized":"2024-04-24T23:38:39.371206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:27.147380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.368995+0000","last_change":"2024-04-24T23:38:33.125559+0000","last_active":"2024-04-24T23:38:39.368995+0000","last_peered":"2024-04-24T23:38:39.368995+0000","last_clean":"2024-04-24T23:38:39.368995+0000","last_became_active":"2024-04-24T23:38:33.125115+0000","last_became_peered":"2024-04-24T23:38:33.125115+0000","last_unstale":"2024-04-24T23:38:39.368995+0000","last_undegraded":"2024-04-24T23:38:39.368995+0000","last_fullsized":"2024-04-24T23:38:39.368995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:07.598128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.236267+0000","last_change":"2024-04-24T23:38:38.221669+0000","last_active":"2024-04-24T23:38:39.236267+0000","last_peered":"2024-04-24T23:38:39.236267+0000","last_clean":"2024-04-24T23:38:39.236267+0000","last_became_active":"2024-04-24T23:38:38.219797+0000","last_became_peered":"2024-04-24T23:38:38.219797+0000","last_unstale":"2024-04-24T23:38:39.236267+0000","last_undegraded":"2024-04-24T23:38:39.236267+0000","last_fullsized":"2024-04-24T23:38:39.236267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:04.091622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370565+0000","last_change":"2024-04-24T23:38:34.163966+0000","last_active":"2024-04-24T23:38:39.370565+0000","last_peered":"2024-04-24T23:38:39.370565+0000","last_clean":"2024-04-24T23:38:39.370565+0000","last_became_active":"2024-04-24T23:38:34.163291+0000","last_became_peered":"2024-04-24T23:38:34.163291+0000","last_unstale":"2024-04-24T23:38:39.370565+0000","last_undegraded":"2024-04-24T23:38:39.370565+0000","last_fullsized":"2024-04-24T23:38:39.370565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:34.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.368689+0000","last_change":"2024-04-24T23:38:33.119549+0000","last_active":"2024-04-24T23:38:39.368689+0000","last_peered":"2024-04-24T23:38:39.368689+0000","last_clean":"2024-04-24T23:38:39.368689+0000","last_became_active":"2024-04-24T23:38:33.119052+0000","last_became_peered":"2024-04-24T23:38:33.119052+0000","last_unstale":"2024-04-24T23:38:39.368689+0000","last_undegraded":"2024-04-24T23:38:39.368689+0000","last_fullsized":"2024-04-24T23:38:39.368689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369506+0000","last_change":"2024-04-24T23:38:38.252720+0000","last_active":"2024-04-24T23:38:39.369506+0000","last_peered":"2024-04-24T23:38:39.369506+0000","last_clean":"2024-04-24T23:38:39.369506+0000","last_became_active":"2024-04-24T23:38:38.252138+0000","last_became_peered":"2024-04-24T23:38:38.252138+0000","last_unstale":"2024-04-24T23:38:39.369506+0000","last_undegraded":"2024-04-24T23:38:39.369506+0000","last_fullsized":"2024-04-24T23:38:39.369506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:18.964372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.234166+0000","last_change":"2024-04-24T23:38:34.157008+0000","last_active":"2024-04-24T23:38:39.234166+0000","last_peered":"2024-04-24T23:38:39.234166+0000","last_clean":"2024-04-24T23:38:39.234166+0000","last_became_active":"2024-04-24T23:38:34.152682+0000","last_became_peered":"2024-04-24T23:38:34.152682+0000","last_unstale":"2024-04-24T23:38:39.234166+0000","last_undegraded":"2024-04-24T23:38:39.234166+0000","last_fullsized":"2024-04-24T23:38:39.234166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:48.697457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370213+0000","last_change":"2024-04-24T23:38:33.139819+0000","last_active":"2024-04-24T23:38:39.370213+0000","last_peered":"2024-04-24T23:38:39.370213+0000","last_clean":"2024-04-24T23:38:39.370213+0000","last_became_active":"2024-04-24T23:38:33.139175+0000","last_became_peered":"2024-04-24T23:38:33.139175+0000","last_unstale":"2024-04-24T23:38:39.370213+0000","last_undegraded":"2024-04-24T23:38:39.370213+0000","last_fullsized":"2024-04-24T23:38:39.370213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:52.007425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.236331+0000","last_change":"2024-04-24T23:38:38.217726+0000","last_active":"2024-04-24T23:38:39.236331+0000","last_peered":"2024-04-24T23:38:39.236331+0000","last_clean":"2024-04-24T23:38:39.236331+0000","last_became_active":"2024-04-24T23:38:38.216742+0000","last_became_peered":"2024-04-24T23:38:38.216742+0000","last_unstale":"2024-04-24T23:38:39.236331+0000","last_undegraded":"2024-04-24T23:38:39.236331+0000","last_fullsized":"2024-04-24T23:38:39.236331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:09:48.267004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.374038+0000","last_change":"2024-04-24T23:38:34.154755+0000","last_active":"2024-04-24T23:38:39.374038+0000","last_peered":"2024-04-24T23:38:39.374038+0000","last_clean":"2024-04-24T23:38:39.374038+0000","last_became_active":"2024-04-24T23:38:34.153967+0000","last_became_peered":"2024-04-24T23:38:34.153967+0000","last_unstale":"2024-04-24T23:38:39.374038+0000","last_undegraded":"2024-04-24T23:38:39.374038+0000","last_fullsized":"2024-04-24T23:38:39.374038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.236385+0000","last_change":"2024-04-24T23:38:33.135885+0000","last_active":"2024-04-24T23:38:39.236385+0000","last_peered":"2024-04-24T23:38:39.236385+0000","last_clean":"2024-04-24T23:38:39.236385+0000","last_became_active":"2024-04-24T23:38:33.135225+0000","last_became_peered":"2024-04-24T23:38:33.135225+0000","last_unstale":"2024-04-24T23:38:39.236385+0000","last_undegraded":"2024-04-24T23:38:39.236385+0000","last_fullsized":"2024-04-24T23:38:39.236385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:52.007425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233734+0000","last_change":"2024-04-24T23:38:38.252002+0000","last_active":"2024-04-24T23:38:39.233734+0000","last_peered":"2024-04-24T23:38:39.233734+0000","last_clean":"2024-04-24T23:38:39.233734+0000","last_became_active":"2024-04-24T23:38:38.251057+0000","last_became_peered":"2024-04-24T23:38:38.251057+0000","last_unstale":"2024-04-24T23:38:39.233734+0000","last_undegraded":"2024-04-24T23:38:39.233734+0000","last_fullsized":"2024-04-24T23:38:39.233734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:49.920273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372125+0000","last_change":"2024-04-24T23:38:34.197959+0000","last_active":"2024-04-24T23:38:39.372125+0000","last_peered":"2024-04-24T23:38:39.372125+0000","last_clean":"2024-04-24T23:38:39.372125+0000","last_became_active":"2024-04-24T23:38:34.197702+0000","last_became_peered":"2024-04-24T23:38:34.197702+0000","last_unstale":"2024-04-24T23:38:39.372125+0000","last_undegraded":"2024-04-24T23:38:39.372125+0000","last_fullsized":"2024-04-24T23:38:39.372125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:56.049789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369618+0000","last_change":"2024-04-24T23:38:33.115409+0000","last_active":"2024-04-24T23:38:39.369618+0000","last_peered":"2024-04-24T23:38:39.369618+0000","last_clean":"2024-04-24T23:38:39.369618+0000","last_became_active":"2024-04-24T23:38:33.115039+0000","last_became_peered":"2024-04-24T23:38:33.115039+0000","last_unstale":"2024-04-24T23:38:39.369618+0000","last_undegraded":"2024-04-24T23:38:39.369618+0000","last_fullsized":"2024-04-24T23:38:39.369618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:52.007425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370020+0000","last_change":"2024-04-24T23:38:38.246602+0000","last_active":"2024-04-24T23:38:39.370020+0000","last_peered":"2024-04-24T23:38:39.370020+0000","last_clean":"2024-04-24T23:38:39.370020+0000","last_became_active":"2024-04-24T23:38:38.245775+0000","last_became_peered":"2024-04-24T23:38:38.245775+0000","last_unstale":"2024-04-24T23:38:39.370020+0000","last_undegraded":"2024-04-24T23:38:39.370020+0000","last_fullsized":"2024-04-24T23:38:39.370020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:29.684133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371153+0000","last_change":"2024-04-24T23:38:34.149008+0000","last_active":"2024-04-24T23:38:39.371153+0000","last_peered":"2024-04-24T23:38:39.371153+0000","last_clean":"2024-04-24T23:38:39.371153+0000","last_became_active":"2024-04-24T23:38:34.148122+0000","last_became_peered":"2024-04-24T23:38:34.148122+0000","last_unstale":"2024-04-24T23:38:39.371153+0000","last_undegraded":"2024-04-24T23:38:39.371153+0000","last_fullsized":"2024-04-24T23:38:39.371153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:39.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372690+0000","last_change":"2024-04-24T23:38:33.142490+0000","last_active":"2024-04-24T23:38:39.372690+0000","last_peered":"2024-04-24T23:38:39.372690+0000","last_clean":"2024-04-24T23:38:39.372690+0000","last_became_active":"2024-04-24T23:38:33.140003+0000","last_became_peered":"2024-04-24T23:38:33.140003+0000","last_unstale":"2024-04-24T23:38:39.372690+0000","last_undegraded":"2024-04-24T23:38:39.372690+0000","last_fullsized":"2024-04-24T23:38:39.372690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:45:12.216173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373352+0000","last_change":"2024-04-24T23:38:38.246291+0000","last_active":"2024-04-24T23:38:39.373352+0000","last_peered":"2024-04-24T23:38:39.373352+0000","last_clean":"2024-04-24T23:38:39.373352+0000","last_became_active":"2024-04-24T23:38:38.245611+0000","last_became_peered":"2024-04-24T23:38:38.245611+0000","last_unstale":"2024-04-24T23:38:39.373352+0000","last_undegraded":"2024-04-24T23:38:39.373352+0000","last_fullsized":"2024-04-24T23:38:39.373352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:47.898644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373130+0000","last_change":"2024-04-24T23:38:34.186285+0000","last_active":"2024-04-24T23:38:39.373130+0000","last_peered":"2024-04-24T23:38:39.373130+0000","last_clean":"2024-04-24T23:38:39.373130+0000","last_became_active":"2024-04-24T23:38:34.185023+0000","last_became_peered":"2024-04-24T23:38:34.185023+0000","last_unstale":"2024-04-24T23:38:39.373130+0000","last_undegraded":"2024-04-24T23:38:39.373130+0000","last_fullsized":"2024-04-24T23:38:39.373130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:56.947423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371300+0000","last_change":"2024-04-24T23:38:33.108447+0000","last_active":"2024-04-24T23:38:39.371300+0000","last_peered":"2024-04-24T23:38:39.371300+0000","last_clean":"2024-04-24T23:38:39.371300+0000","last_became_active":"2024-04-24T23:38:33.108102+0000","last_became_peered":"2024-04-24T23:38:33.108102+0000","last_unstale":"2024-04-24T23:38:39.371300+0000","last_undegraded":"2024-04-24T23:38:39.371300+0000","last_fullsized":"2024-04-24T23:38:39.371300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:47.686974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.368678+0000","last_change":"2024-04-24T23:38:38.213425+0000","last_active":"2024-04-24T23:38:39.368678+0000","last_peered":"2024-04-24T23:38:39.368678+0000","last_clean":"2024-04-24T23:38:39.368678+0000","last_became_active":"2024-04-24T23:38:38.212691+0000","last_became_peered":"2024-04-24T23:38:38.212691+0000","last_unstale":"2024-04-24T23:38:39.368678+0000","last_undegraded":"2024-04-24T23:38:39.368678+0000","last_fullsized":"2024-04-24T23:38:39.368678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:01.031822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.235941+0000","last_change":"2024-04-24T23:38:34.154178+0000","last_active":"2024-04-24T23:38:39.235941+0000","last_peered":"2024-04-24T23:38:39.235941+0000","last_clean":"2024-04-24T23:38:39.235941+0000","last_became_active":"2024-04-24T23:38:34.153372+0000","last_became_peered":"2024-04-24T23:38:34.153372+0000","last_unstale":"2024-04-24T23:38:39.235941+0000","last_undegraded":"2024-04-24T23:38:39.235941+0000","last_fullsized":"2024-04-24T23:38:39.235941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:10.585665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370977+0000","last_change":"2024-04-24T23:38:33.140060+0000","last_active":"2024-04-24T23:38:39.370977+0000","last_peered":"2024-04-24T23:38:39.370977+0000","last_clean":"2024-04-24T23:38:39.370977+0000","last_became_active":"2024-04-24T23:38:33.139012+0000","last_became_peered":"2024-04-24T23:38:33.139012+0000","last_unstale":"2024-04-24T23:38:39.370977+0000","last_undegraded":"2024-04-24T23:38:39.370977+0000","last_fullsized":"2024-04-24T23:38:39.370977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371155+0000","last_change":"2024-04-24T23:38:38.209741+0000","last_active":"2024-04-24T23:38:39.371155+0000","last_peered":"2024-04-24T23:38:39.371155+0000","last_clean":"2024-04-24T23:38:39.371155+0000","last_became_active":"2024-04-24T23:38:38.209117+0000","last_became_peered":"2024-04-24T23:38:38.209117+0000","last_unstale":"2024-04-24T23:38:39.371155+0000","last_undegraded":"2024-04-24T23:38:39.371155+0000","last_fullsized":"2024-04-24T23:38:39.371155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:57.246661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369969+0000","last_change":"2024-04-24T23:38:34.152846+0000","last_active":"2024-04-24T23:38:39.369969+0000","last_peered":"2024-04-24T23:38:39.369969+0000","last_clean":"2024-04-24T23:38:39.369969+0000","last_became_active":"2024-04-24T23:38:34.151917+0000","last_became_peered":"2024-04-24T23:38:34.151917+0000","last_unstale":"2024-04-24T23:38:39.369969+0000","last_undegraded":"2024-04-24T23:38:39.369969+0000","last_fullsized":"2024-04-24T23:38:39.369969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:34.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233390+0000","last_change":"2024-04-24T23:38:33.124295+0000","last_active":"2024-04-24T23:38:39.233390+0000","last_peered":"2024-04-24T23:38:39.233390+0000","last_clean":"2024-04-24T23:38:39.233390+0000","last_became_active":"2024-04-24T23:38:33.123674+0000","last_became_peered":"2024-04-24T23:38:33.123674+0000","last_unstale":"2024-04-24T23:38:39.233390+0000","last_undegraded":"2024-04-24T23:38:39.233390+0000","last_fullsized":"2024-04-24T23:38:39.233390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369687+0000","last_change":"2024-04-24T23:38:38.214721+0000","last_active":"2024-04-24T23:38:39.369687+0000","last_peered":"2024-04-24T23:38:39.369687+0000","last_clean":"2024-04-24T23:38:39.369687+0000","last_became_active":"2024-04-24T23:38:38.214005+0000","last_became_peered":"2024-04-24T23:38:38.214005+0000","last_unstale":"2024-04-24T23:38:39.369687+0000","last_undegraded":"2024-04-24T23:38:39.369687+0000","last_fullsized":"2024-04-24T23:38:39.369687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:29:56.066046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371950+0000","last_change":"2024-04-24T23:38:34.139551+0000","last_active":"2024-04-24T23:38:39.371950+0000","last_peered":"2024-04-24T23:38:39.371950+0000","last_clean":"2024-04-24T23:38:39.371950+0000","last_became_active":"2024-04-24T23:38:34.138681+0000","last_became_peered":"2024-04-24T23:38:34.138681+0000","last_unstale":"2024-04-24T23:38:39.371950+0000","last_undegraded":"2024-04-24T23:38:39.371950+0000","last_fullsized":"2024-04-24T23:38:39.371950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:47.556651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370480+0000","last_change":"2024-04-24T23:38:33.141279+0000","last_active":"2024-04-24T23:38:39.370480+0000","last_peered":"2024-04-24T23:38:39.370480+0000","last_clean":"2024-04-24T23:38:39.370480+0000","last_became_active":"2024-04-24T23:38:33.140618+0000","last_became_peered":"2024-04-24T23:38:33.140618+0000","last_unstale":"2024-04-24T23:38:39.370480+0000","last_undegraded":"2024-04-24T23:38:39.370480+0000","last_fullsized":"2024-04-24T23:38:39.370480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373893+0000","last_change":"2024-04-24T23:38:38.250074+0000","last_active":"2024-04-24T23:38:39.373893+0000","last_peered":"2024-04-24T23:38:39.373893+0000","last_clean":"2024-04-24T23:38:39.373893+0000","last_became_active":"2024-04-24T23:38:38.249402+0000","last_became_peered":"2024-04-24T23:38:38.249402+0000","last_unstale":"2024-04-24T23:38:39.373893+0000","last_undegraded":"2024-04-24T23:38:39.373893+0000","last_fullsized":"2024-04-24T23:38:39.373893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:57.246661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370993+0000","last_change":"2024-04-24T23:38:34.187980+0000","last_active":"2024-04-24T23:38:39.370993+0000","last_peered":"2024-04-24T23:38:39.370993+0000","last_clean":"2024-04-24T23:38:39.370993+0000","last_became_active":"2024-04-24T23:38:34.187655+0000","last_became_peered":"2024-04-24T23:38:34.187655+0000","last_unstale":"2024-04-24T23:38:39.370993+0000","last_undegraded":"2024-04-24T23:38:39.370993+0000","last_fullsized":"2024-04-24T23:38:39.370993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:39.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371342+0000","last_change":"2024-04-24T23:38:33.125255+0000","last_active":"2024-04-24T23:38:39.371342+0000","last_peered":"2024-04-24T23:38:39.371342+0000","last_clean":"2024-04-24T23:38:39.371342+0000","last_became_active":"2024-04-24T23:38:33.115926+0000","last_became_peered":"2024-04-24T23:38:33.115926+0000","last_unstale":"2024-04-24T23:38:39.371342+0000","last_undegraded":"2024-04-24T23:38:39.371342+0000","last_fullsized":"2024-04-24T23:38:39.371342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:42.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370492+0000","last_change":"2024-04-24T23:38:29.564705+0000","last_active":"2024-04-24T23:38:39.370492+0000","last_peered":"2024-04-24T23:38:39.370492+0000","last_clean":"2024-04-24T23:38:39.370492+0000","last_became_active":"2024-04-24T23:38:29.562027+0000","last_became_peered":"2024-04-24T23:38:29.562027+0000","last_unstale":"2024-04-24T23:38:39.370492+0000","last_undegraded":"2024-04-24T23:38:39.370492+0000","last_fullsized":"2024-04-24T23:38:39.370492+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:27.959678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:27.959678+0000","last_clean_scrub_stamp":"2024-04-24T23:38:27.959678+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:40.724497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.234993+0000","last_change":"2024-04-24T23:38:38.254846+0000","last_active":"2024-04-24T23:38:39.234993+0000","last_peered":"2024-04-24T23:38:39.234993+0000","last_clean":"2024-04-24T23:38:39.234993+0000","last_became_active":"2024-04-24T23:38:38.253792+0000","last_became_peered":"2024-04-24T23:38:38.253792+0000","last_unstale":"2024-04-24T23:38:39.234993+0000","last_undegraded":"2024-04-24T23:38:39.234993+0000","last_fullsized":"2024-04-24T23:38:39.234993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:17:11.093562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372209+0000","last_change":"2024-04-24T23:38:34.195003+0000","last_active":"2024-04-24T23:38:39.372209+0000","last_peered":"2024-04-24T23:38:39.372209+0000","last_clean":"2024-04-24T23:38:39.372209+0000","last_became_active":"2024-04-24T23:38:34.194530+0000","last_became_peered":"2024-04-24T23:38:34.194530+0000","last_unstale":"2024-04-24T23:38:39.372209+0000","last_undegraded":"2024-04-24T23:38:39.372209+0000","last_fullsized":"2024-04-24T23:38:39.372209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:00.007223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233847+0000","last_change":"2024-04-24T23:38:33.130165+0000","last_active":"2024-04-24T23:38:39.233847+0000","last_peered":"2024-04-24T23:38:39.233847+0000","last_clean":"2024-04-24T23:38:39.233847+0000","last_became_active":"2024-04-24T23:38:33.129888+0000","last_became_peered":"2024-04-24T23:38:33.129888+0000","last_unstale":"2024-04-24T23:38:39.233847+0000","last_undegraded":"2024-04-24T23:38:39.233847+0000","last_fullsized":"2024-04-24T23:38:39.233847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:27:41.421732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233796+0000","last_change":"2024-04-24T23:38:38.253780+0000","last_active":"2024-04-24T23:38:39.233796+0000","last_peered":"2024-04-24T23:38:39.233796+0000","last_clean":"2024-04-24T23:38:39.233796+0000","last_became_active":"2024-04-24T23:38:38.252899+0000","last_became_peered":"2024-04-24T23:38:38.252899+0000","last_unstale":"2024-04-24T23:38:39.233796+0000","last_undegraded":"2024-04-24T23:38:39.233796+0000","last_fullsized":"2024-04-24T23:38:39.233796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:58.553943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372148+0000","last_change":"2024-04-24T23:38:34.187942+0000","last_active":"2024-04-24T23:38:39.372148+0000","last_peered":"2024-04-24T23:38:39.372148+0000","last_clean":"2024-04-24T23:38:39.372148+0000","last_became_active":"2024-04-24T23:38:34.184929+0000","last_became_peered":"2024-04-24T23:38:34.184929+0000","last_unstale":"2024-04-24T23:38:39.372148+0000","last_undegraded":"2024-04-24T23:38:39.372148+0000","last_fullsized":"2024-04-24T23:38:39.372148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:43.814245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369941+0000","last_change":"2024-04-24T23:38:33.120289+0000","last_active":"2024-04-24T23:38:39.369941+0000","last_peered":"2024-04-24T23:38:39.369941+0000","last_clean":"2024-04-24T23:38:39.369941+0000","last_became_active":"2024-04-24T23:38:33.119790+0000","last_became_peered":"2024-04-24T23:38:33.119790+0000","last_unstale":"2024-04-24T23:38:39.369941+0000","last_undegraded":"2024-04-24T23:38:39.369941+0000","last_fullsized":"2024-04-24T23:38:39.369941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373416+0000","last_change":"2024-04-24T23:38:38.216064+0000","last_active":"2024-04-24T23:38:39.373416+0000","last_peered":"2024-04-24T23:38:39.373416+0000","last_clean":"2024-04-24T23:38:39.373416+0000","last_became_active":"2024-04-24T23:38:38.215599+0000","last_became_peered":"2024-04-24T23:38:38.215599+0000","last_unstale":"2024-04-24T23:38:39.373416+0000","last_undegraded":"2024-04-24T23:38:39.373416+0000","last_fullsized":"2024-04-24T23:38:39.373416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:01.031822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373089+0000","last_change":"2024-04-24T23:38:34.194305+0000","last_active":"2024-04-24T23:38:39.373089+0000","last_peered":"2024-04-24T23:38:39.373089+0000","last_clean":"2024-04-24T23:38:39.373089+0000","last_became_active":"2024-04-24T23:38:34.188815+0000","last_became_peered":"2024-04-24T23:38:34.188815+0000","last_unstale":"2024-04-24T23:38:39.373089+0000","last_undegraded":"2024-04-24T23:38:39.373089+0000","last_fullsized":"2024-04-24T23:38:39.373089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:25.599734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233801+0000","last_change":"2024-04-24T23:38:33.125221+0000","last_active":"2024-04-24T23:38:39.233801+0000","last_peered":"2024-04-24T23:38:39.233801+0000","last_clean":"2024-04-24T23:38:39.233801+0000","last_became_active":"2024-04-24T23:38:33.124849+0000","last_became_peered":"2024-04-24T23:38:33.124849+0000","last_unstale":"2024-04-24T23:38:39.233801+0000","last_undegraded":"2024-04-24T23:38:39.233801+0000","last_fullsized":"2024-04-24T23:38:39.233801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:42.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369725+0000","last_change":"2024-04-24T23:38:38.250618+0000","last_active":"2024-04-24T23:38:39.369725+0000","last_peered":"2024-04-24T23:38:39.369725+0000","last_clean":"2024-04-24T23:38:39.369725+0000","last_became_active":"2024-04-24T23:38:38.249521+0000","last_became_peered":"2024-04-24T23:38:38.249521+0000","last_unstale":"2024-04-24T23:38:39.369725+0000","last_undegraded":"2024-04-24T23:38:39.369725+0000","last_fullsized":"2024-04-24T23:38:39.369725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:57.651551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372769+0000","last_change":"2024-04-24T23:38:34.166018+0000","last_active":"2024-04-24T23:38:39.372769+0000","last_peered":"2024-04-24T23:38:39.372769+0000","last_clean":"2024-04-24T23:38:39.372769+0000","last_became_active":"2024-04-24T23:38:34.165229+0000","last_became_peered":"2024-04-24T23:38:34.165229+0000","last_unstale":"2024-04-24T23:38:39.372769+0000","last_undegraded":"2024-04-24T23:38:39.372769+0000","last_fullsized":"2024-04-24T23:38:39.372769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:56.947423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.236714+0000","last_change":"2024-04-24T23:38:33.109771+0000","last_active":"2024-04-24T23:38:39.236714+0000","last_peered":"2024-04-24T23:38:39.236714+0000","last_clean":"2024-04-24T23:38:39.236714+0000","last_became_active":"2024-04-24T23:38:33.108928+0000","last_became_peered":"2024-04-24T23:38:33.108928+0000","last_unstale":"2024-04-24T23:38:39.236714+0000","last_undegraded":"2024-04-24T23:38:39.236714+0000","last_fullsized":"2024-04-24T23:38:39.236714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:44.838533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233300+0000","last_change":"2024-04-24T23:38:38.221186+0000","last_active":"2024-04-24T23:38:39.233300+0000","last_peered":"2024-04-24T23:38:39.233300+0000","last_clean":"2024-04-24T23:38:39.233300+0000","last_became_active":"2024-04-24T23:38:38.219780+0000","last_became_peered":"2024-04-24T23:38:38.219780+0000","last_unstale":"2024-04-24T23:38:39.233300+0000","last_undegraded":"2024-04-24T23:38:39.233300+0000","last_fullsized":"2024-04-24T23:38:39.233300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:43.959509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370916+0000","last_change":"2024-04-24T23:38:34.188981+0000","last_active":"2024-04-24T23:38:39.370916+0000","last_peered":"2024-04-24T23:38:39.370916+0000","last_clean":"2024-04-24T23:38:39.370916+0000","last_became_active":"2024-04-24T23:38:34.188416+0000","last_became_peered":"2024-04-24T23:38:34.188416+0000","last_unstale":"2024-04-24T23:38:39.370916+0000","last_undegraded":"2024-04-24T23:38:39.370916+0000","last_fullsized":"2024-04-24T23:38:39.370916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:17:07.009163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.232834+0000","last_change":"2024-04-24T23:38:33.100912+0000","last_active":"2024-04-24T23:38:39.232834+0000","last_peered":"2024-04-24T23:38:39.232834+0000","last_clean":"2024-04-24T23:38:39.232834+0000","last_became_active":"2024-04-24T23:38:33.100464+0000","last_became_peered":"2024-04-24T23:38:33.100464+0000","last_unstale":"2024-04-24T23:38:39.232834+0000","last_undegraded":"2024-04-24T23:38:39.232834+0000","last_fullsized":"2024-04-24T23:38:39.232834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:47:27.107958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373806+0000","last_change":"2024-04-24T23:38:38.207627+0000","last_active":"2024-04-24T23:38:39.373806+0000","last_peered":"2024-04-24T23:38:39.373806+0000","last_clean":"2024-04-24T23:38:39.373806+0000","last_became_active":"2024-04-24T23:38:38.207049+0000","last_became_peered":"2024-04-24T23:38:38.207049+0000","last_unstale":"2024-04-24T23:38:39.373806+0000","last_undegraded":"2024-04-24T23:38:39.373806+0000","last_fullsized":"2024-04-24T23:38:39.373806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:29:56.066046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233320+0000","last_change":"2024-04-24T23:38:34.161654+0000","last_active":"2024-04-24T23:38:39.233320+0000","last_peered":"2024-04-24T23:38:39.233320+0000","last_clean":"2024-04-24T23:38:39.233320+0000","last_became_active":"2024-04-24T23:38:34.158756+0000","last_became_peered":"2024-04-24T23:38:34.158756+0000","last_unstale":"2024-04-24T23:38:39.233320+0000","last_undegraded":"2024-04-24T23:38:39.233320+0000","last_fullsized":"2024-04-24T23:38:39.233320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:29.660159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233535+0000","last_change":"2024-04-24T23:38:33.116071+0000","last_active":"2024-04-24T23:38:39.233535+0000","last_peered":"2024-04-24T23:38:39.233535+0000","last_clean":"2024-04-24T23:38:39.233535+0000","last_became_active":"2024-04-24T23:38:33.115472+0000","last_became_peered":"2024-04-24T23:38:33.115472+0000","last_unstale":"2024-04-24T23:38:39.233535+0000","last_undegraded":"2024-04-24T23:38:39.233535+0000","last_fullsized":"2024-04-24T23:38:39.233535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:47.686974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372026+0000","last_change":"2024-04-24T23:38:38.248841+0000","last_active":"2024-04-24T23:38:39.372026+0000","last_peered":"2024-04-24T23:38:39.372026+0000","last_clean":"2024-04-24T23:38:39.372026+0000","last_became_active":"2024-04-24T23:38:38.248311+0000","last_became_peered":"2024-04-24T23:38:38.248311+0000","last_unstale":"2024-04-24T23:38:39.372026+0000","last_undegraded":"2024-04-24T23:38:39.372026+0000","last_fullsized":"2024-04-24T23:38:39.372026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:22.798878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371400+0000","last_change":"2024-04-24T23:38:34.189772+0000","last_active":"2024-04-24T23:38:39.371400+0000","last_peered":"2024-04-24T23:38:39.371400+0000","last_clean":"2024-04-24T23:38:39.371400+0000","last_became_active":"2024-04-24T23:38:34.179801+0000","last_became_peered":"2024-04-24T23:38:34.179801+0000","last_unstale":"2024-04-24T23:38:39.371400+0000","last_undegraded":"2024-04-24T23:38:39.371400+0000","last_fullsized":"2024-04-24T23:38:39.371400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:54.469544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370810+0000","last_change":"2024-04-24T23:38:33.146611+0000","last_active":"2024-04-24T23:38:39.370810+0000","last_peered":"2024-04-24T23:38:39.370810+0000","last_clean":"2024-04-24T23:38:39.370810+0000","last_became_active":"2024-04-24T23:38:33.145896+0000","last_became_peered":"2024-04-24T23:38:33.145896+0000","last_unstale":"2024-04-24T23:38:39.370810+0000","last_undegraded":"2024-04-24T23:38:39.370810+0000","last_fullsized":"2024-04-24T23:38:39.370810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:47.686974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371670+0000","last_change":"2024-04-24T23:38:38.252023+0000","last_active":"2024-04-24T23:38:39.371670+0000","last_peered":"2024-04-24T23:38:39.371670+0000","last_clean":"2024-04-24T23:38:39.371670+0000","last_became_active":"2024-04-24T23:38:38.251541+0000","last_became_peered":"2024-04-24T23:38:38.251541+0000","last_unstale":"2024-04-24T23:38:39.371670+0000","last_undegraded":"2024-04-24T23:38:39.371670+0000","last_fullsized":"2024-04-24T23:38:39.371670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:25:30.720742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372969+0000","last_change":"2024-04-24T23:38:34.164658+0000","last_active":"2024-04-24T23:38:39.372969+0000","last_peered":"2024-04-24T23:38:39.372969+0000","last_clean":"2024-04-24T23:38:39.372969+0000","last_became_active":"2024-04-24T23:38:34.164024+0000","last_became_peered":"2024-04-24T23:38:34.164024+0000","last_unstale":"2024-04-24T23:38:39.372969+0000","last_undegraded":"2024-04-24T23:38:39.372969+0000","last_fullsized":"2024-04-24T23:38:39.372969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:47.516208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373646+0000","last_change":"2024-04-24T23:38:33.111314+0000","last_active":"2024-04-24T23:38:39.373646+0000","last_peered":"2024-04-24T23:38:39.373646+0000","last_clean":"2024-04-24T23:38:39.373646+0000","last_became_active":"2024-04-24T23:38:33.109819+0000","last_became_peered":"2024-04-24T23:38:33.109819+0000","last_unstale":"2024-04-24T23:38:39.373646+0000","last_undegraded":"2024-04-24T23:38:39.373646+0000","last_fullsized":"2024-04-24T23:38:39.373646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:21:39.944505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372849+0000","last_change":"2024-04-24T23:38:38.247323+0000","last_active":"2024-04-24T23:38:39.372849+0000","last_peered":"2024-04-24T23:38:39.372849+0000","last_clean":"2024-04-24T23:38:39.372849+0000","last_became_active":"2024-04-24T23:38:38.246172+0000","last_became_peered":"2024-04-24T23:38:38.246172+0000","last_unstale":"2024-04-24T23:38:39.372849+0000","last_undegraded":"2024-04-24T23:38:39.372849+0000","last_fullsized":"2024-04-24T23:38:39.372849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:32.771055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371920+0000","last_change":"2024-04-24T23:38:34.189746+0000","last_active":"2024-04-24T23:38:39.371920+0000","last_peered":"2024-04-24T23:38:39.371920+0000","last_clean":"2024-04-24T23:38:39.371920+0000","last_became_active":"2024-04-24T23:38:34.179433+0000","last_became_peered":"2024-04-24T23:38:34.179433+0000","last_unstale":"2024-04-24T23:38:39.371920+0000","last_undegraded":"2024-04-24T23:38:39.371920+0000","last_fullsized":"2024-04-24T23:38:39.371920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:56.049789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:44.751455+0000","last_change":"2024-04-24T23:38:33.127637+0000","last_active":"2024-04-24T23:38:44.751455+0000","last_peered":"2024-04-24T23:38:44.751455+0000","last_clean":"2024-04-24T23:38:44.751455+0000","last_became_active":"2024-04-24T23:38:33.127122+0000","last_became_peered":"2024-04-24T23:38:33.127122+0000","last_unstale":"2024-04-24T23:38:44.751455+0000","last_undegraded":"2024-04-24T23:38:44.751455+0000","last_fullsized":"2024-04-24T23:38:44.751455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.368989+0000","last_change":"2024-04-24T23:38:38.216781+0000","last_active":"2024-04-24T23:38:39.368989+0000","last_peered":"2024-04-24T23:38:39.368989+0000","last_clean":"2024-04-24T23:38:39.368989+0000","last_became_active":"2024-04-24T23:38:38.215741+0000","last_became_peered":"2024-04-24T23:38:38.215741+0000","last_unstale":"2024-04-24T23:38:39.368989+0000","last_undegraded":"2024-04-24T23:38:39.368989+0000","last_fullsized":"2024-04-24T23:38:39.368989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:47.898644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.236646+0000","last_change":"2024-04-24T23:38:34.167424+0000","last_active":"2024-04-24T23:38:39.236646+0000","last_peered":"2024-04-24T23:38:39.236646+0000","last_clean":"2024-04-24T23:38:39.236646+0000","last_became_active":"2024-04-24T23:38:34.166602+0000","last_became_peered":"2024-04-24T23:38:34.166602+0000","last_unstale":"2024-04-24T23:38:39.236646+0000","last_undegraded":"2024-04-24T23:38:39.236646+0000","last_fullsized":"2024-04-24T23:38:39.236646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:31.033906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369922+0000","last_change":"2024-04-24T23:38:33.146758+0000","last_active":"2024-04-24T23:38:39.369922+0000","last_peered":"2024-04-24T23:38:39.369922+0000","last_clean":"2024-04-24T23:38:39.369922+0000","last_became_active":"2024-04-24T23:38:33.146311+0000","last_became_peered":"2024-04-24T23:38:33.146311+0000","last_unstale":"2024-04-24T23:38:39.369922+0000","last_undegraded":"2024-04-24T23:38:39.369922+0000","last_fullsized":"2024-04-24T23:38:39.369922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:09.575181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.235128+0000","last_change":"2024-04-24T23:38:38.221177+0000","last_active":"2024-04-24T23:38:39.235128+0000","last_peered":"2024-04-24T23:38:39.235128+0000","last_clean":"2024-04-24T23:38:39.235128+0000","last_became_active":"2024-04-24T23:38:38.219482+0000","last_became_peered":"2024-04-24T23:38:38.219482+0000","last_unstale":"2024-04-24T23:38:39.235128+0000","last_undegraded":"2024-04-24T23:38:39.235128+0000","last_fullsized":"2024-04-24T23:38:39.235128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:00.134189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373742+0000","last_change":"2024-04-24T23:38:34.170044+0000","last_active":"2024-04-24T23:38:39.373742+0000","last_peered":"2024-04-24T23:38:39.373742+0000","last_clean":"2024-04-24T23:38:39.373742+0000","last_became_active":"2024-04-24T23:38:34.169512+0000","last_became_peered":"2024-04-24T23:38:34.169512+0000","last_unstale":"2024-04-24T23:38:39.373742+0000","last_undegraded":"2024-04-24T23:38:39.373742+0000","last_fullsized":"2024-04-24T23:38:39.373742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373445+0000","last_change":"2024-04-24T23:38:33.131079+0000","last_active":"2024-04-24T23:38:39.373445+0000","last_peered":"2024-04-24T23:38:39.373445+0000","last_clean":"2024-04-24T23:38:39.373445+0000","last_became_active":"2024-04-24T23:38:33.130150+0000","last_became_peered":"2024-04-24T23:38:33.130150+0000","last_unstale":"2024-04-24T23:38:39.373445+0000","last_undegraded":"2024-04-24T23:38:39.373445+0000","last_fullsized":"2024-04-24T23:38:39.373445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:07.598128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370359+0000","last_change":"2024-04-24T23:38:38.212241+0000","last_active":"2024-04-24T23:38:39.370359+0000","last_peered":"2024-04-24T23:38:39.370359+0000","last_clean":"2024-04-24T23:38:39.370359+0000","last_became_active":"2024-04-24T23:38:38.208130+0000","last_became_peered":"2024-04-24T23:38:38.208130+0000","last_unstale":"2024-04-24T23:38:39.370359+0000","last_undegraded":"2024-04-24T23:38:39.370359+0000","last_fullsized":"2024-04-24T23:38:39.370359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:32.771055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372578+0000","last_change":"2024-04-24T23:38:34.199814+0000","last_active":"2024-04-24T23:38:39.372578+0000","last_peered":"2024-04-24T23:38:39.372578+0000","last_clean":"2024-04-24T23:38:39.372578+0000","last_became_active":"2024-04-24T23:38:34.199311+0000","last_became_peered":"2024-04-24T23:38:34.199311+0000","last_unstale":"2024-04-24T23:38:39.372578+0000","last_undegraded":"2024-04-24T23:38:39.372578+0000","last_fullsized":"2024-04-24T23:38:39.372578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:09:44.182605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.235904+0000","last_change":"2024-04-24T23:38:33.140029+0000","last_active":"2024-04-24T23:38:39.235904+0000","last_peered":"2024-04-24T23:38:39.235904+0000","last_clean":"2024-04-24T23:38:39.235904+0000","last_became_active":"2024-04-24T23:38:33.139325+0000","last_became_peered":"2024-04-24T23:38:33.139325+0000","last_unstale":"2024-04-24T23:38:39.235904+0000","last_undegraded":"2024-04-24T23:38:39.235904+0000","last_fullsized":"2024-04-24T23:38:39.235904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:07.598128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370490+0000","last_change":"2024-04-24T23:38:38.246245+0000","last_active":"2024-04-24T23:38:39.370490+0000","last_peered":"2024-04-24T23:38:39.370490+0000","last_clean":"2024-04-24T23:38:39.370490+0000","last_became_active":"2024-04-24T23:38:38.245657+0000","last_became_peered":"2024-04-24T23:38:38.245657+0000","last_unstale":"2024-04-24T23:38:39.370490+0000","last_undegraded":"2024-04-24T23:38:39.370490+0000","last_fullsized":"2024-04-24T23:38:39.370490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:45.297412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373571+0000","last_change":"2024-04-24T23:38:38.251308+0000","last_active":"2024-04-24T23:38:39.373571+0000","last_peered":"2024-04-24T23:38:39.373571+0000","last_clean":"2024-04-24T23:38:39.373571+0000","last_became_active":"2024-04-24T23:38:38.250718+0000","last_became_peered":"2024-04-24T23:38:38.250718+0000","last_unstale":"2024-04-24T23:38:39.373571+0000","last_undegraded":"2024-04-24T23:38:39.373571+0000","last_fullsized":"2024-04-24T23:38:39.373571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:18.964372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.368478+0000","last_change":"2024-04-24T23:38:34.174658+0000","last_active":"2024-04-24T23:38:39.368478+0000","last_peered":"2024-04-24T23:38:39.368478+0000","last_clean":"2024-04-24T23:38:39.368478+0000","last_became_active":"2024-04-24T23:38:34.174289+0000","last_became_peered":"2024-04-24T23:38:34.174289+0000","last_unstale":"2024-04-24T23:38:39.368478+0000","last_undegraded":"2024-04-24T23:38:39.368478+0000","last_fullsized":"2024-04-24T23:38:39.368478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:29.660159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370081+0000","last_change":"2024-04-24T23:38:33.131171+0000","last_active":"2024-04-24T23:38:39.370081+0000","last_peered":"2024-04-24T23:38:39.370081+0000","last_clean":"2024-04-24T23:38:39.370081+0000","last_became_active":"2024-04-24T23:38:33.130621+0000","last_became_peered":"2024-04-24T23:38:33.130621+0000","last_unstale":"2024-04-24T23:38:39.370081+0000","last_undegraded":"2024-04-24T23:38:39.370081+0000","last_fullsized":"2024-04-24T23:38:39.370081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.237281+0000","last_change":"2024-04-24T23:38:38.214392+0000","last_active":"2024-04-24T23:38:39.237281+0000","last_peered":"2024-04-24T23:38:39.237281+0000","last_clean":"2024-04-24T23:38:39.237281+0000","last_became_active":"2024-04-24T23:38:38.213249+0000","last_became_peered":"2024-04-24T23:38:38.213249+0000","last_unstale":"2024-04-24T23:38:39.237281+0000","last_undegraded":"2024-04-24T23:38:39.237281+0000","last_fullsized":"2024-04-24T23:38:39.237281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:01.031822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370465+0000","last_change":"2024-04-24T23:38:34.164231+0000","last_active":"2024-04-24T23:38:39.370465+0000","last_peered":"2024-04-24T23:38:39.370465+0000","last_clean":"2024-04-24T23:38:39.370465+0000","last_became_active":"2024-04-24T23:38:34.163685+0000","last_became_peered":"2024-04-24T23:38:34.163685+0000","last_unstale":"2024-04-24T23:38:39.370465+0000","last_undegraded":"2024-04-24T23:38:39.370465+0000","last_fullsized":"2024-04-24T23:38:39.370465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:29.660159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370805+0000","last_change":"2024-04-24T23:38:33.116249+0000","last_active":"2024-04-24T23:38:39.370805+0000","last_peered":"2024-04-24T23:38:39.370805+0000","last_clean":"2024-04-24T23:38:39.370805+0000","last_became_active":"2024-04-24T23:38:33.113333+0000","last_became_peered":"2024-04-24T23:38:33.113333+0000","last_unstale":"2024-04-24T23:38:39.370805+0000","last_undegraded":"2024-04-24T23:38:39.370805+0000","last_fullsized":"2024-04-24T23:38:39.370805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:47:27.107958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.234325+0000","last_change":"2024-04-24T23:38:33.111080+0000","last_active":"2024-04-24T23:38:39.234325+0000","last_peered":"2024-04-24T23:38:39.234325+0000","last_clean":"2024-04-24T23:38:39.234325+0000","last_became_active":"2024-04-24T23:38:33.110315+0000","last_became_peered":"2024-04-24T23:38:33.110315+0000","last_unstale":"2024-04-24T23:38:39.234325+0000","last_undegraded":"2024-04-24T23:38:39.234325+0000","last_fullsized":"2024-04-24T23:38:39.234325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373627+0000","last_change":"2024-04-24T23:38:34.148734+0000","last_active":"2024-04-24T23:38:39.373627+0000","last_peered":"2024-04-24T23:38:39.373627+0000","last_clean":"2024-04-24T23:38:39.373627+0000","last_became_active":"2024-04-24T23:38:34.146909+0000","last_became_peered":"2024-04-24T23:38:34.146909+0000","last_unstale":"2024-04-24T23:38:39.373627+0000","last_undegraded":"2024-04-24T23:38:39.373627+0000","last_fullsized":"2024-04-24T23:38:39.373627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:57:25.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233481+0000","last_change":"2024-04-24T23:38:38.215787+0000","last_active":"2024-04-24T23:38:39.233481+0000","last_peered":"2024-04-24T23:38:39.233481+0000","last_clean":"2024-04-24T23:38:39.233481+0000","last_became_active":"2024-04-24T23:38:38.215395+0000","last_became_peered":"2024-04-24T23:38:38.215395+0000","last_unstale":"2024-04-24T23:38:39.233481+0000","last_undegraded":"2024-04-24T23:38:39.233481+0000","last_fullsized":"2024-04-24T23:38:39.233481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:51.641050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371303+0000","last_change":"2024-04-24T23:38:33.131735+0000","last_active":"2024-04-24T23:38:39.371303+0000","last_peered":"2024-04-24T23:38:39.371303+0000","last_clean":"2024-04-24T23:38:39.371303+0000","last_became_active":"2024-04-24T23:38:33.131314+0000","last_became_peered":"2024-04-24T23:38:33.131314+0000","last_unstale":"2024-04-24T23:38:39.371303+0000","last_undegraded":"2024-04-24T23:38:39.371303+0000","last_fullsized":"2024-04-24T23:38:39.371303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:42.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.234423+0000","last_change":"2024-04-24T23:38:34.150894+0000","last_active":"2024-04-24T23:38:39.234423+0000","last_peered":"2024-04-24T23:38:39.234423+0000","last_clean":"2024-04-24T23:38:39.234423+0000","last_became_active":"2024-04-24T23:38:34.149910+0000","last_became_peered":"2024-04-24T23:38:34.149910+0000","last_unstale":"2024-04-24T23:38:39.234423+0000","last_undegraded":"2024-04-24T23:38:39.234423+0000","last_fullsized":"2024-04-24T23:38:39.234423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:08.608611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370852+0000","last_change":"2024-04-24T23:38:38.219498+0000","last_active":"2024-04-24T23:38:39.370852+0000","last_peered":"2024-04-24T23:38:39.370852+0000","last_clean":"2024-04-24T23:38:39.370852+0000","last_became_active":"2024-04-24T23:38:38.219100+0000","last_became_peered":"2024-04-24T23:38:38.219100+0000","last_unstale":"2024-04-24T23:38:39.370852+0000","last_undegraded":"2024-04-24T23:38:39.370852+0000","last_fullsized":"2024-04-24T23:38:39.370852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:17.585261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.234025+0000","last_change":"2024-04-24T23:38:34.162139+0000","last_active":"2024-04-24T23:38:39.234025+0000","last_peered":"2024-04-24T23:38:39.234025+0000","last_clean":"2024-04-24T23:38:39.234025+0000","last_became_active":"2024-04-24T23:38:34.159701+0000","last_became_peered":"2024-04-24T23:38:34.159701+0000","last_unstale":"2024-04-24T23:38:39.234025+0000","last_undegraded":"2024-04-24T23:38:39.234025+0000","last_fullsized":"2024-04-24T23:38:39.234025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:34.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.232917+0000","last_change":"2024-04-24T23:38:34.156925+0000","last_active":"2024-04-24T23:38:39.232917+0000","last_peered":"2024-04-24T23:38:39.232917+0000","last_clean":"2024-04-24T23:38:39.232917+0000","last_became_active":"2024-04-24T23:38:34.155969+0000","last_became_peered":"2024-04-24T23:38:34.155969+0000","last_unstale":"2024-04-24T23:38:39.232917+0000","last_undegraded":"2024-04-24T23:38:39.232917+0000","last_fullsized":"2024-04-24T23:38:39.232917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:31.033906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370758+0000","last_change":"2024-04-24T23:38:34.188234+0000","last_active":"2024-04-24T23:38:39.370758+0000","last_peered":"2024-04-24T23:38:39.370758+0000","last_clean":"2024-04-24T23:38:39.370758+0000","last_became_active":"2024-04-24T23:38:34.186332+0000","last_became_peered":"2024-04-24T23:38:34.186332+0000","last_unstale":"2024-04-24T23:38:39.370758+0000","last_undegraded":"2024-04-24T23:38:39.370758+0000","last_fullsized":"2024-04-24T23:38:39.370758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:56.049789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373534+0000","last_change":"2024-04-24T23:38:34.154728+0000","last_active":"2024-04-24T23:38:39.373534+0000","last_peered":"2024-04-24T23:38:39.373534+0000","last_clean":"2024-04-24T23:38:39.373534+0000","last_became_active":"2024-04-24T23:38:34.147038+0000","last_became_peered":"2024-04-24T23:38:34.147038+0000","last_unstale":"2024-04-24T23:38:39.373534+0000","last_undegraded":"2024-04-24T23:38:39.373534+0000","last_fullsized":"2024-04-24T23:38:39.373534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:34.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371833+0000","last_change":"2024-04-24T23:38:34.164080+0000","last_active":"2024-04-24T23:38:39.371833+0000","last_peered":"2024-04-24T23:38:39.371833+0000","last_clean":"2024-04-24T23:38:39.371833+0000","last_became_active":"2024-04-24T23:38:34.163761+0000","last_became_peered":"2024-04-24T23:38:34.163761+0000","last_unstale":"2024-04-24T23:38:39.371833+0000","last_undegraded":"2024-04-24T23:38:39.371833+0000","last_fullsized":"2024-04-24T23:38:39.371833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:00.007223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369406+0000","last_change":"2024-04-24T23:38:34.166482+0000","last_active":"2024-04-24T23:38:39.369406+0000","last_peered":"2024-04-24T23:38:39.369406+0000","last_clean":"2024-04-24T23:38:39.369406+0000","last_became_active":"2024-04-24T23:38:34.166059+0000","last_became_peered":"2024-04-24T23:38:34.166059+0000","last_unstale":"2024-04-24T23:38:39.369406+0000","last_undegraded":"2024-04-24T23:38:39.369406+0000","last_fullsized":"2024-04-24T23:38:39.369406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.235851+0000","last_change":"2024-04-24T23:38:34.179301+0000","last_active":"2024-04-24T23:38:39.235851+0000","last_peered":"2024-04-24T23:38:39.235851+0000","last_clean":"2024-04-24T23:38:39.235851+0000","last_became_active":"2024-04-24T23:38:34.178651+0000","last_became_peered":"2024-04-24T23:38:34.178651+0000","last_unstale":"2024-04-24T23:38:39.235851+0000","last_undegraded":"2024-04-24T23:38:39.235851+0000","last_fullsized":"2024-04-24T23:38:39.235851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:57.767771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372076+0000","last_change":"2024-04-24T23:38:34.162572+0000","last_active":"2024-04-24T23:38:39.372076+0000","last_peered":"2024-04-24T23:38:39.372076+0000","last_clean":"2024-04-24T23:38:39.372076+0000","last_became_active":"2024-04-24T23:38:34.162156+0000","last_became_peered":"2024-04-24T23:38:34.162156+0000","last_unstale":"2024-04-24T23:38:39.372076+0000","last_undegraded":"2024-04-24T23:38:39.372076+0000","last_fullsized":"2024-04-24T23:38:39.372076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:57.767771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370006+0000","last_change":"2024-04-24T23:38:34.187429+0000","last_active":"2024-04-24T23:38:39.370006+0000","last_peered":"2024-04-24T23:38:39.370006+0000","last_clean":"2024-04-24T23:38:39.370006+0000","last_became_active":"2024-04-24T23:38:34.184827+0000","last_became_peered":"2024-04-24T23:38:34.184827+0000","last_unstale":"2024-04-24T23:38:39.370006+0000","last_undegraded":"2024-04-24T23:38:39.370006+0000","last_fullsized":"2024-04-24T23:38:39.370006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370651+0000","last_change":"2024-04-24T23:38:34.165830+0000","last_active":"2024-04-24T23:38:39.370651+0000","last_peered":"2024-04-24T23:38:39.370651+0000","last_clean":"2024-04-24T23:38:39.370651+0000","last_became_active":"2024-04-24T23:38:34.165531+0000","last_became_peered":"2024-04-24T23:38:34.165531+0000","last_unstale":"2024-04-24T23:38:39.370651+0000","last_undegraded":"2024-04-24T23:38:39.370651+0000","last_fullsized":"2024-04-24T23:38:39.370651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:57:25.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370515+0000","last_change":"2024-04-24T23:38:34.199810+0000","last_active":"2024-04-24T23:38:39.370515+0000","last_peered":"2024-04-24T23:38:39.370515+0000","last_clean":"2024-04-24T23:38:39.370515+0000","last_became_active":"2024-04-24T23:38:34.199173+0000","last_became_peered":"2024-04-24T23:38:34.199173+0000","last_unstale":"2024-04-24T23:38:39.370515+0000","last_undegraded":"2024-04-24T23:38:39.370515+0000","last_fullsized":"2024-04-24T23:38:39.370515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:27.147380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373229+0000","last_change":"2024-04-24T23:38:34.165276+0000","last_active":"2024-04-24T23:38:39.373229+0000","last_peered":"2024-04-24T23:38:39.373229+0000","last_clean":"2024-04-24T23:38:39.373229+0000","last_became_active":"2024-04-24T23:38:34.165000+0000","last_became_peered":"2024-04-24T23:38:34.165000+0000","last_unstale":"2024-04-24T23:38:39.373229+0000","last_undegraded":"2024-04-24T23:38:39.373229+0000","last_fullsized":"2024-04-24T23:38:39.373229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:30:58.955608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.235067+0000","last_change":"2024-04-24T23:38:34.146904+0000","last_active":"2024-04-24T23:38:39.235067+0000","last_peered":"2024-04-24T23:38:39.235067+0000","last_clean":"2024-04-24T23:38:39.235067+0000","last_became_active":"2024-04-24T23:38:34.146096+0000","last_became_peered":"2024-04-24T23:38:34.146096+0000","last_unstale":"2024-04-24T23:38:39.235067+0000","last_undegraded":"2024-04-24T23:38:39.235067+0000","last_fullsized":"2024-04-24T23:38:39.235067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:39.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372502+0000","last_change":"2024-04-24T23:38:34.178750+0000","last_active":"2024-04-24T23:38:39.372502+0000","last_peered":"2024-04-24T23:38:39.372502+0000","last_clean":"2024-04-24T23:38:39.372502+0000","last_became_active":"2024-04-24T23:38:34.177451+0000","last_became_peered":"2024-04-24T23:38:34.177451+0000","last_unstale":"2024-04-24T23:38:39.372502+0000","last_undegraded":"2024-04-24T23:38:39.372502+0000","last_fullsized":"2024-04-24T23:38:39.372502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:43.814245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.233777+0000","last_change":"2024-04-24T23:38:34.160937+0000","last_active":"2024-04-24T23:38:39.233777+0000","last_peered":"2024-04-24T23:38:39.233777+0000","last_clean":"2024-04-24T23:38:39.233777+0000","last_became_active":"2024-04-24T23:38:34.159252+0000","last_became_peered":"2024-04-24T23:38:34.159252+0000","last_unstale":"2024-04-24T23:38:39.233777+0000","last_undegraded":"2024-04-24T23:38:39.233777+0000","last_fullsized":"2024-04-24T23:38:39.233777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:10.585665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373731+0000","last_change":"2024-04-24T23:38:34.199973+0000","last_active":"2024-04-24T23:38:39.373731+0000","last_peered":"2024-04-24T23:38:39.373731+0000","last_clean":"2024-04-24T23:38:39.373731+0000","last_became_active":"2024-04-24T23:38:34.199464+0000","last_became_peered":"2024-04-24T23:38:34.199464+0000","last_unstale":"2024-04-24T23:38:39.373731+0000","last_undegraded":"2024-04-24T23:38:39.373731+0000","last_fullsized":"2024-04-24T23:38:39.373731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:14.879972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369776+0000","last_change":"2024-04-24T23:38:34.182144+0000","last_active":"2024-04-24T23:38:39.369776+0000","last_peered":"2024-04-24T23:38:39.369776+0000","last_clean":"2024-04-24T23:38:39.369776+0000","last_became_active":"2024-04-24T23:38:34.181459+0000","last_became_peered":"2024-04-24T23:38:34.181459+0000","last_unstale":"2024-04-24T23:38:39.369776+0000","last_undegraded":"2024-04-24T23:38:39.369776+0000","last_fullsized":"2024-04-24T23:38:39.369776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.368577+0000","last_change":"2024-04-24T23:38:34.150090+0000","last_active":"2024-04-24T23:38:39.368577+0000","last_peered":"2024-04-24T23:38:39.368577+0000","last_clean":"2024-04-24T23:38:39.368577+0000","last_became_active":"2024-04-24T23:38:34.149272+0000","last_became_peered":"2024-04-24T23:38:34.149272+0000","last_unstale":"2024-04-24T23:38:39.368577+0000","last_undegraded":"2024-04-24T23:38:39.368577+0000","last_fullsized":"2024-04-24T23:38:39.368577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:57:25.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372819+0000","last_change":"2024-04-24T23:38:34.155641+0000","last_active":"2024-04-24T23:38:39.372819+0000","last_peered":"2024-04-24T23:38:39.372819+0000","last_clean":"2024-04-24T23:38:39.372819+0000","last_became_active":"2024-04-24T23:38:34.153683+0000","last_became_peered":"2024-04-24T23:38:34.153683+0000","last_unstale":"2024-04-24T23:38:39.372819+0000","last_undegraded":"2024-04-24T23:38:39.372819+0000","last_fullsized":"2024-04-24T23:38:39.372819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:24.354101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371146+0000","last_change":"2024-04-24T23:38:34.173601+0000","last_active":"2024-04-24T23:38:39.371146+0000","last_peered":"2024-04-24T23:38:39.371146+0000","last_clean":"2024-04-24T23:38:39.371146+0000","last_became_active":"2024-04-24T23:38:34.165764+0000","last_became_peered":"2024-04-24T23:38:34.165764+0000","last_unstale":"2024-04-24T23:38:39.371146+0000","last_undegraded":"2024-04-24T23:38:39.371146+0000","last_fullsized":"2024-04-24T23:38:39.371146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.236674+0000","last_change":"2024-04-24T23:38:34.142409+0000","last_active":"2024-04-24T23:38:39.236674+0000","last_peered":"2024-04-24T23:38:39.236674+0000","last_clean":"2024-04-24T23:38:39.236674+0000","last_became_active":"2024-04-24T23:38:34.141699+0000","last_became_peered":"2024-04-24T23:38:34.141699+0000","last_unstale":"2024-04-24T23:38:39.236674+0000","last_undegraded":"2024-04-24T23:38:39.236674+0000","last_fullsized":"2024-04-24T23:38:39.236674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:53.017909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.235416+0000","last_change":"2024-04-24T23:38:34.155964+0000","last_active":"2024-04-24T23:38:39.235416+0000","last_peered":"2024-04-24T23:38:39.235416+0000","last_clean":"2024-04-24T23:38:39.235416+0000","last_became_active":"2024-04-24T23:38:34.155106+0000","last_became_peered":"2024-04-24T23:38:34.155106+0000","last_unstale":"2024-04-24T23:38:39.235416+0000","last_undegraded":"2024-04-24T23:38:39.235416+0000","last_fullsized":"2024-04-24T23:38:39.235416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.236714+0000","last_change":"2024-04-24T23:38:34.157245+0000","last_active":"2024-04-24T23:38:39.236714+0000","last_peered":"2024-04-24T23:38:39.236714+0000","last_clean":"2024-04-24T23:38:39.236714+0000","last_became_active":"2024-04-24T23:38:34.156452+0000","last_became_peered":"2024-04-24T23:38:34.156452+0000","last_unstale":"2024-04-24T23:38:39.236714+0000","last_undegraded":"2024-04-24T23:38:39.236714+0000","last_fullsized":"2024-04-24T23:38:39.236714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372998+0000","last_change":"2024-04-24T23:38:34.195530+0000","last_active":"2024-04-24T23:38:39.372998+0000","last_peered":"2024-04-24T23:38:39.372998+0000","last_clean":"2024-04-24T23:38:39.372998+0000","last_became_active":"2024-04-24T23:38:34.194908+0000","last_became_peered":"2024-04-24T23:38:34.194908+0000","last_unstale":"2024-04-24T23:38:39.372998+0000","last_undegraded":"2024-04-24T23:38:39.372998+0000","last_fullsized":"2024-04-24T23:38:39.372998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:53.162262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370190+0000","last_change":"2024-04-24T23:38:34.184693+0000","last_active":"2024-04-24T23:38:39.370190+0000","last_peered":"2024-04-24T23:38:39.370190+0000","last_clean":"2024-04-24T23:38:39.370190+0000","last_became_active":"2024-04-24T23:38:34.184367+0000","last_became_peered":"2024-04-24T23:38:34.184367+0000","last_unstale":"2024-04-24T23:38:39.370190+0000","last_undegraded":"2024-04-24T23:38:39.370190+0000","last_fullsized":"2024-04-24T23:38:39.370190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:30:58.955608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370659+0000","last_change":"2024-04-24T23:38:34.176406+0000","last_active":"2024-04-24T23:38:39.370659+0000","last_peered":"2024-04-24T23:38:39.370659+0000","last_clean":"2024-04-24T23:38:39.370659+0000","last_became_active":"2024-04-24T23:38:34.165882+0000","last_became_peered":"2024-04-24T23:38:34.165882+0000","last_unstale":"2024-04-24T23:38:39.370659+0000","last_undegraded":"2024-04-24T23:38:39.370659+0000","last_fullsized":"2024-04-24T23:38:39.370659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:09:44.182605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.370261+0000","last_change":"2024-04-24T23:38:34.184368+0000","last_active":"2024-04-24T23:38:39.370261+0000","last_peered":"2024-04-24T23:38:39.370261+0000","last_clean":"2024-04-24T23:38:39.370261+0000","last_became_active":"2024-04-24T23:38:34.183652+0000","last_became_peered":"2024-04-24T23:38:34.183652+0000","last_unstale":"2024-04-24T23:38:39.370261+0000","last_undegraded":"2024-04-24T23:38:39.370261+0000","last_fullsized":"2024-04-24T23:38:39.370261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:57.767771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371091+0000","last_change":"2024-04-24T23:38:34.176656+0000","last_active":"2024-04-24T23:38:39.371091+0000","last_peered":"2024-04-24T23:38:39.371091+0000","last_clean":"2024-04-24T23:38:39.371091+0000","last_became_active":"2024-04-24T23:38:34.165931+0000","last_became_peered":"2024-04-24T23:38:34.165931+0000","last_unstale":"2024-04-24T23:38:39.371091+0000","last_undegraded":"2024-04-24T23:38:39.371091+0000","last_fullsized":"2024-04-24T23:38:39.371091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:14.879972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.371772+0000","last_change":"2024-04-24T23:38:34.187001+0000","last_active":"2024-04-24T23:38:39.371772+0000","last_peered":"2024-04-24T23:38:39.371772+0000","last_clean":"2024-04-24T23:38:39.371772+0000","last_became_active":"2024-04-24T23:38:34.186251+0000","last_became_peered":"2024-04-24T23:38:34.186251+0000","last_unstale":"2024-04-24T23:38:39.371772+0000","last_undegraded":"2024-04-24T23:38:39.371772+0000","last_fullsized":"2024-04-24T23:38:39.371772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:00.007223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.373733+0000","last_change":"2024-04-24T23:38:34.150280+0000","last_active":"2024-04-24T23:38:39.373733+0000","last_peered":"2024-04-24T23:38:39.373733+0000","last_clean":"2024-04-24T23:38:39.373733+0000","last_became_active":"2024-04-24T23:38:34.148402+0000","last_became_peered":"2024-04-24T23:38:34.148402+0000","last_unstale":"2024-04-24T23:38:39.373733+0000","last_undegraded":"2024-04-24T23:38:39.373733+0000","last_fullsized":"2024-04-24T23:38:39.373733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:29.660159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.369506+0000","last_change":"2024-04-24T23:38:34.151749+0000","last_active":"2024-04-24T23:38:39.369506+0000","last_peered":"2024-04-24T23:38:39.369506+0000","last_clean":"2024-04-24T23:38:39.369506+0000","last_became_active":"2024-04-24T23:38:34.150987+0000","last_became_peered":"2024-04-24T23:38:34.150987+0000","last_unstale":"2024-04-24T23:38:39.369506+0000","last_undegraded":"2024-04-24T23:38:39.369506+0000","last_fullsized":"2024-04-24T23:38:39.369506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-24T23:38:39.372849+0000","last_change":"2024-04-24T23:38:34.194857+0000","last_active":"2024-04-24T23:38:39.372849+0000","last_peered":"2024-04-24T23:38:39.372849+0000","last_clean":"2024-04-24T23:38:39.372849+0000","last_became_active":"2024-04-24T23:38:34.194195+0000","last_became_peered":"2024-04-24T23:38:34.194195+0000","last_unstale":"2024-04-24T23:38:39.372849+0000","last_undegraded":"2024-04-24T23:38:39.372849+0000","last_fullsized":"2024-04-24T23:38:39.372849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:29:51.981646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67594,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":691206,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":331776,"data_stored":691262,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:39:03.426 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-24T23:39:03.426 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-24T23:39:03.426 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-24T23:39:03.427 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-24T23:39:03.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.581+0000 7ff7454df640 1 Processor -- start 2024-04-24T23:39:03.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.581+0000 7ff7454df640 1 -- start start 2024-04-24T23:39:03.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.581+0000 7ff7454df640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff74014ada0 0x7ff7400b7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:03.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.581+0000 7ff7454df640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff740072980 0x7ff7400be3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:03.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.581+0000 7ff7454df640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7400b8fa0 con 0x7ff7400bde80 2024-04-24T23:39:03.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.581+0000 7ff7454df640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7ff7400be920 con 0x7ff740072980 2024-04-24T23:39:03.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.581+0000 7ff7454df640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7ff740072e10 con 0x7ff74014ada0 2024-04-24T23:39:03.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.581+0000 7ff73e7fc640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff740072980 0x7ff7400be3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:03.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.581+0000 7ff73e7fc640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff740072980 0x7ff7400be3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60350/0 (socket says 172.21.15.57:60350) 2024-04-24T23:39:03.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.581+0000 7ff73e7fc640 1 -- 172.21.15.57:0/624777456 learned_addr learned my addr 172.21.15.57:0/624777456 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:03.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.581+0000 7ff73effd640 1 --2- 172.21.15.57:0/624777456 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff74014ada0 0x7ff7400b7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:03.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.581+0000 7ff73e7fc640 1 -- 172.21.15.57:0/624777456 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff74014ada0 msgr2=0x7ff7400b7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:03.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.581+0000 7ff73e7fc640 1 --2- 172.21.15.57:0/624777456 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff74014ada0 0x7ff7400b7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:03.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.581+0000 7ff73e7fc640 1 -- 172.21.15.57:0/624777456 >> v1:172.21.15.88:6789/0 conn(0x7ff7400bde80 legacy=0x7ff74006eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:03.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.581+0000 7ff73e7fc640 1 -- 172.21.15.57:0/624777456 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff74006f260 con 0x7ff740072980 2024-04-24T23:39:03.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.585+0000 7ff73e7fc640 1 --2- 172.21.15.57:0/624777456 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff740072980 0x7ff7400be3e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff734009870 tx=0x7ff73401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d74ba7fbf2dc8de server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:03.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.585+0000 7ff73dffb640 1 -- 172.21.15.57:0/624777456 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7340b2070 con 0x7ff740072980 2024-04-24T23:39:03.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.585+0000 7ff73dffb640 1 -- 172.21.15.57:0/624777456 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7340a9070 con 0x7ff740072980 2024-04-24T23:39:03.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.585+0000 7ff73dffb640 1 -- 172.21.15.57:0/624777456 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7340ad880 con 0x7ff740072980 2024-04-24T23:39:03.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.585+0000 7ff7454df640 1 -- 172.21.15.57:0/624777456 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff740072980 msgr2=0x7ff7400be3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:03.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.585+0000 7ff7454df640 1 --2- 172.21.15.57:0/624777456 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff740072980 0x7ff7400be3e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff734009870 tx=0x7ff73401c490 comp rx=0 tx=0).stop 2024-04-24T23:39:03.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.585+0000 7ff7454df640 1 -- 172.21.15.57:0/624777456 shutdown_connections 2024-04-24T23:39:03.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.585+0000 7ff7454df640 1 --2- 172.21.15.57:0/624777456 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff740072980 0x7ff7400be3e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:03.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.585+0000 7ff7454df640 1 --2- 172.21.15.57:0/624777456 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff74014ada0 0x7ff7400b7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:03.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.585+0000 7ff7454df640 1 -- 172.21.15.57:0/624777456 >> 172.21.15.57:0/624777456 conn(0x7ff7400beab0 msgr2=0x7ff7400beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:03.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.585+0000 7ff7454df640 1 -- 172.21.15.57:0/624777456 shutdown_connections 2024-04-24T23:39:03.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.585+0000 7ff7454df640 1 -- 172.21.15.57:0/624777456 wait complete. 2024-04-24T23:39:03.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff7454df640 1 Processor -- start 2024-04-24T23:39:03.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff7454df640 1 -- start start 2024-04-24T23:39:03.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff7454df640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff740072980 0x7ff7401e8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:03.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff7454df640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7400bde80 0x7ff7400c1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:03.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff7454df640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff74014ada0 0x7ff74013ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:03.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff7454df640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff74015a8c0 con 0x7ff74014ada0 2024-04-24T23:39:03.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff7454df640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff74015a740 con 0x7ff7400bde80 2024-04-24T23:39:03.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff7454df640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7ff74015aa40 con 0x7ff740072980 2024-04-24T23:39:03.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff73f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff74014ada0 0x7ff74013ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:03.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff73f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff74014ada0 0x7ff74013ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60354/0 (socket says 172.21.15.57:60354) 2024-04-24T23:39:03.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff73f7fe640 1 -- 172.21.15.57:0/301990532 learned_addr learned my addr 172.21.15.57:0/301990532 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:03.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff73e7fc640 1 --2- 172.21.15.57:0/301990532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7400bde80 0x7ff7400c1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:03.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff73effd640 1 --2- 172.21.15.57:0/301990532 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff740072980 0x7ff7401e8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:03.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff73f7fe640 1 -- 172.21.15.57:0/301990532 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff740072980 msgr2=0x7ff7401e8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:03.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff73f7fe640 1 --2- 172.21.15.57:0/301990532 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff740072980 0x7ff7401e8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:03.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff73f7fe640 1 -- 172.21.15.57:0/301990532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7400bde80 msgr2=0x7ff7400c1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:03.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff73f7fe640 1 --2- 172.21.15.57:0/301990532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7400bde80 0x7ff7400c1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:03.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff73f7fe640 1 -- 172.21.15.57:0/301990532 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7400c1040 con 0x7ff74014ada0 2024-04-24T23:39:03.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff73e7fc640 1 --2- 172.21.15.57:0/301990532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7400bde80 0x7ff7400c1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:39:03.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff73effd640 1 --2- 172.21.15.57:0/301990532 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff740072980 0x7ff7401e8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:39:03.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff73f7fe640 1 --2- 172.21.15.57:0/301990532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff74014ada0 0x7ff74013ece0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff73800c3c0 tx=0x7ff73800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:03.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff7277fe640 1 -- 172.21.15.57:0/301990532 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738011790 con 0x7ff74014ada0 2024-04-24T23:39:03.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff7277fe640 1 -- 172.21.15.57:0/301990532 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff738017070 con 0x7ff74014ada0 2024-04-24T23:39:03.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff7454df640 1 -- 172.21.15.57:0/301990532 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff740148e00 con 0x7ff74014ada0 2024-04-24T23:39:03.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff7277fe640 1 -- 172.21.15.57:0/301990532 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738011b70 con 0x7ff74014ada0 2024-04-24T23:39:03.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff7454df640 1 -- 172.21.15.57:0/301990532 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7400c12e0 con 0x7ff74014ada0 2024-04-24T23:39:03.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff7454df640 1 -- 172.21.15.57:0/301990532 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff74013f7c0 con 0x7ff74014ada0 2024-04-24T23:39:03.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff7277fe640 1 -- 172.21.15.57:0/301990532 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff738011d10 con 0x7ff74014ada0 2024-04-24T23:39:03.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff7277fe640 1 --2- 172.21.15.57:0/301990532 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ff72c0678c0 0x7ff72c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:03.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff7277fe640 1 -- 172.21.15.57:0/301990532 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff738085e50 con 0x7ff74014ada0 2024-04-24T23:39:03.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.589+0000 7ff73effd640 1 --2- 172.21.15.57:0/301990532 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ff72c0678c0 0x7ff72c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:03.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.593+0000 7ff73effd640 1 --2- 172.21.15.57:0/301990532 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ff72c0678c0 0x7ff72c069d80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff730007eb0 tx=0x7ff730007400 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:03.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.593+0000 7ff7277fe640 1 -- 172.21.15.57:0/301990532 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7ff74013f7c0 con 0x7ff74014ada0 2024-04-24T23:39:03.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.785+0000 7ff7454df640 1 -- 172.21.15.57:0/301990532 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff740068220 con 0x7ff74014ada0 2024-04-24T23:39:03.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.785+0000 7ff7277fe640 1 -- 172.21.15.57:0/301990532 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7ff7380565d0 con 0x7ff74014ada0 2024-04-24T23:39:03.788 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:39:03.788 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-24T23:39:03.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.789+0000 7ff7454df640 1 -- 172.21.15.57:0/301990532 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ff72c0678c0 msgr2=0x7ff72c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:03.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.789+0000 7ff7454df640 1 --2- 172.21.15.57:0/301990532 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ff72c0678c0 0x7ff72c069d80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff730007eb0 tx=0x7ff730007400 comp rx=0 tx=0).stop 2024-04-24T23:39:03.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.789+0000 7ff7454df640 1 -- 172.21.15.57:0/301990532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff74014ada0 msgr2=0x7ff74013ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:03.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.789+0000 7ff7454df640 1 --2- 172.21.15.57:0/301990532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff74014ada0 0x7ff74013ece0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff73800c3c0 tx=0x7ff73800c880 comp rx=0 tx=0).stop 2024-04-24T23:39:03.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.789+0000 7ff7454df640 1 -- 172.21.15.57:0/301990532 shutdown_connections 2024-04-24T23:39:03.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.789+0000 7ff7454df640 1 --2- 172.21.15.57:0/301990532 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ff72c0678c0 0x7ff72c069d80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:03.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.789+0000 7ff7454df640 1 --2- 172.21.15.57:0/301990532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff74014ada0 0x7ff74013ece0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:03.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.789+0000 7ff7454df640 1 --2- 172.21.15.57:0/301990532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7400bde80 0x7ff7400c1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:03.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.789+0000 7ff7454df640 1 --2- 172.21.15.57:0/301990532 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff740072980 0x7ff7401e8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:03.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.789+0000 7ff7454df640 1 -- 172.21.15.57:0/301990532 >> 172.21.15.57:0/301990532 conn(0x7ff7400beab0 msgr2=0x7ff7400bee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:03.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.789+0000 7ff7454df640 1 -- 172.21.15.57:0/301990532 shutdown_connections 2024-04-24T23:39:03.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.789+0000 7ff7454df640 1 -- 172.21.15.57:0/301990532 wait complete. 2024-04-24T23:39:03.806 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-24T23:39:03.806 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:39:03.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.925+0000 7fd0d4ee7640 1 Processor -- start 2024-04-24T23:39:03.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.925+0000 7fd0d4ee7640 1 -- start start 2024-04-24T23:39:03.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.929+0000 7fd0d4ee7640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0d00bd530 0x7fd0d014dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:03.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.929+0000 7fd0d4ee7640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0d0154cb0 con 0x7fd0d00bdd60 2024-04-24T23:39:03.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.929+0000 7fd0d4ee7640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0d00bd9c0 con 0x7fd0d00c32c0 2024-04-24T23:39:03.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.929+0000 7fd0d4ee7640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fd0d0154820 con 0x7fd0d00bd530 2024-04-24T23:39:03.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.929+0000 7fd0ced9d640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd0d00bdd60 0x7fd0d015b1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53126/0 (socket says 172.21.15.57:53126) 2024-04-24T23:39:03.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.929+0000 7fd0ced9d640 1 -- 172.21.15.57:0/115728764 learned_addr learned my addr 172.21.15.57:0/115728764 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:03.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.929+0000 7fd0cdd9b640 1 --2- 172.21.15.57:0/115728764 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0d00bd530 0x7fd0d014dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:03.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.929+0000 7fd0cd59a640 1 -- 172.21.15.57:0/115728764 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3853892443 0 0) 0x7fd0d0154cb0 con 0x7fd0d00bdd60 2024-04-24T23:39:03.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.929+0000 7fd0cd59a640 1 -- 172.21.15.57:0/115728764 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0b8003530 con 0x7fd0d00bdd60 2024-04-24T23:39:03.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.929+0000 7fd0cdd9b640 1 -- 172.21.15.57:0/115728764 >> v1:172.21.15.88:6789/0 conn(0x7fd0d00c32c0 legacy=0x7fd0d00c0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:03.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.929+0000 7fd0cd59a640 1 -- 172.21.15.57:0/115728764 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2456968512 0 0) 0x7fd0d00bd9c0 con 0x7fd0d00c32c0 2024-04-24T23:39:03.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.929+0000 7fd0cdd9b640 1 -- 172.21.15.57:0/115728764 >> v1:172.21.15.57:6789/0 conn(0x7fd0d00bdd60 legacy=0x7fd0d015b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:03.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.929+0000 7fd0cdd9b640 1 -- 172.21.15.57:0/115728764 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d00c1da0 con 0x7fd0d00bd530 2024-04-24T23:39:03.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0cdd9b640 1 --2- 172.21.15.57:0/115728764 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0d00bd530 0x7fd0d014dab0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd0c40097f0 tx=0x7fd0c401ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7beefad61d720ce0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:03.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0cd59a640 1 -- 172.21.15.57:0/115728764 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c40b5070 con 0x7fd0d00bd530 2024-04-24T23:39:03.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0cd59a640 1 -- 172.21.15.57:0/115728764 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0c40a89d0 con 0x7fd0d00bd530 2024-04-24T23:39:03.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0cd59a640 1 -- 172.21.15.57:0/115728764 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c40a8d80 con 0x7fd0d00bd530 2024-04-24T23:39:03.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0d4ee7640 1 -- 172.21.15.57:0/115728764 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0d00bd530 msgr2=0x7fd0d014dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:03.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0d4ee7640 1 --2- 172.21.15.57:0/115728764 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0d00bd530 0x7fd0d014dab0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd0c40097f0 tx=0x7fd0c401ecd0 comp rx=0 tx=0).stop 2024-04-24T23:39:03.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0d4ee7640 1 -- 172.21.15.57:0/115728764 shutdown_connections 2024-04-24T23:39:03.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0d4ee7640 1 --2- 172.21.15.57:0/115728764 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0d00bd530 0x7fd0d014dab0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:03.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0d4ee7640 1 -- 172.21.15.57:0/115728764 >> 172.21.15.57:0/115728764 conn(0x7fd0d0072d40 msgr2=0x7fd0d0073150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:03.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0d4ee7640 1 -- 172.21.15.57:0/115728764 shutdown_connections 2024-04-24T23:39:03.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0d4ee7640 1 -- 172.21.15.57:0/115728764 wait complete. 2024-04-24T23:39:03.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0d4ee7640 1 Processor -- start 2024-04-24T23:39:03.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0d4ee7640 1 -- start start 2024-04-24T23:39:03.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0d4ee7640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0d00bdd60 0x7fd0d00b9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:03.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0d4ee7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0d00c32c0 0x7fd0d00ba4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:03.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0d4ee7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0d00bb580 0x7fd0d00c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:03.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0d4ee7640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d00c36a0 con 0x7fd0d00c32c0 2024-04-24T23:39:03.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0d4ee7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d00c1350 con 0x7fd0d00bb580 2024-04-24T23:39:03.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0d4ee7640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fd0d00c3820 con 0x7fd0d00bdd60 2024-04-24T23:39:03.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0cdd9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0d00c32c0 0x7fd0d00ba4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:03.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0cdd9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0d00c32c0 0x7fd0d00ba4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60370/0 (socket says 172.21.15.57:60370) 2024-04-24T23:39:03.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0cdd9b640 1 -- 172.21.15.57:0/3121152183 learned_addr learned my addr 172.21.15.57:0/3121152183 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:03.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0ce59c640 1 --2- 172.21.15.57:0/3121152183 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0d00bdd60 0x7fd0d00b9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:03.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0ced9d640 1 --2- 172.21.15.57:0/3121152183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0d00bb580 0x7fd0d00c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:03.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0cdd9b640 1 -- 172.21.15.57:0/3121152183 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0d00bdd60 msgr2=0x7fd0d00b9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:03.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0cdd9b640 1 --2- 172.21.15.57:0/3121152183 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0d00bdd60 0x7fd0d00b9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:03.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0cdd9b640 1 -- 172.21.15.57:0/3121152183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0d00bb580 msgr2=0x7fd0d00c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:03.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0cdd9b640 1 --2- 172.21.15.57:0/3121152183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0d00bb580 0x7fd0d00c64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:03.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0cdd9b640 1 -- 172.21.15.57:0/3121152183 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d013ddd0 con 0x7fd0d00c32c0 2024-04-24T23:39:03.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0ced9d640 1 --2- 172.21.15.57:0/3121152183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0d00bb580 0x7fd0d00c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:39:03.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0cdd9b640 1 --2- 172.21.15.57:0/3121152183 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0d00c32c0 0x7fd0d00ba4b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd0c40b3040 tx=0x7fd0c401ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:03.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0beffd640 1 -- 172.21.15.57:0/3121152183 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c40b5040 con 0x7fd0d00c32c0 2024-04-24T23:39:03.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0beffd640 1 -- 172.21.15.57:0/3121152183 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0c40c0070 con 0x7fd0d00c32c0 2024-04-24T23:39:03.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.933+0000 7fd0beffd640 1 -- 172.21.15.57:0/3121152183 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4003620 con 0x7fd0d00c32c0 2024-04-24T23:39:03.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.937+0000 7fd0d4ee7640 1 -- 172.21.15.57:0/3121152183 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0d013daf0 con 0x7fd0d00c32c0 2024-04-24T23:39:03.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.937+0000 7fd0d4ee7640 1 -- 172.21.15.57:0/3121152183 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0d00bce90 con 0x7fd0d00c32c0 2024-04-24T23:39:03.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.937+0000 7fd0d4ee7640 1 -- 172.21.15.57:0/3121152183 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0d0068930 con 0x7fd0d00c32c0 2024-04-24T23:39:03.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.937+0000 7fd0beffd640 1 -- 172.21.15.57:0/3121152183 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd0c40037c0 con 0x7fd0d00c32c0 2024-04-24T23:39:03.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.937+0000 7fd0beffd640 1 --2- 172.21.15.57:0/3121152183 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd0b00678f0 0x7fd0b0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:03.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.937+0000 7fd0beffd640 1 -- 172.21.15.57:0/3121152183 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd0c4123450 con 0x7fd0d00c32c0 2024-04-24T23:39:03.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.937+0000 7fd0ce59c640 1 --2- 172.21.15.57:0/3121152183 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd0b00678f0 0x7fd0b0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:03.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.937+0000 7fd0ce59c640 1 --2- 172.21.15.57:0/3121152183 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd0b00678f0 0x7fd0b0069db0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8000f70 tx=0x7fd0c8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:03.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:03.941+0000 7fd0beffd640 1 -- 172.21.15.57:0/3121152183 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fd0c4018830 con 0x7fd0d00c32c0 2024-04-24T23:39:04.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.097+0000 7fd0d4ee7640 1 -- 172.21.15.57:0/3121152183 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd0d00c39e0 con 0x7fd0d00c32c0 2024-04-24T23:39:04.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.101+0000 7fd0beffd640 1 -- 172.21.15.57:0/3121152183 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7fd0c40f3c30 con 0x7fd0d00c32c0 2024-04-24T23:39:04.101 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:39:04.101 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":24,"fsid":"1ea31698-444a-4667-bcd9-b2608ad103c3","created":"2024-04-24T23:38:16.748774+0000","modified":"2024-04-24T23:38:38.604475+0000","last_up_change":"2024-04-24T23:38:26.956537+0000","last_in_change":"2024-04-24T23:38:18.972175+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:38:27.611782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:38:31.718061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:38:32.469413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:38:36.215724+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"35ce67bc-9b25-416e-ab1e-774c717631f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6825","nonce":671364028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6827","nonce":671364028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6831","nonce":671364028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6829","nonce":671364028}]},"public_addr":"172.21.15.57:6825/671364028","cluster_addr":"172.21.15.57:6827/671364028","heartbeat_back_addr":"172.21.15.57:6831/671364028","heartbeat_front_addr":"172.21.15.57:6829/671364028","state":["exists","up"]},{"osd":1,"uuid":"38f6f4ef-3bc2-4453-9946-7d1d17e735ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6801","nonce":2653552037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6803","nonce":2653552037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6807","nonce":2653552037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6805","nonce":2653552037}]},"public_addr":"172.21.15.57:6801/2653552037","cluster_addr":"172.21.15.57:6803/2653552037","heartbeat_back_addr":"172.21.15.57:6807/2653552037","heartbeat_front_addr":"172.21.15.57:6805/2653552037","state":["exists","up"]},{"osd":2,"uuid":"d77a0a49-b39a-464e-a1c9-49e19280c440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6816","nonce":1565874109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6819","nonce":1565874109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6823","nonce":1565874109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6821","nonce":1565874109}]},"public_addr":"172.21.15.57:6816/1565874109","cluster_addr":"172.21.15.57:6819/1565874109","heartbeat_back_addr":"172.21.15.57:6823/1565874109","heartbeat_front_addr":"172.21.15.57:6821/1565874109","state":["exists","up"]},{"osd":3,"uuid":"f8ea9bfe-d839-44a6-a185-0f0985da314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6809","nonce":3474703186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6811","nonce":3474703186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6817","nonce":3474703186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6813","nonce":3474703186}]},"public_addr":"172.21.15.57:6809/3474703186","cluster_addr":"172.21.15.57:6811/3474703186","heartbeat_back_addr":"172.21.15.57:6817/3474703186","heartbeat_front_addr":"172.21.15.57:6813/3474703186","state":["exists","up"]},{"osd":4,"uuid":"454647d4-6ac2-46b4-8451-320eb951a87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6801","nonce":1271707713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6803","nonce":1271707713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6807","nonce":1271707713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6805","nonce":1271707713}]},"public_addr":"172.21.15.88:6801/1271707713","cluster_addr":"172.21.15.88:6803/1271707713","heartbeat_back_addr":"172.21.15.88:6807/1271707713","heartbeat_front_addr":"172.21.15.88:6805/1271707713","state":["exists","up"]},{"osd":5,"uuid":"f71c03a3-7ad8-46d3-89c9-d61de102586b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6809","nonce":2035054888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6813","nonce":2035054888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6820","nonce":2035054888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6816","nonce":2035054888}]},"public_addr":"172.21.15.88:6809/2035054888","cluster_addr":"172.21.15.88:6813/2035054888","heartbeat_back_addr":"172.21.15.88:6820/2035054888","heartbeat_front_addr":"172.21.15.88:6816/2035054888","state":["exists","up"]},{"osd":6,"uuid":"ec7ae2b7-9cb4-4059-8f98-0022c9763f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6825","nonce":1752291242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6827","nonce":1752291242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6831","nonce":1752291242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6829","nonce":1752291242}]},"public_addr":"172.21.15.88:6825/1752291242","cluster_addr":"172.21.15.88:6827/1752291242","heartbeat_back_addr":"172.21.15.88:6831/1752291242","heartbeat_front_addr":"172.21.15.88:6829/1752291242","state":["exists","up"]},{"osd":7,"uuid":"c0ee7505-60c1-40ba-9902-47313a04dafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6812","nonce":1782800372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6817","nonce":1782800372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6823","nonce":1782800372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6821","nonce":1782800372}]},"public_addr":"172.21.15.88:6812/1782800372","cluster_addr":"172.21.15.88:6817/1782800372","heartbeat_back_addr":"172.21.15.88:6823/1782800372","heartbeat_front_addr":"172.21.15.88:6821/1782800372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.698562+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.682587+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.680197+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.561753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.011095+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.493320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.353451+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.423877+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:39:04.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.101+0000 7fd0d4ee7640 1 -- 172.21.15.57:0/3121152183 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd0b00678f0 msgr2=0x7fd0b0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:04.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.101+0000 7fd0d4ee7640 1 --2- 172.21.15.57:0/3121152183 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd0b00678f0 0x7fd0b0069db0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8000f70 tx=0x7fd0c8009040 comp rx=0 tx=0).stop 2024-04-24T23:39:04.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.101+0000 7fd0d4ee7640 1 -- 172.21.15.57:0/3121152183 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0d00c32c0 msgr2=0x7fd0d00ba4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:04.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.101+0000 7fd0d4ee7640 1 --2- 172.21.15.57:0/3121152183 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0d00c32c0 0x7fd0d00ba4b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd0c40b3040 tx=0x7fd0c401ba70 comp rx=0 tx=0).stop 2024-04-24T23:39:04.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.101+0000 7fd0d4ee7640 1 -- 172.21.15.57:0/3121152183 shutdown_connections 2024-04-24T23:39:04.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.101+0000 7fd0d4ee7640 1 --2- 172.21.15.57:0/3121152183 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd0b00678f0 0x7fd0b0069db0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:04.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.101+0000 7fd0d4ee7640 1 --2- 172.21.15.57:0/3121152183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0d00bb580 0x7fd0d00c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:04.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.101+0000 7fd0d4ee7640 1 --2- 172.21.15.57:0/3121152183 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0d00c32c0 0x7fd0d00ba4b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:04.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.101+0000 7fd0d4ee7640 1 --2- 172.21.15.57:0/3121152183 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0d00bdd60 0x7fd0d00b9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:04.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.101+0000 7fd0d4ee7640 1 -- 172.21.15.57:0/3121152183 >> 172.21.15.57:0/3121152183 conn(0x7fd0d0072d40 msgr2=0x7fd0d014bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:04.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.101+0000 7fd0d4ee7640 1 -- 172.21.15.57:0/3121152183 shutdown_connections 2024-04-24T23:39:04.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.101+0000 7fd0d4ee7640 1 -- 172.21.15.57:0/3121152183 wait complete. 2024-04-24T23:39:04.118 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:38:27.611782+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:38:31.718061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:38:32.469413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-24T23:38:36.215724+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-24T23:39:04.119 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:39:04.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.237+0000 7f66d733d640 1 Processor -- start 2024-04-24T23:39:04.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.237+0000 7f66d733d640 1 -- start start 2024-04-24T23:39:04.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66d733d640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f66d014e5d0 0x7f66d0159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:04.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66d733d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66d01529c0 con 0x7f66d00b7fe0 2024-04-24T23:39:04.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66d733d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66d00be330 con 0x7f66d014bd80 2024-04-24T23:39:04.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66d733d640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f66d0151b40 con 0x7f66d014e5d0 2024-04-24T23:39:04.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66d48d8640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f66d00b7fe0 0x7f66d006b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53134/0 (socket says 172.21.15.57:53134) 2024-04-24T23:39:04.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66d48d8640 1 -- 172.21.15.57:0/372335837 learned_addr learned my addr 172.21.15.57:0/372335837 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:04.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66d58da640 1 --2- 172.21.15.57:0/372335837 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f66d014e5d0 0x7f66d0159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:04.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66c7fff640 1 -- 172.21.15.57:0/372335837 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1486891737 0 0) 0x7f66d01529c0 con 0x7f66d00b7fe0 2024-04-24T23:39:04.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66c7fff640 1 -- 172.21.15.57:0/372335837 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66bc003530 con 0x7f66d00b7fe0 2024-04-24T23:39:04.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66c7fff640 1 -- 172.21.15.57:0/372335837 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2932104755 0 0) 0x7f66bc003530 con 0x7f66d00b7fe0 2024-04-24T23:39:04.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66c7fff640 1 -- 172.21.15.57:0/372335837 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f66d014e5d0 msgr2=0x7f66d0159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:04.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66c7fff640 1 --2- 172.21.15.57:0/372335837 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f66d014e5d0 0x7f66d0159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:04.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66c7fff640 1 -- 172.21.15.57:0/372335837 >> v1:172.21.15.88:6789/0 conn(0x7f66d014bd80 legacy=0x7f66d01522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:04.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66c7fff640 1 -- 172.21.15.57:0/372335837 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d0151d90 con 0x7f66d00b7fe0 2024-04-24T23:39:04.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66c7fff640 1 -- 172.21.15.57:0/372335837 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7f66c0001680 con 0x7f66d00b7fe0 2024-04-24T23:39:04.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66c7fff640 1 -- 172.21.15.57:0/372335837 >> v1:172.21.15.57:6789/0 conn(0x7f66d00b7fe0 legacy=0x7f66d006b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:04.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66c7fff640 1 --2- 172.21.15.57:0/372335837 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66bc0039f0 0x7f66bc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:04.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66c7fff640 1 --2- 172.21.15.57:0/372335837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66bc004810 0x7f66bc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:04.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66c7fff640 1 --2- 172.21.15.57:0/372335837 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f66d014e5d0 0x7f66bc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:04.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66c7fff640 1 -- 172.21.15.57:0/372335837 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f66d0151b40 con 0x7f66bc004810 2024-04-24T23:39:04.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66c7fff640 1 -- 172.21.15.57:0/372335837 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f66bc00bb00 con 0x7f66bc0039f0 2024-04-24T23:39:04.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66c7fff640 1 -- 172.21.15.57:0/372335837 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f66bc00bd00 con 0x7f66d014e5d0 2024-04-24T23:39:04.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66d48d8640 1 --2- 172.21.15.57:0/372335837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66bc004810 0x7f66bc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:04.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66d50d9640 1 --2- 172.21.15.57:0/372335837 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66bc0039f0 0x7f66bc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:04.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66d48d8640 1 -- 172.21.15.57:0/372335837 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f66d014e5d0 msgr2=0x7f66bc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:04.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66d48d8640 1 --2- 172.21.15.57:0/372335837 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f66d014e5d0 0x7f66bc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:04.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66d48d8640 1 -- 172.21.15.57:0/372335837 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66bc0039f0 msgr2=0x7f66bc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:04.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66d48d8640 1 --2- 172.21.15.57:0/372335837 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66bc0039f0 0x7f66bc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:04.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66d48d8640 1 -- 172.21.15.57:0/372335837 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66bc003530 con 0x7f66bc004810 2024-04-24T23:39:04.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66d50d9640 1 --2- 172.21.15.57:0/372335837 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66bc0039f0 0x7f66bc003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:39:04.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66d48d8640 1 --2- 172.21.15.57:0/372335837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66bc004810 0x7f66bc004c90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f66d00b8420 tx=0x7f66c001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3bec809d5865a94 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:04.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.241+0000 7f66c7fff640 1 -- 172.21.15.57:0/372335837 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c0007d40 con 0x7f66bc004810 2024-04-24T23:39:04.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66c7fff640 1 -- 172.21.15.57:0/372335837 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66c00a9070 con 0x7f66bc004810 2024-04-24T23:39:04.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66c7fff640 1 -- 172.21.15.57:0/372335837 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c0005d40 con 0x7f66bc004810 2024-04-24T23:39:04.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66d733d640 1 -- 172.21.15.57:0/372335837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66bc004810 msgr2=0x7f66bc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:04.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66d733d640 1 --2- 172.21.15.57:0/372335837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66bc004810 0x7f66bc004c90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f66d00b8420 tx=0x7f66c001cc60 comp rx=0 tx=0).stop 2024-04-24T23:39:04.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66d58da640 1 -- 172.21.15.57:0/372335837 reap_dead start 2024-04-24T23:39:04.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66d733d640 1 -- 172.21.15.57:0/372335837 shutdown_connections 2024-04-24T23:39:04.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66d733d640 1 -- 172.21.15.57:0/372335837 >> 172.21.15.57:0/372335837 conn(0x7f66d00c2fc0 msgr2=0x7f66d00c33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:04.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66d733d640 1 -- 172.21.15.57:0/372335837 shutdown_connections 2024-04-24T23:39:04.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66d733d640 1 -- 172.21.15.57:0/372335837 wait complete. 2024-04-24T23:39:04.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66d733d640 1 Processor -- start 2024-04-24T23:39:04.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66d733d640 1 -- start start 2024-04-24T23:39:04.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66d733d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66bc004810 0x7f66d00c2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:04.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66d733d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66d00c2690 0x7f66d0145690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:04.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66d733d640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f66d01516c0 0x7f66d0145bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:04.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66d733d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f66d00bdc30 con 0x7f66d00c2690 2024-04-24T23:39:04.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66d733d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f66d014e9e0 con 0x7f66bc004810 2024-04-24T23:39:04.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66d733d640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f66d00bddb0 con 0x7f66d01516c0 2024-04-24T23:39:04.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66d48d8640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66d00c2690 0x7f66d0145690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:04.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66d48d8640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66d00c2690 0x7f66d0145690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60388/0 (socket says 172.21.15.57:60388) 2024-04-24T23:39:04.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66d48d8640 1 -- 172.21.15.57:0/988863038 learned_addr learned my addr 172.21.15.57:0/988863038 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:04.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66d58da640 1 --2- 172.21.15.57:0/988863038 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f66d01516c0 0x7f66d0145bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:04.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66d50d9640 1 --2- 172.21.15.57:0/988863038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66bc004810 0x7f66d00c2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:04.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66d48d8640 1 -- 172.21.15.57:0/988863038 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f66d01516c0 msgr2=0x7f66d0145bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:04.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66d48d8640 1 --2- 172.21.15.57:0/988863038 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f66d01516c0 0x7f66d0145bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:04.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66d48d8640 1 -- 172.21.15.57:0/988863038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66bc004810 msgr2=0x7f66d00c2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:04.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66d48d8640 1 --2- 172.21.15.57:0/988863038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66bc004810 0x7f66d00c2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:04.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66d48d8640 1 -- 172.21.15.57:0/988863038 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d013b590 con 0x7f66d00c2690 2024-04-24T23:39:04.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66d48d8640 1 --2- 172.21.15.57:0/988863038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66d00c2690 0x7f66d0145690 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f66c0001980 tx=0x7f66bc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:04.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66c5ffb640 1 -- 172.21.15.57:0/988863038 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c0005d20 con 0x7f66d00c2690 2024-04-24T23:39:04.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66c5ffb640 1 -- 172.21.15.57:0/988863038 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66c00047f0 con 0x7f66d00c2690 2024-04-24T23:39:04.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66d733d640 1 -- 172.21.15.57:0/988863038 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66d01474f0 con 0x7f66d00c2690 2024-04-24T23:39:04.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66c5ffb640 1 -- 172.21.15.57:0/988863038 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c0004bc0 con 0x7f66d00c2690 2024-04-24T23:39:04.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66d733d640 1 -- 172.21.15.57:0/988863038 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66d0150ad0 con 0x7f66d00c2690 2024-04-24T23:39:04.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.245+0000 7f66d733d640 1 -- 172.21.15.57:0/988863038 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66d0146110 con 0x7f66d00c2690 2024-04-24T23:39:04.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.249+0000 7f66c5ffb640 1 -- 172.21.15.57:0/988863038 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f66c0007070 con 0x7f66d00c2690 2024-04-24T23:39:04.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.249+0000 7f66c5ffb640 1 --2- 172.21.15.57:0/988863038 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f66b40678c0 0x7f66b4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:04.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.249+0000 7f66c5ffb640 1 -- 172.21.15.57:0/988863038 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f66c011f7d0 con 0x7f66d00c2690 2024-04-24T23:39:04.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.249+0000 7f66d50d9640 1 --2- 172.21.15.57:0/988863038 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f66b40678c0 0x7f66b4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:04.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.249+0000 7f66d50d9640 1 --2- 172.21.15.57:0/988863038 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f66b40678c0 0x7f66b4069d80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f66cc000f70 tx=0x7f66cc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:04.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.253+0000 7f66c5ffb640 1 -- 172.21.15.57:0/988863038 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f66c0016970 con 0x7f66d00c2690 2024-04-24T23:39:04.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.405+0000 7f66d733d640 1 -- 172.21.15.57:0/988863038 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f66d0068930 con 0x7f66d00c2690 2024-04-24T23:39:04.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.405+0000 7f66c5ffb640 1 -- 172.21.15.57:0/988863038 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f66c00f0060 con 0x7f66d00c2690 2024-04-24T23:39:04.408 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-04-24T23:39:04.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.409+0000 7f66d733d640 1 -- 172.21.15.57:0/988863038 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f66b40678c0 msgr2=0x7f66b4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:04.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.409+0000 7f66d733d640 1 --2- 172.21.15.57:0/988863038 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f66b40678c0 0x7f66b4069d80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f66cc000f70 tx=0x7f66cc009040 comp rx=0 tx=0).stop 2024-04-24T23:39:04.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.409+0000 7f66d733d640 1 -- 172.21.15.57:0/988863038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66d00c2690 msgr2=0x7f66d0145690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:04.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.409+0000 7f66d733d640 1 --2- 172.21.15.57:0/988863038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66d00c2690 0x7f66d0145690 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f66c0001980 tx=0x7f66bc005840 comp rx=0 tx=0).stop 2024-04-24T23:39:04.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.409+0000 7f66d733d640 1 -- 172.21.15.57:0/988863038 shutdown_connections 2024-04-24T23:39:04.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.409+0000 7f66d733d640 1 --2- 172.21.15.57:0/988863038 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f66b40678c0 0x7f66b4069d80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:04.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.409+0000 7f66d733d640 1 --2- 172.21.15.57:0/988863038 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f66d01516c0 0x7f66d0145bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:04.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.409+0000 7f66d733d640 1 --2- 172.21.15.57:0/988863038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66d00c2690 0x7f66d0145690 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:04.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.409+0000 7f66d733d640 1 --2- 172.21.15.57:0/988863038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66bc004810 0x7f66d00c2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:04.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.409+0000 7f66d733d640 1 -- 172.21.15.57:0/988863038 >> 172.21.15.57:0/988863038 conn(0x7f66d00c2fc0 msgr2=0x7f66d014aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:04.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.409+0000 7f66d733d640 1 -- 172.21.15.57:0/988863038 shutdown_connections 2024-04-24T23:39:04.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.409+0000 7f66d733d640 1 -- 172.21.15.57:0/988863038 wait complete. 2024-04-24T23:39:04.426 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:39:04.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.553+0000 7f203f6cb640 1 Processor -- start 2024-04-24T23:39:04.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.553+0000 7f203f6cb640 1 -- start start 2024-04-24T23:39:04.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.553+0000 7f203f6cb640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f203814deb0 0x7f20380c2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:04.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.553+0000 7f203f6cb640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f20380c3490 0x7f20380c1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:04.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.553+0000 7f203f6cb640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2038151270 con 0x7f20380b8660 2024-04-24T23:39:04.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.553+0000 7f203f6cb640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f20380c0a90 con 0x7f203814deb0 2024-04-24T23:39:04.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.553+0000 7f203f6cb640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f20380c0d70 con 0x7f20380c3490 2024-04-24T23:39:04.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.553+0000 7f203d467640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f203814deb0 0x7f20380c2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:04.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.553+0000 7f203cc66640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f20380c3490 0x7f20380c1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:04.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.553+0000 7f203d467640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f203814deb0 0x7f20380c2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.57:60312/0 (socket says 172.21.15.57:60312) 2024-04-24T23:39:04.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.553+0000 7f203d467640 1 -- 172.21.15.57:0/375982844 learned_addr learned my addr 172.21.15.57:0/375982844 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:04.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.553+0000 7f203cc66640 1 -- 172.21.15.57:0/375982844 >> v2:172.21.15.88:3300/0 conn(0x7f203814deb0 msgr2=0x7f20380c2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:04.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.553+0000 7f203cc66640 1 --2- 172.21.15.57:0/375982844 >> v2:172.21.15.88:3300/0 conn(0x7f203814deb0 0x7f20380c2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:04.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.553+0000 7f203cc66640 1 -- 172.21.15.57:0/375982844 >> v1:172.21.15.88:6789/0 conn(0x7f20380b8660 legacy=0x7f2038153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:04.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.553+0000 7f203cc66640 1 -- 172.21.15.57:0/375982844 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2038151550 con 0x7f20380c3490 2024-04-24T23:39:04.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.553+0000 7f203d467640 1 --2- 172.21.15.57:0/375982844 >> v2:172.21.15.88:3300/0 conn(0x7f203814deb0 0x7f20380c2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:39:04.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.557+0000 7f203cc66640 1 --2- 172.21.15.57:0/375982844 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f20380c3490 0x7f20380c1200 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f202c0097c0 tx=0x7f202c01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=475b65e1e58f691f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:04.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.557+0000 7f2037fff640 1 -- 172.21.15.57:0/375982844 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c0b5070 con 0x7f20380c3490 2024-04-24T23:39:04.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.557+0000 7f2037fff640 1 -- 172.21.15.57:0/375982844 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f202c0a8990 con 0x7f20380c3490 2024-04-24T23:39:04.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.557+0000 7f2037fff640 1 -- 172.21.15.57:0/375982844 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c0a8d60 con 0x7f20380c3490 2024-04-24T23:39:04.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.557+0000 7f203f6cb640 1 -- 172.21.15.57:0/375982844 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f20380c3490 msgr2=0x7f20380c1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:04.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.557+0000 7f203f6cb640 1 --2- 172.21.15.57:0/375982844 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f20380c3490 0x7f20380c1200 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f202c0097c0 tx=0x7f202c01ec90 comp rx=0 tx=0).stop 2024-04-24T23:39:04.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.557+0000 7f203f6cb640 1 -- 172.21.15.57:0/375982844 shutdown_connections 2024-04-24T23:39:04.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.557+0000 7f203f6cb640 1 --2- 172.21.15.57:0/375982844 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f20380c3490 0x7f20380c1200 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:04.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.557+0000 7f203f6cb640 1 --2- 172.21.15.57:0/375982844 >> v2:172.21.15.88:3300/0 conn(0x7f203814deb0 0x7f20380c2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:04.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.557+0000 7f203f6cb640 1 -- 172.21.15.57:0/375982844 >> 172.21.15.57:0/375982844 conn(0x7f2038067120 msgr2=0x7f2038067530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:04.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.557+0000 7f203f6cb640 1 -- 172.21.15.57:0/375982844 shutdown_connections 2024-04-24T23:39:04.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.557+0000 7f203f6cb640 1 -- 172.21.15.57:0/375982844 wait complete. 2024-04-24T23:39:04.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.557+0000 7f203f6cb640 1 Processor -- start 2024-04-24T23:39:04.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.557+0000 7f203f6cb640 1 -- start start 2024-04-24T23:39:04.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.561+0000 7f203f6cb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20380b8660 0x7f2038153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:04.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.561+0000 7f203f6cb640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20380c3490 0x7f20381dafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:04.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.561+0000 7f203f6cb640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f203814deb0 0x7f20380bed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:04.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.561+0000 7f203f6cb640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f20380c1740 con 0x7f20380c3490 2024-04-24T23:39:04.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.561+0000 7f203f6cb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f203814e290 con 0x7f20380b8660 2024-04-24T23:39:04.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.561+0000 7f203f6cb640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f20380c18c0 con 0x7f203814deb0 2024-04-24T23:39:04.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.561+0000 7f203cc66640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20380c3490 0x7f20381dafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:04.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.561+0000 7f203cc66640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20380c3490 0x7f20381dafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60392/0 (socket says 172.21.15.57:60392) 2024-04-24T23:39:04.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.561+0000 7f203cc66640 1 -- 172.21.15.57:0/482796405 learned_addr learned my addr 172.21.15.57:0/482796405 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:04.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.561+0000 7f203d467640 1 --2- 172.21.15.57:0/482796405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20380b8660 0x7f2038153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:04.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.561+0000 7f203dc68640 1 --2- 172.21.15.57:0/482796405 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f203814deb0 0x7f20380bed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:04.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.561+0000 7f203cc66640 1 -- 172.21.15.57:0/482796405 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f203814deb0 msgr2=0x7f20380bed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:04.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.561+0000 7f203cc66640 1 --2- 172.21.15.57:0/482796405 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f203814deb0 0x7f20380bed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:04.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.561+0000 7f203cc66640 1 -- 172.21.15.57:0/482796405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20380b8660 msgr2=0x7f2038153eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:04.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.561+0000 7f203cc66640 1 --2- 172.21.15.57:0/482796405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20380b8660 0x7f2038153eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:04.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.561+0000 7f203cc66640 1 -- 172.21.15.57:0/482796405 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20381543f0 con 0x7f20380c3490 2024-04-24T23:39:04.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.561+0000 7f203dc68640 1 --2- 172.21.15.57:0/482796405 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f203814deb0 0x7f20380bed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:39:04.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.561+0000 7f203d467640 1 --2- 172.21.15.57:0/482796405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20380b8660 0x7f2038153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:39:04.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.561+0000 7f203cc66640 1 --2- 172.21.15.57:0/482796405 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20380c3490 0x7f20381dafd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f202c01c8c0 tx=0x7f202c01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:04.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.561+0000 7f2035ffb640 1 -- 172.21.15.57:0/482796405 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c0bf070 con 0x7f20380c3490 2024-04-24T23:39:04.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.561+0000 7f2035ffb640 1 -- 172.21.15.57:0/482796405 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f202c0b07a0 con 0x7f20380c3490 2024-04-24T23:39:04.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.561+0000 7f2035ffb640 1 -- 172.21.15.57:0/482796405 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c0b5040 con 0x7f20380c3490 2024-04-24T23:39:04.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.561+0000 7f203f6cb640 1 -- 172.21.15.57:0/482796405 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20381db800 con 0x7f20380c3490 2024-04-24T23:39:04.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.561+0000 7f203f6cb640 1 -- 172.21.15.57:0/482796405 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2038149e30 con 0x7f20380c3490 2024-04-24T23:39:04.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.561+0000 7f203f6cb640 1 -- 172.21.15.57:0/482796405 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2038068290 con 0x7f20380c3490 2024-04-24T23:39:04.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.561+0000 7f2035ffb640 1 -- 172.21.15.57:0/482796405 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f202c0b0b90 con 0x7f20380c3490 2024-04-24T23:39:04.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.561+0000 7f2035ffb640 1 --2- 172.21.15.57:0/482796405 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f20240678c0 0x7f2024069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:04.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.561+0000 7f2035ffb640 1 -- 172.21.15.57:0/482796405 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f202c122f60 con 0x7f20380c3490 2024-04-24T23:39:04.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.561+0000 7f203d467640 1 --2- 172.21.15.57:0/482796405 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f20240678c0 0x7f2024069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:04.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.565+0000 7f203d467640 1 --2- 172.21.15.57:0/482796405 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f20240678c0 0x7f2024069d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2030009240 tx=0x7f203000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:04.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.565+0000 7f2035ffb640 1 -- 172.21.15.57:0/482796405 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f202c0c8070 con 0x7f20380c3490 2024-04-24T23:39:04.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.725+0000 7f203f6cb640 1 -- 172.21.15.57:0/482796405 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f203814a000 con 0x7f20380c3490 2024-04-24T23:39:04.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.725+0000 7f2035ffb640 1 -- 172.21.15.57:0/482796405 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f20381543f0 con 0x7f20380c3490 2024-04-24T23:39:04.728 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-04-24T23:39:04.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.729+0000 7f203f6cb640 1 -- 172.21.15.57:0/482796405 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f20240678c0 msgr2=0x7f2024069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:04.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.729+0000 7f203f6cb640 1 --2- 172.21.15.57:0/482796405 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f20240678c0 0x7f2024069d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2030009240 tx=0x7f203000b040 comp rx=0 tx=0).stop 2024-04-24T23:39:04.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.729+0000 7f203f6cb640 1 -- 172.21.15.57:0/482796405 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20380c3490 msgr2=0x7f20381dafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:04.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.729+0000 7f203f6cb640 1 --2- 172.21.15.57:0/482796405 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20380c3490 0x7f20381dafd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f202c01c8c0 tx=0x7f202c01ba30 comp rx=0 tx=0).stop 2024-04-24T23:39:04.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.729+0000 7f203f6cb640 1 -- 172.21.15.57:0/482796405 shutdown_connections 2024-04-24T23:39:04.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.729+0000 7f203f6cb640 1 --2- 172.21.15.57:0/482796405 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f20240678c0 0x7f2024069d80 secure :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2030009240 tx=0x7f203000b040 comp rx=0 tx=0).stop 2024-04-24T23:39:04.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.729+0000 7f203f6cb640 1 --2- 172.21.15.57:0/482796405 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f203814deb0 0x7f20380bed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:04.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.729+0000 7f203f6cb640 1 --2- 172.21.15.57:0/482796405 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20380c3490 0x7f20381dafd0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:04.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.729+0000 7f203f6cb640 1 --2- 172.21.15.57:0/482796405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20380b8660 0x7f2038153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:04.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.729+0000 7f203f6cb640 1 -- 172.21.15.57:0/482796405 >> 172.21.15.57:0/482796405 conn(0x7f2038067120 msgr2=0x7f2038067500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:04.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.729+0000 7f203f6cb640 1 -- 172.21.15.57:0/482796405 shutdown_connections 2024-04-24T23:39:04.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.729+0000 7f203f6cb640 1 -- 172.21.15.57:0/482796405 wait complete. 2024-04-24T23:39:04.747 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:39:04.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.877+0000 7f80dfc6c640 1 Processor -- start 2024-04-24T23:39:04.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.877+0000 7f80dfc6c640 1 -- start start 2024-04-24T23:39:04.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.877+0000 7f80dfc6c640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f80d814deb0 0x7f80d80c2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:04.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.877+0000 7f80dfc6c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f80d80c3490 0x7f80d80c1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:04.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.877+0000 7f80dfc6c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f80d80b8660 0x7f80d8153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:04.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.877+0000 7f80dfc6c640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f80d80c0a90 con 0x7f80d80b8660 2024-04-24T23:39:04.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.877+0000 7f80dfc6c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f80d80c0d70 con 0x7f80d80c3490 2024-04-24T23:39:04.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.877+0000 7f80dfc6c640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f80d8151270 con 0x7f80d814deb0 2024-04-24T23:39:04.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.877+0000 7f80de209640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f80d80b8660 0x7f80d8153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:04.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.877+0000 7f80de209640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f80d80b8660 0x7f80d8153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60398/0 (socket says 172.21.15.57:60398) 2024-04-24T23:39:04.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.877+0000 7f80de209640 1 -- 172.21.15.57:0/2512711512 learned_addr learned my addr 172.21.15.57:0/2512711512 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:04.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.877+0000 7f80dd207640 1 --2- 172.21.15.57:0/2512711512 >> v2:172.21.15.88:3300/0 conn(0x7f80d80c3490 0x7f80d80c1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:04.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.877+0000 7f80dda08640 1 --2- 172.21.15.57:0/2512711512 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f80d814deb0 0x7f80d80c2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:04.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.877+0000 7f80de209640 1 -- 172.21.15.57:0/2512711512 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f80d814deb0 msgr2=0x7f80d80c2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:04.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.877+0000 7f80de209640 1 --2- 172.21.15.57:0/2512711512 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f80d814deb0 0x7f80d80c2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:04.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.877+0000 7f80de209640 1 -- 172.21.15.57:0/2512711512 >> v2:172.21.15.88:3300/0 conn(0x7f80d80c3490 msgr2=0x7f80d80c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:04.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.877+0000 7f80de209640 1 --2- 172.21.15.57:0/2512711512 >> v2:172.21.15.88:3300/0 conn(0x7f80d80c3490 0x7f80d80c1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:04.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.877+0000 7f80de209640 1 -- 172.21.15.57:0/2512711512 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80d8151550 con 0x7f80d80b8660 2024-04-24T23:39:04.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.881+0000 7f80de209640 1 --2- 172.21.15.57:0/2512711512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80d80b8660 0x7f80d8153cd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f80d80c7170 tx=0x7f80d001f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79431556e15174c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:04.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.881+0000 7f80dca06640 1 -- 172.21.15.57:0/2512711512 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d00b4070 con 0x7f80d80b8660 2024-04-24T23:39:04.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.881+0000 7f80dca06640 1 -- 172.21.15.57:0/2512711512 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80d00af400 con 0x7f80d80b8660 2024-04-24T23:39:04.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.881+0000 7f80dca06640 1 -- 172.21.15.57:0/2512711512 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d00af7d0 con 0x7f80d80b8660 2024-04-24T23:39:04.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.881+0000 7f80dfc6c640 1 -- 172.21.15.57:0/2512711512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80d80b8660 msgr2=0x7f80d8153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:04.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.881+0000 7f80dfc6c640 1 --2- 172.21.15.57:0/2512711512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80d80b8660 0x7f80d8153cd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f80d80c7170 tx=0x7f80d001f1e0 comp rx=0 tx=0).stop 2024-04-24T23:39:04.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.881+0000 7f80dfc6c640 1 -- 172.21.15.57:0/2512711512 shutdown_connections 2024-04-24T23:39:04.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.881+0000 7f80dfc6c640 1 --2- 172.21.15.57:0/2512711512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80d80b8660 0x7f80d8153cd0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:04.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.881+0000 7f80dfc6c640 1 --2- 172.21.15.57:0/2512711512 >> v2:172.21.15.88:3300/0 conn(0x7f80d80c3490 0x7f80d80c1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:04.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.881+0000 7f80dfc6c640 1 --2- 172.21.15.57:0/2512711512 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f80d814deb0 0x7f80d80c2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:04.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.881+0000 7f80dfc6c640 1 -- 172.21.15.57:0/2512711512 >> 172.21.15.57:0/2512711512 conn(0x7f80d8067120 msgr2=0x7f80d8067530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:04.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.881+0000 7f80dfc6c640 1 -- 172.21.15.57:0/2512711512 shutdown_connections 2024-04-24T23:39:04.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.881+0000 7f80dfc6c640 1 -- 172.21.15.57:0/2512711512 wait complete. 2024-04-24T23:39:04.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.881+0000 7f80dfc6c640 1 Processor -- start 2024-04-24T23:39:04.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.881+0000 7f80dfc6c640 1 -- start start 2024-04-24T23:39:04.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.881+0000 7f80dfc6c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80d80b8660 0x7f80d81e9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:04.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.881+0000 7f80dfc6c640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f80d80c3490 0x7f80d81e9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:04.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.881+0000 7f80dfc6c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80d814deb0 0x7f80d8147700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:04.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.881+0000 7f80dfc6c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f80d80c1740 con 0x7f80d80b8660 2024-04-24T23:39:04.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.881+0000 7f80dfc6c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f80d814e290 con 0x7f80d814deb0 2024-04-24T23:39:04.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.881+0000 7f80dfc6c640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f80d80c18c0 con 0x7f80d80c3490 2024-04-24T23:39:04.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.881+0000 7f80dda08640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80d80b8660 0x7f80d81e9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:04.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.881+0000 7f80dda08640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80d80b8660 0x7f80d81e9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60406/0 (socket says 172.21.15.57:60406) 2024-04-24T23:39:04.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.881+0000 7f80dda08640 1 -- 172.21.15.57:0/2865435367 learned_addr learned my addr 172.21.15.57:0/2865435367 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:04.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.885+0000 7f80de209640 1 --2- 172.21.15.57:0/2865435367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80d814deb0 0x7f80d8147700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:04.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.885+0000 7f80dda08640 1 -- 172.21.15.57:0/2865435367 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f80d80c3490 msgr2=0x7f80d81e9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:04.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.885+0000 7f80dd207640 1 --2- 172.21.15.57:0/2865435367 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f80d80c3490 0x7f80d81e9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:04.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.885+0000 7f80dda08640 1 --2- 172.21.15.57:0/2865435367 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f80d80c3490 0x7f80d81e9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:04.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.885+0000 7f80dda08640 1 -- 172.21.15.57:0/2865435367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80d814deb0 msgr2=0x7f80d8147700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:04.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.885+0000 7f80dda08640 1 --2- 172.21.15.57:0/2865435367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80d814deb0 0x7f80d8147700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:04.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.885+0000 7f80dda08640 1 -- 172.21.15.57:0/2865435367 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80d80c6a70 con 0x7f80d80b8660 2024-04-24T23:39:04.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.885+0000 7f80de209640 1 --2- 172.21.15.57:0/2865435367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80d814deb0 0x7f80d8147700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:39:04.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.885+0000 7f80dda08640 1 --2- 172.21.15.57:0/2865435367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80d80b8660 0x7f80d81e9850 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f80d400d830 tx=0x7f80d400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:04.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.885+0000 7f80ce7fc640 1 -- 172.21.15.57:0/2865435367 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d400b6c0 con 0x7f80d80b8660 2024-04-24T23:39:04.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.885+0000 7f80ce7fc640 1 -- 172.21.15.57:0/2865435367 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80d4019070 con 0x7f80d80b8660 2024-04-24T23:39:04.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.885+0000 7f80ce7fc640 1 -- 172.21.15.57:0/2865435367 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d400ba60 con 0x7f80d80b8660 2024-04-24T23:39:04.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.885+0000 7f80dfc6c640 1 -- 172.21.15.57:0/2865435367 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80d80bec30 con 0x7f80d80b8660 2024-04-24T23:39:04.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.885+0000 7f80dfc6c640 1 -- 172.21.15.57:0/2865435367 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80d81489b0 con 0x7f80d80b8660 2024-04-24T23:39:04.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.885+0000 7f80dfc6c640 1 -- 172.21.15.57:0/2865435367 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80d8068290 con 0x7f80d80b8660 2024-04-24T23:39:04.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.885+0000 7f80ce7fc640 1 -- 172.21.15.57:0/2865435367 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f80d401e460 con 0x7f80d80b8660 2024-04-24T23:39:04.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.885+0000 7f80ce7fc640 1 --2- 172.21.15.57:0/2865435367 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f80bc0678c0 0x7f80bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:04.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.885+0000 7f80ce7fc640 1 -- 172.21.15.57:0/2865435367 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f80d4086640 con 0x7f80d80b8660 2024-04-24T23:39:04.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.885+0000 7f80dd207640 1 --2- 172.21.15.57:0/2865435367 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f80bc0678c0 0x7f80bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:04.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.885+0000 7f80dd207640 1 --2- 172.21.15.57:0/2865435367 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f80bc0678c0 0x7f80bc069d80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f80d80c70f0 tx=0x7f80c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:04.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:04.889+0000 7f80ce7fc640 1 -- 172.21.15.57:0/2865435367 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f80d4056ed0 con 0x7f80d80b8660 2024-04-24T23:39:05.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.053+0000 7f80dfc6c640 1 -- 172.21.15.57:0/2865435367 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f80d80c23d0 con 0x7f80d80b8660 2024-04-24T23:39:05.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.053+0000 7f80ce7fc640 1 -- 172.21.15.57:0/2865435367 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f80d40567d0 con 0x7f80d80b8660 2024-04-24T23:39:05.054 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-24T23:39:05.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.053+0000 7f80dfc6c640 1 -- 172.21.15.57:0/2865435367 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f80bc0678c0 msgr2=0x7f80bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:05.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.053+0000 7f80dfc6c640 1 --2- 172.21.15.57:0/2865435367 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f80bc0678c0 0x7f80bc069d80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f80d80c70f0 tx=0x7f80c8008040 comp rx=0 tx=0).stop 2024-04-24T23:39:05.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.053+0000 7f80dfc6c640 1 -- 172.21.15.57:0/2865435367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80d80b8660 msgr2=0x7f80d81e9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:05.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.053+0000 7f80dfc6c640 1 --2- 172.21.15.57:0/2865435367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80d80b8660 0x7f80d81e9850 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f80d400d830 tx=0x7f80d400dcf0 comp rx=0 tx=0).stop 2024-04-24T23:39:05.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.053+0000 7f80dfc6c640 1 -- 172.21.15.57:0/2865435367 shutdown_connections 2024-04-24T23:39:05.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.053+0000 7f80dfc6c640 1 --2- 172.21.15.57:0/2865435367 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f80bc0678c0 0x7f80bc069d80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:05.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.053+0000 7f80dfc6c640 1 --2- 172.21.15.57:0/2865435367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80d814deb0 0x7f80d8147700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:05.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.053+0000 7f80dfc6c640 1 --2- 172.21.15.57:0/2865435367 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f80d80c3490 0x7f80d81e9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:05.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.053+0000 7f80dfc6c640 1 --2- 172.21.15.57:0/2865435367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80d80b8660 0x7f80d81e9850 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:05.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.053+0000 7f80dfc6c640 1 -- 172.21.15.57:0/2865435367 >> 172.21.15.57:0/2865435367 conn(0x7f80d8067120 msgr2=0x7f80d8067500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:05.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.053+0000 7f80dfc6c640 1 -- 172.21.15.57:0/2865435367 shutdown_connections 2024-04-24T23:39:05.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.053+0000 7f80dfc6c640 1 -- 172.21.15.57:0/2865435367 wait complete. 2024-04-24T23:39:05.073 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-24T23:39:05.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.193+0000 7fb94247e640 1 Processor -- start 2024-04-24T23:39:05.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.193+0000 7fb94247e640 1 -- start start 2024-04-24T23:39:05.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.193+0000 7fb94247e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb93c06ea40 0x7fb93c1514f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:05.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.193+0000 7fb94247e640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb93c0bc3f0 0x7fb93c14a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:05.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.193+0000 7fb94247e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb93c151a30 con 0x7fb93c14ade0 2024-04-24T23:39:05.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.193+0000 7fb94247e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fb93c14d640 con 0x7fb93c06ea40 2024-04-24T23:39:05.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.193+0000 7fb94247e640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fb93c0be040 con 0x7fb93c0bc3f0 2024-04-24T23:39:05.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.197+0000 7fb93b7fe640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb93c0bc3f0 0x7fb93c14a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:05.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.197+0000 7fb93b7fe640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb93c0bc3f0 0x7fb93c14a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.57:33188/0 (socket says 172.21.15.57:33188) 2024-04-24T23:39:05.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.197+0000 7fb93bfff640 1 --2- 172.21.15.57:0/4242837544 >> v2:172.21.15.88:3300/0 conn(0x7fb93c06ea40 0x7fb93c1514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:05.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.197+0000 7fb93b7fe640 1 -- 172.21.15.57:0/4242837544 learned_addr learned my addr 172.21.15.57:0/4242837544 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:05.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.197+0000 7fb93b7fe640 1 -- 172.21.15.57:0/4242837544 >> v2:172.21.15.88:3300/0 conn(0x7fb93c06ea40 msgr2=0x7fb93c1514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:05.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.197+0000 7fb93b7fe640 1 --2- 172.21.15.57:0/4242837544 >> v2:172.21.15.88:3300/0 conn(0x7fb93c06ea40 0x7fb93c1514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:05.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.197+0000 7fb93b7fe640 1 -- 172.21.15.57:0/4242837544 >> v1:172.21.15.88:6789/0 conn(0x7fb93c14ade0 legacy=0x7fb93c14dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:05.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.197+0000 7fb93b7fe640 1 -- 172.21.15.57:0/4242837544 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb93c0be320 con 0x7fb93c0bc3f0 2024-04-24T23:39:05.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.197+0000 7fb93b7fe640 1 --2- 172.21.15.57:0/4242837544 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb93c0bc3f0 0x7fb93c14a8a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb930009870 tx=0x7fb93001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab906fd180fb443b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:05.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.197+0000 7fb93affd640 1 -- 172.21.15.57:0/4242837544 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9300b2070 con 0x7fb93c0bc3f0 2024-04-24T23:39:05.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.197+0000 7fb93affd640 1 -- 172.21.15.57:0/4242837544 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9300a9070 con 0x7fb93c0bc3f0 2024-04-24T23:39:05.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.197+0000 7fb93affd640 1 -- 172.21.15.57:0/4242837544 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9300ad880 con 0x7fb93c0bc3f0 2024-04-24T23:39:05.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb94247e640 1 -- 172.21.15.57:0/4242837544 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb93c0bc3f0 msgr2=0x7fb93c14a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:05.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb94247e640 1 --2- 172.21.15.57:0/4242837544 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb93c0bc3f0 0x7fb93c14a8a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb930009870 tx=0x7fb93001c560 comp rx=0 tx=0).stop 2024-04-24T23:39:05.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb94247e640 1 -- 172.21.15.57:0/4242837544 shutdown_connections 2024-04-24T23:39:05.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb94247e640 1 --2- 172.21.15.57:0/4242837544 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb93c0bc3f0 0x7fb93c14a8a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:05.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb94247e640 1 --2- 172.21.15.57:0/4242837544 >> v2:172.21.15.88:3300/0 conn(0x7fb93c06ea40 0x7fb93c1514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:05.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb94247e640 1 -- 172.21.15.57:0/4242837544 >> 172.21.15.57:0/4242837544 conn(0x7fb93c06b920 msgr2=0x7fb93c0c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:05.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb94247e640 1 -- 172.21.15.57:0/4242837544 shutdown_connections 2024-04-24T23:39:05.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb94247e640 1 -- 172.21.15.57:0/4242837544 wait complete. 2024-04-24T23:39:05.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb94247e640 1 Processor -- start 2024-04-24T23:39:05.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb94247e640 1 -- start start 2024-04-24T23:39:05.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb94247e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb93c06ea40 0x7fb93c1490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:05.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb94247e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb93c0bc3f0 0x7fb93c14e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:05.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb94247e640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb93c14ade0 0x7fb93c14bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:05.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb94247e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb93c06d850 con 0x7fb93c0bc3f0 2024-04-24T23:39:05.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb94247e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb93c06d6d0 con 0x7fb93c06ea40 2024-04-24T23:39:05.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb94247e640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fb93c06d9d0 con 0x7fb93c14ade0 2024-04-24T23:39:05.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb93b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb93c0bc3f0 0x7fb93c14e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:05.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb93b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb93c0bc3f0 0x7fb93c14e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60414/0 (socket says 172.21.15.57:60414) 2024-04-24T23:39:05.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb93b7fe640 1 -- 172.21.15.57:0/2552257475 learned_addr learned my addr 172.21.15.57:0/2552257475 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:05.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb93bfff640 1 --2- 172.21.15.57:0/2552257475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb93c06ea40 0x7fb93c1490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:05.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb940a1b640 1 --2- 172.21.15.57:0/2552257475 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb93c14ade0 0x7fb93c14bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:05.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb93b7fe640 1 -- 172.21.15.57:0/2552257475 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb93c14ade0 msgr2=0x7fb93c14bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:05.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb93b7fe640 1 --2- 172.21.15.57:0/2552257475 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb93c14ade0 0x7fb93c14bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:05.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb93b7fe640 1 -- 172.21.15.57:0/2552257475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb93c06ea40 msgr2=0x7fb93c1490d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:05.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb93b7fe640 1 --2- 172.21.15.57:0/2552257475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb93c06ea40 0x7fb93c1490d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:05.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb93b7fe640 1 -- 172.21.15.57:0/2552257475 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb93c14c310 con 0x7fb93c0bc3f0 2024-04-24T23:39:05.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb940a1b640 1 --2- 172.21.15.57:0/2552257475 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb93c14ade0 0x7fb93c14bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:39:05.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb93b7fe640 1 --2- 172.21.15.57:0/2552257475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb93c0bc3f0 0x7fb93c14e910 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb9300b0040 tx=0x7fb930019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:05.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb938ff9640 1 -- 172.21.15.57:0/2552257475 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9300bb070 con 0x7fb93c0bc3f0 2024-04-24T23:39:05.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb938ff9640 1 -- 172.21.15.57:0/2552257475 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9300addc0 con 0x7fb93c0bc3f0 2024-04-24T23:39:05.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb94247e640 1 -- 172.21.15.57:0/2552257475 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb93c14c960 con 0x7fb93c0bc3f0 2024-04-24T23:39:05.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb938ff9640 1 -- 172.21.15.57:0/2552257475 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9300b2040 con 0x7fb93c0bc3f0 2024-04-24T23:39:05.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.201+0000 7fb94247e640 1 -- 172.21.15.57:0/2552257475 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb93c14cc40 con 0x7fb93c0bc3f0 2024-04-24T23:39:05.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.205+0000 7fb94247e640 1 -- 172.21.15.57:0/2552257475 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb93c068290 con 0x7fb93c0bc3f0 2024-04-24T23:39:05.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.205+0000 7fb938ff9640 1 -- 172.21.15.57:0/2552257475 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb9300be070 con 0x7fb93c0bc3f0 2024-04-24T23:39:05.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.205+0000 7fb938ff9640 1 --2- 172.21.15.57:0/2552257475 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fb9280678c0 0x7fb928069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:05.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.205+0000 7fb938ff9640 1 -- 172.21.15.57:0/2552257475 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb93011f220 con 0x7fb93c0bc3f0 2024-04-24T23:39:05.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.205+0000 7fb93bfff640 1 --2- 172.21.15.57:0/2552257475 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fb9280678c0 0x7fb928069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:05.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.205+0000 7fb93bfff640 1 --2- 172.21.15.57:0/2552257475 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fb9280678c0 0x7fb928069d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb92c0113e0 tx=0x7fb92c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:05.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.209+0000 7fb938ff9640 1 -- 172.21.15.57:0/2552257475 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fb93c14c310 con 0x7fb93c0bc3f0 2024-04-24T23:39:05.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.365+0000 7fb94247e640 1 -- 172.21.15.57:0/2552257475 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fb93c0a5600 con 0x7fb93c0bc3f0 2024-04-24T23:39:05.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.365+0000 7fb938ff9640 1 -- 172.21.15.57:0/2552257475 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7fb930016150 con 0x7fb93c0bc3f0 2024-04-24T23:39:05.368 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-04-24T23:39:05.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.369+0000 7fb94247e640 1 -- 172.21.15.57:0/2552257475 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fb9280678c0 msgr2=0x7fb928069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:05.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.369+0000 7fb94247e640 1 --2- 172.21.15.57:0/2552257475 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fb9280678c0 0x7fb928069d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb92c0113e0 tx=0x7fb92c00b040 comp rx=0 tx=0).stop 2024-04-24T23:39:05.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.369+0000 7fb94247e640 1 -- 172.21.15.57:0/2552257475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb93c0bc3f0 msgr2=0x7fb93c14e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:05.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.369+0000 7fb94247e640 1 --2- 172.21.15.57:0/2552257475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb93c0bc3f0 0x7fb93c14e910 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb9300b0040 tx=0x7fb930019300 comp rx=0 tx=0).stop 2024-04-24T23:39:05.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.369+0000 7fb94247e640 1 -- 172.21.15.57:0/2552257475 shutdown_connections 2024-04-24T23:39:05.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.369+0000 7fb94247e640 1 --2- 172.21.15.57:0/2552257475 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fb9280678c0 0x7fb928069d80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:05.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.369+0000 7fb94247e640 1 --2- 172.21.15.57:0/2552257475 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb93c14ade0 0x7fb93c14bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:05.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.369+0000 7fb94247e640 1 --2- 172.21.15.57:0/2552257475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb93c0bc3f0 0x7fb93c14e910 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:05.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.369+0000 7fb94247e640 1 --2- 172.21.15.57:0/2552257475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb93c06ea40 0x7fb93c1490d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:05.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.369+0000 7fb94247e640 1 -- 172.21.15.57:0/2552257475 >> 172.21.15.57:0/2552257475 conn(0x7fb93c06b920 msgr2=0x7fb93c0bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:05.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.369+0000 7fb94247e640 1 -- 172.21.15.57:0/2552257475 shutdown_connections 2024-04-24T23:39:05.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.369+0000 7fb94247e640 1 -- 172.21.15.57:0/2552257475 wait complete. 2024-04-24T23:39:05.385 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:39:05.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.505+0000 7ffb7dc07640 1 Processor -- start 2024-04-24T23:39:05.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.505+0000 7ffb7dc07640 1 -- start start 2024-04-24T23:39:05.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.505+0000 7ffb7dc07640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ffb7814ada0 0x7ffb780b7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:05.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.505+0000 7ffb7dc07640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffb78072980 0x7ffb780be3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:05.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.505+0000 7ffb7dc07640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb780b8fa0 con 0x7ffb780bde80 2024-04-24T23:39:05.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.505+0000 7ffb7dc07640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7ffb780be920 con 0x7ffb7814ada0 2024-04-24T23:39:05.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.505+0000 7ffb7dc07640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7ffb78072e10 con 0x7ffb78072980 2024-04-24T23:39:05.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.505+0000 7ffb777fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ffb7814ada0 0x7ffb780b7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:05.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.505+0000 7ffb777fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ffb7814ada0 0x7ffb780b7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60418/0 (socket says 172.21.15.57:60418) 2024-04-24T23:39:05.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.505+0000 7ffb777fe640 1 -- 172.21.15.57:0/1466719287 learned_addr learned my addr 172.21.15.57:0/1466719287 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:05.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.505+0000 7ffb76ffd640 1 --2- 172.21.15.57:0/1466719287 >> v2:172.21.15.88:3300/0 conn(0x7ffb78072980 0x7ffb780be3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:05.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.505+0000 7ffb777fe640 1 -- 172.21.15.57:0/1466719287 >> v2:172.21.15.88:3300/0 conn(0x7ffb78072980 msgr2=0x7ffb780be3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:05.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.505+0000 7ffb777fe640 1 --2- 172.21.15.57:0/1466719287 >> v2:172.21.15.88:3300/0 conn(0x7ffb78072980 0x7ffb780be3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:05.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.505+0000 7ffb777fe640 1 -- 172.21.15.57:0/1466719287 >> v1:172.21.15.88:6789/0 conn(0x7ffb780bde80 legacy=0x7ffb7806eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:05.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.505+0000 7ffb777fe640 1 -- 172.21.15.57:0/1466719287 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb7806f260 con 0x7ffb7814ada0 2024-04-24T23:39:05.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb777fe640 1 --2- 172.21.15.57:0/1466719287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb7814ada0 0x7ffb780b7470 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffb780bfa00 tx=0x7ffb6801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef12dd51c2d4aac server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:05.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb767fc640 1 -- 172.21.15.57:0/1466719287 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb680b2070 con 0x7ffb7814ada0 2024-04-24T23:39:05.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb767fc640 1 -- 172.21.15.57:0/1466719287 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb680a9070 con 0x7ffb7814ada0 2024-04-24T23:39:05.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb767fc640 1 -- 172.21.15.57:0/1466719287 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb680ad880 con 0x7ffb7814ada0 2024-04-24T23:39:05.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb7dc07640 1 -- 172.21.15.57:0/1466719287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb7814ada0 msgr2=0x7ffb780b7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:05.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb7dc07640 1 --2- 172.21.15.57:0/1466719287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb7814ada0 0x7ffb780b7470 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffb780bfa00 tx=0x7ffb6801c450 comp rx=0 tx=0).stop 2024-04-24T23:39:05.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb7dc07640 1 -- 172.21.15.57:0/1466719287 shutdown_connections 2024-04-24T23:39:05.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb7dc07640 1 --2- 172.21.15.57:0/1466719287 >> v2:172.21.15.88:3300/0 conn(0x7ffb78072980 0x7ffb780be3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:05.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb7dc07640 1 --2- 172.21.15.57:0/1466719287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb7814ada0 0x7ffb780b7470 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:05.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb7dc07640 1 -- 172.21.15.57:0/1466719287 >> 172.21.15.57:0/1466719287 conn(0x7ffb780beab0 msgr2=0x7ffb780beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:05.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb7dc07640 1 -- 172.21.15.57:0/1466719287 shutdown_connections 2024-04-24T23:39:05.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb7dc07640 1 -- 172.21.15.57:0/1466719287 wait complete. 2024-04-24T23:39:05.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb7dc07640 1 Processor -- start 2024-04-24T23:39:05.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb7dc07640 1 -- start start 2024-04-24T23:39:05.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb7dc07640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb78072980 0x7ffb7813a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:05.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb7dc07640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb780bde80 0x7ffb780c11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:05.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb7dc07640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb7814ada0 0x7ffb78143640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:05.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb7dc07640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ffb781588b0 con 0x7ffb7814ada0 2024-04-24T23:39:05.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb7dc07640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ffb78158730 con 0x7ffb780bde80 2024-04-24T23:39:05.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb7dc07640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7ffb78158a30 con 0x7ffb78072980 2024-04-24T23:39:05.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb77fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb7814ada0 0x7ffb78143640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:05.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb77fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb7814ada0 0x7ffb78143640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60432/0 (socket says 172.21.15.57:60432) 2024-04-24T23:39:05.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb77fff640 1 -- 172.21.15.57:0/1289424833 learned_addr learned my addr 172.21.15.57:0/1289424833 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:05.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb777fe640 1 --2- 172.21.15.57:0/1289424833 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb78072980 0x7ffb7813a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:05.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb76ffd640 1 --2- 172.21.15.57:0/1289424833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb780bde80 0x7ffb780c11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:05.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb77fff640 1 -- 172.21.15.57:0/1289424833 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb78072980 msgr2=0x7ffb7813a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:05.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb77fff640 1 --2- 172.21.15.57:0/1289424833 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb78072980 0x7ffb7813a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:05.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb77fff640 1 -- 172.21.15.57:0/1289424833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb780bde80 msgr2=0x7ffb780c11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:05.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb77fff640 1 --2- 172.21.15.57:0/1289424833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb780bde80 0x7ffb780c11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:05.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb77fff640 1 -- 172.21.15.57:0/1289424833 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb780c0b70 con 0x7ffb7814ada0 2024-04-24T23:39:05.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb77fff640 1 --2- 172.21.15.57:0/1289424833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb7814ada0 0x7ffb78143640 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffb7000c7b0 tx=0x7ffb7000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:05.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb5ffff640 1 -- 172.21.15.57:0/1289424833 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb70004b70 con 0x7ffb7814ada0 2024-04-24T23:39:05.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb5ffff640 1 -- 172.21.15.57:0/1289424833 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb70004d10 con 0x7ffb7814ada0 2024-04-24T23:39:05.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb7dc07640 1 -- 172.21.15.57:0/1289424833 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb780bfcd0 con 0x7ffb7814ada0 2024-04-24T23:39:05.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb5ffff640 1 -- 172.21.15.57:0/1289424833 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7000aa30 con 0x7ffb7814ada0 2024-04-24T23:39:05.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.509+0000 7ffb7dc07640 1 -- 172.21.15.57:0/1289424833 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb780c0e10 con 0x7ffb7814ada0 2024-04-24T23:39:05.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.513+0000 7ffb7dc07640 1 -- 172.21.15.57:0/1289424833 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb78068220 con 0x7ffb7814ada0 2024-04-24T23:39:05.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.513+0000 7ffb5ffff640 1 -- 172.21.15.57:0/1289424833 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffb7000abd0 con 0x7ffb7814ada0 2024-04-24T23:39:05.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.513+0000 7ffb5ffff640 1 --2- 172.21.15.57:0/1289424833 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ffb640678c0 0x7ffb64069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:05.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.513+0000 7ffb5ffff640 1 -- 172.21.15.57:0/1289424833 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ffb700860f0 con 0x7ffb7814ada0 2024-04-24T23:39:05.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.513+0000 7ffb777fe640 1 --2- 172.21.15.57:0/1289424833 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ffb640678c0 0x7ffb64069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:05.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.513+0000 7ffb777fe640 1 --2- 172.21.15.57:0/1289424833 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ffb640678c0 0x7ffb64069d80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffb680af000 tx=0x7ffb68008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:05.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.517+0000 7ffb5ffff640 1 -- 172.21.15.57:0/1289424833 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7ffb70020070 con 0x7ffb7814ada0 2024-04-24T23:39:05.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.713+0000 7ffb7dc07640 1 -- 172.21.15.57:0/1289424833 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb7806cbd0 con 0x7ffb7814ada0 2024-04-24T23:39:05.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.713+0000 7ffb5ffff640 1 -- 172.21.15.57:0/1289424833 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+4350 (secure 0 0 0) 0x7ffb70056980 con 0x7ffb7814ada0 2024-04-24T23:39:05.714 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:39:05.714 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2925410225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2925410225},{"type":"v1","addr":"172.21.15.88:6835","nonce":2925410225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4227,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/173597347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":173597347},{"type":"v1","addr":"172.21.15.57:6834","nonce":173597347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:38:33.449139+0000","modified":"2024-04-24T23:38:57.042000+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4230":{"gid":4230,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/1701414040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":1701414040},{"type":"v1","addr":"172.21.15.57:6835","nonce":1701414040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4230,"qdb_cluster":[4230]},"id":1}]} 2024-04-24T23:39:05.718 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 9 2024-04-24T23:39:05.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.713+0000 7ffb7dc07640 1 -- 172.21.15.57:0/1289424833 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ffb640678c0 msgr2=0x7ffb64069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:05.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.713+0000 7ffb7dc07640 1 --2- 172.21.15.57:0/1289424833 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ffb640678c0 0x7ffb64069d80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffb680af000 tx=0x7ffb68008040 comp rx=0 tx=0).stop 2024-04-24T23:39:05.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.713+0000 7ffb7dc07640 1 -- 172.21.15.57:0/1289424833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb7814ada0 msgr2=0x7ffb78143640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:05.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.713+0000 7ffb7dc07640 1 --2- 172.21.15.57:0/1289424833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb7814ada0 0x7ffb78143640 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffb7000c7b0 tx=0x7ffb7000cc70 comp rx=0 tx=0).stop 2024-04-24T23:39:05.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.713+0000 7ffb7dc07640 1 -- 172.21.15.57:0/1289424833 shutdown_connections 2024-04-24T23:39:05.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.713+0000 7ffb7dc07640 1 --2- 172.21.15.57:0/1289424833 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ffb640678c0 0x7ffb64069d80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:05.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.713+0000 7ffb7dc07640 1 --2- 172.21.15.57:0/1289424833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb7814ada0 0x7ffb78143640 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:05.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.717+0000 7ffb7dc07640 1 --2- 172.21.15.57:0/1289424833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb780bde80 0x7ffb780c11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:05.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.717+0000 7ffb7dc07640 1 --2- 172.21.15.57:0/1289424833 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb78072980 0x7ffb7813a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:05.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.717+0000 7ffb7dc07640 1 -- 172.21.15.57:0/1289424833 >> 172.21.15.57:0/1289424833 conn(0x7ffb780beab0 msgr2=0x7ffb78071070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:05.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.717+0000 7ffb7dc07640 1 -- 172.21.15.57:0/1289424833 shutdown_connections 2024-04-24T23:39:05.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.717+0000 7ffb7dc07640 1 -- 172.21.15.57:0/1289424833 wait complete. 2024-04-24T23:39:05.733 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:39:05.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.853+0000 7f3373d40640 1 Processor -- start 2024-04-24T23:39:05.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.853+0000 7f3373d40640 1 -- start start 2024-04-24T23:39:05.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.857+0000 7f3373d40640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f336c06edb0 0x7f336c152160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:05.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.857+0000 7f3373d40640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f336c159000 0x7f336c15f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:05.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.857+0000 7f3373d40640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f336c0a74e0 con 0x7f336c154cf0 2024-04-24T23:39:05.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.857+0000 7f3373d40640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f336c071cc0 con 0x7f336c06edb0 2024-04-24T23:39:05.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.857+0000 7f3373d40640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f336c158410 con 0x7f336c159000 2024-04-24T23:39:05.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.857+0000 7f3371adc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f336c06edb0 0x7f336c152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:05.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.857+0000 7f33722dd640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f336c159000 0x7f336c15f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:05.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.857+0000 7f33712db640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f336c154cf0 0x7f336c1588f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.57:56224/0 (socket says 172.21.15.57:56224) 2024-04-24T23:39:05.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.857+0000 7f33712db640 1 -- 172.21.15.57:0/4033616606 learned_addr learned my addr 172.21.15.57:0/4033616606 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:05.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.857+0000 7f3371adc640 1 -- 172.21.15.57:0/4033616606 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f336c159000 msgr2=0x7f336c15f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:05.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.857+0000 7f3371adc640 1 --2- 172.21.15.57:0/4033616606 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f336c159000 0x7f336c15f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:05.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.857+0000 7f3371adc640 1 -- 172.21.15.57:0/4033616606 >> v1:172.21.15.88:6789/0 conn(0x7f336c154cf0 legacy=0x7f336c1588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:05.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.857+0000 7f3371adc640 1 -- 172.21.15.57:0/4033616606 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f336c0a7200 con 0x7f336c06edb0 2024-04-24T23:39:05.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.857+0000 7f33722dd640 1 --2- 172.21.15.57:0/4033616606 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f336c159000 0x7f336c15f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:39:05.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.861+0000 7f3371adc640 1 --2- 172.21.15.57:0/4033616606 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f336c06edb0 0x7f336c152160 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f33680097c0 tx=0x7f336801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca0e7a5dd0d09746 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:05.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.861+0000 7f3370ada640 1 -- 172.21.15.57:0/4033616606 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33680b0070 con 0x7f336c06edb0 2024-04-24T23:39:05.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.861+0000 7f3370ada640 1 -- 172.21.15.57:0/4033616606 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33680ab600 con 0x7f336c06edb0 2024-04-24T23:39:05.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.861+0000 7f3370ada640 1 -- 172.21.15.57:0/4033616606 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33680ab9d0 con 0x7f336c06edb0 2024-04-24T23:39:05.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.861+0000 7f3373d40640 1 -- 172.21.15.57:0/4033616606 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f336c06edb0 msgr2=0x7f336c152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:05.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.861+0000 7f3373d40640 1 --2- 172.21.15.57:0/4033616606 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f336c06edb0 0x7f336c152160 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f33680097c0 tx=0x7f336801c410 comp rx=0 tx=0).stop 2024-04-24T23:39:05.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.861+0000 7f3373d40640 1 -- 172.21.15.57:0/4033616606 shutdown_connections 2024-04-24T23:39:05.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.861+0000 7f3373d40640 1 --2- 172.21.15.57:0/4033616606 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f336c159000 0x7f336c15f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:05.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.861+0000 7f3373d40640 1 --2- 172.21.15.57:0/4033616606 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f336c06edb0 0x7f336c152160 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:05.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.861+0000 7f3373d40640 1 -- 172.21.15.57:0/4033616606 >> 172.21.15.57:0/4033616606 conn(0x7f336c0beab0 msgr2=0x7f336c0beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:05.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.861+0000 7f3373d40640 1 -- 172.21.15.57:0/4033616606 shutdown_connections 2024-04-24T23:39:05.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.861+0000 7f3373d40640 1 -- 172.21.15.57:0/4033616606 wait complete. 2024-04-24T23:39:05.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.865+0000 7f3373d40640 1 Processor -- start 2024-04-24T23:39:05.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.865+0000 7f3373d40640 1 -- start start 2024-04-24T23:39:05.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.865+0000 7f3373d40640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f336c06edb0 0x7f336c06dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:05.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.865+0000 7f3373d40640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f336c154cf0 0x7f336c1edf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:05.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.865+0000 7f3373d40640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f336c159000 0x7f336c1ee4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:05.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.865+0000 7f3373d40640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f336c162550 con 0x7f336c154cf0 2024-04-24T23:39:05.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.865+0000 7f3373d40640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f336c1623d0 con 0x7f336c06edb0 2024-04-24T23:39:05.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.865+0000 7f3373d40640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f336c1626d0 con 0x7f336c159000 2024-04-24T23:39:05.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.865+0000 7f33712db640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f336c154cf0 0x7f336c1edf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:05.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.865+0000 7f33712db640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f336c154cf0 0x7f336c1edf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60448/0 (socket says 172.21.15.57:60448) 2024-04-24T23:39:05.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.865+0000 7f33712db640 1 -- 172.21.15.57:0/1977940745 learned_addr learned my addr 172.21.15.57:0/1977940745 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:05.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.865+0000 7f3371adc640 1 --2- 172.21.15.57:0/1977940745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f336c06edb0 0x7f336c06dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:05.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.865+0000 7f33722dd640 1 --2- 172.21.15.57:0/1977940745 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f336c159000 0x7f336c1ee4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:05.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.865+0000 7f33712db640 1 -- 172.21.15.57:0/1977940745 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f336c159000 msgr2=0x7f336c1ee4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:05.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.865+0000 7f33712db640 1 --2- 172.21.15.57:0/1977940745 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f336c159000 0x7f336c1ee4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:05.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.865+0000 7f33712db640 1 -- 172.21.15.57:0/1977940745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f336c06edb0 msgr2=0x7f336c06dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:05.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.865+0000 7f33712db640 1 --2- 172.21.15.57:0/1977940745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f336c06edb0 0x7f336c06dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:05.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.865+0000 7f33712db640 1 -- 172.21.15.57:0/1977940745 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f336c1f19f0 con 0x7f336c154cf0 2024-04-24T23:39:05.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.865+0000 7f33712db640 1 --2- 172.21.15.57:0/1977940745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f336c154cf0 0x7f336c1edf70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f336000c420 tx=0x7f336000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:05.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.865+0000 7f335e7fc640 1 -- 172.21.15.57:0/1977940745 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3360017070 con 0x7f336c154cf0 2024-04-24T23:39:05.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.865+0000 7f335e7fc640 1 -- 172.21.15.57:0/1977940745 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3360005cf0 con 0x7f336c154cf0 2024-04-24T23:39:05.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.865+0000 7f3373d40640 1 -- 172.21.15.57:0/1977940745 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f336c1eda50 con 0x7f336c154cf0 2024-04-24T23:39:05.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.865+0000 7f335e7fc640 1 -- 172.21.15.57:0/1977940745 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33600072f0 con 0x7f336c154cf0 2024-04-24T23:39:05.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.865+0000 7f3373d40640 1 -- 172.21.15.57:0/1977940745 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f336c1f1cd0 con 0x7f336c154cf0 2024-04-24T23:39:05.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.865+0000 7f3373d40640 1 -- 172.21.15.57:0/1977940745 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f336c068220 con 0x7f336c154cf0 2024-04-24T23:39:05.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.865+0000 7f335e7fc640 1 -- 172.21.15.57:0/1977940745 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f336001a070 con 0x7f336c154cf0 2024-04-24T23:39:05.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.869+0000 7f335e7fc640 1 --2- 172.21.15.57:0/1977940745 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f33500678c0 0x7f3350069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:05.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.869+0000 7f335e7fc640 1 -- 172.21.15.57:0/1977940745 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f33600851f0 con 0x7f336c154cf0 2024-04-24T23:39:05.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.869+0000 7f3371adc640 1 --2- 172.21.15.57:0/1977940745 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f33500678c0 0x7f3350069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:05.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.869+0000 7f3371adc640 1 --2- 172.21.15.57:0/1977940745 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f33500678c0 0x7f3350069d80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f33680ad000 tx=0x7f3368008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:05.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:05.873+0000 7f335e7fc640 1 -- 172.21.15.57:0/1977940745 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f3360055430 con 0x7f336c154cf0 2024-04-24T23:39:06.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.033+0000 7f3373d40640 1 -- 172.21.15.57:0/1977940745 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f336c155320 con 0x7f336c154cf0 2024-04-24T23:39:06.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.037+0000 7f335e7fc640 1 -- 172.21.15.57:0/1977940745 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7f3360059730 con 0x7f336c154cf0 2024-04-24T23:39:06.037 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:39:06.037 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":24,"fsid":"1ea31698-444a-4667-bcd9-b2608ad103c3","created":"2024-04-24T23:38:16.748774+0000","modified":"2024-04-24T23:38:38.604475+0000","last_up_change":"2024-04-24T23:38:26.956537+0000","last_in_change":"2024-04-24T23:38:18.972175+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:38:27.611782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:38:31.718061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:38:32.469413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:38:36.215724+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"35ce67bc-9b25-416e-ab1e-774c717631f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6825","nonce":671364028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6827","nonce":671364028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6831","nonce":671364028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6829","nonce":671364028}]},"public_addr":"172.21.15.57:6825/671364028","cluster_addr":"172.21.15.57:6827/671364028","heartbeat_back_addr":"172.21.15.57:6831/671364028","heartbeat_front_addr":"172.21.15.57:6829/671364028","state":["exists","up"]},{"osd":1,"uuid":"38f6f4ef-3bc2-4453-9946-7d1d17e735ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6801","nonce":2653552037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6803","nonce":2653552037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6807","nonce":2653552037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6805","nonce":2653552037}]},"public_addr":"172.21.15.57:6801/2653552037","cluster_addr":"172.21.15.57:6803/2653552037","heartbeat_back_addr":"172.21.15.57:6807/2653552037","heartbeat_front_addr":"172.21.15.57:6805/2653552037","state":["exists","up"]},{"osd":2,"uuid":"d77a0a49-b39a-464e-a1c9-49e19280c440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6816","nonce":1565874109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6819","nonce":1565874109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6823","nonce":1565874109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6821","nonce":1565874109}]},"public_addr":"172.21.15.57:6816/1565874109","cluster_addr":"172.21.15.57:6819/1565874109","heartbeat_back_addr":"172.21.15.57:6823/1565874109","heartbeat_front_addr":"172.21.15.57:6821/1565874109","state":["exists","up"]},{"osd":3,"uuid":"f8ea9bfe-d839-44a6-a185-0f0985da314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6809","nonce":3474703186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6811","nonce":3474703186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6817","nonce":3474703186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6813","nonce":3474703186}]},"public_addr":"172.21.15.57:6809/3474703186","cluster_addr":"172.21.15.57:6811/3474703186","heartbeat_back_addr":"172.21.15.57:6817/3474703186","heartbeat_front_addr":"172.21.15.57:6813/3474703186","state":["exists","up"]},{"osd":4,"uuid":"454647d4-6ac2-46b4-8451-320eb951a87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6801","nonce":1271707713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6803","nonce":1271707713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6807","nonce":1271707713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6805","nonce":1271707713}]},"public_addr":"172.21.15.88:6801/1271707713","cluster_addr":"172.21.15.88:6803/1271707713","heartbeat_back_addr":"172.21.15.88:6807/1271707713","heartbeat_front_addr":"172.21.15.88:6805/1271707713","state":["exists","up"]},{"osd":5,"uuid":"f71c03a3-7ad8-46d3-89c9-d61de102586b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6809","nonce":2035054888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6813","nonce":2035054888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6820","nonce":2035054888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6816","nonce":2035054888}]},"public_addr":"172.21.15.88:6809/2035054888","cluster_addr":"172.21.15.88:6813/2035054888","heartbeat_back_addr":"172.21.15.88:6820/2035054888","heartbeat_front_addr":"172.21.15.88:6816/2035054888","state":["exists","up"]},{"osd":6,"uuid":"ec7ae2b7-9cb4-4059-8f98-0022c9763f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6825","nonce":1752291242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6827","nonce":1752291242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6831","nonce":1752291242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6829","nonce":1752291242}]},"public_addr":"172.21.15.88:6825/1752291242","cluster_addr":"172.21.15.88:6827/1752291242","heartbeat_back_addr":"172.21.15.88:6831/1752291242","heartbeat_front_addr":"172.21.15.88:6829/1752291242","state":["exists","up"]},{"osd":7,"uuid":"c0ee7505-60c1-40ba-9902-47313a04dafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6812","nonce":1782800372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6817","nonce":1782800372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6823","nonce":1782800372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6821","nonce":1782800372}]},"public_addr":"172.21.15.88:6812/1782800372","cluster_addr":"172.21.15.88:6817/1782800372","heartbeat_back_addr":"172.21.15.88:6823/1782800372","heartbeat_front_addr":"172.21.15.88:6821/1782800372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.698562+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.682587+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.680197+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.561753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.011095+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.493320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.353451+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.423877+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:39:06.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.037+0000 7f3373d40640 1 -- 172.21.15.57:0/1977940745 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f33500678c0 msgr2=0x7f3350069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:06.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.037+0000 7f3373d40640 1 --2- 172.21.15.57:0/1977940745 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f33500678c0 0x7f3350069d80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f33680ad000 tx=0x7f3368008040 comp rx=0 tx=0).stop 2024-04-24T23:39:06.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.037+0000 7f3373d40640 1 -- 172.21.15.57:0/1977940745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f336c154cf0 msgr2=0x7f336c1edf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:06.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.037+0000 7f3373d40640 1 --2- 172.21.15.57:0/1977940745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f336c154cf0 0x7f336c1edf70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f336000c420 tx=0x7f336000c8e0 comp rx=0 tx=0).stop 2024-04-24T23:39:06.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.037+0000 7f3373d40640 1 -- 172.21.15.57:0/1977940745 shutdown_connections 2024-04-24T23:39:06.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.037+0000 7f3373d40640 1 --2- 172.21.15.57:0/1977940745 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f33500678c0 0x7f3350069d80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:06.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.037+0000 7f3373d40640 1 --2- 172.21.15.57:0/1977940745 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f336c159000 0x7f336c1ee4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:06.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.037+0000 7f3373d40640 1 --2- 172.21.15.57:0/1977940745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f336c154cf0 0x7f336c1edf70 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:06.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.037+0000 7f3373d40640 1 --2- 172.21.15.57:0/1977940745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f336c06edb0 0x7f336c06dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:06.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.037+0000 7f3373d40640 1 -- 172.21.15.57:0/1977940745 >> 172.21.15.57:0/1977940745 conn(0x7f336c0beab0 msgr2=0x7f336c0a6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:06.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.037+0000 7f3373d40640 1 -- 172.21.15.57:0/1977940745 shutdown_connections 2024-04-24T23:39:06.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.037+0000 7f3373d40640 1 -- 172.21.15.57:0/1977940745 wait complete. 2024-04-24T23:39:06.057 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:38:27.611782+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:38:31.718061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:38:32.469413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-24T23:38:36.215724+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-24T23:39:06.057 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:39:06.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.189+0000 7fd9939ec640 1 Processor -- start 2024-04-24T23:39:06.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.189+0000 7fd9939ec640 1 -- start start 2024-04-24T23:39:06.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.189+0000 7fd9939ec640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd98c14deb0 0x7fd98c0c2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:06.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.189+0000 7fd9939ec640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd98c0c3490 0x7fd98c0c1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:06.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.189+0000 7fd9939ec640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd98c151270 con 0x7fd98c0b8660 2024-04-24T23:39:06.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.189+0000 7fd9939ec640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fd98c0c0a90 con 0x7fd98c0c3490 2024-04-24T23:39:06.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.189+0000 7fd9939ec640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fd98c0c0d70 con 0x7fd98c14deb0 2024-04-24T23:39:06.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.189+0000 7fd990f87640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd98c0c3490 0x7fd98c0c1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:06.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.189+0000 7fd991f89640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd98c0b8660 0x7fd98c153cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53142/0 (socket says 172.21.15.57:53142) 2024-04-24T23:39:06.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.189+0000 7fd991f89640 1 -- 172.21.15.57:0/578159808 learned_addr learned my addr 172.21.15.57:0/578159808 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:06.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.189+0000 7fd991788640 1 --2- 172.21.15.57:0/578159808 >> v2:172.21.15.88:3300/0 conn(0x7fd98c14deb0 0x7fd98c0c2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:06.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.189+0000 7fd990f87640 1 -- 172.21.15.57:0/578159808 >> v2:172.21.15.88:3300/0 conn(0x7fd98c14deb0 msgr2=0x7fd98c0c2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:06.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.189+0000 7fd990f87640 1 --2- 172.21.15.57:0/578159808 >> v2:172.21.15.88:3300/0 conn(0x7fd98c14deb0 0x7fd98c0c2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:06.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.189+0000 7fd990f87640 1 -- 172.21.15.57:0/578159808 >> v1:172.21.15.57:6789/0 conn(0x7fd98c0b8660 legacy=0x7fd98c153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:06.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.189+0000 7fd990f87640 1 -- 172.21.15.57:0/578159808 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd98c151550 con 0x7fd98c0c3490 2024-04-24T23:39:06.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.189+0000 7fd991788640 1 --2- 172.21.15.57:0/578159808 >> v2:172.21.15.88:3300/0 conn(0x7fd98c14deb0 0x7fd98c0c2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:39:06.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd990f87640 1 --2- 172.21.15.57:0/578159808 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd98c0c3490 0x7fd98c0c1200 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd98c0c2360 tx=0x7fd97c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a86f5fe7b2b5b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:06.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd983fff640 1 -- 172.21.15.57:0/578159808 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c0b5070 con 0x7fd98c0c3490 2024-04-24T23:39:06.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd983fff640 1 -- 172.21.15.57:0/578159808 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd97c0a8970 con 0x7fd98c0c3490 2024-04-24T23:39:06.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd983fff640 1 -- 172.21.15.57:0/578159808 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c0a8d40 con 0x7fd98c0c3490 2024-04-24T23:39:06.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd9939ec640 1 -- 172.21.15.57:0/578159808 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd98c0c3490 msgr2=0x7fd98c0c1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:06.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd9939ec640 1 --2- 172.21.15.57:0/578159808 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd98c0c3490 0x7fd98c0c1200 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd98c0c2360 tx=0x7fd97c01ec70 comp rx=0 tx=0).stop 2024-04-24T23:39:06.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd9939ec640 1 -- 172.21.15.57:0/578159808 shutdown_connections 2024-04-24T23:39:06.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd9939ec640 1 --2- 172.21.15.57:0/578159808 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd98c0c3490 0x7fd98c0c1200 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:06.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd9939ec640 1 --2- 172.21.15.57:0/578159808 >> v2:172.21.15.88:3300/0 conn(0x7fd98c14deb0 0x7fd98c0c2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:06.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd9939ec640 1 -- 172.21.15.57:0/578159808 >> 172.21.15.57:0/578159808 conn(0x7fd98c067120 msgr2=0x7fd98c067530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:06.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd9939ec640 1 -- 172.21.15.57:0/578159808 shutdown_connections 2024-04-24T23:39:06.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd9939ec640 1 -- 172.21.15.57:0/578159808 wait complete. 2024-04-24T23:39:06.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd9939ec640 1 Processor -- start 2024-04-24T23:39:06.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd9939ec640 1 -- start start 2024-04-24T23:39:06.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd9939ec640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd98c0b8660 0x7fd98c0be0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:06.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd9939ec640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd98c0c3490 0x7fd98c152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:06.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd9939ec640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd98c14deb0 0x7fd98c153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:06.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd9939ec640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd98c0c1740 con 0x7fd98c14deb0 2024-04-24T23:39:06.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd9939ec640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd98c14e290 con 0x7fd98c0b8660 2024-04-24T23:39:06.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd9939ec640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fd98c0c18c0 con 0x7fd98c0c3490 2024-04-24T23:39:06.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd991f89640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd98c14deb0 0x7fd98c153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:06.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd991f89640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd98c14deb0 0x7fd98c153430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60468/0 (socket says 172.21.15.57:60468) 2024-04-24T23:39:06.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd991f89640 1 -- 172.21.15.57:0/1535067041 learned_addr learned my addr 172.21.15.57:0/1535067041 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:06.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd990f87640 1 --2- 172.21.15.57:0/1535067041 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd98c0c3490 0x7fd98c152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:06.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd991788640 1 --2- 172.21.15.57:0/1535067041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd98c0b8660 0x7fd98c0be0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:06.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd991f89640 1 -- 172.21.15.57:0/1535067041 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd98c0c3490 msgr2=0x7fd98c152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:06.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd991f89640 1 --2- 172.21.15.57:0/1535067041 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd98c0c3490 0x7fd98c152ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:06.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd991f89640 1 -- 172.21.15.57:0/1535067041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd98c0b8660 msgr2=0x7fd98c0be0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:06.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd991f89640 1 --2- 172.21.15.57:0/1535067041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd98c0b8660 0x7fd98c0be0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:06.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd991f89640 1 -- 172.21.15.57:0/1535067041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd98c0be610 con 0x7fd98c14deb0 2024-04-24T23:39:06.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.193+0000 7fd991f89640 1 --2- 172.21.15.57:0/1535067041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd98c14deb0 0x7fd98c153430 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd98400cad0 tx=0x7fd98400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:06.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.197+0000 7fd981ffb640 1 -- 172.21.15.57:0/1535067041 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd984017070 con 0x7fd98c14deb0 2024-04-24T23:39:06.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.197+0000 7fd981ffb640 1 -- 172.21.15.57:0/1535067041 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd98400ac30 con 0x7fd98c14deb0 2024-04-24T23:39:06.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.197+0000 7fd9939ec640 1 -- 172.21.15.57:0/1535067041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd98c1db980 con 0x7fd98c14deb0 2024-04-24T23:39:06.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.197+0000 7fd981ffb640 1 -- 172.21.15.57:0/1535067041 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd984012620 con 0x7fd98c14deb0 2024-04-24T23:39:06.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.197+0000 7fd9939ec640 1 -- 172.21.15.57:0/1535067041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd98c1da270 con 0x7fd98c14deb0 2024-04-24T23:39:06.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.197+0000 7fd9939ec640 1 -- 172.21.15.57:0/1535067041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd98c1da580 con 0x7fd98c14deb0 2024-04-24T23:39:06.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.197+0000 7fd981ffb640 1 -- 172.21.15.57:0/1535067041 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd98401a070 con 0x7fd98c14deb0 2024-04-24T23:39:06.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.197+0000 7fd981ffb640 1 --2- 172.21.15.57:0/1535067041 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd9700678c0 0x7fd970069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:06.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.197+0000 7fd981ffb640 1 -- 172.21.15.57:0/1535067041 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd984085ce0 con 0x7fd98c14deb0 2024-04-24T23:39:06.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.197+0000 7fd991788640 1 --2- 172.21.15.57:0/1535067041 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd9700678c0 0x7fd970069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:06.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.197+0000 7fd991788640 1 --2- 172.21.15.57:0/1535067041 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd9700678c0 0x7fd970069d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd98800ba10 tx=0x7fd988008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:06.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.201+0000 7fd981ffb640 1 -- 172.21.15.57:0/1535067041 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fd98c0be610 con 0x7fd98c14deb0 2024-04-24T23:39:06.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.365+0000 7fd9939ec640 1 -- 172.21.15.57:0/1535067041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd98c068290 con 0x7fd98c14deb0 2024-04-24T23:39:06.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.365+0000 7fd981ffb640 1 -- 172.21.15.57:0/1535067041 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7fd98400ae20 con 0x7fd98c14deb0 2024-04-24T23:39:06.365 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-04-24T23:39:06.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.365+0000 7fd9939ec640 1 -- 172.21.15.57:0/1535067041 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd9700678c0 msgr2=0x7fd970069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:06.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.365+0000 7fd9939ec640 1 --2- 172.21.15.57:0/1535067041 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd9700678c0 0x7fd970069d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd98800ba10 tx=0x7fd988008040 comp rx=0 tx=0).stop 2024-04-24T23:39:06.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.365+0000 7fd9939ec640 1 -- 172.21.15.57:0/1535067041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd98c14deb0 msgr2=0x7fd98c153430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:06.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.365+0000 7fd9939ec640 1 --2- 172.21.15.57:0/1535067041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd98c14deb0 0x7fd98c153430 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd98400cad0 tx=0x7fd98400cf90 comp rx=0 tx=0).stop 2024-04-24T23:39:06.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.365+0000 7fd9939ec640 1 -- 172.21.15.57:0/1535067041 shutdown_connections 2024-04-24T23:39:06.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.365+0000 7fd9939ec640 1 --2- 172.21.15.57:0/1535067041 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd9700678c0 0x7fd970069d80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:06.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.365+0000 7fd9939ec640 1 --2- 172.21.15.57:0/1535067041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd98c14deb0 0x7fd98c153430 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:06.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.365+0000 7fd9939ec640 1 --2- 172.21.15.57:0/1535067041 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd98c0c3490 0x7fd98c152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:06.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.365+0000 7fd9939ec640 1 --2- 172.21.15.57:0/1535067041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd98c0b8660 0x7fd98c0be0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:06.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.365+0000 7fd9939ec640 1 -- 172.21.15.57:0/1535067041 >> 172.21.15.57:0/1535067041 conn(0x7fd98c067120 msgr2=0x7fd98c0ba290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:06.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.365+0000 7fd9939ec640 1 -- 172.21.15.57:0/1535067041 shutdown_connections 2024-04-24T23:39:06.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.365+0000 7fd9939ec640 1 -- 172.21.15.57:0/1535067041 wait complete. 2024-04-24T23:39:06.384 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:39:06.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.501+0000 7fda43d50640 1 Processor -- start 2024-04-24T23:39:06.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.501+0000 7fda43d50640 1 -- start start 2024-04-24T23:39:06.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.505+0000 7fda43d50640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fda3c0b8660 0x7fda3c0c1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:06.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.505+0000 7fda43d50640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fda3c0c1740 0x7fda3c15b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:06.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.505+0000 7fda43d50640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda3c151270 con 0x7fda3c14deb0 2024-04-24T23:39:06.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.505+0000 7fda43d50640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fda3c0c0a90 con 0x7fda3c0b8660 2024-04-24T23:39:06.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.505+0000 7fda43d50640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fda3c0c0d70 con 0x7fda3c0c1740 2024-04-24T23:39:06.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.505+0000 7fda412eb640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fda3c0b8660 0x7fda3c0c1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:06.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.505+0000 7fda41aec640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fda3c14deb0 0x7fda3c0c2f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53156/0 (socket says 172.21.15.57:53156) 2024-04-24T23:39:06.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.505+0000 7fda41aec640 1 -- 172.21.15.57:0/4289837223 learned_addr learned my addr 172.21.15.57:0/4289837223 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:06.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.505+0000 7fda422ed640 1 --2- 172.21.15.57:0/4289837223 >> v2:172.21.15.88:3300/0 conn(0x7fda3c0c1740 0x7fda3c15b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:06.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.505+0000 7fda412eb640 1 -- 172.21.15.57:0/4289837223 >> v2:172.21.15.88:3300/0 conn(0x7fda3c0c1740 msgr2=0x7fda3c15b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:06.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.505+0000 7fda412eb640 1 --2- 172.21.15.57:0/4289837223 >> v2:172.21.15.88:3300/0 conn(0x7fda3c0c1740 0x7fda3c15b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:06.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.505+0000 7fda412eb640 1 -- 172.21.15.57:0/4289837223 >> v1:172.21.15.57:6789/0 conn(0x7fda3c14deb0 legacy=0x7fda3c0c2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:06.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.505+0000 7fda412eb640 1 -- 172.21.15.57:0/4289837223 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda3c151550 con 0x7fda3c0b8660 2024-04-24T23:39:06.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.505+0000 7fda422ed640 1 --2- 172.21.15.57:0/4289837223 >> v2:172.21.15.88:3300/0 conn(0x7fda3c0c1740 0x7fda3c15b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:39:06.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.505+0000 7fda412eb640 1 --2- 172.21.15.57:0/4289837223 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda3c0b8660 0x7fda3c0c1200 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fda3c06bed0 tx=0x7fda2c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f0957b8c09767f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:06.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.505+0000 7fda40aea640 1 -- 172.21.15.57:0/4289837223 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2c0b5070 con 0x7fda3c0b8660 2024-04-24T23:39:06.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.505+0000 7fda40aea640 1 -- 172.21.15.57:0/4289837223 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda2c0a8970 con 0x7fda3c0b8660 2024-04-24T23:39:06.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.505+0000 7fda40aea640 1 -- 172.21.15.57:0/4289837223 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2c0a8d40 con 0x7fda3c0b8660 2024-04-24T23:39:06.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.505+0000 7fda43d50640 1 -- 172.21.15.57:0/4289837223 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda3c0b8660 msgr2=0x7fda3c0c1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:06.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.505+0000 7fda43d50640 1 --2- 172.21.15.57:0/4289837223 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda3c0b8660 0x7fda3c0c1200 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fda3c06bed0 tx=0x7fda2c01ec70 comp rx=0 tx=0).stop 2024-04-24T23:39:06.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.505+0000 7fda43d50640 1 -- 172.21.15.57:0/4289837223 shutdown_connections 2024-04-24T23:39:06.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.505+0000 7fda43d50640 1 --2- 172.21.15.57:0/4289837223 >> v2:172.21.15.88:3300/0 conn(0x7fda3c0c1740 0x7fda3c15b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:06.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.505+0000 7fda43d50640 1 --2- 172.21.15.57:0/4289837223 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda3c0b8660 0x7fda3c0c1200 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:06.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.505+0000 7fda43d50640 1 -- 172.21.15.57:0/4289837223 >> 172.21.15.57:0/4289837223 conn(0x7fda3c067120 msgr2=0x7fda3c067530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:06.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.505+0000 7fda43d50640 1 -- 172.21.15.57:0/4289837223 shutdown_connections 2024-04-24T23:39:06.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.505+0000 7fda43d50640 1 -- 172.21.15.57:0/4289837223 wait complete. 2024-04-24T23:39:06.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.509+0000 7fda43d50640 1 Processor -- start 2024-04-24T23:39:06.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.509+0000 7fda43d50640 1 -- start start 2024-04-24T23:39:06.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.509+0000 7fda43d50640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda3c0b8660 0x7fda3c0bef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:06.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.509+0000 7fda43d50640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda3c0c1740 0x7fda3c0bca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:06.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.509+0000 7fda43d50640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda3c14deb0 0x7fda3c13e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:06.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.509+0000 7fda43d50640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fda3c14e290 con 0x7fda3c0b8660 2024-04-24T23:39:06.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.509+0000 7fda43d50640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fda3c0c3660 con 0x7fda3c0c1740 2024-04-24T23:39:06.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.509+0000 7fda43d50640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fda3c0b91f0 con 0x7fda3c14deb0 2024-04-24T23:39:06.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.509+0000 7fda41aec640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda3c0b8660 0x7fda3c0bef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:06.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.509+0000 7fda41aec640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda3c0b8660 0x7fda3c0bef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60490/0 (socket says 172.21.15.57:60490) 2024-04-24T23:39:06.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.509+0000 7fda41aec640 1 -- 172.21.15.57:0/57424395 learned_addr learned my addr 172.21.15.57:0/57424395 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:06.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.509+0000 7fda412eb640 1 --2- 172.21.15.57:0/57424395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda3c0c1740 0x7fda3c0bca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:06.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.509+0000 7fda422ed640 1 --2- 172.21.15.57:0/57424395 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda3c14deb0 0x7fda3c13e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:06.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.509+0000 7fda41aec640 1 -- 172.21.15.57:0/57424395 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda3c14deb0 msgr2=0x7fda3c13e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:06.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.509+0000 7fda41aec640 1 --2- 172.21.15.57:0/57424395 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda3c14deb0 0x7fda3c13e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:06.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.509+0000 7fda41aec640 1 -- 172.21.15.57:0/57424395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda3c0c1740 msgr2=0x7fda3c0bca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:06.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.509+0000 7fda41aec640 1 --2- 172.21.15.57:0/57424395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda3c0c1740 0x7fda3c0bca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:06.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.509+0000 7fda41aec640 1 -- 172.21.15.57:0/57424395 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda3c0c1530 con 0x7fda3c0b8660 2024-04-24T23:39:06.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.509+0000 7fda41aec640 1 --2- 172.21.15.57:0/57424395 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda3c0b8660 0x7fda3c0bef40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fda3800c370 tx=0x7fda3800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:06.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.509+0000 7fda327fc640 1 -- 172.21.15.57:0/57424395 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda38017070 con 0x7fda3c0b8660 2024-04-24T23:39:06.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.509+0000 7fda327fc640 1 -- 172.21.15.57:0/57424395 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda38005cf0 con 0x7fda3c0b8660 2024-04-24T23:39:06.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.509+0000 7fda327fc640 1 -- 172.21.15.57:0/57424395 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda380072f0 con 0x7fda3c0b8660 2024-04-24T23:39:06.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.509+0000 7fda43d50640 1 -- 172.21.15.57:0/57424395 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda3c0bcfb0 con 0x7fda3c0b8660 2024-04-24T23:39:06.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.509+0000 7fda43d50640 1 -- 172.21.15.57:0/57424395 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda3c1543c0 con 0x7fda3c0b8660 2024-04-24T23:39:06.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.509+0000 7fda43d50640 1 -- 172.21.15.57:0/57424395 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda3c068290 con 0x7fda3c0b8660 2024-04-24T23:39:06.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.509+0000 7fda327fc640 1 -- 172.21.15.57:0/57424395 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fda3801a070 con 0x7fda3c0b8660 2024-04-24T23:39:06.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.513+0000 7fda327fc640 1 --2- 172.21.15.57:0/57424395 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fda200678c0 0x7fda20069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:06.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.513+0000 7fda327fc640 1 -- 172.21.15.57:0/57424395 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fda380853b0 con 0x7fda3c0b8660 2024-04-24T23:39:06.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.513+0000 7fda412eb640 1 --2- 172.21.15.57:0/57424395 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fda200678c0 0x7fda20069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:06.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.513+0000 7fda412eb640 1 --2- 172.21.15.57:0/57424395 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fda200678c0 0x7fda20069d80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0b2000 tx=0x7fda2c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:06.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.517+0000 7fda327fc640 1 -- 172.21.15.57:0/57424395 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fda3c0bcfb0 con 0x7fda3c0b8660 2024-04-24T23:39:06.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.673+0000 7fda43d50640 1 -- 172.21.15.57:0/57424395 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fda3c0c23d0 con 0x7fda3c0b8660 2024-04-24T23:39:06.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.673+0000 7fda327fc640 1 -- 172.21.15.57:0/57424395 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7fda38055ba0 con 0x7fda3c0b8660 2024-04-24T23:39:06.675 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-04-24T23:39:06.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.677+0000 7fda43d50640 1 -- 172.21.15.57:0/57424395 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fda200678c0 msgr2=0x7fda20069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:06.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.677+0000 7fda43d50640 1 --2- 172.21.15.57:0/57424395 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fda200678c0 0x7fda20069d80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0b2000 tx=0x7fda2c008040 comp rx=0 tx=0).stop 2024-04-24T23:39:06.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.677+0000 7fda43d50640 1 -- 172.21.15.57:0/57424395 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda3c0b8660 msgr2=0x7fda3c0bef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:06.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.677+0000 7fda43d50640 1 --2- 172.21.15.57:0/57424395 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda3c0b8660 0x7fda3c0bef40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fda3800c370 tx=0x7fda3800c830 comp rx=0 tx=0).stop 2024-04-24T23:39:06.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.677+0000 7fda43d50640 1 -- 172.21.15.57:0/57424395 shutdown_connections 2024-04-24T23:39:06.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.677+0000 7fda43d50640 1 --2- 172.21.15.57:0/57424395 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fda200678c0 0x7fda20069d80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:06.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.677+0000 7fda43d50640 1 --2- 172.21.15.57:0/57424395 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda3c14deb0 0x7fda3c13e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:06.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.677+0000 7fda43d50640 1 --2- 172.21.15.57:0/57424395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda3c0c1740 0x7fda3c0bca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:06.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.677+0000 7fda43d50640 1 --2- 172.21.15.57:0/57424395 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda3c0b8660 0x7fda3c0bef40 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:06.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.677+0000 7fda43d50640 1 -- 172.21.15.57:0/57424395 >> 172.21.15.57:0/57424395 conn(0x7fda3c067120 msgr2=0x7fda3c0c5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:06.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.677+0000 7fda43d50640 1 -- 172.21.15.57:0/57424395 shutdown_connections 2024-04-24T23:39:06.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.677+0000 7fda43d50640 1 -- 172.21.15.57:0/57424395 wait complete. 2024-04-24T23:39:06.693 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:39:06.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83eb32e640 1 Processor -- start 2024-04-24T23:39:06.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83eb32e640 1 -- start start 2024-04-24T23:39:06.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83eb32e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f83e40bd5f0 0x7f83e4151c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:06.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83eb32e640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83e40bd200 con 0x7f83e40bc3b0 2024-04-24T23:39:06.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83eb32e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83e40be070 con 0x7f83e414bc60 2024-04-24T23:39:06.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83eb32e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f83e40bde20 con 0x7f83e40bd5f0 2024-04-24T23:39:06.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83e98cb640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f83e40bc3b0 0x7f83e4158f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53172/0 (socket says 172.21.15.57:53172) 2024-04-24T23:39:06.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83e98cb640 1 -- 172.21.15.57:0/2489129496 learned_addr learned my addr 172.21.15.57:0/2489129496 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:06.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83e88c9640 1 --2- 172.21.15.57:0/2489129496 >> v2:172.21.15.88:3300/0 conn(0x7f83e40bd5f0 0x7f83e4151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:06.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83dbfff640 1 -- 172.21.15.57:0/2489129496 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1296455700 0 0) 0x7f83e40bd200 con 0x7f83e40bc3b0 2024-04-24T23:39:06.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83dbfff640 1 -- 172.21.15.57:0/2489129496 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83d0003530 con 0x7f83e40bc3b0 2024-04-24T23:39:06.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83dbfff640 1 -- 172.21.15.57:0/2489129496 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3633156946 0 0) 0x7f83d0003530 con 0x7f83e40bc3b0 2024-04-24T23:39:06.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83dbfff640 1 -- 172.21.15.57:0/2489129496 >> v2:172.21.15.88:3300/0 conn(0x7f83e40bd5f0 msgr2=0x7f83e4151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:06.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83dbfff640 1 --2- 172.21.15.57:0/2489129496 >> v2:172.21.15.88:3300/0 conn(0x7f83e40bd5f0 0x7f83e4151c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:06.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83dbfff640 1 -- 172.21.15.57:0/2489129496 >> v1:172.21.15.88:6789/0 conn(0x7f83e414bc60 legacy=0x7f83e40c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:06.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83dbfff640 1 -- 172.21.15.57:0/2489129496 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e40be350 con 0x7f83e40bc3b0 2024-04-24T23:39:06.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83dbfff640 1 -- 172.21.15.57:0/2489129496 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7f83dc001a00 con 0x7f83e40bc3b0 2024-04-24T23:39:06.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83dbfff640 1 -- 172.21.15.57:0/2489129496 >> v1:172.21.15.57:6789/0 conn(0x7f83e40bc3b0 legacy=0x7f83e4158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:06.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83dbfff640 1 --2- 172.21.15.57:0/2489129496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83d00039c0 0x7f83d0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:06.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83dbfff640 1 --2- 172.21.15.57:0/2489129496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83d0004810 0x7f83d0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:06.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83dbfff640 1 --2- 172.21.15.57:0/2489129496 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f83d00052f0 0x7f83d000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:06.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83dbfff640 1 -- 172.21.15.57:0/2489129496 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f83e40bde20 con 0x7f83d00039c0 2024-04-24T23:39:06.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83dbfff640 1 -- 172.21.15.57:0/2489129496 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f83d000c1c0 con 0x7f83d0004810 2024-04-24T23:39:06.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83dbfff640 1 -- 172.21.15.57:0/2489129496 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f83d000c3c0 con 0x7f83d00052f0 2024-04-24T23:39:06.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83e90ca640 1 --2- 172.21.15.57:0/2489129496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83d00039c0 0x7f83d0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:06.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83e88c9640 1 --2- 172.21.15.57:0/2489129496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83d0004810 0x7f83d0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:06.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83e98cb640 1 --2- 172.21.15.57:0/2489129496 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f83d00052f0 0x7f83d000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:06.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83e90ca640 1 -- 172.21.15.57:0/2489129496 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f83d00052f0 msgr2=0x7f83d000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:06.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83e90ca640 1 --2- 172.21.15.57:0/2489129496 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f83d00052f0 0x7f83d000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:06.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83e90ca640 1 -- 172.21.15.57:0/2489129496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83d0004810 msgr2=0x7f83d0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:06.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83e90ca640 1 --2- 172.21.15.57:0/2489129496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83d0004810 0x7f83d0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:06.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83e90ca640 1 -- 172.21.15.57:0/2489129496 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d0003530 con 0x7f83d00039c0 2024-04-24T23:39:06.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.821+0000 7f83e98cb640 1 -- 172.21.15.57:0/2489129496 reap_dead start 2024-04-24T23:39:06.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.825+0000 7f83e90ca640 1 --2- 172.21.15.57:0/2489129496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83d00039c0 0x7f83d0003de0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f83e0001750 tx=0x7f83e001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b1d6b0e4487366 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:06.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.825+0000 7f83dbfff640 1 -- 172.21.15.57:0/2489129496 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e00013a0 con 0x7f83d00039c0 2024-04-24T23:39:06.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.825+0000 7f83dbfff640 1 -- 172.21.15.57:0/2489129496 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83e00052f0 con 0x7f83d00039c0 2024-04-24T23:39:06.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.825+0000 7f83dbfff640 1 -- 172.21.15.57:0/2489129496 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e0003840 con 0x7f83d00039c0 2024-04-24T23:39:06.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.825+0000 7f83eb32e640 1 -- 172.21.15.57:0/2489129496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83d00039c0 msgr2=0x7f83d0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:06.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.825+0000 7f83eb32e640 1 --2- 172.21.15.57:0/2489129496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83d00039c0 0x7f83d0003de0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f83e0001750 tx=0x7f83e001c3c0 comp rx=0 tx=0).stop 2024-04-24T23:39:06.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.825+0000 7f83eb32e640 1 -- 172.21.15.57:0/2489129496 shutdown_connections 2024-04-24T23:39:06.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.825+0000 7f83eb32e640 1 --2- 172.21.15.57:0/2489129496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83d00039c0 0x7f83d0003de0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:06.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.825+0000 7f83eb32e640 1 -- 172.21.15.57:0/2489129496 >> 172.21.15.57:0/2489129496 conn(0x7f83e406b920 msgr2=0x7f83e40c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:06.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.825+0000 7f83eb32e640 1 -- 172.21.15.57:0/2489129496 shutdown_connections 2024-04-24T23:39:06.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.825+0000 7f83eb32e640 1 -- 172.21.15.57:0/2489129496 wait complete. 2024-04-24T23:39:06.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.825+0000 7f83eb32e640 1 Processor -- start 2024-04-24T23:39:06.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.825+0000 7f83eb32e640 1 -- start start 2024-04-24T23:39:06.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.825+0000 7f83eb32e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83d00039c0 0x7f83e40b8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:06.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.825+0000 7f83eb32e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83e414c5e0 0x7f83e40bbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:06.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.825+0000 7f83eb32e640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f83e41e7ad0 0x7f83e414f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:06.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.825+0000 7f83eb32e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f83e4151da0 con 0x7f83d00039c0 2024-04-24T23:39:06.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.825+0000 7f83eb32e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f83e4151c20 con 0x7f83e414c5e0 2024-04-24T23:39:06.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.825+0000 7f83eb32e640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f83e4151f20 con 0x7f83e41e7ad0 2024-04-24T23:39:06.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.825+0000 7f83e90ca640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83d00039c0 0x7f83e40b8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:06.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.825+0000 7f83e90ca640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83d00039c0 0x7f83e40b8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60504/0 (socket says 172.21.15.57:60504) 2024-04-24T23:39:06.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.825+0000 7f83e90ca640 1 -- 172.21.15.57:0/594012747 learned_addr learned my addr 172.21.15.57:0/594012747 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:06.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.825+0000 7f83e88c9640 1 --2- 172.21.15.57:0/594012747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83e414c5e0 0x7f83e40bbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:06.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.825+0000 7f83e98cb640 1 --2- 172.21.15.57:0/594012747 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f83e41e7ad0 0x7f83e414f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:06.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.825+0000 7f83e90ca640 1 -- 172.21.15.57:0/594012747 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f83e41e7ad0 msgr2=0x7f83e414f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:06.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.825+0000 7f83e90ca640 1 --2- 172.21.15.57:0/594012747 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f83e41e7ad0 0x7f83e414f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:06.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.825+0000 7f83e90ca640 1 -- 172.21.15.57:0/594012747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83e414c5e0 msgr2=0x7f83e40bbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:06.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.825+0000 7f83e90ca640 1 --2- 172.21.15.57:0/594012747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83e414c5e0 0x7f83e40bbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:06.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.825+0000 7f83e90ca640 1 -- 172.21.15.57:0/594012747 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e41eaa80 con 0x7f83d00039c0 2024-04-24T23:39:06.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.829+0000 7f83e90ca640 1 --2- 172.21.15.57:0/594012747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83d00039c0 0x7f83e40b8d80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f83e0005040 tx=0x7f83d0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:06.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.829+0000 7f83d9ffb640 1 -- 172.21.15.57:0/594012747 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e00b8070 con 0x7f83d00039c0 2024-04-24T23:39:06.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.829+0000 7f83d9ffb640 1 -- 172.21.15.57:0/594012747 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83e0000ee0 con 0x7f83d00039c0 2024-04-24T23:39:06.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.829+0000 7f83eb32e640 1 -- 172.21.15.57:0/594012747 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83e41ea7e0 con 0x7f83d00039c0 2024-04-24T23:39:06.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.829+0000 7f83d9ffb640 1 -- 172.21.15.57:0/594012747 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e0007a40 con 0x7f83d00039c0 2024-04-24T23:39:06.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.829+0000 7f83eb32e640 1 -- 172.21.15.57:0/594012747 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83e41e72d0 con 0x7f83d00039c0 2024-04-24T23:39:06.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.829+0000 7f83eb32e640 1 -- 172.21.15.57:0/594012747 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83e4068290 con 0x7f83d00039c0 2024-04-24T23:39:06.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.829+0000 7f83d9ffb640 1 -- 172.21.15.57:0/594012747 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f83e00052f0 con 0x7f83d00039c0 2024-04-24T23:39:06.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.829+0000 7f83d9ffb640 1 --2- 172.21.15.57:0/594012747 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f83c80678c0 0x7f83c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:06.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.829+0000 7f83d9ffb640 1 -- 172.21.15.57:0/594012747 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f83e011fa10 con 0x7f83d00039c0 2024-04-24T23:39:06.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.829+0000 7f83e88c9640 1 --2- 172.21.15.57:0/594012747 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f83c80678c0 0x7f83c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:06.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.829+0000 7f83e88c9640 1 --2- 172.21.15.57:0/594012747 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f83c80678c0 0x7f83c8069d80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f83e414f1e0 tx=0x7f83d4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:06.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.833+0000 7f83d9ffb640 1 -- 172.21.15.57:0/594012747 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f83e00160d0 con 0x7f83d00039c0 2024-04-24T23:39:06.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.997+0000 7f83eb32e640 1 -- 172.21.15.57:0/594012747 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f83e406ef70 con 0x7f83d00039c0 2024-04-24T23:39:06.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.997+0000 7f83d9ffb640 1 -- 172.21.15.57:0/594012747 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f83e00f02a0 con 0x7f83d00039c0 2024-04-24T23:39:06.998 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-24T23:39:07.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.997+0000 7f83eb32e640 1 -- 172.21.15.57:0/594012747 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f83c80678c0 msgr2=0x7f83c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:07.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.997+0000 7f83eb32e640 1 --2- 172.21.15.57:0/594012747 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f83c80678c0 0x7f83c8069d80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f83e414f1e0 tx=0x7f83d4008040 comp rx=0 tx=0).stop 2024-04-24T23:39:07.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.997+0000 7f83eb32e640 1 -- 172.21.15.57:0/594012747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83d00039c0 msgr2=0x7f83e40b8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:07.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.997+0000 7f83eb32e640 1 --2- 172.21.15.57:0/594012747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83d00039c0 0x7f83e40b8d80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f83e0005040 tx=0x7f83d0005840 comp rx=0 tx=0).stop 2024-04-24T23:39:07.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.997+0000 7f83eb32e640 1 -- 172.21.15.57:0/594012747 shutdown_connections 2024-04-24T23:39:07.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.997+0000 7f83eb32e640 1 --2- 172.21.15.57:0/594012747 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f83c80678c0 0x7f83c8069d80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:07.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.997+0000 7f83eb32e640 1 --2- 172.21.15.57:0/594012747 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f83e41e7ad0 0x7f83e414f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:07.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.997+0000 7f83eb32e640 1 --2- 172.21.15.57:0/594012747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83e414c5e0 0x7f83e40bbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:07.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.997+0000 7f83eb32e640 1 --2- 172.21.15.57:0/594012747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83d00039c0 0x7f83e40b8d80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:07.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.997+0000 7f83eb32e640 1 -- 172.21.15.57:0/594012747 >> 172.21.15.57:0/594012747 conn(0x7f83e406b920 msgr2=0x7f83e4147b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:07.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:06.997+0000 7f83eb32e640 1 -- 172.21.15.57:0/594012747 shutdown_connections 2024-04-24T23:39:07.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.001+0000 7f83eb32e640 1 -- 172.21.15.57:0/594012747 wait complete. 2024-04-24T23:39:07.016 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-24T23:39:07.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.141+0000 7f474082c640 1 Processor -- start 2024-04-24T23:39:07.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.141+0000 7f474082c640 1 -- start start 2024-04-24T23:39:07.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.141+0000 7f474082c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f473c0bc3f0 0x7f473c14a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:07.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.141+0000 7f474082c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f473c14ade0 0x7f473c14dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:07.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.141+0000 7f474082c640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f473c0be040 con 0x7f473c06ea40 2024-04-24T23:39:07.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.141+0000 7f474082c640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f473c14b210 con 0x7f473c14ade0 2024-04-24T23:39:07.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.141+0000 7f474082c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f473c14d640 con 0x7f473c0bc3f0 2024-04-24T23:39:07.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.141+0000 7f473ad9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f473c14ade0 0x7f473c14dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:07.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.141+0000 7f473a59c640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f473c06ea40 0x7f473c1514f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53182/0 (socket says 172.21.15.57:53182) 2024-04-24T23:39:07.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.141+0000 7f473a59c640 1 -- 172.21.15.57:0/2900889289 learned_addr learned my addr 172.21.15.57:0/2900889289 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:07.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.141+0000 7f4731d9b640 1 --2- 172.21.15.57:0/2900889289 >> v2:172.21.15.88:3300/0 conn(0x7f473c0bc3f0 0x7f473c14a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:07.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.141+0000 7f4739d9b640 1 -- 172.21.15.57:0/2900889289 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4008155157 0 0) 0x7f473c0be040 con 0x7f473c06ea40 2024-04-24T23:39:07.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.141+0000 7f473ad9d640 1 -- 172.21.15.57:0/2900889289 >> v2:172.21.15.88:3300/0 conn(0x7f473c0bc3f0 msgr2=0x7f473c14a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:07.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.141+0000 7f473ad9d640 1 --2- 172.21.15.57:0/2900889289 >> v2:172.21.15.88:3300/0 conn(0x7f473c0bc3f0 0x7f473c14a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:07.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.141+0000 7f473ad9d640 1 -- 172.21.15.57:0/2900889289 >> v1:172.21.15.57:6789/0 conn(0x7f473c06ea40 legacy=0x7f473c1514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:07.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.141+0000 7f473ad9d640 1 -- 172.21.15.57:0/2900889289 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473c0be320 con 0x7f473c14ade0 2024-04-24T23:39:07.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.141+0000 7f4731d9b640 1 --2- 172.21.15.57:0/2900889289 >> v2:172.21.15.88:3300/0 conn(0x7f473c0bc3f0 0x7f473c14a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:39:07.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f473ad9d640 1 --2- 172.21.15.57:0/2900889289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f473c14ade0 0x7f473c14dad0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f473c0a5bd0 tx=0x7f473401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc151d4cec1c517f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:07.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f4739d9b640 1 -- 172.21.15.57:0/2900889289 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47340b2070 con 0x7f473c14ade0 2024-04-24T23:39:07.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f4739d9b640 1 -- 172.21.15.57:0/2900889289 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47340a5950 con 0x7f473c14ade0 2024-04-24T23:39:07.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f4739d9b640 1 -- 172.21.15.57:0/2900889289 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47340a5d20 con 0x7f473c14ade0 2024-04-24T23:39:07.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f474082c640 1 -- 172.21.15.57:0/2900889289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f473c14ade0 msgr2=0x7f473c14dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:07.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f474082c640 1 --2- 172.21.15.57:0/2900889289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f473c14ade0 0x7f473c14dad0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f473c0a5bd0 tx=0x7f473401c900 comp rx=0 tx=0).stop 2024-04-24T23:39:07.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f474082c640 1 -- 172.21.15.57:0/2900889289 shutdown_connections 2024-04-24T23:39:07.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f474082c640 1 --2- 172.21.15.57:0/2900889289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f473c14ade0 0x7f473c14dad0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:07.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f474082c640 1 --2- 172.21.15.57:0/2900889289 >> v2:172.21.15.88:3300/0 conn(0x7f473c0bc3f0 0x7f473c14a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:07.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f474082c640 1 -- 172.21.15.57:0/2900889289 >> 172.21.15.57:0/2900889289 conn(0x7f473c06b920 msgr2=0x7f473c0c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:07.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f474082c640 1 -- 172.21.15.57:0/2900889289 shutdown_connections 2024-04-24T23:39:07.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f474082c640 1 -- 172.21.15.57:0/2900889289 wait complete. 2024-04-24T23:39:07.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f474082c640 1 Processor -- start 2024-04-24T23:39:07.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f474082c640 1 -- start start 2024-04-24T23:39:07.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f474082c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f473c06ea40 0x7f473c13b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:07.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f474082c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f473c0bc3f0 0x7f473c133e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:07.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f474082c640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f473c14ade0 0x7f473c134370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:07.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f474082c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f473c06efa0 con 0x7f473c0bc3f0 2024-04-24T23:39:07.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f474082c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f473c06ee20 con 0x7f473c06ea40 2024-04-24T23:39:07.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f474082c640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f473c06d6d0 con 0x7f473c14ade0 2024-04-24T23:39:07.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f4731d9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f473c0bc3f0 0x7f473c133e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:07.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f4731d9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f473c0bc3f0 0x7f473c133e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60514/0 (socket says 172.21.15.57:60514) 2024-04-24T23:39:07.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f4731d9b640 1 -- 172.21.15.57:0/1240662729 learned_addr learned my addr 172.21.15.57:0/1240662729 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:07.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f473a59c640 1 --2- 172.21.15.57:0/1240662729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f473c06ea40 0x7f473c13b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:07.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f4731d9b640 1 -- 172.21.15.57:0/1240662729 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f473c14ade0 msgr2=0x7f473c134370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:07.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f4731d9b640 1 --2- 172.21.15.57:0/1240662729 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f473c14ade0 0x7f473c134370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:07.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f4731d9b640 1 -- 172.21.15.57:0/1240662729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f473c06ea40 msgr2=0x7f473c13b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:07.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f4731d9b640 1 --2- 172.21.15.57:0/1240662729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f473c06ea40 0x7f473c13b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:07.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f4731d9b640 1 -- 172.21.15.57:0/1240662729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473c13bda0 con 0x7f473c0bc3f0 2024-04-24T23:39:07.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f473a59c640 1 --2- 172.21.15.57:0/1240662729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f473c06ea40 0x7f473c13b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:39:07.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f4731d9b640 1 --2- 172.21.15.57:0/1240662729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f473c0bc3f0 0x7f473c133e30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f472400e840 tx=0x7f472400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:07.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f47337fe640 1 -- 172.21.15.57:0/1240662729 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4724017070 con 0x7f473c0bc3f0 2024-04-24T23:39:07.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f47337fe640 1 -- 172.21.15.57:0/1240662729 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f472400c8d0 con 0x7f473c0bc3f0 2024-04-24T23:39:07.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f474082c640 1 -- 172.21.15.57:0/1240662729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f473c14c790 con 0x7f473c0bc3f0 2024-04-24T23:39:07.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f47337fe640 1 -- 172.21.15.57:0/1240662729 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472400f040 con 0x7f473c0bc3f0 2024-04-24T23:39:07.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.145+0000 7f474082c640 1 -- 172.21.15.57:0/1240662729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f473c14ca30 con 0x7f473c0bc3f0 2024-04-24T23:39:07.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.149+0000 7f474082c640 1 -- 172.21.15.57:0/1240662729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f473c068290 con 0x7f473c0bc3f0 2024-04-24T23:39:07.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.149+0000 7f47337fe640 1 -- 172.21.15.57:0/1240662729 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f472401a070 con 0x7f473c0bc3f0 2024-04-24T23:39:07.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.149+0000 7f47337fe640 1 --2- 172.21.15.57:0/1240662729 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f471c0678f0 0x7f471c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:07.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.149+0000 7f47337fe640 1 -- 172.21.15.57:0/1240662729 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4724085c70 con 0x7f473c0bc3f0 2024-04-24T23:39:07.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.149+0000 7f473a59c640 1 --2- 172.21.15.57:0/1240662729 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f471c0678f0 0x7f471c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:07.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.149+0000 7f473a59c640 1 --2- 172.21.15.57:0/1240662729 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f471c0678f0 0x7f471c069db0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f472c000f70 tx=0x7f472c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:07.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.153+0000 7f47337fe640 1 -- 172.21.15.57:0/1240662729 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f473c13bda0 con 0x7f473c0bc3f0 2024-04-24T23:39:07.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.305+0000 7f474082c640 1 -- 172.21.15.57:0/1240662729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f473c14e670 con 0x7f473c0bc3f0 2024-04-24T23:39:07.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.309+0000 7f47337fe640 1 -- 172.21.15.57:0/1240662729 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f47240563e0 con 0x7f473c0bc3f0 2024-04-24T23:39:07.308 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-04-24T23:39:07.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.309+0000 7f474082c640 1 -- 172.21.15.57:0/1240662729 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f471c0678f0 msgr2=0x7f471c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:07.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.309+0000 7f474082c640 1 --2- 172.21.15.57:0/1240662729 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f471c0678f0 0x7f471c069db0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f472c000f70 tx=0x7f472c009040 comp rx=0 tx=0).stop 2024-04-24T23:39:07.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.309+0000 7f474082c640 1 -- 172.21.15.57:0/1240662729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f473c0bc3f0 msgr2=0x7f473c133e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:07.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.309+0000 7f474082c640 1 --2- 172.21.15.57:0/1240662729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f473c0bc3f0 0x7f473c133e30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f472400e840 tx=0x7f472400ed00 comp rx=0 tx=0).stop 2024-04-24T23:39:07.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.309+0000 7f474082c640 1 -- 172.21.15.57:0/1240662729 shutdown_connections 2024-04-24T23:39:07.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.309+0000 7f474082c640 1 --2- 172.21.15.57:0/1240662729 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f471c0678f0 0x7f471c069db0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:07.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.309+0000 7f474082c640 1 --2- 172.21.15.57:0/1240662729 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f473c14ade0 0x7f473c134370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:07.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.309+0000 7f474082c640 1 --2- 172.21.15.57:0/1240662729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f473c0bc3f0 0x7f473c133e30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:07.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.309+0000 7f474082c640 1 --2- 172.21.15.57:0/1240662729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f473c06ea40 0x7f473c13b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:07.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.309+0000 7f474082c640 1 -- 172.21.15.57:0/1240662729 >> 172.21.15.57:0/1240662729 conn(0x7f473c06b920 msgr2=0x7f473c0bcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:07.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.309+0000 7f474082c640 1 -- 172.21.15.57:0/1240662729 shutdown_connections 2024-04-24T23:39:07.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.309+0000 7f474082c640 1 -- 172.21.15.57:0/1240662729 wait complete. 2024-04-24T23:39:07.316 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:39:07.318 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:39:07.321 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:39:07.323 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:39:07.326 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:39:07.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.513+0000 7fa4fb0cc640 1 Processor -- start 2024-04-24T23:39:07.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.513+0000 7fa4fb0cc640 1 -- start start 2024-04-24T23:39:07.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.513+0000 7fa4fb0cc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa4f414a790 0x7fa4f40bc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:07.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.513+0000 7fa4fb0cc640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa4f4153cf0 0x7fa4f4154100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:07.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.513+0000 7fa4fb0cc640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4f406f620 con 0x7fa4f40bee00 2024-04-24T23:39:07.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.513+0000 7fa4fb0cc640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fa4f406f900 con 0x7fa4f4153cf0 2024-04-24T23:39:07.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.513+0000 7fa4fb0cc640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fa4f406fbe0 con 0x7fa4f414a790 2024-04-24T23:39:07.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.513+0000 7fa4f9669640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa4f4153cf0 0x7fa4f4154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:07.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.513+0000 7fa4f9669640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa4f4153cf0 0x7fa4f4154100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60528/0 (socket says 172.21.15.57:60528) 2024-04-24T23:39:07.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.513+0000 7fa4f9669640 1 -- 172.21.15.57:0/579771120 learned_addr learned my addr 172.21.15.57:0/579771120 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:07.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.513+0000 7fa4f8e68640 1 --2- 172.21.15.57:0/579771120 >> v2:172.21.15.88:3300/0 conn(0x7fa4f414a790 0x7fa4f40bc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:07.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.513+0000 7fa4f9669640 1 -- 172.21.15.57:0/579771120 >> v2:172.21.15.88:3300/0 conn(0x7fa4f414a790 msgr2=0x7fa4f40bc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:07.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.513+0000 7fa4f9669640 1 --2- 172.21.15.57:0/579771120 >> v2:172.21.15.88:3300/0 conn(0x7fa4f414a790 0x7fa4f40bc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:07.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.513+0000 7fa4f9669640 1 -- 172.21.15.57:0/579771120 >> v1:172.21.15.88:6789/0 conn(0x7fa4f40bee00 legacy=0x7fa4f40bcf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:07.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.513+0000 7fa4f9669640 1 -- 172.21.15.57:0/579771120 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f406fec0 con 0x7fa4f4153cf0 2024-04-24T23:39:07.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4f9669640 1 --2- 172.21.15.57:0/579771120 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4f4153cf0 0x7fa4f4154100 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa4f406c0d0 tx=0x7fa4e401ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef02dbe30d5c7feb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:07.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4f37fe640 1 -- 172.21.15.57:0/579771120 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e40b5070 con 0x7fa4f4153cf0 2024-04-24T23:39:07.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4f37fe640 1 -- 172.21.15.57:0/579771120 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4e40a89d0 con 0x7fa4f4153cf0 2024-04-24T23:39:07.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4f37fe640 1 -- 172.21.15.57:0/579771120 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e40a8da0 con 0x7fa4f4153cf0 2024-04-24T23:39:07.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4fb0cc640 1 -- 172.21.15.57:0/579771120 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4f4153cf0 msgr2=0x7fa4f4154100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:07.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4fb0cc640 1 --2- 172.21.15.57:0/579771120 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4f4153cf0 0x7fa4f4154100 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa4f406c0d0 tx=0x7fa4e401ecd0 comp rx=0 tx=0).stop 2024-04-24T23:39:07.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4fb0cc640 1 -- 172.21.15.57:0/579771120 shutdown_connections 2024-04-24T23:39:07.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4fb0cc640 1 --2- 172.21.15.57:0/579771120 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4f4153cf0 0x7fa4f4154100 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:07.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4fb0cc640 1 --2- 172.21.15.57:0/579771120 >> v2:172.21.15.88:3300/0 conn(0x7fa4f414a790 0x7fa4f40bc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:07.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4fb0cc640 1 -- 172.21.15.57:0/579771120 >> 172.21.15.57:0/579771120 conn(0x7fa4f40bfb50 msgr2=0x7fa4f40bff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:07.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4fb0cc640 1 -- 172.21.15.57:0/579771120 shutdown_connections 2024-04-24T23:39:07.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4fb0cc640 1 -- 172.21.15.57:0/579771120 wait complete. 2024-04-24T23:39:07.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4fb0cc640 1 Processor -- start 2024-04-24T23:39:07.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4fb0cc640 1 -- start start 2024-04-24T23:39:07.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4fb0cc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4f40bee00 0x7fa4f40a7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:07.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4fb0cc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4f414a790 0x7fa4f414e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:07.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4fb0cc640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa4f4153cf0 0x7fa4f414ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:07.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4fb0cc640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f4154640 con 0x7fa4f414a790 2024-04-24T23:39:07.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4fb0cc640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f414ab70 con 0x7fa4f40bee00 2024-04-24T23:39:07.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4fb0cc640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fa4f41547c0 con 0x7fa4f4153cf0 2024-04-24T23:39:07.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4f3fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4f414a790 0x7fa4f414e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:07.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4f3fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4f414a790 0x7fa4f414e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60538/0 (socket says 172.21.15.57:60538) 2024-04-24T23:39:07.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4f3fff640 1 -- 172.21.15.57:0/2467348469 learned_addr learned my addr 172.21.15.57:0/2467348469 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:07.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4f8e68640 1 --2- 172.21.15.57:0/2467348469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4f40bee00 0x7fa4f40a7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:07.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4f3fff640 1 -- 172.21.15.57:0/2467348469 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa4f4153cf0 msgr2=0x7fa4f414ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:07.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4f3fff640 1 --2- 172.21.15.57:0/2467348469 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa4f4153cf0 0x7fa4f414ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:07.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4f3fff640 1 -- 172.21.15.57:0/2467348469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4f40bee00 msgr2=0x7fa4f40a7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:07.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4f3fff640 1 --2- 172.21.15.57:0/2467348469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4f40bee00 0x7fa4f40a7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:07.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4f3fff640 1 -- 172.21.15.57:0/2467348469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f40a7690 con 0x7fa4f414a790 2024-04-24T23:39:07.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4f3fff640 1 --2- 172.21.15.57:0/2467348469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4f414a790 0x7fa4f414e930 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa4e800c480 tx=0x7fa4e800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:07.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4f17fa640 1 -- 172.21.15.57:0/2467348469 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8012830 con 0x7fa4f414a790 2024-04-24T23:39:07.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4f17fa640 1 -- 172.21.15.57:0/2467348469 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4e8017070 con 0x7fa4f414a790 2024-04-24T23:39:07.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4f17fa640 1 -- 172.21.15.57:0/2467348469 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8012c30 con 0x7fa4f414a790 2024-04-24T23:39:07.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4fb0cc640 1 -- 172.21.15.57:0/2467348469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4f4150320 con 0x7fa4f414a790 2024-04-24T23:39:07.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.517+0000 7fa4fb0cc640 1 -- 172.21.15.57:0/2467348469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4f41db4f0 con 0x7fa4f414a790 2024-04-24T23:39:07.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.521+0000 7fa4fb0cc640 1 -- 172.21.15.57:0/2467348469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4f4068930 con 0x7fa4f414a790 2024-04-24T23:39:07.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.521+0000 7fa4f17fa640 1 -- 172.21.15.57:0/2467348469 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa4e801c460 con 0x7fa4f414a790 2024-04-24T23:39:07.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.521+0000 7fa4f17fa640 1 --2- 172.21.15.57:0/2467348469 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa4e00678f0 0x7fa4e0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:07.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.521+0000 7fa4f17fa640 1 -- 172.21.15.57:0/2467348469 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa4e8085d40 con 0x7fa4f414a790 2024-04-24T23:39:07.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.521+0000 7fa4f8e68640 1 --2- 172.21.15.57:0/2467348469 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa4e00678f0 0x7fa4e0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:07.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.521+0000 7fa4f8e68640 1 --2- 172.21.15.57:0/2467348469 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa4e00678f0 0x7fa4e0069db0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec009f30 tx=0x7fa4ec00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:07.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.525+0000 7fa4f17fa640 1 -- 172.21.15.57:0/2467348469 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fa4f40a7690 con 0x7fa4f414a790 2024-04-24T23:39:07.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.721+0000 7fa4fb0cc640 1 -- 172.21.15.57:0/2467348469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4f40bc550 con 0x7fa4f414a790 2024-04-24T23:39:07.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.721+0000 7fa4f17fa640 1 -- 172.21.15.57:0/2467348469 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+4350 (secure 0 0 0) 0x7fa4e80565d0 con 0x7fa4f414a790 2024-04-24T23:39:07.722 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:39:07.722 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2925410225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2925410225},{"type":"v1","addr":"172.21.15.88:6835","nonce":2925410225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4227,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/173597347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":173597347},{"type":"v1","addr":"172.21.15.57:6834","nonce":173597347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:38:33.449139+0000","modified":"2024-04-24T23:38:57.042000+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4230":{"gid":4230,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/1701414040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":1701414040},{"type":"v1","addr":"172.21.15.57:6835","nonce":1701414040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4230,"qdb_cluster":[4230]},"id":1}]} 2024-04-24T23:39:07.722 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 9 2024-04-24T23:39:07.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.721+0000 7fa4fb0cc640 1 -- 172.21.15.57:0/2467348469 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa4e00678f0 msgr2=0x7fa4e0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:07.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.721+0000 7fa4fb0cc640 1 --2- 172.21.15.57:0/2467348469 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa4e00678f0 0x7fa4e0069db0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec009f30 tx=0x7fa4ec00b040 comp rx=0 tx=0).stop 2024-04-24T23:39:07.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.721+0000 7fa4fb0cc640 1 -- 172.21.15.57:0/2467348469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4f414a790 msgr2=0x7fa4f414e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:07.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.721+0000 7fa4fb0cc640 1 --2- 172.21.15.57:0/2467348469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4f414a790 0x7fa4f414e930 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa4e800c480 tx=0x7fa4e800c940 comp rx=0 tx=0).stop 2024-04-24T23:39:07.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.721+0000 7fa4fb0cc640 1 -- 172.21.15.57:0/2467348469 shutdown_connections 2024-04-24T23:39:07.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.721+0000 7fa4fb0cc640 1 --2- 172.21.15.57:0/2467348469 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa4e00678f0 0x7fa4e0069db0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:07.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.721+0000 7fa4fb0cc640 1 --2- 172.21.15.57:0/2467348469 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa4f4153cf0 0x7fa4f414ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:07.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.721+0000 7fa4fb0cc640 1 --2- 172.21.15.57:0/2467348469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4f414a790 0x7fa4f414e930 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:07.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.721+0000 7fa4fb0cc640 1 --2- 172.21.15.57:0/2467348469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4f40bee00 0x7fa4f40a7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:07.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.721+0000 7fa4fb0cc640 1 -- 172.21.15.57:0/2467348469 >> 172.21.15.57:0/2467348469 conn(0x7fa4f40bfb50 msgr2=0x7fa4f4072a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:07.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.721+0000 7fa4fb0cc640 1 -- 172.21.15.57:0/2467348469 shutdown_connections 2024-04-24T23:39:07.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.721+0000 7fa4fb0cc640 1 -- 172.21.15.57:0/2467348469 wait complete. 2024-04-24T23:39:07.741 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:39:07.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.849+0000 7f94c2cea640 1 Processor -- start 2024-04-24T23:39:07.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.849+0000 7f94c2cea640 1 -- start start 2024-04-24T23:39:07.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.853+0000 7f94c2cea640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f94bc072610 0x7f94bc0bd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:07.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.853+0000 7f94c2cea640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94bc151540 con 0x7f94bc14e2c0 2024-04-24T23:39:07.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.853+0000 7f94c2cea640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94bc0bcae0 con 0x7f94bc06edb0 2024-04-24T23:39:07.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.853+0000 7f94c2cea640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f94bc1512f0 con 0x7f94bc072610 2024-04-24T23:39:07.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.853+0000 7f94c1287640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f94bc14e2c0 0x7f94bc15b1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43662/0 (socket says 172.21.15.57:43662) 2024-04-24T23:39:07.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.853+0000 7f94c1287640 1 -- 172.21.15.57:0/3436712409 learned_addr learned my addr 172.21.15.57:0/3436712409 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:07.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.853+0000 7f94bb7fe640 1 -- 172.21.15.57:0/3436712409 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2994046904 0 0) 0x7f94bc151540 con 0x7f94bc14e2c0 2024-04-24T23:39:07.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.853+0000 7f94bb7fe640 1 -- 172.21.15.57:0/3436712409 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94a4003530 con 0x7f94bc14e2c0 2024-04-24T23:39:07.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.853+0000 7f94bbfff640 1 --2- 172.21.15.57:0/3436712409 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f94bc072610 0x7f94bc0bd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:07.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.853+0000 7f94bb7fe640 1 -- 172.21.15.57:0/3436712409 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 174182030 0 0) 0x7f94a4003530 con 0x7f94bc14e2c0 2024-04-24T23:39:07.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.853+0000 7f94bb7fe640 1 -- 172.21.15.57:0/3436712409 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f94bc072610 msgr2=0x7f94bc0bd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:07.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.853+0000 7f94bb7fe640 1 --2- 172.21.15.57:0/3436712409 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f94bc072610 0x7f94bc0bd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:07.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.853+0000 7f94bb7fe640 1 -- 172.21.15.57:0/3436712409 >> v1:172.21.15.88:6789/0 conn(0x7f94bc06edb0 legacy=0x7f94bc14dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:07.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.853+0000 7f94bb7fe640 1 -- 172.21.15.57:0/3436712409 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94bc0b90e0 con 0x7f94bc14e2c0 2024-04-24T23:39:07.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.853+0000 7f94bb7fe640 1 -- 172.21.15.57:0/3436712409 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7f94b4001a00 con 0x7f94bc14e2c0 2024-04-24T23:39:07.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.853+0000 7f94bb7fe640 1 -- 172.21.15.57:0/3436712409 >> v1:172.21.15.57:6789/0 conn(0x7f94bc14e2c0 legacy=0x7f94bc15b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:07.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.853+0000 7f94bb7fe640 1 --2- 172.21.15.57:0/3436712409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94a40039f0 0x7f94a4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:07.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.853+0000 7f94bb7fe640 1 --2- 172.21.15.57:0/3436712409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94a4004810 0x7f94a4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:07.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.853+0000 7f94bb7fe640 1 --2- 172.21.15.57:0/3436712409 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f94a40051d0 0x7f94a400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:07.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.853+0000 7f94bb7fe640 1 -- 172.21.15.57:0/3436712409 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f94bc1512f0 con 0x7f94a40039f0 2024-04-24T23:39:07.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.853+0000 7f94bb7fe640 1 -- 172.21.15.57:0/3436712409 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f94a400bf10 con 0x7f94a4004810 2024-04-24T23:39:07.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.853+0000 7f94bb7fe640 1 -- 172.21.15.57:0/3436712409 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f94a400c090 con 0x7f94a40051d0 2024-04-24T23:39:07.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.853+0000 7f94bbfff640 1 --2- 172.21.15.57:0/3436712409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94a4004810 0x7f94a4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:07.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.853+0000 7f94c0a86640 1 --2- 172.21.15.57:0/3436712409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94a40039f0 0x7f94a4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:07.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.853+0000 7f94c1287640 1 --2- 172.21.15.57:0/3436712409 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f94a40051d0 0x7f94a400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:07.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.853+0000 7f94bbfff640 1 -- 172.21.15.57:0/3436712409 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f94a40051d0 msgr2=0x7f94a400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:07.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.853+0000 7f94bbfff640 1 --2- 172.21.15.57:0/3436712409 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f94a40051d0 0x7f94a400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:07.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.853+0000 7f94bbfff640 1 -- 172.21.15.57:0/3436712409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94a40039f0 msgr2=0x7f94a4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:07.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.853+0000 7f94bbfff640 1 --2- 172.21.15.57:0/3436712409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94a40039f0 0x7f94a4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:07.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.853+0000 7f94bbfff640 1 -- 172.21.15.57:0/3436712409 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94a4003530 con 0x7f94a4004810 2024-04-24T23:39:07.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94bbfff640 1 --2- 172.21.15.57:0/3436712409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94a4004810 0x7f94a4004c90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f94ac009ae0 tx=0x7f94ac01ca70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8acd38eba375507e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:07.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94bb7fe640 1 -- 172.21.15.57:0/3436712409 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ac0096b0 con 0x7f94a4004810 2024-04-24T23:39:07.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94bb7fe640 1 -- 172.21.15.57:0/3436712409 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94ac0a6450 con 0x7f94a4004810 2024-04-24T23:39:07.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94bb7fe640 1 -- 172.21.15.57:0/3436712409 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ac0a6840 con 0x7f94a4004810 2024-04-24T23:39:07.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94c2cea640 1 -- 172.21.15.57:0/3436712409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94a4004810 msgr2=0x7f94a4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:07.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94c2cea640 1 --2- 172.21.15.57:0/3436712409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94a4004810 0x7f94a4004c90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f94ac009ae0 tx=0x7f94ac01ca70 comp rx=0 tx=0).stop 2024-04-24T23:39:07.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94c1287640 1 -- 172.21.15.57:0/3436712409 reap_dead start 2024-04-24T23:39:07.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94c2cea640 1 -- 172.21.15.57:0/3436712409 shutdown_connections 2024-04-24T23:39:07.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94c2cea640 1 -- 172.21.15.57:0/3436712409 >> 172.21.15.57:0/3436712409 conn(0x7f94bc0beab0 msgr2=0x7f94bc0beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:07.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94c2cea640 1 -- 172.21.15.57:0/3436712409 shutdown_connections 2024-04-24T23:39:07.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94c2cea640 1 -- 172.21.15.57:0/3436712409 wait complete. 2024-04-24T23:39:07.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94c2cea640 1 Processor -- start 2024-04-24T23:39:07.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94c2cea640 1 -- start start 2024-04-24T23:39:07.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94c2cea640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94a4004810 0x7f94bc14cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:07.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94c2cea640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f94bc0c1630 0x7f94bc14f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:07.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94c2cea640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94bc0bb980 0x7f94bc0bbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:07.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94c2cea640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f94bc0b7ef0 con 0x7f94a4004810 2024-04-24T23:39:07.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94c2cea640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f94bc0b7590 con 0x7f94bc0bb980 2024-04-24T23:39:07.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94c2cea640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f94bc15cb20 con 0x7f94bc0c1630 2024-04-24T23:39:07.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94c0a86640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94a4004810 0x7f94bc14cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:07.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94c0a86640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94a4004810 0x7f94bc14cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59926/0 (socket says 172.21.15.57:59926) 2024-04-24T23:39:07.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94c0a86640 1 -- 172.21.15.57:0/2156994114 learned_addr learned my addr 172.21.15.57:0/2156994114 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:07.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94bbfff640 1 --2- 172.21.15.57:0/2156994114 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f94bc0c1630 0x7f94bc14f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:07.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94c1287640 1 --2- 172.21.15.57:0/2156994114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94bc0bb980 0x7f94bc0bbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:07.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94c0a86640 1 -- 172.21.15.57:0/2156994114 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f94bc0c1630 msgr2=0x7f94bc14f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:07.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94c0a86640 1 --2- 172.21.15.57:0/2156994114 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f94bc0c1630 0x7f94bc14f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:07.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94c0a86640 1 -- 172.21.15.57:0/2156994114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94bc0bb980 msgr2=0x7f94bc0bbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:07.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94c0a86640 1 --2- 172.21.15.57:0/2156994114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94bc0bb980 0x7f94bc0bbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:07.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94c0a86640 1 -- 172.21.15.57:0/2156994114 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94bc14fed0 con 0x7f94a4004810 2024-04-24T23:39:07.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94c1287640 1 --2- 172.21.15.57:0/2156994114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94bc0bb980 0x7f94bc0bbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:39:07.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94c0a86640 1 --2- 172.21.15.57:0/2156994114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94a4004810 0x7f94bc14cc80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f94b000f5f0 tx=0x7f94b000fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:07.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.857+0000 7f94b97fa640 1 -- 172.21.15.57:0/2156994114 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b00052e0 con 0x7f94a4004810 2024-04-24T23:39:07.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.861+0000 7f94b97fa640 1 -- 172.21.15.57:0/2156994114 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94b0018070 con 0x7f94a4004810 2024-04-24T23:39:07.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.861+0000 7f94c2cea640 1 -- 172.21.15.57:0/2156994114 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94bc1ed270 con 0x7f94a4004810 2024-04-24T23:39:07.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.861+0000 7f94b97fa640 1 -- 172.21.15.57:0/2156994114 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b0005480 con 0x7f94a4004810 2024-04-24T23:39:07.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.861+0000 7f94c2cea640 1 -- 172.21.15.57:0/2156994114 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94bc1eceb0 con 0x7f94a4004810 2024-04-24T23:39:07.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.861+0000 7f94c2cea640 1 -- 172.21.15.57:0/2156994114 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94bc068220 con 0x7f94a4004810 2024-04-24T23:39:07.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.861+0000 7f94b97fa640 1 -- 172.21.15.57:0/2156994114 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f94b0003820 con 0x7f94a4004810 2024-04-24T23:39:07.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.861+0000 7f94b97fa640 1 --2- 172.21.15.57:0/2156994114 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f94a80678c0 0x7f94a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:07.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.861+0000 7f94b97fa640 1 -- 172.21.15.57:0/2156994114 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f94b0085dd0 con 0x7f94a4004810 2024-04-24T23:39:07.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.861+0000 7f94bbfff640 1 --2- 172.21.15.57:0/2156994114 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f94a80678c0 0x7f94a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:07.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.861+0000 7f94bbfff640 1 --2- 172.21.15.57:0/2156994114 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f94a80678c0 0x7f94a8069d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0ad000 tx=0x7f94ac0b2040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:07.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:07.865+0000 7f94b97fa640 1 -- 172.21.15.57:0/2156994114 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f94bc14fed0 con 0x7f94a4004810 2024-04-24T23:39:08.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.025+0000 7f94c2cea640 1 -- 172.21.15.57:0/2156994114 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f94bc1e8f80 con 0x7f94a4004810 2024-04-24T23:39:08.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.029+0000 7f94b97fa640 1 -- 172.21.15.57:0/2156994114 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7f94b00565d0 con 0x7f94a4004810 2024-04-24T23:39:08.030 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:39:08.030 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":24,"fsid":"1ea31698-444a-4667-bcd9-b2608ad103c3","created":"2024-04-24T23:38:16.748774+0000","modified":"2024-04-24T23:38:38.604475+0000","last_up_change":"2024-04-24T23:38:26.956537+0000","last_in_change":"2024-04-24T23:38:18.972175+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:38:27.611782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:38:31.718061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:38:32.469413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:38:36.215724+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"35ce67bc-9b25-416e-ab1e-774c717631f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6825","nonce":671364028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6827","nonce":671364028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6831","nonce":671364028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6829","nonce":671364028}]},"public_addr":"172.21.15.57:6825/671364028","cluster_addr":"172.21.15.57:6827/671364028","heartbeat_back_addr":"172.21.15.57:6831/671364028","heartbeat_front_addr":"172.21.15.57:6829/671364028","state":["exists","up"]},{"osd":1,"uuid":"38f6f4ef-3bc2-4453-9946-7d1d17e735ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6801","nonce":2653552037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6803","nonce":2653552037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6807","nonce":2653552037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6805","nonce":2653552037}]},"public_addr":"172.21.15.57:6801/2653552037","cluster_addr":"172.21.15.57:6803/2653552037","heartbeat_back_addr":"172.21.15.57:6807/2653552037","heartbeat_front_addr":"172.21.15.57:6805/2653552037","state":["exists","up"]},{"osd":2,"uuid":"d77a0a49-b39a-464e-a1c9-49e19280c440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6816","nonce":1565874109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6819","nonce":1565874109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6823","nonce":1565874109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6821","nonce":1565874109}]},"public_addr":"172.21.15.57:6816/1565874109","cluster_addr":"172.21.15.57:6819/1565874109","heartbeat_back_addr":"172.21.15.57:6823/1565874109","heartbeat_front_addr":"172.21.15.57:6821/1565874109","state":["exists","up"]},{"osd":3,"uuid":"f8ea9bfe-d839-44a6-a185-0f0985da314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6809","nonce":3474703186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6811","nonce":3474703186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6817","nonce":3474703186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6813","nonce":3474703186}]},"public_addr":"172.21.15.57:6809/3474703186","cluster_addr":"172.21.15.57:6811/3474703186","heartbeat_back_addr":"172.21.15.57:6817/3474703186","heartbeat_front_addr":"172.21.15.57:6813/3474703186","state":["exists","up"]},{"osd":4,"uuid":"454647d4-6ac2-46b4-8451-320eb951a87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6801","nonce":1271707713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6803","nonce":1271707713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6807","nonce":1271707713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6805","nonce":1271707713}]},"public_addr":"172.21.15.88:6801/1271707713","cluster_addr":"172.21.15.88:6803/1271707713","heartbeat_back_addr":"172.21.15.88:6807/1271707713","heartbeat_front_addr":"172.21.15.88:6805/1271707713","state":["exists","up"]},{"osd":5,"uuid":"f71c03a3-7ad8-46d3-89c9-d61de102586b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6809","nonce":2035054888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6813","nonce":2035054888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6820","nonce":2035054888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6816","nonce":2035054888}]},"public_addr":"172.21.15.88:6809/2035054888","cluster_addr":"172.21.15.88:6813/2035054888","heartbeat_back_addr":"172.21.15.88:6820/2035054888","heartbeat_front_addr":"172.21.15.88:6816/2035054888","state":["exists","up"]},{"osd":6,"uuid":"ec7ae2b7-9cb4-4059-8f98-0022c9763f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6825","nonce":1752291242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6827","nonce":1752291242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6831","nonce":1752291242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6829","nonce":1752291242}]},"public_addr":"172.21.15.88:6825/1752291242","cluster_addr":"172.21.15.88:6827/1752291242","heartbeat_back_addr":"172.21.15.88:6831/1752291242","heartbeat_front_addr":"172.21.15.88:6829/1752291242","state":["exists","up"]},{"osd":7,"uuid":"c0ee7505-60c1-40ba-9902-47313a04dafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6812","nonce":1782800372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6817","nonce":1782800372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6823","nonce":1782800372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6821","nonce":1782800372}]},"public_addr":"172.21.15.88:6812/1782800372","cluster_addr":"172.21.15.88:6817/1782800372","heartbeat_back_addr":"172.21.15.88:6823/1782800372","heartbeat_front_addr":"172.21.15.88:6821/1782800372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.698562+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.682587+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.680197+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.561753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.011095+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.493320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.353451+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.423877+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:39:08.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.029+0000 7f94c2cea640 1 -- 172.21.15.57:0/2156994114 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f94a80678c0 msgr2=0x7f94a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:08.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.029+0000 7f94c2cea640 1 --2- 172.21.15.57:0/2156994114 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f94a80678c0 0x7f94a8069d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0ad000 tx=0x7f94ac0b2040 comp rx=0 tx=0).stop 2024-04-24T23:39:08.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.029+0000 7f94c2cea640 1 -- 172.21.15.57:0/2156994114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94a4004810 msgr2=0x7f94bc14cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:08.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.029+0000 7f94c2cea640 1 --2- 172.21.15.57:0/2156994114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94a4004810 0x7f94bc14cc80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f94b000f5f0 tx=0x7f94b000fab0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.029+0000 7f94c2cea640 1 -- 172.21.15.57:0/2156994114 shutdown_connections 2024-04-24T23:39:08.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.029+0000 7f94c2cea640 1 --2- 172.21.15.57:0/2156994114 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f94a80678c0 0x7f94a8069d80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.029+0000 7f94c2cea640 1 --2- 172.21.15.57:0/2156994114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94bc0bb980 0x7f94bc0bbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.029+0000 7f94c2cea640 1 --2- 172.21.15.57:0/2156994114 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f94bc0c1630 0x7f94bc14f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.029+0000 7f94c2cea640 1 --2- 172.21.15.57:0/2156994114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94a4004810 0x7f94bc14cc80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.029+0000 7f94c2cea640 1 -- 172.21.15.57:0/2156994114 >> 172.21.15.57:0/2156994114 conn(0x7f94bc0beab0 msgr2=0x7f94bc071e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:08.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.029+0000 7f94c2cea640 1 -- 172.21.15.57:0/2156994114 shutdown_connections 2024-04-24T23:39:08.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.033+0000 7f94c2cea640 1 -- 172.21.15.57:0/2156994114 wait complete. 2024-04-24T23:39:08.048 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:39:08.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.165+0000 7fdc1c8f3640 1 Processor -- start 2024-04-24T23:39:08.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.165+0000 7fdc1c8f3640 1 -- start start 2024-04-24T23:39:08.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc1c8f3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdc18072980 0x7fdc180b7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:08.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc1c8f3640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc180b8fa0 con 0x7fdc1814ada0 2024-04-24T23:39:08.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc1c8f3640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc1806f260 con 0x7fdc180bde80 2024-04-24T23:39:08.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc1c8f3640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fdc18072e10 con 0x7fdc18072980 2024-04-24T23:39:08.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc1659c640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fdc1814ada0 0x7fdc1806eb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43674/0 (socket says 172.21.15.57:43674) 2024-04-24T23:39:08.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc1659c640 1 -- 172.21.15.57:0/114224482 learned_addr learned my addr 172.21.15.57:0/114224482 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:08.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc15d9b640 1 --2- 172.21.15.57:0/114224482 >> v2:172.21.15.88:3300/0 conn(0x7fdc18072980 0x7fdc180b7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:08.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc1559a640 1 -- 172.21.15.57:0/114224482 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1158353188 0 0) 0x7fdc180b8fa0 con 0x7fdc1814ada0 2024-04-24T23:39:08.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc1559a640 1 -- 172.21.15.57:0/114224482 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc00003530 con 0x7fdc1814ada0 2024-04-24T23:39:08.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc1559a640 1 -- 172.21.15.57:0/114224482 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2164064193 0 0) 0x7fdc00003530 con 0x7fdc1814ada0 2024-04-24T23:39:08.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc1559a640 1 -- 172.21.15.57:0/114224482 >> v2:172.21.15.88:3300/0 conn(0x7fdc18072980 msgr2=0x7fdc180b7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:08.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc1559a640 1 --2- 172.21.15.57:0/114224482 >> v2:172.21.15.88:3300/0 conn(0x7fdc18072980 0x7fdc180b7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc1559a640 1 -- 172.21.15.57:0/114224482 >> v1:172.21.15.88:6789/0 conn(0x7fdc180bde80 legacy=0x7fdc18157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:08.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc1559a640 1 -- 172.21.15.57:0/114224482 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc1814e0d0 con 0x7fdc1814ada0 2024-04-24T23:39:08.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc1559a640 1 -- 172.21.15.57:0/114224482 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7fdc08001a00 con 0x7fdc1814ada0 2024-04-24T23:39:08.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc1559a640 1 -- 172.21.15.57:0/114224482 >> v1:172.21.15.57:6789/0 conn(0x7fdc1814ada0 legacy=0x7fdc1806eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:08.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc1559a640 1 --2- 172.21.15.57:0/114224482 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdc00003a10 0x7fdc00003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:08.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc1559a640 1 --2- 172.21.15.57:0/114224482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc00004810 0x7fdc00004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:08.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc1559a640 1 --2- 172.21.15.57:0/114224482 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc00005220 0x7fdc0000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:08.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc1559a640 1 -- 172.21.15.57:0/114224482 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fdc18072e10 con 0x7fdc00005220 2024-04-24T23:39:08.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc1559a640 1 -- 172.21.15.57:0/114224482 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0000c170 con 0x7fdc00004810 2024-04-24T23:39:08.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc1559a640 1 -- 172.21.15.57:0/114224482 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fdc0000c370 con 0x7fdc00003a10 2024-04-24T23:39:08.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc16d9d640 1 --2- 172.21.15.57:0/114224482 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc00005220 0x7fdc0000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:08.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc15d9b640 1 --2- 172.21.15.57:0/114224482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc00004810 0x7fdc00004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:08.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc1659c640 1 --2- 172.21.15.57:0/114224482 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdc00003a10 0x7fdc00003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:08.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc16d9d640 1 -- 172.21.15.57:0/114224482 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdc00003a10 msgr2=0x7fdc00003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:08.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc16d9d640 1 --2- 172.21.15.57:0/114224482 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdc00003a10 0x7fdc00003e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc16d9d640 1 -- 172.21.15.57:0/114224482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc00004810 msgr2=0x7fdc00004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:08.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc16d9d640 1 --2- 172.21.15.57:0/114224482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc00004810 0x7fdc00004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc16d9d640 1 -- 172.21.15.57:0/114224482 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc00003530 con 0x7fdc00005220 2024-04-24T23:39:08.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc15d9b640 1 --2- 172.21.15.57:0/114224482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc00004810 0x7fdc00004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:39:08.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc16d9d640 1 -- 172.21.15.57:0/114224482 reap_dead start 2024-04-24T23:39:08.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc16d9d640 1 --2- 172.21.15.57:0/114224482 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc00005220 0x7fdc0000b9d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdc10001360 tx=0x7fdc1001e610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22177bbbdf1d289 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:08.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc1559a640 1 -- 172.21.15.57:0/114224482 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc100013a0 con 0x7fdc00005220 2024-04-24T23:39:08.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc1559a640 1 -- 172.21.15.57:0/114224482 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc100052d0 con 0x7fdc00005220 2024-04-24T23:39:08.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.169+0000 7fdc1559a640 1 -- 172.21.15.57:0/114224482 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc10003840 con 0x7fdc00005220 2024-04-24T23:39:08.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc1c8f3640 1 -- 172.21.15.57:0/114224482 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc00005220 msgr2=0x7fdc0000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:08.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc1c8f3640 1 --2- 172.21.15.57:0/114224482 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc00005220 0x7fdc0000b9d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdc10001360 tx=0x7fdc1001e610 comp rx=0 tx=0).stop 2024-04-24T23:39:08.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc1c8f3640 1 -- 172.21.15.57:0/114224482 shutdown_connections 2024-04-24T23:39:08.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc1c8f3640 1 --2- 172.21.15.57:0/114224482 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc00005220 0x7fdc0000b9d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc1c8f3640 1 -- 172.21.15.57:0/114224482 >> 172.21.15.57:0/114224482 conn(0x7fdc180beab0 msgr2=0x7fdc180beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:08.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc1c8f3640 1 -- 172.21.15.57:0/114224482 shutdown_connections 2024-04-24T23:39:08.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc1c8f3640 1 -- 172.21.15.57:0/114224482 wait complete. 2024-04-24T23:39:08.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc1c8f3640 1 Processor -- start 2024-04-24T23:39:08.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc1c8f3640 1 -- start start 2024-04-24T23:39:08.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc1c8f3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc00005220 0x7fdc181512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:08.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc1c8f3640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdc18150890 0x7fdc1814fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:08.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc1c8f3640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc181453a0 0x7fdc181e1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:08.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc1c8f3640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1814b300 con 0x7fdc181453a0 2024-04-24T23:39:08.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc1c8f3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1814b180 con 0x7fdc00005220 2024-04-24T23:39:08.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc1c8f3640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fdc180b7470 con 0x7fdc18150890 2024-04-24T23:39:08.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc16d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc181453a0 0x7fdc181e1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:08.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc16d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc181453a0 0x7fdc181e1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59938/0 (socket says 172.21.15.57:59938) 2024-04-24T23:39:08.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc16d9d640 1 -- 172.21.15.57:0/3749816045 learned_addr learned my addr 172.21.15.57:0/3749816045 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:08.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc1659c640 1 --2- 172.21.15.57:0/3749816045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc00005220 0x7fdc181512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:08.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc15d9b640 1 --2- 172.21.15.57:0/3749816045 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdc18150890 0x7fdc1814fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:08.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc16d9d640 1 -- 172.21.15.57:0/3749816045 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdc18150890 msgr2=0x7fdc1814fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:08.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc16d9d640 1 --2- 172.21.15.57:0/3749816045 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdc18150890 0x7fdc1814fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc16d9d640 1 -- 172.21.15.57:0/3749816045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc00005220 msgr2=0x7fdc181512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:08.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc16d9d640 1 --2- 172.21.15.57:0/3749816045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc00005220 0x7fdc181512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc16d9d640 1 -- 172.21.15.57:0/3749816045 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc18151820 con 0x7fdc181453a0 2024-04-24T23:39:08.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc1659c640 1 --2- 172.21.15.57:0/3749816045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc00005220 0x7fdc181512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:39:08.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc16d9d640 1 --2- 172.21.15.57:0/3749816045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc181453a0 0x7fdc181e1f20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdc1009a030 tx=0x7fdc00005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:08.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc06ffd640 1 -- 172.21.15.57:0/3749816045 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc10005480 con 0x7fdc181453a0 2024-04-24T23:39:08.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc06ffd640 1 -- 172.21.15.57:0/3749816045 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc10007240 con 0x7fdc181453a0 2024-04-24T23:39:08.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc1c8f3640 1 -- 172.21.15.57:0/3749816045 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc18146970 con 0x7fdc181453a0 2024-04-24T23:39:08.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc06ffd640 1 -- 172.21.15.57:0/3749816045 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc100075f0 con 0x7fdc181453a0 2024-04-24T23:39:08.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.173+0000 7fdc1c8f3640 1 -- 172.21.15.57:0/3749816045 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc181e5af0 con 0x7fdc181453a0 2024-04-24T23:39:08.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.177+0000 7fdc1c8f3640 1 -- 172.21.15.57:0/3749816045 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc18068220 con 0x7fdc181453a0 2024-04-24T23:39:08.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.177+0000 7fdc06ffd640 1 -- 172.21.15.57:0/3749816045 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdc100067e0 con 0x7fdc181453a0 2024-04-24T23:39:08.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.177+0000 7fdc06ffd640 1 --2- 172.21.15.57:0/3749816045 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fdbf80678c0 0x7fdbf8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:08.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.177+0000 7fdc06ffd640 1 -- 172.21.15.57:0/3749816045 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdc10121080 con 0x7fdc181453a0 2024-04-24T23:39:08.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.177+0000 7fdc1659c640 1 --2- 172.21.15.57:0/3749816045 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fdbf80678c0 0x7fdbf8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:08.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.177+0000 7fdc1659c640 1 --2- 172.21.15.57:0/3749816045 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fdbf80678c0 0x7fdbf8069d80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdc08001b70 tx=0x7fdc08001840 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:08.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.181+0000 7fdc06ffd640 1 -- 172.21.15.57:0/3749816045 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fdc10018320 con 0x7fdc181453a0 2024-04-24T23:39:08.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.373+0000 7fdc1c8f3640 1 -- 172.21.15.57:0/3749816045 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc18146c50 con 0x7fdc181453a0 2024-04-24T23:39:08.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.373+0000 7fdc06ffd640 1 -- 172.21.15.57:0/3749816045 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+4350 (secure 0 0 0) 0x7fdc100f1910 con 0x7fdc181453a0 2024-04-24T23:39:08.375 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:39:08.375 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2925410225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2925410225},{"type":"v1","addr":"172.21.15.88:6835","nonce":2925410225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4227,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/173597347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":173597347},{"type":"v1","addr":"172.21.15.57:6834","nonce":173597347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:38:33.449139+0000","modified":"2024-04-24T23:38:57.042000+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4230":{"gid":4230,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/1701414040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":1701414040},{"type":"v1","addr":"172.21.15.57:6835","nonce":1701414040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4230,"qdb_cluster":[4230]},"id":1}]} 2024-04-24T23:39:08.375 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 9 2024-04-24T23:39:08.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.377+0000 7fdc1c8f3640 1 -- 172.21.15.57:0/3749816045 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fdbf80678c0 msgr2=0x7fdbf8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:08.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.377+0000 7fdc1c8f3640 1 --2- 172.21.15.57:0/3749816045 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fdbf80678c0 0x7fdbf8069d80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdc08001b70 tx=0x7fdc08001840 comp rx=0 tx=0).stop 2024-04-24T23:39:08.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.377+0000 7fdc1c8f3640 1 -- 172.21.15.57:0/3749816045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc181453a0 msgr2=0x7fdc181e1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:08.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.377+0000 7fdc1c8f3640 1 --2- 172.21.15.57:0/3749816045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc181453a0 0x7fdc181e1f20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdc1009a030 tx=0x7fdc00005840 comp rx=0 tx=0).stop 2024-04-24T23:39:08.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.377+0000 7fdc1c8f3640 1 -- 172.21.15.57:0/3749816045 shutdown_connections 2024-04-24T23:39:08.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.377+0000 7fdc1c8f3640 1 --2- 172.21.15.57:0/3749816045 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fdbf80678c0 0x7fdbf8069d80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.377+0000 7fdc1c8f3640 1 --2- 172.21.15.57:0/3749816045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc181453a0 0x7fdc181e1f20 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.377+0000 7fdc1c8f3640 1 --2- 172.21.15.57:0/3749816045 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdc18150890 0x7fdc1814fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.377+0000 7fdc1c8f3640 1 --2- 172.21.15.57:0/3749816045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc00005220 0x7fdc181512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.377+0000 7fdc1c8f3640 1 -- 172.21.15.57:0/3749816045 >> 172.21.15.57:0/3749816045 conn(0x7fdc180beab0 msgr2=0x7fdc18071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:08.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.377+0000 7fdc1c8f3640 1 -- 172.21.15.57:0/3749816045 shutdown_connections 2024-04-24T23:39:08.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.377+0000 7fdc1c8f3640 1 -- 172.21.15.57:0/3749816045 wait complete. 2024-04-24T23:39:08.695 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-24T23:38:33.449139+0000', 'modified': '2024-04-24T23:38:57.042000+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4230}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4230': {'gid': 4230, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/1701414040', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 1701414040}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 1701414040}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4230, 'qdb_cluster': [4230]} 2024-04-24T23:39:08.695 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-24T23:39:08.695 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-24T23:39:08.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.825+0000 7fad5e4c9640 1 Processor -- start 2024-04-24T23:39:08.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.825+0000 7fad5e4c9640 1 -- start start 2024-04-24T23:39:08.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.825+0000 7fad5e4c9640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fad5814bdc0 0x7fad580bc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:08.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.825+0000 7fad5e4c9640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad580b7ae0 con 0x7fad580b7230 2024-04-24T23:39:08.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.825+0000 7fad5e4c9640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad5814c1a0 con 0x7fad580b6e10 2024-04-24T23:39:08.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.825+0000 7fad5e4c9640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fad5814f470 con 0x7fad5814bdc0 2024-04-24T23:39:08.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.825+0000 7fad5ca66640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fad580b7230 0x7fad5806e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43690/0 (socket says 172.21.15.57:43690) 2024-04-24T23:39:08.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.825+0000 7fad5ca66640 1 -- 172.21.15.57:0/528790698 learned_addr learned my addr 172.21.15.57:0/528790698 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:08.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.825+0000 7fad57fff640 1 --2- 172.21.15.57:0/528790698 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fad5814bdc0 0x7fad580bc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:08.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.825+0000 7fad56ffd640 1 -- 172.21.15.57:0/528790698 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2376938852 0 0) 0x7fad580b7ae0 con 0x7fad580b7230 2024-04-24T23:39:08.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.825+0000 7fad56ffd640 1 -- 172.21.15.57:0/528790698 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad40003530 con 0x7fad580b7230 2024-04-24T23:39:08.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.825+0000 7fad56ffd640 1 -- 172.21.15.57:0/528790698 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1098882810 0 0) 0x7fad5814c1a0 con 0x7fad580b6e10 2024-04-24T23:39:08.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.825+0000 7fad56ffd640 1 -- 172.21.15.57:0/528790698 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad580b7ae0 con 0x7fad580b6e10 2024-04-24T23:39:08.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.825+0000 7fad56ffd640 1 -- 172.21.15.57:0/528790698 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 906786033 0 0) 0x7fad40003530 con 0x7fad580b7230 2024-04-24T23:39:08.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.825+0000 7fad56ffd640 1 -- 172.21.15.57:0/528790698 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fad5814bdc0 msgr2=0x7fad580bc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:08.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.825+0000 7fad56ffd640 1 --2- 172.21.15.57:0/528790698 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fad5814bdc0 0x7fad580bc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.825+0000 7fad56ffd640 1 -- 172.21.15.57:0/528790698 >> v1:172.21.15.88:6789/0 conn(0x7fad580b6e10 legacy=0x7fad5806dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:08.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.829+0000 7fad56ffd640 1 -- 172.21.15.57:0/528790698 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad5806f3c0 con 0x7fad580b7230 2024-04-24T23:39:08.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.829+0000 7fad56ffd640 1 -- 172.21.15.57:0/528790698 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7fad50001a00 con 0x7fad580b7230 2024-04-24T23:39:08.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.829+0000 7fad56ffd640 1 -- 172.21.15.57:0/528790698 >> v1:172.21.15.57:6789/0 conn(0x7fad580b7230 legacy=0x7fad5806e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:08.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.829+0000 7fad56ffd640 1 --2- 172.21.15.57:0/528790698 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad40003b80 0x7fad40003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:08.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.829+0000 7fad56ffd640 1 --2- 172.21.15.57:0/528790698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad40004810 0x7fad40004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:08.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.829+0000 7fad56ffd640 1 --2- 172.21.15.57:0/528790698 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fad5814bdc0 0x7fad40005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:08.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.829+0000 7fad56ffd640 1 -- 172.21.15.57:0/528790698 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fad4000bb60 con 0x7fad40004810 2024-04-24T23:39:08.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.829+0000 7fad56ffd640 1 -- 172.21.15.57:0/528790698 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fad4000bce0 con 0x7fad40003b80 2024-04-24T23:39:08.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.829+0000 7fad56ffd640 1 -- 172.21.15.57:0/528790698 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fad4000beb0 con 0x7fad5814bdc0 2024-04-24T23:39:08.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.829+0000 7fad577fe640 1 --2- 172.21.15.57:0/528790698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad40004810 0x7fad40004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:08.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.829+0000 7fad57fff640 1 --2- 172.21.15.57:0/528790698 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad40003b80 0x7fad40003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:08.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.829+0000 7fad5ca66640 1 --2- 172.21.15.57:0/528790698 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fad5814bdc0 0x7fad40005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:08.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.829+0000 7fad577fe640 1 -- 172.21.15.57:0/528790698 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fad5814bdc0 msgr2=0x7fad40005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:08.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.829+0000 7fad577fe640 1 --2- 172.21.15.57:0/528790698 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fad5814bdc0 0x7fad40005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.829+0000 7fad577fe640 1 -- 172.21.15.57:0/528790698 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad40003b80 msgr2=0x7fad40003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:08.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.829+0000 7fad577fe640 1 --2- 172.21.15.57:0/528790698 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad40003b80 0x7fad40003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.829+0000 7fad577fe640 1 -- 172.21.15.57:0/528790698 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad40003530 con 0x7fad40004810 2024-04-24T23:39:08.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.829+0000 7fad577fe640 1 --2- 172.21.15.57:0/528790698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad40004810 0x7fad40004c90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fad4c001900 tx=0x7fad4c01c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b885d8d154a6ab86 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:08.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.829+0000 7fad56ffd640 1 -- 172.21.15.57:0/528790698 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4c001520 con 0x7fad40004810 2024-04-24T23:39:08.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.829+0000 7fad56ffd640 1 -- 172.21.15.57:0/528790698 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad4c0050d0 con 0x7fad40004810 2024-04-24T23:39:08.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.829+0000 7fad56ffd640 1 -- 172.21.15.57:0/528790698 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4c0054a0 con 0x7fad40004810 2024-04-24T23:39:08.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.829+0000 7fad5e4c9640 1 -- 172.21.15.57:0/528790698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad40004810 msgr2=0x7fad40004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:08.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.829+0000 7fad5e4c9640 1 --2- 172.21.15.57:0/528790698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad40004810 0x7fad40004c90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fad4c001900 tx=0x7fad4c01c580 comp rx=0 tx=0).stop 2024-04-24T23:39:08.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.829+0000 7fad5ca66640 1 -- 172.21.15.57:0/528790698 reap_dead start 2024-04-24T23:39:08.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.829+0000 7fad5e4c9640 1 -- 172.21.15.57:0/528790698 shutdown_connections 2024-04-24T23:39:08.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.829+0000 7fad5e4c9640 1 -- 172.21.15.57:0/528790698 >> 172.21.15.57:0/528790698 conn(0x7fad580be8f0 msgr2=0x7fad580bed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:08.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.829+0000 7fad5e4c9640 1 -- 172.21.15.57:0/528790698 shutdown_connections 2024-04-24T23:39:08.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.829+0000 7fad5e4c9640 1 -- 172.21.15.57:0/528790698 wait complete. 2024-04-24T23:39:08.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.833+0000 7fad5e4c9640 1 Processor -- start 2024-04-24T23:39:08.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.833+0000 7fad5e4c9640 1 -- start start 2024-04-24T23:39:08.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.833+0000 7fad5e4c9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad40004810 0x7fad58142330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:08.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.833+0000 7fad5e4c9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad580c1040 0x7fad580bffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:08.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.833+0000 7fad5e4c9640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fad580c0500 0x7fad581e9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:08.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.833+0000 7fad5e4c9640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fad580b7890 con 0x7fad40004810 2024-04-24T23:39:08.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.833+0000 7fad5e4c9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fad580a70f0 con 0x7fad580c1040 2024-04-24T23:39:08.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.833+0000 7fad5e4c9640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fad580b7dc0 con 0x7fad580c0500 2024-04-24T23:39:08.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.833+0000 7fad57fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad40004810 0x7fad58142330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:08.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.833+0000 7fad57fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad40004810 0x7fad58142330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59954/0 (socket says 172.21.15.57:59954) 2024-04-24T23:39:08.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.833+0000 7fad57fff640 1 -- 172.21.15.57:0/2485824004 learned_addr learned my addr 172.21.15.57:0/2485824004 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:08.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.833+0000 7fad577fe640 1 --2- 172.21.15.57:0/2485824004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad580c1040 0x7fad580bffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:08.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.833+0000 7fad5ca66640 1 --2- 172.21.15.57:0/2485824004 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fad580c0500 0x7fad581e9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:08.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.833+0000 7fad57fff640 1 -- 172.21.15.57:0/2485824004 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fad580c0500 msgr2=0x7fad581e9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:08.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.833+0000 7fad57fff640 1 --2- 172.21.15.57:0/2485824004 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fad580c0500 0x7fad581e9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.833+0000 7fad57fff640 1 -- 172.21.15.57:0/2485824004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad580c1040 msgr2=0x7fad580bffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:08.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.833+0000 7fad57fff640 1 --2- 172.21.15.57:0/2485824004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad580c1040 0x7fad580bffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.833+0000 7fad57fff640 1 -- 172.21.15.57:0/2485824004 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad580bf9e0 con 0x7fad40004810 2024-04-24T23:39:08.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.833+0000 7fad57fff640 1 --2- 172.21.15.57:0/2485824004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad40004810 0x7fad58142330 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fad48011640 tx=0x7fad48011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:08.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.833+0000 7fad54ff9640 1 -- 172.21.15.57:0/2485824004 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4800f920 con 0x7fad40004810 2024-04-24T23:39:08.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.833+0000 7fad54ff9640 1 -- 172.21.15.57:0/2485824004 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad4800fac0 con 0x7fad40004810 2024-04-24T23:39:08.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.833+0000 7fad5e4c9640 1 -- 172.21.15.57:0/2485824004 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad580c0980 con 0x7fad40004810 2024-04-24T23:39:08.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.833+0000 7fad54ff9640 1 -- 172.21.15.57:0/2485824004 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4800fe70 con 0x7fad40004810 2024-04-24T23:39:08.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.833+0000 7fad5e4c9640 1 -- 172.21.15.57:0/2485824004 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad581447b0 con 0x7fad40004810 2024-04-24T23:39:08.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad61642000 1 Processor -- start 2024-04-24T23:39:08.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad61642000 1 -- start start 2024-04-24T23:39:08.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad54ff9640 1 -- 172.21.15.57:0/2485824004 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fad48015460 con 0x7fad40004810 2024-04-24T23:39:08.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad61642000 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565486e2db80 0x565486e2df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:08.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad61642000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565486e2e4a0 0x565486e2e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:08.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad61642000 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x565486e2edc0 0x565486e73a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:08.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad61642000 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x565486c7e5e0 con 0x565486e2db80 2024-04-24T23:39:08.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad61642000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x565486c05c50 con 0x565486e2e4a0 2024-04-24T23:39:08.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad61642000 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x565486c7a5a0 con 0x565486e2edc0 2024-04-24T23:39:08.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad5ca66640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565486e2db80 0x565486e2df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:08.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad5ca66640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565486e2db80 0x565486e2df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59956/0 (socket says 172.21.15.57:59956) 2024-04-24T23:39:08.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad5ca66640 1 -- 172.21.15.57:0/4270982025 learned_addr learned my addr 172.21.15.57:0/4270982025 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:08.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad57fff640 1 --2- 172.21.15.57:0/4270982025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565486e2e4a0 0x565486e2e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:08.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad577fe640 1 --2- 172.21.15.57:0/4270982025 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x565486e2edc0 0x565486e73a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:08.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad54ff9640 1 --2- 172.21.15.57:0/2485824004 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fad440678c0 0x7fad44069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:08.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad5ca66640 1 -- 172.21.15.57:0/4270982025 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x565486e2edc0 msgr2=0x565486e73a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:08.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad5ca66640 1 --2- 172.21.15.57:0/4270982025 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x565486e2edc0 0x565486e73a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad5ca66640 1 -- 172.21.15.57:0/4270982025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565486e2e4a0 msgr2=0x565486e2e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:08.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad5ca66640 1 --2- 172.21.15.57:0/4270982025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565486e2e4a0 0x565486e2e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad5ca66640 1 -- 172.21.15.57:0/4270982025 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565486c03d10 con 0x565486e2db80 2024-04-24T23:39:08.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad54ff9640 1 -- 172.21.15.57:0/2485824004 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fad48086840 con 0x7fad40004810 2024-04-24T23:39:08.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad5ca66640 1 --2- 172.21.15.57:0/4270982025 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565486e2db80 0x565486e2df60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fad580be6d0 tx=0x7fad50005f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf1411af20e5434 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:08.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad5ca66640 1 --2- 172.21.15.57:0/2485824004 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fad440678c0 0x7fad44069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:08.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad3dffb640 1 -- 172.21.15.57:0/4270982025 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad500077c0 con 0x565486e2db80 2024-04-24T23:39:08.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad3dffb640 1 -- 172.21.15.57:0/4270982025 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad50019020 con 0x565486e2db80 2024-04-24T23:39:08.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad3dffb640 1 -- 172.21.15.57:0/4270982025 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad500079a0 con 0x565486e2db80 2024-04-24T23:39:08.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad5ca66640 1 --2- 172.21.15.57:0/2485824004 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fad440678c0 0x7fad44069d80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fad5001a000 tx=0x7fad50015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:08.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad61642000 1 -- 172.21.15.57:0/4270982025 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565486e2db80 msgr2=0x565486e2df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:08.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad61642000 1 --2- 172.21.15.57:0/4270982025 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565486e2db80 0x565486e2df60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fad580be6d0 tx=0x7fad50005f50 comp rx=0 tx=0).stop 2024-04-24T23:39:08.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad61642000 1 -- 172.21.15.57:0/4270982025 shutdown_connections 2024-04-24T23:39:08.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad61642000 1 --2- 172.21.15.57:0/4270982025 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x565486e2edc0 0x565486e73a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad61642000 1 --2- 172.21.15.57:0/4270982025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565486e2e4a0 0x565486e2e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad61642000 1 --2- 172.21.15.57:0/4270982025 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565486e2db80 0x565486e2df60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad61642000 1 -- 172.21.15.57:0/4270982025 >> 172.21.15.57:0/4270982025 conn(0x565486e677a0 msgr2=0x565486e69bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:08.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad61642000 1 -- 172.21.15.57:0/4270982025 shutdown_connections 2024-04-24T23:39:08.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad61642000 1 -- 172.21.15.57:0/4270982025 wait complete. 2024-04-24T23:39:08.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad61642000 1 -- start start 2024-04-24T23:39:08.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.837+0000 7fad61642000 1 Processor -- start 2024-04-24T23:39:08.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad61642000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565486e2db80 0x565486e35ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:08.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad61642000 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x565486e2e4a0 0x565486e33f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:08.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad61642000 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565486e2edc0 0x565486e34450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:08.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad61642000 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x565486c82c10 con 0x565486e2edc0 2024-04-24T23:39:08.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad61642000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x565486c38520 con 0x565486e2db80 2024-04-24T23:39:08.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad61642000 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x565486c4b340 con 0x565486e2e4a0 2024-04-24T23:39:08.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad61642000 10 client.0 _ll_register_callbacks cb 0x565486e1b5c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:39:08.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad5ca66640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565486e2edc0 0x565486e34450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:08.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad5ca66640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565486e2edc0 0x565486e34450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59970/0 (socket says 172.21.15.57:59970) 2024-04-24T23:39:08.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad5ca66640 1 -- 172.21.15.57:0/1365461686 learned_addr learned my addr 172.21.15.57:0/1365461686 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:08.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad57fff640 1 --2- 172.21.15.57:0/1365461686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565486e2db80 0x565486e35ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:08.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad577fe640 1 --2- 172.21.15.57:0/1365461686 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x565486e2e4a0 0x565486e33f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:08.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad5ca66640 1 -- 172.21.15.57:0/1365461686 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x565486e2e4a0 msgr2=0x565486e33f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:08.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad5ca66640 1 --2- 172.21.15.57:0/1365461686 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x565486e2e4a0 0x565486e33f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad5ca66640 1 -- 172.21.15.57:0/1365461686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565486e2db80 msgr2=0x565486e35ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:08.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad5ca66640 1 --2- 172.21.15.57:0/1365461686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565486e2db80 0x565486e35ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad5ca66640 1 -- 172.21.15.57:0/1365461686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565486c167b0 con 0x565486e2edc0 2024-04-24T23:39:08.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad5ca66640 1 --2- 172.21.15.57:0/1365461686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565486e2edc0 0x565486e34450 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fad50022860 tx=0x7fad50001d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6be43d20fbe38c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:08.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad36ffd640 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2024-04-24T23:39:08.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad36ffd640 1 -- 172.21.15.57:0/1365461686 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5002f070 con 0x565486e2edc0 2024-04-24T23:39:08.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad36ffd640 1 -- 172.21.15.57:0/1365461686 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fad50022b50 con 0x565486e2edc0 2024-04-24T23:39:08.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad61642000 1 -- 172.21.15.57:0/1365461686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad50019020 con 0x565486e2edc0 2024-04-24T23:39:08.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad36ffd640 1 -- 172.21.15.57:0/1365461686 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fad50018070 con 0x565486e2edc0 2024-04-24T23:39:08.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad61642000 10 client.4794 fetch_fsmap learned FSMap version 9 2024-04-24T23:39:08.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad61642000 1 -- 172.21.15.57:0/1365461686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x565486c05ea0 con 0x565486e2edc0 2024-04-24T23:39:08.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad36ffd640 1 -- 172.21.15.57:0/1365461686 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad50019020 con 0x565486e2edc0 2024-04-24T23:39:08.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad36ffd640 1 -- 172.21.15.57:0/1365461686 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 9) ==== 2897+0+0 (secure 0 0 0) 0x7fad50028040 con 0x565486e2edc0 2024-04-24T23:39:08.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad61642000 10 client.4794 fetch_fsmap finished waiting for FSMap version 9 2024-04-24T23:39:08.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad61642000 10 client.4794 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-24T23:39:08.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad61642000 20 client.4794 populate_metadata read hostname 'smithi057' 2024-04-24T23:39:08.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad61642000 1 --2- 172.21.15.57:0/1365461686 >> [v2:172.21.15.57:6833/1701414040,v1:172.21.15.57:6835/1701414040] conn(0x565486e34e60 0x565486e35240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:08.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad61642000 4 client.4794 mds_command: new command op to 4230 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-24T23:39:08.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad61642000 1 -- 172.21.15.57:0/1365461686 --> [v2:172.21.15.57:6833/1701414040,v1:172.21.15.57:6835/1701414040] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565486c19ab0 con 0x565486e34e60 2024-04-24T23:39:08.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad57fff640 1 --2- 172.21.15.57:0/1365461686 >> [v2:172.21.15.57:6833/1701414040,v1:172.21.15.57:6835/1701414040] conn(0x565486e34e60 0x565486e35240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:08.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad57fff640 1 --2- 172.21.15.57:0/1365461686 >> [v2:172.21.15.57:6833/1701414040,v1:172.21.15.57:6835/1701414040] conn(0x565486e34e60 0x565486e35240 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ae29e777c9abb56 server_cookie=c5959e812d5f2f73 in_seq=0 out_seq=0 2024-04-24T23:39:08.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad36ffd640 10 client.4794 ms_handle_connect on v2:172.21.15.57:6833/1701414040 2024-04-24T23:39:08.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad36ffd640 1 -- 172.21.15.57:0/1365461686 <== mds.0 v2:172.21.15.57:6833/1701414040 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x565486c19ab0 con 0x565486e34e60 2024-04-24T23:39:08.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad36ffd640 10 client.4794 handle_command_reply: tid=0 2024-04-24T23:39:08.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad61642000 1 client.4794 shutdown 2024-04-24T23:39:08.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad61642000 1 -- 172.21.15.57:0/1365461686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565486e2edc0 msgr2=0x565486e34450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:08.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad61642000 1 --2- 172.21.15.57:0/1365461686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565486e2edc0 0x565486e34450 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fad50022860 tx=0x7fad50001d00 comp rx=0 tx=0).stop 2024-04-24T23:39:08.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad61642000 1 -- 172.21.15.57:0/1365461686 shutdown_connections 2024-04-24T23:39:08.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad61642000 1 --2- 172.21.15.57:0/1365461686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565486e2edc0 0x565486e34450 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad61642000 1 --2- 172.21.15.57:0/1365461686 >> [v2:172.21.15.57:6833/1701414040,v1:172.21.15.57:6835/1701414040] conn(0x565486e34e60 0x565486e35240 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad61642000 1 --2- 172.21.15.57:0/1365461686 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x565486e2e4a0 0x565486e33f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad61642000 1 --2- 172.21.15.57:0/1365461686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565486e2db80 0x565486e35ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad36ffd640 0 client.4794 ms_handle_reset on v2:172.21.15.57:6833/1701414040 2024-04-24T23:39:08.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad61642000 1 -- 172.21.15.57:0/1365461686 >> 172.21.15.57:0/1365461686 conn(0x565486e677a0 msgr2=0x565486e2d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:08.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad61642000 1 -- 172.21.15.57:0/1365461686 shutdown_connections 2024-04-24T23:39:08.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad61642000 1 -- 172.21.15.57:0/1365461686 wait complete. 2024-04-24T23:39:08.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.841+0000 7fad61642000 20 client.4794 trim_cache size 0 max 16384 2024-04-24T23:39:08.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad61642000 1 Processor -- start 2024-04-24T23:39:08.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad61642000 1 -- start start 2024-04-24T23:39:08.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad61642000 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565486e2db80 0x565486e33a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:08.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad61642000 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x565486e2e4a0 0x565486e83e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:08.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad61642000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565486e2edc0 0x565486e84350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:08.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad61642000 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fad581f7520 con 0x565486e2db80 2024-04-24T23:39:08.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad61642000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fad581f6030 con 0x565486e2edc0 2024-04-24T23:39:08.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad61642000 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fad581f6680 con 0x565486e2e4a0 2024-04-24T23:39:08.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad57fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565486e2db80 0x565486e33a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:08.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad57fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565486e2db80 0x565486e33a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59978/0 (socket says 172.21.15.57:59978) 2024-04-24T23:39:08.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad57fff640 1 -- 172.21.15.57:0/3615917189 learned_addr learned my addr 172.21.15.57:0/3615917189 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:08.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad5ca66640 1 --2- 172.21.15.57:0/3615917189 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565486e2edc0 0x565486e84350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:08.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad57fff640 1 -- 172.21.15.57:0/3615917189 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x565486e2e4a0 msgr2=0x565486e83e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:08.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad57fff640 1 --2- 172.21.15.57:0/3615917189 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x565486e2e4a0 0x565486e83e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad57fff640 1 -- 172.21.15.57:0/3615917189 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565486e2edc0 msgr2=0x565486e84350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:08.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad57fff640 1 --2- 172.21.15.57:0/3615917189 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565486e2edc0 0x565486e84350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad57fff640 1 -- 172.21.15.57:0/3615917189 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565486c06e80 con 0x565486e2db80 2024-04-24T23:39:08.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad57fff640 1 --2- 172.21.15.57:0/3615917189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565486e2db80 0x565486e33a20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fad48010010 tx=0x7fad48084990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c3da9f237f462f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:08.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad3d7fa640 1 -- 172.21.15.57:0/3615917189 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4806ae60 con 0x565486e2db80 2024-04-24T23:39:08.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad3d7fa640 1 -- 172.21.15.57:0/3615917189 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad48084e50 con 0x565486e2db80 2024-04-24T23:39:08.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad3d7fa640 1 -- 172.21.15.57:0/3615917189 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad480569d0 con 0x565486e2db80 2024-04-24T23:39:08.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad61642000 1 -- 172.21.15.57:0/3615917189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565486e2db80 msgr2=0x565486e33a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:08.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad61642000 1 --2- 172.21.15.57:0/3615917189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565486e2db80 0x565486e33a20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fad48010010 tx=0x7fad48084990 comp rx=0 tx=0).stop 2024-04-24T23:39:08.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad61642000 1 -- 172.21.15.57:0/3615917189 shutdown_connections 2024-04-24T23:39:08.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad61642000 1 --2- 172.21.15.57:0/3615917189 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565486e2edc0 0x565486e84350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad61642000 1 --2- 172.21.15.57:0/3615917189 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x565486e2e4a0 0x565486e83e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad61642000 1 --2- 172.21.15.57:0/3615917189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565486e2db80 0x565486e33a20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad61642000 1 -- 172.21.15.57:0/3615917189 >> 172.21.15.57:0/3615917189 conn(0x565486e677a0 msgr2=0x565486e33310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:08.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad61642000 1 -- 172.21.15.57:0/3615917189 shutdown_connections 2024-04-24T23:39:08.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad61642000 1 -- 172.21.15.57:0/3615917189 wait complete. 2024-04-24T23:39:08.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad61642000 1 -- start start 2024-04-24T23:39:08.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.861+0000 7fad61642000 1 Processor -- start 2024-04-24T23:39:08.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad61642000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565486e2db80 0x565486e833f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:08.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad61642000 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565486e2e4a0 0x565486e83b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:08.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad61642000 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x565486e2edc0 0x565486e840d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:08.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad61642000 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x565486e39250 con 0x565486e2e4a0 2024-04-24T23:39:08.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad61642000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x565486c7d8f0 con 0x565486e2db80 2024-04-24T23:39:08.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad61642000 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x565486c82c10 con 0x565486e2edc0 2024-04-24T23:39:08.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad61642000 10 client.0 _ll_register_callbacks cb 0x7fad500018b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:39:08.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad577fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565486e2e4a0 0x565486e83b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:08.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad577fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565486e2e4a0 0x565486e83b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59984/0 (socket says 172.21.15.57:59984) 2024-04-24T23:39:08.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad577fe640 1 -- 172.21.15.57:0/624539836 learned_addr learned my addr 172.21.15.57:0/624539836 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:08.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad57fff640 1 --2- 172.21.15.57:0/624539836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565486e2db80 0x565486e833f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:08.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad577fe640 1 -- 172.21.15.57:0/624539836 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x565486e2edc0 msgr2=0x565486e840d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:08.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad5ca66640 1 --2- 172.21.15.57:0/624539836 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x565486e2edc0 0x565486e840d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:08.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad577fe640 1 --2- 172.21.15.57:0/624539836 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x565486e2edc0 0x565486e840d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad577fe640 1 -- 172.21.15.57:0/624539836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565486e2db80 msgr2=0x565486e833f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:08.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad577fe640 1 --2- 172.21.15.57:0/624539836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565486e2db80 0x565486e833f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad577fe640 1 -- 172.21.15.57:0/624539836 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565486c4b760 con 0x565486e2e4a0 2024-04-24T23:39:08.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad57fff640 1 --2- 172.21.15.57:0/624539836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565486e2db80 0x565486e833f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:39:08.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad577fe640 1 --2- 172.21.15.57:0/624539836 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565486e2e4a0 0x565486e83b90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fad4c0ae040 tx=0x7fad40005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb646f78f016e791 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:08.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad36ffd640 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2024-04-24T23:39:08.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad36ffd640 1 -- 172.21.15.57:0/624539836 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4c0bc070 con 0x565486e2e4a0 2024-04-24T23:39:08.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad36ffd640 1 -- 172.21.15.57:0/624539836 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fad4c0a9040 con 0x565486e2e4a0 2024-04-24T23:39:08.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad61642000 1 -- 172.21.15.57:0/624539836 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad48084e50 con 0x565486e2e4a0 2024-04-24T23:39:08.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad36ffd640 1 -- 172.21.15.57:0/624539836 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fad4c0c7050 con 0x565486e2e4a0 2024-04-24T23:39:08.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad61642000 10 client.4800 fetch_fsmap learned FSMap version 9 2024-04-24T23:39:08.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad61642000 1 -- 172.21.15.57:0/624539836 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x565486cd79e0 con 0x565486e2e4a0 2024-04-24T23:39:08.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad36ffd640 1 -- 172.21.15.57:0/624539836 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad48084e50 con 0x565486e2e4a0 2024-04-24T23:39:08.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad36ffd640 1 -- 172.21.15.57:0/624539836 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 9) ==== 2897+0+0 (secure 0 0 0) 0x7fad4c0ca020 con 0x565486e2e4a0 2024-04-24T23:39:08.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad61642000 10 client.4800 fetch_fsmap finished waiting for FSMap version 9 2024-04-24T23:39:08.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad61642000 10 client.4800 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-24T23:39:08.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad61642000 20 client.4800 populate_metadata read hostname 'smithi057' 2024-04-24T23:39:08.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad61642000 1 --2- 172.21.15.57:0/624539836 >> [v2:172.21.15.57:6833/1701414040,v1:172.21.15.57:6835/1701414040] conn(0x565486ea6480 0x565486ea6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:08.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad61642000 4 client.4800 mds_command: new command op to 4230 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-24T23:39:08.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad61642000 1 -- 172.21.15.57:0/624539836 --> [v2:172.21.15.57:6833/1701414040,v1:172.21.15.57:6835/1701414040] -- command(tid 0: {"prefix": "status"}) -- 0x565486c8bb20 con 0x565486ea6480 2024-04-24T23:39:08.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad57fff640 1 --2- 172.21.15.57:0/624539836 >> [v2:172.21.15.57:6833/1701414040,v1:172.21.15.57:6835/1701414040] conn(0x565486ea6480 0x565486ea6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:08.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad57fff640 1 --2- 172.21.15.57:0/624539836 >> [v2:172.21.15.57:6833/1701414040,v1:172.21.15.57:6835/1701414040] conn(0x565486ea6480 0x565486ea6860 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec42fa861192c137 server_cookie=a96b252f4d02878e in_seq=0 out_seq=0 2024-04-24T23:39:08.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad36ffd640 10 client.4800 ms_handle_connect on v2:172.21.15.57:6833/1701414040 2024-04-24T23:39:08.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad36ffd640 1 -- 172.21.15.57:0/624539836 <== mds.0 v2:172.21.15.57:6833/1701414040 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x565486c8bb20 con 0x565486ea6480 2024-04-24T23:39:08.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad36ffd640 10 client.4800 handle_command_reply: tid=0 2024-04-24T23:39:08.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad61642000 1 client.4800 shutdown 2024-04-24T23:39:08.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad61642000 1 -- 172.21.15.57:0/624539836 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565486e2e4a0 msgr2=0x565486e83b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:08.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad61642000 1 --2- 172.21.15.57:0/624539836 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565486e2e4a0 0x565486e83b90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fad4c0ae040 tx=0x7fad40005840 comp rx=0 tx=0).stop 2024-04-24T23:39:08.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad61642000 1 -- 172.21.15.57:0/624539836 shutdown_connections 2024-04-24T23:39:08.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad61642000 1 --2- 172.21.15.57:0/624539836 >> [v2:172.21.15.57:6833/1701414040,v1:172.21.15.57:6835/1701414040] conn(0x565486ea6480 0x565486ea6860 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad61642000 1 --2- 172.21.15.57:0/624539836 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x565486e2edc0 0x565486e840d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad61642000 1 --2- 172.21.15.57:0/624539836 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x565486e2e4a0 0x565486e83b90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad36ffd640 0 client.4800 ms_handle_reset on v2:172.21.15.57:6833/1701414040 2024-04-24T23:39:08.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad61642000 1 --2- 172.21.15.57:0/624539836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x565486e2db80 0x565486e833f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad61642000 1 -- 172.21.15.57:0/624539836 >> 172.21.15.57:0/624539836 conn(0x565486e677a0 msgr2=0x565486e33a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:08.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad61642000 1 -- 172.21.15.57:0/624539836 shutdown_connections 2024-04-24T23:39:08.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad61642000 1 -- 172.21.15.57:0/624539836 wait complete. 2024-04-24T23:39:08.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad61642000 20 client.4800 trim_cache size 0 max 16384 2024-04-24T23:39:08.873 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-24T23:39:08.873 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "1ea31698-444a-4667-bcd9-b2608ad103c3", 2024-04-24T23:39:08.873 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 0, 2024-04-24T23:39:08.873 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 4230, 2024-04-24T23:39:08.873 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2024-04-24T23:39:08.873 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2024-04-24T23:39:08.873 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2024-04-24T23:39:08.873 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 34.711738226999998, 2024-04-24T23:39:08.873 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 9, 2024-04-24T23:39:08.874 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 24, 2024-04-24T23:39:08.874 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 24, 2024-04-24T23:39:08.874 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 41.424457054999998 2024-04-24T23:39:08.874 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-24T23:39:08.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad5e4c9640 1 -- 172.21.15.57:0/2485824004 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fad440678c0 msgr2=0x7fad44069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:08.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad5e4c9640 1 --2- 172.21.15.57:0/2485824004 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fad440678c0 0x7fad44069d80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fad5001a000 tx=0x7fad50015000 comp rx=0 tx=0).stop 2024-04-24T23:39:08.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad5e4c9640 1 -- 172.21.15.57:0/2485824004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad40004810 msgr2=0x7fad58142330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:08.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad5e4c9640 1 --2- 172.21.15.57:0/2485824004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad40004810 0x7fad58142330 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fad48011640 tx=0x7fad48011b00 comp rx=0 tx=0).stop 2024-04-24T23:39:08.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad5e4c9640 1 -- 172.21.15.57:0/2485824004 shutdown_connections 2024-04-24T23:39:08.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad5e4c9640 1 --2- 172.21.15.57:0/2485824004 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fad440678c0 0x7fad44069d80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad5e4c9640 1 --2- 172.21.15.57:0/2485824004 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fad580c0500 0x7fad581e9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad5e4c9640 1 --2- 172.21.15.57:0/2485824004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad580c1040 0x7fad580bffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad5e4c9640 1 --2- 172.21.15.57:0/2485824004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad40004810 0x7fad58142330 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:08.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad5e4c9640 1 -- 172.21.15.57:0/2485824004 >> 172.21.15.57:0/2485824004 conn(0x7fad580be8f0 msgr2=0x7fad5814e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:08.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad5e4c9640 1 -- 172.21.15.57:0/2485824004 shutdown_connections 2024-04-24T23:39:08.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:08.865+0000 7fad5e4c9640 1 -- 172.21.15.57:0/2485824004 wait complete. 2024-04-24T23:39:08.883 INFO:teuthology.run_tasks:Running task sequential... 2024-04-24T23:39:08.898 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-24T23:39:08.898 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-24T23:39:08.898 INFO:teuthology.task.print:Enabling mgr modules 2024-04-24T23:39:08.898 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-24T23:39:08.928 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-24T23:39:08.928 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-04-24T23:39:08.929 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-24T23:39:08.929 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-24T23:39:08.929 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-24T23:39:08.929 INFO:tasks.ceph_fuse:client.1 config is {} 2024-04-24T23:39:08.929 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-24T23:39:08.929 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-24T23:39:08.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:39:08.929 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2024-04-24T23:39:08.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:39:08.936 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link delete ceph-brx 2024-04-24T23:39:09.000 INFO:teuthology.orchestra.run.smithi174.stderr:Cannot find device "ceph-brx" 2024-04-24T23:39:09.001 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:39:09.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:39:09.002 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2024-04-24T23:39:09.009 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-24T23:39:09.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:39:09.009 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-24T23:39:09.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:39:09.065 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link delete ceph-brx 2024-04-24T23:39:09.253 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-24T23:39:09.254 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-24T23:39:09.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.389+0000 7f357fdc1640 1 Processor -- start 2024-04-24T23:39:09.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.389+0000 7f357fdc1640 1 -- start start 2024-04-24T23:39:09.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.389+0000 7f357fdc1640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f357806edb0 0x7f3578152160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:09.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.389+0000 7f357fdc1640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3578159000 0x7f357815f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:09.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.389+0000 7f357fdc1640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35780a74e0 con 0x7f3578154cf0 2024-04-24T23:39:09.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.389+0000 7f357fdc1640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f3578071cc0 con 0x7f357806edb0 2024-04-24T23:39:09.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.389+0000 7f357fdc1640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f3578158410 con 0x7f3578159000 2024-04-24T23:39:09.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.389+0000 7f357db5d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f357806edb0 0x7f3578152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:09.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.389+0000 7f357db5d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f357806edb0 0x7f3578152160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59990/0 (socket says 172.21.15.57:59990) 2024-04-24T23:39:09.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.389+0000 7f357db5d640 1 -- 172.21.15.57:0/1395878281 learned_addr learned my addr 172.21.15.57:0/1395878281 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:09.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.389+0000 7f357e35e640 1 --2- 172.21.15.57:0/1395878281 >> v2:172.21.15.88:3300/0 conn(0x7f3578159000 0x7f357815f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:09.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.389+0000 7f357db5d640 1 -- 172.21.15.57:0/1395878281 >> v2:172.21.15.88:3300/0 conn(0x7f3578159000 msgr2=0x7f357815f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:09.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.389+0000 7f357db5d640 1 --2- 172.21.15.57:0/1395878281 >> v2:172.21.15.88:3300/0 conn(0x7f3578159000 0x7f357815f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:09.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.389+0000 7f357db5d640 1 -- 172.21.15.57:0/1395878281 >> v1:172.21.15.88:6789/0 conn(0x7f3578154cf0 legacy=0x7f35781588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:09.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.389+0000 7f357db5d640 1 -- 172.21.15.57:0/1395878281 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35780a7200 con 0x7f357806edb0 2024-04-24T23:39:09.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.389+0000 7f357e35e640 1 --2- 172.21.15.57:0/1395878281 >> v2:172.21.15.88:3300/0 conn(0x7f3578159000 0x7f357815f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:39:09.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.393+0000 7f357db5d640 1 --2- 172.21.15.57:0/1395878281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f357806edb0 0x7f3578152160 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3578155e60 tx=0x7f357001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e04b5025605d39 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:09.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.393+0000 7f357cb5b640 1 -- 172.21.15.57:0/1395878281 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35700a55e0 con 0x7f357806edb0 2024-04-24T23:39:09.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.393+0000 7f357cb5b640 1 -- 172.21.15.57:0/1395878281 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35700a5780 con 0x7f357806edb0 2024-04-24T23:39:09.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.393+0000 7f357cb5b640 1 -- 172.21.15.57:0/1395878281 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35700a5b50 con 0x7f357806edb0 2024-04-24T23:39:09.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.393+0000 7f357fdc1640 1 -- 172.21.15.57:0/1395878281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f357806edb0 msgr2=0x7f3578152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:09.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.393+0000 7f357fdc1640 1 --2- 172.21.15.57:0/1395878281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f357806edb0 0x7f3578152160 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3578155e60 tx=0x7f357001c920 comp rx=0 tx=0).stop 2024-04-24T23:39:09.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.393+0000 7f357fdc1640 1 -- 172.21.15.57:0/1395878281 shutdown_connections 2024-04-24T23:39:09.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.393+0000 7f357fdc1640 1 --2- 172.21.15.57:0/1395878281 >> v2:172.21.15.88:3300/0 conn(0x7f3578159000 0x7f357815f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:09.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.393+0000 7f357fdc1640 1 --2- 172.21.15.57:0/1395878281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f357806edb0 0x7f3578152160 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:09.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.393+0000 7f357fdc1640 1 -- 172.21.15.57:0/1395878281 >> 172.21.15.57:0/1395878281 conn(0x7f35780beab0 msgr2=0x7f35780beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:09.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.393+0000 7f357fdc1640 1 -- 172.21.15.57:0/1395878281 shutdown_connections 2024-04-24T23:39:09.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.393+0000 7f357fdc1640 1 -- 172.21.15.57:0/1395878281 wait complete. 2024-04-24T23:39:09.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.393+0000 7f357fdc1640 1 Processor -- start 2024-04-24T23:39:09.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.393+0000 7f357fdc1640 1 -- start start 2024-04-24T23:39:09.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.393+0000 7f357fdc1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f357806edb0 0x7f35780b8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:09.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.393+0000 7f357fdc1640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3578154cf0 0x7f3578151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:09.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.393+0000 7f357fdc1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3578159000 0x7f3578151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:09.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.393+0000 7f357fdc1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3578162550 con 0x7f3578159000 2024-04-24T23:39:09.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.393+0000 7f357fdc1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f35781623d0 con 0x7f357806edb0 2024-04-24T23:39:09.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.393+0000 7f357fdc1640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f35781626d0 con 0x7f3578154cf0 2024-04-24T23:39:09.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.393+0000 7f357e35e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3578159000 0x7f3578151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:09.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.393+0000 7f357e35e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3578159000 0x7f3578151550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60004/0 (socket says 172.21.15.57:60004) 2024-04-24T23:39:09.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.393+0000 7f357e35e640 1 -- 172.21.15.57:0/2304843384 learned_addr learned my addr 172.21.15.57:0/2304843384 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:09.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.397+0000 7f357db5d640 1 --2- 172.21.15.57:0/2304843384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f357806edb0 0x7f35780b8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:09.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.397+0000 7f357d35c640 1 --2- 172.21.15.57:0/2304843384 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3578154cf0 0x7f3578151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:09.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.397+0000 7f357e35e640 1 -- 172.21.15.57:0/2304843384 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3578154cf0 msgr2=0x7f3578151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:09.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.397+0000 7f357e35e640 1 --2- 172.21.15.57:0/2304843384 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3578154cf0 0x7f3578151010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:09.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.397+0000 7f357e35e640 1 -- 172.21.15.57:0/2304843384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f357806edb0 msgr2=0x7f35780b8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:09.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.397+0000 7f357e35e640 1 --2- 172.21.15.57:0/2304843384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f357806edb0 0x7f35780b8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:09.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.397+0000 7f357e35e640 1 -- 172.21.15.57:0/2304843384 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35780b87c0 con 0x7f3578159000 2024-04-24T23:39:09.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.397+0000 7f357e35e640 1 --2- 172.21.15.57:0/2304843384 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3578159000 0x7f3578151550 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f357400c820 tx=0x7f357400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:09.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.397+0000 7f356e7fc640 1 -- 172.21.15.57:0/2304843384 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3574015020 con 0x7f3578159000 2024-04-24T23:39:09.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.397+0000 7f356e7fc640 1 -- 172.21.15.57:0/2304843384 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3574004240 con 0x7f3578159000 2024-04-24T23:39:09.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.397+0000 7f357fdc1640 1 -- 172.21.15.57:0/2304843384 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f357814d170 con 0x7f3578159000 2024-04-24T23:39:09.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.397+0000 7f356e7fc640 1 -- 172.21.15.57:0/2304843384 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3574003620 con 0x7f3578159000 2024-04-24T23:39:09.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.397+0000 7f357fdc1640 1 -- 172.21.15.57:0/2304843384 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35781f1d00 con 0x7f3578159000 2024-04-24T23:39:09.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.397+0000 7f357fdc1640 1 -- 172.21.15.57:0/2304843384 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3578068220 con 0x7f3578159000 2024-04-24T23:39:09.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.397+0000 7f356e7fc640 1 -- 172.21.15.57:0/2304843384 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3574018020 con 0x7f3578159000 2024-04-24T23:39:09.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.397+0000 7f356e7fc640 1 --2- 172.21.15.57:0/2304843384 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f355c0678f0 0x7f355c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:09.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.397+0000 7f356e7fc640 1 -- 172.21.15.57:0/2304843384 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f35740864f0 con 0x7f3578159000 2024-04-24T23:39:09.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.397+0000 7f357db5d640 1 --2- 172.21.15.57:0/2304843384 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f355c0678f0 0x7f355c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:09.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.397+0000 7f357db5d640 1 --2- 172.21.15.57:0/2304843384 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f355c0678f0 0x7f355c069db0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f35700ae000 tx=0x7f35700a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:09.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.401+0000 7f356e7fc640 1 -- 172.21.15.57:0/2304843384 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f357401f020 con 0x7f3578159000 2024-04-24T23:39:09.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.597+0000 7f357fdc1640 1 -- 172.21.15.57:0/2304843384 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3578153cf0 con 0x7f3578159000 2024-04-24T23:39:09.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.597+0000 7f356e7fc640 1 -- 172.21.15.57:0/2304843384 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f35780b87c0 con 0x7f3578159000 2024-04-24T23:39:09.597 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-24T23:39:09.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.597+0000 7f357fdc1640 1 -- 172.21.15.57:0/2304843384 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f355c0678f0 msgr2=0x7f355c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:09.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.597+0000 7f357fdc1640 1 --2- 172.21.15.57:0/2304843384 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f355c0678f0 0x7f355c069db0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f35700ae000 tx=0x7f35700a7070 comp rx=0 tx=0).stop 2024-04-24T23:39:09.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.597+0000 7f357fdc1640 1 -- 172.21.15.57:0/2304843384 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3578159000 msgr2=0x7f3578151550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:09.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.597+0000 7f357fdc1640 1 --2- 172.21.15.57:0/2304843384 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3578159000 0x7f3578151550 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f357400c820 tx=0x7f357400cce0 comp rx=0 tx=0).stop 2024-04-24T23:39:09.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.597+0000 7f357fdc1640 1 -- 172.21.15.57:0/2304843384 shutdown_connections 2024-04-24T23:39:09.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.597+0000 7f357fdc1640 1 --2- 172.21.15.57:0/2304843384 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f355c0678f0 0x7f355c069db0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:09.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.597+0000 7f357fdc1640 1 --2- 172.21.15.57:0/2304843384 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3578159000 0x7f3578151550 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:09.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.597+0000 7f357fdc1640 1 --2- 172.21.15.57:0/2304843384 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3578154cf0 0x7f3578151010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:09.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.597+0000 7f357fdc1640 1 --2- 172.21.15.57:0/2304843384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f357806edb0 0x7f35780b8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:09.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.597+0000 7f357fdc1640 1 -- 172.21.15.57:0/2304843384 >> 172.21.15.57:0/2304843384 conn(0x7f35780beab0 msgr2=0x7f35780a6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:09.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.597+0000 7f357fdc1640 1 -- 172.21.15.57:0/2304843384 shutdown_connections 2024-04-24T23:39:09.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:09.597+0000 7f357fdc1640 1 -- 172.21.15.57:0/2304843384 wait complete. 2024-04-24T23:39:09.615 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-24T23:39:09.615 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-24T23:39:09.615 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi116.front.sepia.ceph.com 2024-04-24T23:39:09.615 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-24T23:39:09.615 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-24T23:39:09.615 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-24T23:39:09.615 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-24T23:39:09.615 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-24T23:39:09.615 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:39:09.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:39:09.616 DEBUG:teuthology.orchestra.run.smithi116:> ip addr 2024-04-24T23:39:09.623 INFO:teuthology.orchestra.run.smithi116.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:39:09.623 INFO:teuthology.orchestra.run.smithi116.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:39:09.623 INFO:teuthology.orchestra.run.smithi116.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:39:09.623 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:39:09.623 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 ::1/128 scope host 2024-04-24T23:39:09.623 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:39:09.623 INFO:teuthology.orchestra.run.smithi116.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-24T23:39:09.623 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:90 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:39:09.623 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f0 2024-04-24T23:39:09.623 INFO:teuthology.orchestra.run.smithi116.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-24T23:39:09.623 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:91 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:39:09.624 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f1 2024-04-24T23:39:09.624 INFO:teuthology.orchestra.run.smithi116.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-24T23:39:09.624 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:66 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:39:09.624 INFO:teuthology.orchestra.run.smithi116.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-24T23:39:09.624 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:67 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:39:09.624 INFO:teuthology.orchestra.run.smithi116.stdout: inet 172.21.15.116/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-24T23:39:09.624 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft 42420sec preferred_lft 42420sec 2024-04-24T23:39:09.624 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::ec4:7aff:fe8f:3f67/64 scope link 2024-04-24T23:39:09.624 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:39:09.624 INFO:teuthology.orchestra.run.smithi116.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-24T23:39:09.624 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 02:42:65:c2:38:a7 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:39:09.624 INFO:teuthology.orchestra.run.smithi116.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-24T23:39:09.625 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:39:09.625 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-24T23:39:09.625 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:39:09.625 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-04-24T23:39:09.625 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link add name ceph-brx type bridge 2024-04-24T23:39:09.625 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip addr flush dev ceph-brx 2024-04-24T23:39:09.625 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set ceph-brx up 2024-04-24T23:39:09.625 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-24T23:39:09.625 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-04-24T23:39:09.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-24T23:39:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:39:09.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-24T23:39:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:39:09.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:39:09.758 DEBUG:teuthology.orchestra.run.smithi116:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-24T23:39:09.767 INFO:teuthology.orchestra.run.smithi116.stdout:1 2024-04-24T23:39:09.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:39:09.769 DEBUG:teuthology.orchestra.run.smithi116:> route 2024-04-24T23:39:09.821 INFO:teuthology.orchestra.run.smithi116.stdout:Kernel IP routing table 2024-04-24T23:39:09.821 INFO:teuthology.orchestra.run.smithi116.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-24T23:39:09.821 INFO:teuthology.orchestra.run.smithi116.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-24T23:39:09.821 INFO:teuthology.orchestra.run.smithi116.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-24T23:39:09.822 INFO:teuthology.orchestra.run.smithi116.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-24T23:39:09.822 INFO:teuthology.orchestra.run.smithi116.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-24T23:39:09.822 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-24T23:39:09.822 INFO:teuthology.orchestra.run.smithi116.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-24T23:39:09.822 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-24T23:39:09.822 INFO:teuthology.orchestra.run.smithi116.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-24T23:39:09.822 INFO:teuthology.orchestra.run.smithi116.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-24T23:39:09.822 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:39:09.822 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-04-24T23:39:09.823 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-24T23:39:09.823 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-24T23:39:09.823 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-24T23:39:09.823 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-04-24T23:39:09.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-24T23:39:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:39:09.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-24T23:39:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:39:09.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:39:09.946 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2024-04-24T23:39:09.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:39:09.952 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list-id 2024-04-24T23:39:10.001 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:39:10.001 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-04-24T23:39:10.001 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:39:10.001 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-24T23:39:10.001 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-04-24T23:39:10.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-24T23:39:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:39:10.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-24T23:39:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:39:10.117 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-24T23:39:10.117 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:39:10.117 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-04-24T23:39:10.117 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-24T23:39:10.118 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-24T23:39:10.118 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-24T23:39:10.118 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-24T23:39:10.118 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-24T23:39:10.118 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-04-24T23:39:10.157 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-24T23:39:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:39:10.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-24T23:39:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:39:10.209 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:39:10.209 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-04-24T23:39:10.209 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set brx.0 up 2024-04-24T23:39:10.209 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set dev brx.0 master ceph-brx 2024-04-24T23:39:10.209 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-04-24T23:39:10.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-24T23:39:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:39:10.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-24T23:39:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:39:10.311 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-24T23:39:10.311 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:39:10.311 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-24T23:39:10.355 INFO:teuthology.orchestra.run.smithi116.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:39:10.356 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:39:10.356 DEBUG:teuthology.orchestra.run.smithi116:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-24T23:39:10.403 DEBUG:teuthology.orchestra.run.smithi116:> sudo modprobe fuse 2024-04-24T23:39:10.454 DEBUG:teuthology.orchestra.run.smithi116:> cat /proc/self/mounts | awk '{print $2}' 2024-04-24T23:39:10.501 INFO:teuthology.orchestra.run.smithi116.stdout:/sys 2024-04-24T23:39:10.501 INFO:teuthology.orchestra.run.smithi116.stdout:/proc 2024-04-24T23:39:10.501 INFO:teuthology.orchestra.run.smithi116.stdout:/dev 2024-04-24T23:39:10.501 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/pts 2024-04-24T23:39:10.501 INFO:teuthology.orchestra.run.smithi116.stdout:/run 2024-04-24T23:39:10.501 INFO:teuthology.orchestra.run.smithi116.stdout:/ 2024-04-24T23:39:10.501 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/security 2024-04-24T23:39:10.501 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/shm 2024-04-24T23:39:10.501 INFO:teuthology.orchestra.run.smithi116.stdout:/run/lock 2024-04-24T23:39:10.502 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/cgroup 2024-04-24T23:39:10.502 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/pstore 2024-04-24T23:39:10.502 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/bpf 2024-04-24T23:39:10.502 INFO:teuthology.orchestra.run.smithi116.stdout:/proc/sys/fs/binfmt_misc 2024-04-24T23:39:10.502 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/hugepages 2024-04-24T23:39:10.502 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/mqueue 2024-04-24T23:39:10.502 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/debug 2024-04-24T23:39:10.502 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/tracing 2024-04-24T23:39:10.502 INFO:teuthology.orchestra.run.smithi116.stdout:/proc/fs/nfsd 2024-04-24T23:39:10.502 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/fuse/connections 2024-04-24T23:39:10.502 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/config 2024-04-24T23:39:10.502 INFO:teuthology.orchestra.run.smithi116.stdout:/run/credentials/systemd-sysusers.service 2024-04-24T23:39:10.503 INFO:teuthology.orchestra.run.smithi116.stdout:/run/rpc_pipefs 2024-04-24T23:39:10.503 INFO:teuthology.orchestra.run.smithi116.stdout:/run/user/1000 2024-04-24T23:39:10.503 INFO:teuthology.orchestra.run.smithi116.stdout:/var/lib/ceph 2024-04-24T23:39:10.503 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns 2024-04-24T23:39:10.503 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:39:10.503 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:39:10.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:39:10.504 DEBUG:teuthology.orchestra.run.smithi116:> ls /sys/fs/fuse/connections 2024-04-24T23:39:10.551 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-24T23:39:10.551 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-24T23:39:10.597 DEBUG:teuthology.orchestra.run.smithi116:> sudo modprobe fuse 2024-04-24T23:39:10.612 DEBUG:teuthology.orchestra.run.smithi116:> cat /proc/self/mounts | awk '{print $2}' 2024-04-24T23:39:10.660 INFO:teuthology.orchestra.run.smithi116.stdout:/sys 2024-04-24T23:39:10.660 INFO:teuthology.orchestra.run.smithi116.stdout:/proc 2024-04-24T23:39:10.660 INFO:teuthology.orchestra.run.smithi116.stdout:/dev 2024-04-24T23:39:10.660 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/pts 2024-04-24T23:39:10.660 INFO:teuthology.orchestra.run.smithi116.stdout:/run 2024-04-24T23:39:10.660 INFO:teuthology.orchestra.run.smithi116.stdout:/ 2024-04-24T23:39:10.660 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/security 2024-04-24T23:39:10.660 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/shm 2024-04-24T23:39:10.660 INFO:teuthology.orchestra.run.smithi116.stdout:/run/lock 2024-04-24T23:39:10.660 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/cgroup 2024-04-24T23:39:10.660 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/pstore 2024-04-24T23:39:10.661 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/bpf 2024-04-24T23:39:10.661 INFO:teuthology.orchestra.run.smithi116.stdout:/proc/sys/fs/binfmt_misc 2024-04-24T23:39:10.661 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/hugepages 2024-04-24T23:39:10.661 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/mqueue 2024-04-24T23:39:10.661 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/debug 2024-04-24T23:39:10.661 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/tracing 2024-04-24T23:39:10.661 INFO:teuthology.orchestra.run.smithi116.stdout:/proc/fs/nfsd 2024-04-24T23:39:10.661 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/fuse/connections 2024-04-24T23:39:10.661 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/config 2024-04-24T23:39:10.661 INFO:teuthology.orchestra.run.smithi116.stdout:/run/credentials/systemd-sysusers.service 2024-04-24T23:39:10.661 INFO:teuthology.orchestra.run.smithi116.stdout:/run/rpc_pipefs 2024-04-24T23:39:10.661 INFO:teuthology.orchestra.run.smithi116.stdout:/run/user/1000 2024-04-24T23:39:10.662 INFO:teuthology.orchestra.run.smithi116.stdout:/var/lib/ceph 2024-04-24T23:39:10.662 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns 2024-04-24T23:39:10.662 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:39:10.662 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:39:10.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:39:10.663 DEBUG:teuthology.orchestra.run.smithi116:> ls /sys/fs/fuse/connections 2024-04-24T23:39:10.674 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi116.stderr:2024-04-24T23:39:10.669+0000 7ffa4fe6b580 -1 init, newargv = 0x55f183df7670 newargc=15 2024-04-24T23:39:10.674 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi116.stderr:ceph-fuse[23030]: starting ceph client 2024-04-24T23:39:10.683 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi116.stderr:ceph-fuse[23030]: starting fuse 2024-04-24T23:39:11.779 DEBUG:teuthology.orchestra.run.smithi116:> sudo modprobe fuse 2024-04-24T23:39:11.795 DEBUG:teuthology.orchestra.run.smithi116:> cat /proc/self/mounts | awk '{print $2}' 2024-04-24T23:39:11.845 INFO:teuthology.orchestra.run.smithi116.stdout:/sys 2024-04-24T23:39:11.845 INFO:teuthology.orchestra.run.smithi116.stdout:/proc 2024-04-24T23:39:11.845 INFO:teuthology.orchestra.run.smithi116.stdout:/dev 2024-04-24T23:39:11.845 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/pts 2024-04-24T23:39:11.845 INFO:teuthology.orchestra.run.smithi116.stdout:/run 2024-04-24T23:39:11.845 INFO:teuthology.orchestra.run.smithi116.stdout:/ 2024-04-24T23:39:11.845 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/security 2024-04-24T23:39:11.845 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/shm 2024-04-24T23:39:11.845 INFO:teuthology.orchestra.run.smithi116.stdout:/run/lock 2024-04-24T23:39:11.846 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/cgroup 2024-04-24T23:39:11.846 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/pstore 2024-04-24T23:39:11.846 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/bpf 2024-04-24T23:39:11.846 INFO:teuthology.orchestra.run.smithi116.stdout:/proc/sys/fs/binfmt_misc 2024-04-24T23:39:11.846 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/hugepages 2024-04-24T23:39:11.846 INFO:teuthology.orchestra.run.smithi116.stdout:/dev/mqueue 2024-04-24T23:39:11.846 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/debug 2024-04-24T23:39:11.846 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/tracing 2024-04-24T23:39:11.846 INFO:teuthology.orchestra.run.smithi116.stdout:/proc/fs/nfsd 2024-04-24T23:39:11.846 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/fs/fuse/connections 2024-04-24T23:39:11.846 INFO:teuthology.orchestra.run.smithi116.stdout:/sys/kernel/config 2024-04-24T23:39:11.846 INFO:teuthology.orchestra.run.smithi116.stdout:/run/credentials/systemd-sysusers.service 2024-04-24T23:39:11.846 INFO:teuthology.orchestra.run.smithi116.stdout:/run/rpc_pipefs 2024-04-24T23:39:11.847 INFO:teuthology.orchestra.run.smithi116.stdout:/run/user/1000 2024-04-24T23:39:11.847 INFO:teuthology.orchestra.run.smithi116.stdout:/var/lib/ceph 2024-04-24T23:39:11.847 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns 2024-04-24T23:39:11.847 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:39:11.847 INFO:teuthology.orchestra.run.smithi116.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:39:11.847 INFO:teuthology.orchestra.run.smithi116.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-24T23:39:11.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:39:11.848 DEBUG:teuthology.orchestra.run.smithi116:> ls /sys/fs/fuse/connections 2024-04-24T23:39:11.896 INFO:teuthology.orchestra.run.smithi116.stdout:45 2024-04-24T23:39:11.896 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-24T23:39:11.897 DEBUG:teuthology.orchestra.run.smithi116:> sudo stdin-killer -- python3 -c ' 2024-04-24T23:39:11.897 DEBUG:teuthology.orchestra.run.smithi116:> import glob 2024-04-24T23:39:11.897 DEBUG:teuthology.orchestra.run.smithi116:> import re 2024-04-24T23:39:11.897 DEBUG:teuthology.orchestra.run.smithi116:> import os 2024-04-24T23:39:11.897 DEBUG:teuthology.orchestra.run.smithi116:> import subprocess 2024-04-24T23:39:11.897 DEBUG:teuthology.orchestra.run.smithi116:> 2024-04-24T23:39:11.897 DEBUG:teuthology.orchestra.run.smithi116:> def _find_admin_socket(client_name): 2024-04-24T23:39:11.897 DEBUG:teuthology.orchestra.run.smithi116:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-24T23:39:11.897 DEBUG:teuthology.orchestra.run.smithi116:> files = glob.glob(asok_path) 2024-04-24T23:39:11.897 DEBUG:teuthology.orchestra.run.smithi116:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-24T23:39:11.897 DEBUG:teuthology.orchestra.run.smithi116:> 2024-04-24T23:39:11.897 DEBUG:teuthology.orchestra.run.smithi116:> # Given a non-glob path, it better be there 2024-04-24T23:39:11.898 DEBUG:teuthology.orchestra.run.smithi116:> if "*" not in asok_path: 2024-04-24T23:39:11.898 DEBUG:teuthology.orchestra.run.smithi116:> assert(len(files) == 1) 2024-04-24T23:39:11.898 DEBUG:teuthology.orchestra.run.smithi116:> return files[0] 2024-04-24T23:39:11.898 DEBUG:teuthology.orchestra.run.smithi116:> 2024-04-24T23:39:11.898 DEBUG:teuthology.orchestra.run.smithi116:> for f in files: 2024-04-24T23:39:11.898 DEBUG:teuthology.orchestra.run.smithi116:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-24T23:39:11.898 DEBUG:teuthology.orchestra.run.smithi116:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-24T23:39:11.898 DEBUG:teuthology.orchestra.run.smithi116:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-24T23:39:11.898 DEBUG:teuthology.orchestra.run.smithi116:> contents = proc_f.read() 2024-04-24T23:39:11.898 DEBUG:teuthology.orchestra.run.smithi116:> if mountpoint in contents: 2024-04-24T23:39:11.898 DEBUG:teuthology.orchestra.run.smithi116:> return f 2024-04-24T23:39:11.898 DEBUG:teuthology.orchestra.run.smithi116:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-24T23:39:11.898 DEBUG:teuthology.orchestra.run.smithi116:> 2024-04-24T23:39:11.898 DEBUG:teuthology.orchestra.run.smithi116:> print(_find_admin_socket("client.0")) 2024-04-24T23:39:11.899 DEBUG:teuthology.orchestra.run.smithi116:> ' 2024-04-24T23:39:12.020 INFO:teuthology.orchestra.run.smithi116.stdout:/var/run/ceph/ceph-client.0.23030.asok 2024-04-24T23:39:12.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-24T23:39:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:39:12.031 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.23030.asok 2024-04-24T23:39:12.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:39:12.032 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.23030.asok status 2024-04-24T23:39:12.189 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-24T23:39:12.189 INFO:teuthology.orchestra.run.smithi116.stdout: "metadata": { 2024-04-24T23:39:12.189 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_sha1": "d2c45d977142e024a59b68a8f1dce8f0b9840551", 2024-04-24T23:39:12.189 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_version": "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)", 2024-04-24T23:39:12.189 INFO:teuthology.orchestra.run.smithi116.stdout: "entity_id": "0", 2024-04-24T23:39:12.189 INFO:teuthology.orchestra.run.smithi116.stdout: "hostname": "smithi116", 2024-04-24T23:39:12.189 INFO:teuthology.orchestra.run.smithi116.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-24T23:39:12.190 INFO:teuthology.orchestra.run.smithi116.stdout: "pid": "23030", 2024-04-24T23:39:12.190 INFO:teuthology.orchestra.run.smithi116.stdout: "root": "/" 2024-04-24T23:39:12.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-24T23:39:12.190 INFO:teuthology.orchestra.run.smithi116.stdout: "dentry_count": 0, 2024-04-24T23:39:12.190 INFO:teuthology.orchestra.run.smithi116.stdout: "dentry_pinned_count": 0, 2024-04-24T23:39:12.190 INFO:teuthology.orchestra.run.smithi116.stdout: "id": 4735, 2024-04-24T23:39:12.190 INFO:teuthology.orchestra.run.smithi116.stdout: "inst": { 2024-04-24T23:39:12.190 INFO:teuthology.orchestra.run.smithi116.stdout: "name": { 2024-04-24T23:39:12.190 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "client", 2024-04-24T23:39:12.190 INFO:teuthology.orchestra.run.smithi116.stdout: "num": 4735 2024-04-24T23:39:12.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-24T23:39:12.190 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": { 2024-04-24T23:39:12.190 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-04-24T23:39:12.190 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:0", 2024-04-24T23:39:12.191 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 536932681 2024-04-24T23:39:12.191 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-24T23:39:12.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-24T23:39:12.191 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": { 2024-04-24T23:39:12.191 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-04-24T23:39:12.191 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:0", 2024-04-24T23:39:12.191 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 536932681 2024-04-24T23:39:12.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-24T23:39:12.191 INFO:teuthology.orchestra.run.smithi116.stdout: "inst_str": "client.4735 172.21.15.116:0/536932681", 2024-04-24T23:39:12.191 INFO:teuthology.orchestra.run.smithi116.stdout: "addr_str": "172.21.15.116:0/536932681", 2024-04-24T23:39:12.191 INFO:teuthology.orchestra.run.smithi116.stdout: "inode_count": 1, 2024-04-24T23:39:12.191 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_epoch": 9, 2024-04-24T23:39:12.191 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_epoch": 24, 2024-04-24T23:39:12.191 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_epoch_barrier": 0, 2024-04-24T23:39:12.191 INFO:teuthology.orchestra.run.smithi116.stdout: "blocklisted": false, 2024-04-24T23:39:12.192 INFO:teuthology.orchestra.run.smithi116.stdout: "fs_name": "cephfs" 2024-04-24T23:39:12.192 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-24T23:39:12.203 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-24T23:39:12.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.337+0000 7effc4fc3640 1 Processor -- start 2024-04-24T23:39:12.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.337+0000 7effc4fc3640 1 -- start start 2024-04-24T23:39:12.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.341+0000 7effc4fc3640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7effc014ada0 0x7effc00b7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:12.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.341+0000 7effc4fc3640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7effc0072980 0x7effc00be3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:12.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.341+0000 7effc4fc3640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effc00b8fa0 con 0x7effc00bde80 2024-04-24T23:39:12.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.341+0000 7effc4fc3640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7effc00be920 con 0x7effc0072980 2024-04-24T23:39:12.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.341+0000 7effc4fc3640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7effc0072e10 con 0x7effc014ada0 2024-04-24T23:39:12.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.341+0000 7effbdd9b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7effc0072980 0x7effc00be3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:12.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.341+0000 7effbdd9b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7effc0072980 0x7effc00be3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60012/0 (socket says 172.21.15.57:60012) 2024-04-24T23:39:12.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.341+0000 7effbdd9b640 1 -- 172.21.15.57:0/3503447836 learned_addr learned my addr 172.21.15.57:0/3503447836 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:12.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.341+0000 7effbe59c640 1 --2- 172.21.15.57:0/3503447836 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7effc014ada0 0x7effc00b7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:12.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.341+0000 7effbdd9b640 1 -- 172.21.15.57:0/3503447836 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7effc014ada0 msgr2=0x7effc00b7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:12.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.341+0000 7effbdd9b640 1 --2- 172.21.15.57:0/3503447836 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7effc014ada0 0x7effc00b7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:12.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.341+0000 7effbdd9b640 1 -- 172.21.15.57:0/3503447836 >> v1:172.21.15.88:6789/0 conn(0x7effc00bde80 legacy=0x7effc006eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:12.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.341+0000 7effbdd9b640 1 -- 172.21.15.57:0/3503447836 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc006f260 con 0x7effc0072980 2024-04-24T23:39:12.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.341+0000 7effbdd9b640 1 --2- 172.21.15.57:0/3503447836 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effc0072980 0x7effc00be3e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7effb4009870 tx=0x7effb401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5606b08a4b4568 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:12.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.341+0000 7effbd59a640 1 -- 172.21.15.57:0/3503447836 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb40b2070 con 0x7effc0072980 2024-04-24T23:39:12.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effbd59a640 1 -- 172.21.15.57:0/3503447836 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effb40a9070 con 0x7effc0072980 2024-04-24T23:39:12.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effbd59a640 1 -- 172.21.15.57:0/3503447836 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb40ad880 con 0x7effc0072980 2024-04-24T23:39:12.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effc4fc3640 1 -- 172.21.15.57:0/3503447836 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effc0072980 msgr2=0x7effc00be3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:12.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effc4fc3640 1 --2- 172.21.15.57:0/3503447836 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effc0072980 0x7effc00be3e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7effb4009870 tx=0x7effb401c490 comp rx=0 tx=0).stop 2024-04-24T23:39:12.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effc4fc3640 1 -- 172.21.15.57:0/3503447836 shutdown_connections 2024-04-24T23:39:12.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effc4fc3640 1 --2- 172.21.15.57:0/3503447836 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effc0072980 0x7effc00be3e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:12.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effc4fc3640 1 --2- 172.21.15.57:0/3503447836 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7effc014ada0 0x7effc00b7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:12.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effc4fc3640 1 -- 172.21.15.57:0/3503447836 >> 172.21.15.57:0/3503447836 conn(0x7effc00beab0 msgr2=0x7effc00beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:12.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effc4fc3640 1 -- 172.21.15.57:0/3503447836 shutdown_connections 2024-04-24T23:39:12.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effc4fc3640 1 -- 172.21.15.57:0/3503447836 wait complete. 2024-04-24T23:39:12.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effc4fc3640 1 Processor -- start 2024-04-24T23:39:12.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effc4fc3640 1 -- start start 2024-04-24T23:39:12.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effc4fc3640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effc0072980 0x7effc0144a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:12.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effc4fc3640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7effc00bde80 0x7effc0159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:12.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effc4fc3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effc014ada0 0x7effc0142160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:12.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effc4fc3640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7effc01588b0 con 0x7effc0072980 2024-04-24T23:39:12.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effc4fc3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7effc0158730 con 0x7effc014ada0 2024-04-24T23:39:12.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effc4fc3640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7effc0158a30 con 0x7effc00bde80 2024-04-24T23:39:12.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effbe59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effc0072980 0x7effc0144a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:12.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effbe59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effc0072980 0x7effc0144a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60016/0 (socket says 172.21.15.57:60016) 2024-04-24T23:39:12.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effbe59c640 1 -- 172.21.15.57:0/3393436702 learned_addr learned my addr 172.21.15.57:0/3393436702 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:12.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effbed9d640 1 --2- 172.21.15.57:0/3393436702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effc014ada0 0x7effc0142160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:12.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effbdd9b640 1 --2- 172.21.15.57:0/3393436702 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7effc00bde80 0x7effc0159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:12.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effbe59c640 1 -- 172.21.15.57:0/3393436702 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7effc00bde80 msgr2=0x7effc0159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:12.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effbe59c640 1 --2- 172.21.15.57:0/3393436702 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7effc00bde80 0x7effc0159190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:12.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effbe59c640 1 -- 172.21.15.57:0/3393436702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effc014ada0 msgr2=0x7effc0142160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:12.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effbe59c640 1 --2- 172.21.15.57:0/3393436702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effc014ada0 0x7effc0142160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:12.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effbe59c640 1 -- 172.21.15.57:0/3393436702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc0145570 con 0x7effc0072980 2024-04-24T23:39:12.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effbe59c640 1 --2- 172.21.15.57:0/3393436702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effc0072980 0x7effc0144a30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7effb000c7f0 tx=0x7effb000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:12.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effaeffd640 1 -- 172.21.15.57:0/3393436702 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb0015070 con 0x7effc0072980 2024-04-24T23:39:12.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effaeffd640 1 -- 172.21.15.57:0/3393436702 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effb0004240 con 0x7effc0072980 2024-04-24T23:39:12.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.345+0000 7effaeffd640 1 -- 172.21.15.57:0/3393436702 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb0003620 con 0x7effc0072980 2024-04-24T23:39:12.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.349+0000 7effc4fc3640 1 -- 172.21.15.57:0/3393436702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effc015a0d0 con 0x7effc0072980 2024-04-24T23:39:12.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.349+0000 7effc4fc3640 1 -- 172.21.15.57:0/3393436702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effc01ed060 con 0x7effc0072980 2024-04-24T23:39:12.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.349+0000 7effc4fc3640 1 -- 172.21.15.57:0/3393436702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effc014a790 con 0x7effc0072980 2024-04-24T23:39:12.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.349+0000 7effaeffd640 1 -- 172.21.15.57:0/3393436702 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7effb00039d0 con 0x7effc0072980 2024-04-24T23:39:12.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.349+0000 7effaeffd640 1 --2- 172.21.15.57:0/3393436702 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7effa00678c0 0x7effa0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:12.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.349+0000 7effaeffd640 1 -- 172.21.15.57:0/3393436702 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7effb0085fb0 con 0x7effc0072980 2024-04-24T23:39:12.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.349+0000 7effbdd9b640 1 --2- 172.21.15.57:0/3393436702 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7effa00678c0 0x7effa0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:12.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.349+0000 7effbdd9b640 1 --2- 172.21.15.57:0/3393436702 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7effa00678c0 0x7effa0069d80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7effb40af000 tx=0x7effb4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:12.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.353+0000 7effaeffd640 1 -- 172.21.15.57:0/3393436702 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7effb0056840 con 0x7effc0072980 2024-04-24T23:39:12.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.553+0000 7effc4fc3640 1 -- 172.21.15.57:0/3393436702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7effc01ece90 con 0x7effc0072980 2024-04-24T23:39:12.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.553+0000 7effaeffd640 1 -- 172.21.15.57:0/3393436702 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7effb0056140 con 0x7effc0072980 2024-04-24T23:39:12.555 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-24T23:39:12.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.557+0000 7effc4fc3640 1 -- 172.21.15.57:0/3393436702 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7effa00678c0 msgr2=0x7effa0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:12.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.557+0000 7effc4fc3640 1 --2- 172.21.15.57:0/3393436702 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7effa00678c0 0x7effa0069d80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7effb40af000 tx=0x7effb4008040 comp rx=0 tx=0).stop 2024-04-24T23:39:12.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.557+0000 7effc4fc3640 1 -- 172.21.15.57:0/3393436702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effc0072980 msgr2=0x7effc0144a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:12.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.557+0000 7effc4fc3640 1 --2- 172.21.15.57:0/3393436702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effc0072980 0x7effc0144a30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7effb000c7f0 tx=0x7effb000ccb0 comp rx=0 tx=0).stop 2024-04-24T23:39:12.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.557+0000 7effc4fc3640 1 -- 172.21.15.57:0/3393436702 shutdown_connections 2024-04-24T23:39:12.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.557+0000 7effc4fc3640 1 --2- 172.21.15.57:0/3393436702 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7effa00678c0 0x7effa0069d80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:12.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.557+0000 7effc4fc3640 1 --2- 172.21.15.57:0/3393436702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effc014ada0 0x7effc0142160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:12.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.557+0000 7effc4fc3640 1 --2- 172.21.15.57:0/3393436702 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7effc00bde80 0x7effc0159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:12.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.557+0000 7effc4fc3640 1 --2- 172.21.15.57:0/3393436702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effc0072980 0x7effc0144a30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:12.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.557+0000 7effc4fc3640 1 -- 172.21.15.57:0/3393436702 >> 172.21.15.57:0/3393436702 conn(0x7effc00beab0 msgr2=0x7effc014c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:12.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.557+0000 7effc4fc3640 1 -- 172.21.15.57:0/3393436702 shutdown_connections 2024-04-24T23:39:12.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:12.557+0000 7effc4fc3640 1 -- 172.21.15.57:0/3393436702 wait complete. 2024-04-24T23:39:12.571 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-24T23:39:12.572 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-24T23:39:12.572 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi174.front.sepia.ceph.com 2024-04-24T23:39:12.572 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-24T23:39:12.572 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-24T23:39:12.572 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-24T23:39:12.572 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-24T23:39:12.572 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-24T23:39:12.572 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-24T23:39:12.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:39:12.572 DEBUG:teuthology.orchestra.run.smithi174:> ip addr 2024-04-24T23:39:12.579 INFO:teuthology.orchestra.run.smithi174.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:39:12.579 INFO:teuthology.orchestra.run.smithi174.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:39:12.579 INFO:teuthology.orchestra.run.smithi174.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:39:12.579 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:39:12.579 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 ::1/128 scope host 2024-04-24T23:39:12.579 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:39:12.579 INFO:teuthology.orchestra.run.smithi174.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-24T23:39:12.579 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e0 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:39:12.579 INFO:teuthology.orchestra.run.smithi174.stdout: altname enp7s0f0 2024-04-24T23:39:12.579 INFO:teuthology.orchestra.run.smithi174.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-24T23:39:12.580 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e1 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:39:12.580 INFO:teuthology.orchestra.run.smithi174.stdout: altname enp7s0f1 2024-04-24T23:39:12.580 INFO:teuthology.orchestra.run.smithi174.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-24T23:39:12.580 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1a brd ff:ff:ff:ff:ff:ff 2024-04-24T23:39:12.580 INFO:teuthology.orchestra.run.smithi174.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-24T23:39:12.580 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1b brd ff:ff:ff:ff:ff:ff 2024-04-24T23:39:12.580 INFO:teuthology.orchestra.run.smithi174.stdout: inet 172.21.15.174/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-24T23:39:12.580 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft 42422sec preferred_lft 42422sec 2024-04-24T23:39:12.580 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::ec4:7aff:fe88:771b/64 scope link 2024-04-24T23:39:12.580 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:39:12.580 INFO:teuthology.orchestra.run.smithi174.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-24T23:39:12.580 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 02:42:50:2c:f7:f0 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:39:12.580 INFO:teuthology.orchestra.run.smithi174.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-24T23:39:12.581 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:39:12.581 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-24T23:39:12.581 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:39:12.581 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-04-24T23:39:12.581 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link add name ceph-brx type bridge 2024-04-24T23:39:12.581 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip addr flush dev ceph-brx 2024-04-24T23:39:12.581 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set ceph-brx up 2024-04-24T23:39:12.581 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-24T23:39:12.581 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-04-24T23:39:12.670 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-24T23:39:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:39:12.707 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-24T23:39:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:39:12.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:39:12.715 DEBUG:teuthology.orchestra.run.smithi174:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-24T23:39:12.724 INFO:teuthology.orchestra.run.smithi174.stdout:1 2024-04-24T23:39:12.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:39:12.725 DEBUG:teuthology.orchestra.run.smithi174:> route 2024-04-24T23:39:12.782 INFO:teuthology.orchestra.run.smithi174.stdout:Kernel IP routing table 2024-04-24T23:39:12.782 INFO:teuthology.orchestra.run.smithi174.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-24T23:39:12.782 INFO:teuthology.orchestra.run.smithi174.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-24T23:39:12.782 INFO:teuthology.orchestra.run.smithi174.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-24T23:39:12.782 INFO:teuthology.orchestra.run.smithi174.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-24T23:39:12.782 INFO:teuthology.orchestra.run.smithi174.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-24T23:39:12.782 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-24T23:39:12.782 INFO:teuthology.orchestra.run.smithi174.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-24T23:39:12.782 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-24T23:39:12.782 INFO:teuthology.orchestra.run.smithi174.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-24T23:39:12.783 INFO:teuthology.orchestra.run.smithi174.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-24T23:39:12.783 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:39:12.783 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-04-24T23:39:12.783 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-24T23:39:12.783 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-24T23:39:12.783 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-24T23:39:12.783 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-04-24T23:39:12.867 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-24T23:39:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:39:12.894 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-24T23:39:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:39:12.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:39:12.901 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2024-04-24T23:39:12.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:39:12.947 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list-id 2024-04-24T23:39:12.995 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:39:12.995 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-04-24T23:39:12.995 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-24T23:39:12.995 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-24T23:39:12.995 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-04-24T23:39:13.083 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-24T23:39:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:39:13.104 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-24T23:39:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:39:13.112 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-24T23:39:13.112 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:39:13.112 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-04-24T23:39:13.113 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-24T23:39:13.113 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-24T23:39:13.113 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-24T23:39:13.113 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-24T23:39:13.113 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-24T23:39:13.113 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-04-24T23:39:13.153 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-24T23:39:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:39:13.211 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-24T23:39:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:39:13.218 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:39:13.218 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-04-24T23:39:13.218 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set brx.0 up 2024-04-24T23:39:13.218 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set dev brx.0 master ceph-brx 2024-04-24T23:39:13.218 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-04-24T23:39:13.304 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-24T23:39:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:39:13.319 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-24T23:39:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:39:13.326 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-24T23:39:13.326 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:39:13.326 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-24T23:39:13.375 INFO:teuthology.orchestra.run.smithi174.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-24T23:39:13.375 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:39:13.375 DEBUG:teuthology.orchestra.run.smithi174:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-24T23:39:13.422 DEBUG:teuthology.orchestra.run.smithi174:> sudo modprobe fuse 2024-04-24T23:39:13.480 DEBUG:teuthology.orchestra.run.smithi174:> cat /proc/self/mounts | awk '{print $2}' 2024-04-24T23:39:13.528 INFO:teuthology.orchestra.run.smithi174.stdout:/sys 2024-04-24T23:39:13.528 INFO:teuthology.orchestra.run.smithi174.stdout:/proc 2024-04-24T23:39:13.528 INFO:teuthology.orchestra.run.smithi174.stdout:/dev 2024-04-24T23:39:13.528 INFO:teuthology.orchestra.run.smithi174.stdout:/dev/pts 2024-04-24T23:39:13.528 INFO:teuthology.orchestra.run.smithi174.stdout:/run 2024-04-24T23:39:13.528 INFO:teuthology.orchestra.run.smithi174.stdout:/ 2024-04-24T23:39:13.528 INFO:teuthology.orchestra.run.smithi174.stdout:/sys/kernel/security 2024-04-24T23:39:13.528 INFO:teuthology.orchestra.run.smithi174.stdout:/dev/shm 2024-04-24T23:39:13.528 INFO:teuthology.orchestra.run.smithi174.stdout:/run/lock 2024-04-24T23:39:13.528 INFO:teuthology.orchestra.run.smithi174.stdout:/sys/fs/cgroup 2024-04-24T23:39:13.529 INFO:teuthology.orchestra.run.smithi174.stdout:/sys/fs/pstore 2024-04-24T23:39:13.529 INFO:teuthology.orchestra.run.smithi174.stdout:/sys/fs/bpf 2024-04-24T23:39:13.529 INFO:teuthology.orchestra.run.smithi174.stdout:/proc/sys/fs/binfmt_misc 2024-04-24T23:39:13.529 INFO:teuthology.orchestra.run.smithi174.stdout:/dev/hugepages 2024-04-24T23:39:13.529 INFO:teuthology.orchestra.run.smithi174.stdout:/dev/mqueue 2024-04-24T23:39:13.529 INFO:teuthology.orchestra.run.smithi174.stdout:/sys/kernel/debug 2024-04-24T23:39:13.529 INFO:teuthology.orchestra.run.smithi174.stdout:/sys/kernel/tracing 2024-04-24T23:39:13.529 INFO:teuthology.orchestra.run.smithi174.stdout:/proc/fs/nfsd 2024-04-24T23:39:13.529 INFO:teuthology.orchestra.run.smithi174.stdout:/sys/fs/fuse/connections 2024-04-24T23:39:13.529 INFO:teuthology.orchestra.run.smithi174.stdout:/sys/kernel/config 2024-04-24T23:39:13.529 INFO:teuthology.orchestra.run.smithi174.stdout:/run/credentials/systemd-sysusers.service 2024-04-24T23:39:13.529 INFO:teuthology.orchestra.run.smithi174.stdout:/run/rpc_pipefs 2024-04-24T23:39:13.529 INFO:teuthology.orchestra.run.smithi174.stdout:/run/user/1000 2024-04-24T23:39:13.529 INFO:teuthology.orchestra.run.smithi174.stdout:/var/lib/ceph 2024-04-24T23:39:13.529 INFO:teuthology.orchestra.run.smithi174.stdout:/run/netns 2024-04-24T23:39:13.530 INFO:teuthology.orchestra.run.smithi174.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-24T23:39:13.530 INFO:teuthology.orchestra.run.smithi174.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-24T23:39:13.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:39:13.531 DEBUG:teuthology.orchestra.run.smithi174:> ls /sys/fs/fuse/connections 2024-04-24T23:39:13.579 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-24T23:39:13.579 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-24T23:39:13.628 DEBUG:teuthology.orchestra.run.smithi174:> sudo modprobe fuse 2024-04-24T23:39:13.642 DEBUG:teuthology.orchestra.run.smithi174:> cat /proc/self/mounts | awk '{print $2}' 2024-04-24T23:39:13.687 INFO:teuthology.orchestra.run.smithi174.stdout:/sys 2024-04-24T23:39:13.687 INFO:teuthology.orchestra.run.smithi174.stdout:/proc 2024-04-24T23:39:13.687 INFO:teuthology.orchestra.run.smithi174.stdout:/dev 2024-04-24T23:39:13.687 INFO:teuthology.orchestra.run.smithi174.stdout:/dev/pts 2024-04-24T23:39:13.688 INFO:teuthology.orchestra.run.smithi174.stdout:/run 2024-04-24T23:39:13.688 INFO:teuthology.orchestra.run.smithi174.stdout:/ 2024-04-24T23:39:13.688 INFO:teuthology.orchestra.run.smithi174.stdout:/sys/kernel/security 2024-04-24T23:39:13.688 INFO:teuthology.orchestra.run.smithi174.stdout:/dev/shm 2024-04-24T23:39:13.688 INFO:teuthology.orchestra.run.smithi174.stdout:/run/lock 2024-04-24T23:39:13.688 INFO:teuthology.orchestra.run.smithi174.stdout:/sys/fs/cgroup 2024-04-24T23:39:13.688 INFO:teuthology.orchestra.run.smithi174.stdout:/sys/fs/pstore 2024-04-24T23:39:13.688 INFO:teuthology.orchestra.run.smithi174.stdout:/sys/fs/bpf 2024-04-24T23:39:13.688 INFO:teuthology.orchestra.run.smithi174.stdout:/proc/sys/fs/binfmt_misc 2024-04-24T23:39:13.688 INFO:teuthology.orchestra.run.smithi174.stdout:/dev/hugepages 2024-04-24T23:39:13.688 INFO:teuthology.orchestra.run.smithi174.stdout:/dev/mqueue 2024-04-24T23:39:13.688 INFO:teuthology.orchestra.run.smithi174.stdout:/sys/kernel/debug 2024-04-24T23:39:13.688 INFO:teuthology.orchestra.run.smithi174.stdout:/sys/kernel/tracing 2024-04-24T23:39:13.688 INFO:teuthology.orchestra.run.smithi174.stdout:/proc/fs/nfsd 2024-04-24T23:39:13.689 INFO:teuthology.orchestra.run.smithi174.stdout:/sys/fs/fuse/connections 2024-04-24T23:39:13.689 INFO:teuthology.orchestra.run.smithi174.stdout:/sys/kernel/config 2024-04-24T23:39:13.689 INFO:teuthology.orchestra.run.smithi174.stdout:/run/credentials/systemd-sysusers.service 2024-04-24T23:39:13.689 INFO:teuthology.orchestra.run.smithi174.stdout:/run/rpc_pipefs 2024-04-24T23:39:13.689 INFO:teuthology.orchestra.run.smithi174.stdout:/run/user/1000 2024-04-24T23:39:13.689 INFO:teuthology.orchestra.run.smithi174.stdout:/var/lib/ceph 2024-04-24T23:39:13.689 INFO:teuthology.orchestra.run.smithi174.stdout:/run/netns 2024-04-24T23:39:13.689 INFO:teuthology.orchestra.run.smithi174.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-24T23:39:13.689 INFO:teuthology.orchestra.run.smithi174.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-24T23:39:13.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:39:13.690 DEBUG:teuthology.orchestra.run.smithi174:> ls /sys/fs/fuse/connections 2024-04-24T23:39:13.726 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi174.stderr:2024-04-24T23:39:13.720+0000 7f010aa38580 -1 init, newargv = 0x55a602d4a9c0 newargc=15 2024-04-24T23:39:13.726 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi174.stderr:ceph-fuse[22859]: starting ceph client 2024-04-24T23:39:13.735 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi174.stderr:ceph-fuse[22859]: starting fuse 2024-04-24T23:39:14.832 DEBUG:teuthology.orchestra.run.smithi174:> sudo modprobe fuse 2024-04-24T23:39:14.848 DEBUG:teuthology.orchestra.run.smithi174:> cat /proc/self/mounts | awk '{print $2}' 2024-04-24T23:39:14.896 INFO:teuthology.orchestra.run.smithi174.stdout:/sys 2024-04-24T23:39:14.896 INFO:teuthology.orchestra.run.smithi174.stdout:/proc 2024-04-24T23:39:14.896 INFO:teuthology.orchestra.run.smithi174.stdout:/dev 2024-04-24T23:39:14.896 INFO:teuthology.orchestra.run.smithi174.stdout:/dev/pts 2024-04-24T23:39:14.896 INFO:teuthology.orchestra.run.smithi174.stdout:/run 2024-04-24T23:39:14.896 INFO:teuthology.orchestra.run.smithi174.stdout:/ 2024-04-24T23:39:14.896 INFO:teuthology.orchestra.run.smithi174.stdout:/sys/kernel/security 2024-04-24T23:39:14.896 INFO:teuthology.orchestra.run.smithi174.stdout:/dev/shm 2024-04-24T23:39:14.897 INFO:teuthology.orchestra.run.smithi174.stdout:/run/lock 2024-04-24T23:39:14.897 INFO:teuthology.orchestra.run.smithi174.stdout:/sys/fs/cgroup 2024-04-24T23:39:14.897 INFO:teuthology.orchestra.run.smithi174.stdout:/sys/fs/pstore 2024-04-24T23:39:14.897 INFO:teuthology.orchestra.run.smithi174.stdout:/sys/fs/bpf 2024-04-24T23:39:14.897 INFO:teuthology.orchestra.run.smithi174.stdout:/proc/sys/fs/binfmt_misc 2024-04-24T23:39:14.897 INFO:teuthology.orchestra.run.smithi174.stdout:/dev/hugepages 2024-04-24T23:39:14.897 INFO:teuthology.orchestra.run.smithi174.stdout:/dev/mqueue 2024-04-24T23:39:14.897 INFO:teuthology.orchestra.run.smithi174.stdout:/sys/kernel/debug 2024-04-24T23:39:14.897 INFO:teuthology.orchestra.run.smithi174.stdout:/sys/kernel/tracing 2024-04-24T23:39:14.897 INFO:teuthology.orchestra.run.smithi174.stdout:/proc/fs/nfsd 2024-04-24T23:39:14.897 INFO:teuthology.orchestra.run.smithi174.stdout:/sys/fs/fuse/connections 2024-04-24T23:39:14.897 INFO:teuthology.orchestra.run.smithi174.stdout:/sys/kernel/config 2024-04-24T23:39:14.897 INFO:teuthology.orchestra.run.smithi174.stdout:/run/credentials/systemd-sysusers.service 2024-04-24T23:39:14.897 INFO:teuthology.orchestra.run.smithi174.stdout:/run/rpc_pipefs 2024-04-24T23:39:14.897 INFO:teuthology.orchestra.run.smithi174.stdout:/run/user/1000 2024-04-24T23:39:14.898 INFO:teuthology.orchestra.run.smithi174.stdout:/var/lib/ceph 2024-04-24T23:39:14.898 INFO:teuthology.orchestra.run.smithi174.stdout:/run/netns 2024-04-24T23:39:14.898 INFO:teuthology.orchestra.run.smithi174.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-24T23:39:14.898 INFO:teuthology.orchestra.run.smithi174.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-24T23:39:14.898 INFO:teuthology.orchestra.run.smithi174.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-24T23:39:14.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:39:14.899 DEBUG:teuthology.orchestra.run.smithi174:> ls /sys/fs/fuse/connections 2024-04-24T23:39:14.947 INFO:teuthology.orchestra.run.smithi174.stdout:45 2024-04-24T23:39:14.947 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-24T23:39:14.947 DEBUG:teuthology.orchestra.run.smithi174:> sudo stdin-killer -- python3 -c ' 2024-04-24T23:39:14.947 DEBUG:teuthology.orchestra.run.smithi174:> import glob 2024-04-24T23:39:14.947 DEBUG:teuthology.orchestra.run.smithi174:> import re 2024-04-24T23:39:14.948 DEBUG:teuthology.orchestra.run.smithi174:> import os 2024-04-24T23:39:14.948 DEBUG:teuthology.orchestra.run.smithi174:> import subprocess 2024-04-24T23:39:14.948 DEBUG:teuthology.orchestra.run.smithi174:> 2024-04-24T23:39:14.948 DEBUG:teuthology.orchestra.run.smithi174:> def _find_admin_socket(client_name): 2024-04-24T23:39:14.948 DEBUG:teuthology.orchestra.run.smithi174:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-24T23:39:14.948 DEBUG:teuthology.orchestra.run.smithi174:> files = glob.glob(asok_path) 2024-04-24T23:39:14.948 DEBUG:teuthology.orchestra.run.smithi174:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-24T23:39:14.948 DEBUG:teuthology.orchestra.run.smithi174:> 2024-04-24T23:39:14.948 DEBUG:teuthology.orchestra.run.smithi174:> # Given a non-glob path, it better be there 2024-04-24T23:39:14.948 DEBUG:teuthology.orchestra.run.smithi174:> if "*" not in asok_path: 2024-04-24T23:39:14.948 DEBUG:teuthology.orchestra.run.smithi174:> assert(len(files) == 1) 2024-04-24T23:39:14.948 DEBUG:teuthology.orchestra.run.smithi174:> return files[0] 2024-04-24T23:39:14.948 DEBUG:teuthology.orchestra.run.smithi174:> 2024-04-24T23:39:14.948 DEBUG:teuthology.orchestra.run.smithi174:> for f in files: 2024-04-24T23:39:14.948 DEBUG:teuthology.orchestra.run.smithi174:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-24T23:39:14.949 DEBUG:teuthology.orchestra.run.smithi174:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-24T23:39:14.949 DEBUG:teuthology.orchestra.run.smithi174:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-24T23:39:14.949 DEBUG:teuthology.orchestra.run.smithi174:> contents = proc_f.read() 2024-04-24T23:39:14.949 DEBUG:teuthology.orchestra.run.smithi174:> if mountpoint in contents: 2024-04-24T23:39:14.949 DEBUG:teuthology.orchestra.run.smithi174:> return f 2024-04-24T23:39:14.949 DEBUG:teuthology.orchestra.run.smithi174:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-24T23:39:14.949 DEBUG:teuthology.orchestra.run.smithi174:> 2024-04-24T23:39:14.949 DEBUG:teuthology.orchestra.run.smithi174:> print(_find_admin_socket("client.1")) 2024-04-24T23:39:14.949 DEBUG:teuthology.orchestra.run.smithi174:> ' 2024-04-24T23:39:15.070 INFO:teuthology.orchestra.run.smithi174.stdout:/var/run/ceph/ceph-client.1.22859.asok 2024-04-24T23:39:15.074 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-24T23:39:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:39:15.082 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.22859.asok 2024-04-24T23:39:15.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:39:15.082 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.22859.asok status 2024-04-24T23:39:15.239 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-24T23:39:15.239 INFO:teuthology.orchestra.run.smithi174.stdout: "metadata": { 2024-04-24T23:39:15.239 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_sha1": "d2c45d977142e024a59b68a8f1dce8f0b9840551", 2024-04-24T23:39:15.239 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_version": "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)", 2024-04-24T23:39:15.239 INFO:teuthology.orchestra.run.smithi174.stdout: "entity_id": "1", 2024-04-24T23:39:15.239 INFO:teuthology.orchestra.run.smithi174.stdout: "hostname": "smithi174", 2024-04-24T23:39:15.239 INFO:teuthology.orchestra.run.smithi174.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-24T23:39:15.239 INFO:teuthology.orchestra.run.smithi174.stdout: "pid": "22859", 2024-04-24T23:39:15.239 INFO:teuthology.orchestra.run.smithi174.stdout: "root": "/" 2024-04-24T23:39:15.239 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-24T23:39:15.239 INFO:teuthology.orchestra.run.smithi174.stdout: "dentry_count": 0, 2024-04-24T23:39:15.239 INFO:teuthology.orchestra.run.smithi174.stdout: "dentry_pinned_count": 0, 2024-04-24T23:39:15.240 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 4553, 2024-04-24T23:39:15.240 INFO:teuthology.orchestra.run.smithi174.stdout: "inst": { 2024-04-24T23:39:15.240 INFO:teuthology.orchestra.run.smithi174.stdout: "name": { 2024-04-24T23:39:15.240 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "client", 2024-04-24T23:39:15.240 INFO:teuthology.orchestra.run.smithi174.stdout: "num": 4553 2024-04-24T23:39:15.240 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-24T23:39:15.240 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2024-04-24T23:39:15.240 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2024-04-24T23:39:15.240 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "172.21.15.174:0", 2024-04-24T23:39:15.240 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 669159551 2024-04-24T23:39:15.240 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-24T23:39:15.240 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-24T23:39:15.240 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2024-04-24T23:39:15.240 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2024-04-24T23:39:15.241 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "172.21.15.174:0", 2024-04-24T23:39:15.241 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 669159551 2024-04-24T23:39:15.241 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-24T23:39:15.241 INFO:teuthology.orchestra.run.smithi174.stdout: "inst_str": "client.4553 172.21.15.174:0/669159551", 2024-04-24T23:39:15.241 INFO:teuthology.orchestra.run.smithi174.stdout: "addr_str": "172.21.15.174:0/669159551", 2024-04-24T23:39:15.241 INFO:teuthology.orchestra.run.smithi174.stdout: "inode_count": 1, 2024-04-24T23:39:15.241 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_epoch": 9, 2024-04-24T23:39:15.241 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_epoch": 24, 2024-04-24T23:39:15.241 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_epoch_barrier": 0, 2024-04-24T23:39:15.241 INFO:teuthology.orchestra.run.smithi174.stdout: "blocklisted": false, 2024-04-24T23:39:15.241 INFO:teuthology.orchestra.run.smithi174.stdout: "fs_name": "cephfs" 2024-04-24T23:39:15.241 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-24T23:39:15.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:39:15.254 DEBUG:teuthology.orchestra.run.smithi116:> stat --file-system '--printf=%T 2024-04-24T23:39:15.254 DEBUG:teuthology.orchestra.run.smithi116:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-24T23:39:15.262 INFO:teuthology.orchestra.run.smithi116.stdout:fuseblk 2024-04-24T23:39:15.262 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-24T23:39:15.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:39:15.262 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-24T23:39:15.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:39:15.317 DEBUG:teuthology.orchestra.run.smithi174:> stat --file-system '--printf=%T 2024-04-24T23:39:15.317 DEBUG:teuthology.orchestra.run.smithi174:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-24T23:39:15.324 INFO:teuthology.orchestra.run.smithi174.stdout:fuseblk 2024-04-24T23:39:15.324 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-24T23:39:15.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:39:15.324 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-24T23:39:15.379 INFO:teuthology.run_tasks:Running task pexec... 2024-04-24T23:39:15.404 INFO:teuthology.task.pexec:Executing custom commands... 2024-04-24T23:39:15.405 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi116.front.sepia.ceph.com 2024-04-24T23:39:15.405 DEBUG:teuthology.orchestra.run.smithi116:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-04-24T23:39:15.406 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi174.front.sepia.ceph.com 2024-04-24T23:39:15.406 DEBUG:teuthology.orchestra.run.smithi174:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-04-24T23:39:15.415 INFO:teuthology.orchestra.run.smithi116.stderr:+ cd /home/ubuntu/cephtest 2024-04-24T23:39:15.415 INFO:teuthology.orchestra.run.smithi116.stderr:+ sudo apt purge -y mpich 2024-04-24T23:39:15.430 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-04-24T23:39:15.430 INFO:teuthology.orchestra.run.smithi116.stderr:WARNING: apt does not have a stable CLI interface. Use with caution in scripts. 2024-04-24T23:39:15.430 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-04-24T23:39:15.430 INFO:teuthology.orchestra.run.smithi174.stderr:+ cd /home/ubuntu/cephtest 2024-04-24T23:39:15.431 INFO:teuthology.orchestra.run.smithi174.stderr:+ sudo apt purge -y mpich 2024-04-24T23:39:15.441 INFO:teuthology.orchestra.run.smithi174.stderr: 2024-04-24T23:39:15.441 INFO:teuthology.orchestra.run.smithi174.stderr:WARNING: apt does not have a stable CLI interface. Use with caution in scripts. 2024-04-24T23:39:15.442 INFO:teuthology.orchestra.run.smithi174.stderr: 2024-04-24T23:39:15.478 INFO:teuthology.orchestra.run.smithi116.stdout:Reading package lists... 2024-04-24T23:39:15.493 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2024-04-24T23:39:15.684 INFO:teuthology.orchestra.run.smithi116.stdout:Building dependency tree... 2024-04-24T23:39:15.684 INFO:teuthology.orchestra.run.smithi116.stdout:Reading state information... 2024-04-24T23:39:15.695 INFO:teuthology.orchestra.run.smithi174.stdout:Building dependency tree... 2024-04-24T23:39:15.696 INFO:teuthology.orchestra.run.smithi174.stdout:Reading state information... 2024-04-24T23:39:15.878 INFO:teuthology.orchestra.run.smithi116.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T23:39:15.878 INFO:teuthology.orchestra.run.smithi116.stdout: hwloc-nox libboost-iostreams1.74.0 libboost-thread1.74.0 libfabric1 2024-04-24T23:39:15.879 INFO:teuthology.orchestra.run.smithi116.stdout: libgfapi0 libgfrpc0 libgfxdr0 libglusterfs0 libhwloc-plugins libhwloc15 2024-04-24T23:39:15.879 INFO:teuthology.orchestra.run.smithi116.stdout: libiscsi7 libmpich12 libpmemobj1 libpsm-infinipath1 libpsm2-2 libpython2-dev 2024-04-24T23:39:15.879 INFO:teuthology.orchestra.run.smithi116.stdout: libpython2-stdlib libpython2.7 libpython2.7-dev libpython2.7-minimal 2024-04-24T23:39:15.879 INFO:teuthology.orchestra.run.smithi116.stdout: libpython2.7-stdlib libslurm37 libxnvctrl0 linux-image-5.4.0-135-generic 2024-04-24T23:39:15.879 INFO:teuthology.orchestra.run.smithi116.stdout: linux-modules-5.4.0-135-generic python2 python2-dev python2-minimal 2024-04-24T23:39:15.879 INFO:teuthology.orchestra.run.smithi116.stdout: python2.7 python2.7-dev python2.7-minimal 2024-04-24T23:39:15.880 INFO:teuthology.orchestra.run.smithi116.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T23:39:15.890 INFO:teuthology.orchestra.run.smithi174.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T23:39:15.890 INFO:teuthology.orchestra.run.smithi174.stdout: hwloc-nox libboost-iostreams1.74.0 libboost-thread1.74.0 libfabric1 2024-04-24T23:39:15.890 INFO:teuthology.orchestra.run.smithi174.stdout: libgfapi0 libgfrpc0 libgfxdr0 libglusterfs0 libhwloc-plugins libhwloc15 2024-04-24T23:39:15.890 INFO:teuthology.orchestra.run.smithi174.stdout: libiscsi7 libmpich12 libpmemobj1 libpsm-infinipath1 libpsm2-2 libpython2-dev 2024-04-24T23:39:15.890 INFO:teuthology.orchestra.run.smithi174.stdout: libpython2-stdlib libpython2.7 libpython2.7-dev libpython2.7-minimal 2024-04-24T23:39:15.890 INFO:teuthology.orchestra.run.smithi174.stdout: libpython2.7-stdlib libslurm37 libxnvctrl0 linux-image-5.4.0-135-generic 2024-04-24T23:39:15.891 INFO:teuthology.orchestra.run.smithi174.stdout: linux-modules-5.4.0-135-generic python2 python2-dev python2-minimal 2024-04-24T23:39:15.891 INFO:teuthology.orchestra.run.smithi174.stdout: python2.7 python2.7-dev python2.7-minimal 2024-04-24T23:39:15.891 INFO:teuthology.orchestra.run.smithi174.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T23:39:15.904 INFO:teuthology.orchestra.run.smithi116.stdout:The following packages will be REMOVED: 2024-04-24T23:39:15.904 INFO:teuthology.orchestra.run.smithi116.stdout: libmpich-dev* mpich* 2024-04-24T23:39:15.918 INFO:teuthology.orchestra.run.smithi174.stdout:The following packages will be REMOVED: 2024-04-24T23:39:15.918 INFO:teuthology.orchestra.run.smithi174.stdout: libmpich-dev* mpich* 2024-04-24T23:39:16.231 INFO:teuthology.orchestra.run.smithi116.stdout:0 upgraded, 0 newly installed, 2 to remove and 298 not upgraded. 2024-04-24T23:39:16.231 INFO:teuthology.orchestra.run.smithi116.stdout:After this operation, 60.3 MB disk space will be freed. 2024-04-24T23:39:16.360 INFO:teuthology.orchestra.run.smithi116.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176786 files and directories currently installed.) 2024-04-24T23:39:16.366 INFO:teuthology.orchestra.run.smithi116.stdout:Removing libmpich-dev:amd64 (4.0-3) ... 2024-04-24T23:39:16.456 INFO:teuthology.orchestra.run.smithi174.stdout:0 upgraded, 0 newly installed, 2 to remove and 298 not upgraded. 2024-04-24T23:39:16.456 INFO:teuthology.orchestra.run.smithi174.stdout:After this operation, 60.3 MB disk space will be freed. 2024-04-24T23:39:16.580 INFO:teuthology.orchestra.run.smithi174.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176786 files and directories currently installed.) 2024-04-24T23:39:16.585 INFO:teuthology.orchestra.run.smithi174.stdout:Removing libmpich-dev:amd64 (4.0-3) ... 2024-04-24T23:39:16.719 INFO:teuthology.orchestra.run.smithi116.stdout:Removing mpich (4.0-3) ... 2024-04-24T23:39:16.900 INFO:teuthology.orchestra.run.smithi174.stdout:Removing mpich (4.0-3) ... 2024-04-24T23:39:17.211 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-24T23:39:17.402 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-24T23:39:18.464 INFO:teuthology.orchestra.run.smithi116.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176712 files and directories currently installed.) 2024-04-24T23:39:18.470 INFO:teuthology.orchestra.run.smithi116.stdout:Purging configuration files for libmpich-dev:amd64 (4.0-3) ... 2024-04-24T23:39:18.644 INFO:teuthology.orchestra.run.smithi174.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176712 files and directories currently installed.) 2024-04-24T23:39:18.649 INFO:teuthology.orchestra.run.smithi174.stdout:Purging configuration files for libmpich-dev:amd64 (4.0-3) ... 2024-04-24T23:39:18.683 INFO:teuthology.orchestra.run.smithi116.stdout:dpkg: warning: while removing libmpich-dev:amd64, directory '/usr/lib/x86_64-linux-gnu/fortran' not empty so not removed 2024-04-24T23:39:18.871 INFO:teuthology.orchestra.run.smithi174.stdout:dpkg: warning: while removing libmpich-dev:amd64, directory '/usr/lib/x86_64-linux-gnu/fortran' not empty so not removed 2024-04-24T23:39:19.220 INFO:teuthology.orchestra.run.smithi116.stderr:+ sudo apt install -y mpich 2024-04-24T23:39:19.228 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-04-24T23:39:19.228 INFO:teuthology.orchestra.run.smithi116.stderr:WARNING: apt does not have a stable CLI interface. Use with caution in scripts. 2024-04-24T23:39:19.228 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-04-24T23:39:19.271 INFO:teuthology.orchestra.run.smithi116.stdout:Reading package lists... 2024-04-24T23:39:19.402 INFO:teuthology.orchestra.run.smithi174.stderr:+ sudo apt install -y mpich 2024-04-24T23:39:19.412 INFO:teuthology.orchestra.run.smithi174.stderr: 2024-04-24T23:39:19.412 INFO:teuthology.orchestra.run.smithi174.stderr:WARNING: apt does not have a stable CLI interface. Use with caution in scripts. 2024-04-24T23:39:19.412 INFO:teuthology.orchestra.run.smithi174.stderr: 2024-04-24T23:39:19.454 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2024-04-24T23:39:19.467 INFO:teuthology.orchestra.run.smithi116.stdout:Building dependency tree... 2024-04-24T23:39:19.468 INFO:teuthology.orchestra.run.smithi116.stdout:Reading state information... 2024-04-24T23:39:19.642 INFO:teuthology.orchestra.run.smithi116.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T23:39:19.642 INFO:teuthology.orchestra.run.smithi116.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T23:39:19.642 INFO:teuthology.orchestra.run.smithi116.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T23:39:19.642 INFO:teuthology.orchestra.run.smithi116.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T23:39:19.643 INFO:teuthology.orchestra.run.smithi116.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-24T23:39:19.643 INFO:teuthology.orchestra.run.smithi116.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-24T23:39:19.643 INFO:teuthology.orchestra.run.smithi116.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T23:39:19.644 INFO:teuthology.orchestra.run.smithi116.stdout:The following additional packages will be installed: 2024-04-24T23:39:19.645 INFO:teuthology.orchestra.run.smithi116.stdout: libmpich-dev 2024-04-24T23:39:19.645 INFO:teuthology.orchestra.run.smithi116.stdout:Suggested packages: 2024-04-24T23:39:19.646 INFO:teuthology.orchestra.run.smithi116.stdout: mpich-doc 2024-04-24T23:39:19.654 INFO:teuthology.orchestra.run.smithi174.stdout:Building dependency tree... 2024-04-24T23:39:19.655 INFO:teuthology.orchestra.run.smithi174.stdout:Reading state information... 2024-04-24T23:39:19.673 INFO:teuthology.orchestra.run.smithi116.stdout:The following NEW packages will be installed: 2024-04-24T23:39:19.673 INFO:teuthology.orchestra.run.smithi116.stdout: libmpich-dev mpich 2024-04-24T23:39:19.841 INFO:teuthology.orchestra.run.smithi174.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T23:39:19.841 INFO:teuthology.orchestra.run.smithi174.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T23:39:19.842 INFO:teuthology.orchestra.run.smithi174.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T23:39:19.842 INFO:teuthology.orchestra.run.smithi174.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T23:39:19.842 INFO:teuthology.orchestra.run.smithi174.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-24T23:39:19.842 INFO:teuthology.orchestra.run.smithi174.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-24T23:39:19.842 INFO:teuthology.orchestra.run.smithi174.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T23:39:19.843 INFO:teuthology.orchestra.run.smithi174.stdout:The following additional packages will be installed: 2024-04-24T23:39:19.844 INFO:teuthology.orchestra.run.smithi174.stdout: libmpich-dev 2024-04-24T23:39:19.845 INFO:teuthology.orchestra.run.smithi174.stdout:Suggested packages: 2024-04-24T23:39:19.845 INFO:teuthology.orchestra.run.smithi174.stdout: mpich-doc 2024-04-24T23:39:19.872 INFO:teuthology.orchestra.run.smithi174.stdout:The following NEW packages will be installed: 2024-04-24T23:39:19.872 INFO:teuthology.orchestra.run.smithi174.stdout: libmpich-dev mpich 2024-04-24T23:39:19.877 INFO:teuthology.orchestra.run.smithi116.stdout:0 upgraded, 2 newly installed, 0 to remove and 298 not upgraded. 2024-04-24T23:39:19.877 INFO:teuthology.orchestra.run.smithi116.stdout:Need to get 7,571 kB of archives. 2024-04-24T23:39:19.877 INFO:teuthology.orchestra.run.smithi116.stdout:After this operation, 60.3 MB of additional disk space will be used. 2024-04-24T23:39:19.877 INFO:teuthology.orchestra.run.smithi116.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 mpich amd64 4.0-3 [197 kB] 2024-04-24T23:39:19.932 INFO:teuthology.orchestra.run.smithi174.stdout:0 upgraded, 2 newly installed, 0 to remove and 298 not upgraded. 2024-04-24T23:39:19.932 INFO:teuthology.orchestra.run.smithi174.stdout:Need to get 7,571 kB of archives. 2024-04-24T23:39:19.932 INFO:teuthology.orchestra.run.smithi174.stdout:After this operation, 60.3 MB of additional disk space will be used. 2024-04-24T23:39:19.932 INFO:teuthology.orchestra.run.smithi174.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 mpich amd64 4.0-3 [197 kB] 2024-04-24T23:39:20.039 INFO:teuthology.orchestra.run.smithi174.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmpich-dev amd64 4.0-3 [7,375 kB] 2024-04-24T23:39:20.308 INFO:teuthology.orchestra.run.smithi116.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmpich-dev amd64 4.0-3 [7,375 kB] 2024-04-24T23:39:20.513 INFO:teuthology.orchestra.run.smithi174.stderr:debconf: unable to initialize frontend: Dialog 2024-04-24T23:39:20.513 INFO:teuthology.orchestra.run.smithi174.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-04-24T23:39:20.513 INFO:teuthology.orchestra.run.smithi174.stderr:debconf: falling back to frontend: Readline 2024-04-24T23:39:20.526 INFO:teuthology.orchestra.run.smithi174.stderr:debconf: unable to initialize frontend: Readline 2024-04-24T23:39:20.526 INFO:teuthology.orchestra.run.smithi174.stderr:debconf: (This frontend requires a controlling tty.) 2024-04-24T23:39:20.526 INFO:teuthology.orchestra.run.smithi174.stderr:debconf: falling back to frontend: Teletype 2024-04-24T23:39:20.529 INFO:teuthology.orchestra.run.smithi174.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-04-24T23:39:20.562 INFO:teuthology.orchestra.run.smithi174.stdout:Fetched 7,571 kB in 0s (21.9 MB/s) 2024-04-24T23:39:20.667 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package mpich. 2024-04-24T23:39:20.732 INFO:teuthology.orchestra.run.smithi174.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176711 files and directories currently installed.) 2024-04-24T23:39:20.737 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../archives/mpich_4.0-3_amd64.deb ... 2024-04-24T23:39:20.783 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking mpich (4.0-3) ... 2024-04-24T23:39:21.213 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libmpich-dev:amd64. 2024-04-24T23:39:21.241 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../libmpich-dev_4.0-3_amd64.deb ... 2024-04-24T23:39:21.291 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libmpich-dev:amd64 (4.0-3) ... 2024-04-24T23:39:22.141 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up mpich (4.0-3) ... 2024-04-24T23:39:22.257 INFO:teuthology.orchestra.run.smithi174.stdout:update-alternatives: using /usr/bin/mpicc.mpich to provide /usr/bin/mpicc (mpi) in auto mode 2024-04-24T23:39:22.288 INFO:teuthology.orchestra.run.smithi174.stdout:update-alternatives: using /usr/bin/mpirun.mpich to provide /usr/bin/mpirun (mpirun) in auto mode 2024-04-24T23:39:22.343 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libmpich-dev:amd64 (4.0-3) ... 2024-04-24T23:39:22.417 INFO:teuthology.orchestra.run.smithi174.stdout:update-alternatives: using /usr/include/x86_64-linux-gnu/mpich to provide /usr/include/x86_64-linux-gnu/mpi (mpi-x86_64-linux-gnu) in auto mode 2024-04-24T23:39:22.488 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-24T23:39:22.659 INFO:teuthology.orchestra.run.smithi116.stderr:debconf: unable to initialize frontend: Dialog 2024-04-24T23:39:22.660 INFO:teuthology.orchestra.run.smithi116.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-04-24T23:39:22.660 INFO:teuthology.orchestra.run.smithi116.stderr:debconf: falling back to frontend: Readline 2024-04-24T23:39:22.674 INFO:teuthology.orchestra.run.smithi116.stderr:debconf: unable to initialize frontend: Readline 2024-04-24T23:39:22.675 INFO:teuthology.orchestra.run.smithi116.stderr:debconf: (This frontend requires a controlling tty.) 2024-04-24T23:39:22.675 INFO:teuthology.orchestra.run.smithi116.stderr:debconf: falling back to frontend: Teletype 2024-04-24T23:39:22.679 INFO:teuthology.orchestra.run.smithi116.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-04-24T23:39:22.713 INFO:teuthology.orchestra.run.smithi116.stdout:Fetched 7,571 kB in 3s (2,835 kB/s) 2024-04-24T23:39:22.830 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package mpich. 2024-04-24T23:39:22.921 INFO:teuthology.orchestra.run.smithi116.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176711 files and directories currently installed.) 2024-04-24T23:39:22.927 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../archives/mpich_4.0-3_amd64.deb ... 2024-04-24T23:39:22.970 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking mpich (4.0-3) ... 2024-04-24T23:39:23.333 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libmpich-dev:amd64. 2024-04-24T23:39:23.361 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../libmpich-dev_4.0-3_amd64.deb ... 2024-04-24T23:39:23.403 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libmpich-dev:amd64 (4.0-3) ... 2024-04-24T23:39:23.832 INFO:teuthology.orchestra.run.smithi174.stderr:+ wget http://download.ceph.com/qa/ior-3.3.0.tar.bz2 2024-04-24T23:39:23.853 INFO:teuthology.orchestra.run.smithi174.stderr:--2024-04-24 23:39:23-- http://download.ceph.com/qa/ior-3.3.0.tar.bz2 2024-04-24T23:39:23.855 INFO:teuthology.orchestra.run.smithi174.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-04-24T23:39:23.891 INFO:teuthology.orchestra.run.smithi174.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-04-24T23:39:23.943 INFO:teuthology.orchestra.run.smithi174.stderr:HTTP request sent, awaiting response... 200 OK 2024-04-24T23:39:23.943 INFO:teuthology.orchestra.run.smithi174.stderr:Length: 250606 (245K) [application/octet-stream] 2024-04-24T23:39:23.945 INFO:teuthology.orchestra.run.smithi174.stderr:Saving to: 'ior-3.3.0.tar.bz2' 2024-04-24T23:39:23.945 INFO:teuthology.orchestra.run.smithi174.stderr: 2024-04-24T23:39:24.015 INFO:teuthology.orchestra.run.smithi174.stderr: 0K .......... .......... .......... .......... .......... 20% 704K 0s 2024-04-24T23:39:24.051 INFO:teuthology.orchestra.run.smithi174.stderr: 50K .......... .......... .......... .......... .......... 40% 1.38M 0s 2024-04-24T23:39:24.052 INFO:teuthology.orchestra.run.smithi174.stderr: 100K .......... .......... .......... .......... .......... 61% 77.3M 0s 2024-04-24T23:39:24.052 INFO:teuthology.orchestra.run.smithi174.stderr: 150K .......... .......... .......... .......... .......... 81% 102M 0s 2024-04-24T23:39:24.086 INFO:teuthology.orchestra.run.smithi174.stderr: 200K .......... .......... .......... .......... .... 100% 1.25M=0.1s 2024-04-24T23:39:24.086 INFO:teuthology.orchestra.run.smithi174.stderr: 2024-04-24T23:39:24.086 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-24 23:39:24 (1.68 MB/s) - 'ior-3.3.0.tar.bz2' saved [250606/250606] 2024-04-24T23:39:24.086 INFO:teuthology.orchestra.run.smithi174.stderr: 2024-04-24T23:39:24.086 INFO:teuthology.orchestra.run.smithi174.stderr:+ tar xvfj ior-3.3.0.tar.bz2 2024-04-24T23:39:24.123 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/ 2024-04-24T23:39:24.124 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/AUTHORS 2024-04-24T23:39:24.124 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/COPYRIGHT 2024-04-24T23:39:24.124 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/META 2024-04-24T23:39:24.124 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/Makefile.am 2024-04-24T23:39:24.124 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/Makefile.in 2024-04-24T23:39:24.124 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/NEWS 2024-04-24T23:39:24.124 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/README.md 2024-04-24T23:39:24.124 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/aclocal.m4 2024-04-24T23:39:24.125 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/config/ 2024-04-24T23:39:24.125 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/config/ax_prog_cc_mpi.m4 2024-04-24T23:39:24.125 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/config/compile 2024-04-24T23:39:24.125 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/config/config.guess 2024-04-24T23:39:24.125 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/config/config.sub 2024-04-24T23:39:24.126 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/config/depcomp 2024-04-24T23:39:24.127 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/config/install-sh 2024-04-24T23:39:24.127 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/config/missing 2024-04-24T23:39:24.127 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/config/test-driver 2024-04-24T23:39:24.127 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/config/x_ac_meta.m4 2024-04-24T23:39:24.127 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/configure 2024-04-24T23:39:24.131 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/configure.ac 2024-04-24T23:39:24.131 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/contrib/ 2024-04-24T23:39:24.131 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/contrib/Makefile.am 2024-04-24T23:39:24.131 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/contrib/Makefile.in 2024-04-24T23:39:24.131 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/contrib/cbif.c 2024-04-24T23:39:24.132 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/doc/ 2024-04-24T23:39:24.132 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/doc/Makefile.am 2024-04-24T23:39:24.132 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/doc/Makefile.in 2024-04-24T23:39:24.132 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/doc/USER_GUIDE 2024-04-24T23:39:24.132 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/doc/mdtest.1 2024-04-24T23:39:24.133 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/ 2024-04-24T23:39:24.133 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/Makefile.am 2024-04-24T23:39:24.133 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/Makefile.in 2024-04-24T23:39:24.135 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/aiori-CEPHFS.c 2024-04-24T23:39:24.135 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/aiori-DAOS.c 2024-04-24T23:39:24.135 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/aiori-DFS.c 2024-04-24T23:39:24.135 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/aiori-DUMMY.c 2024-04-24T23:39:24.135 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/aiori-Gfarm.c 2024-04-24T23:39:24.136 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/aiori-HDF5.c 2024-04-24T23:39:24.136 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/aiori-HDFS.c 2024-04-24T23:39:24.136 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/aiori-IME.c 2024-04-24T23:39:24.136 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/aiori-MMAP.c 2024-04-24T23:39:24.136 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/aiori-MPIIO.c 2024-04-24T23:39:24.145 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/aiori-NCMPI.c 2024-04-24T23:39:24.145 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/aiori-POSIX.c 2024-04-24T23:39:24.145 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/aiori-RADOS.c 2024-04-24T23:39:24.145 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/aiori-S3.c 2024-04-24T23:39:24.146 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/aiori.c 2024-04-24T23:39:24.146 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/aiori.h 2024-04-24T23:39:24.146 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/config.h.in 2024-04-24T23:39:24.147 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/ior-internal.h 2024-04-24T23:39:24.147 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/ior-main.c 2024-04-24T23:39:24.147 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/ior-output.c 2024-04-24T23:39:24.147 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/ior.c 2024-04-24T23:39:24.147 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/ior.h 2024-04-24T23:39:24.147 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/iordef.h 2024-04-24T23:39:24.148 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/mdtest-main.c 2024-04-24T23:39:24.148 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/mdtest.c 2024-04-24T23:39:24.149 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/mdtest.h 2024-04-24T23:39:24.149 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/option.c 2024-04-24T23:39:24.149 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/option.h 2024-04-24T23:39:24.149 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/parse_options.c 2024-04-24T23:39:24.149 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/parse_options.h 2024-04-24T23:39:24.150 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/test/ 2024-04-24T23:39:24.150 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/test/Makefile.am 2024-04-24T23:39:24.150 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/test/Makefile.in 2024-04-24T23:39:24.150 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/test/example.c 2024-04-24T23:39:24.150 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/test/lib.c 2024-04-24T23:39:24.150 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/utilities.c 2024-04-24T23:39:24.153 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/src/utilities.h 2024-04-24T23:39:24.153 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/ 2024-04-24T23:39:24.153 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/basic-tests.sh 2024-04-24T23:39:24.153 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/bug-multi-node.conf 2024-04-24T23:39:24.153 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/build/ 2024-04-24T23:39:24.154 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/build/test/ 2024-04-24T23:39:24.154 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/complex-tests.sh 2024-04-24T23:39:24.154 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/docker/ 2024-04-24T23:39:24.154 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/docker/README.md 2024-04-24T23:39:24.154 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/docker/centos6/ 2024-04-24T23:39:24.154 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/docker/centos6/Dockerfile 2024-04-24T23:39:24.154 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/docker/centos6/run-test.sh 2024-04-24T23:39:24.154 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/docker/centos7/ 2024-04-24T23:39:24.154 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/docker/centos7/Dockerfile 2024-04-24T23:39:24.154 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/docker/centos7/run-test.sh 2024-04-24T23:39:24.154 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/docker/ceph/ 2024-04-24T23:39:24.154 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/docker/ceph/NOTES 2024-04-24T23:39:24.154 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/docker/prepare.sh 2024-04-24T23:39:24.154 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/docker/run-all-tests.sh 2024-04-24T23:39:24.155 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/docker/ubuntu14.04/ 2024-04-24T23:39:24.155 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/docker/ubuntu14.04/Dockerfile 2024-04-24T23:39:24.155 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/docker/ubuntu14.04/run-test.sh 2024-04-24T23:39:24.155 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/docker/ubuntu16.04/ 2024-04-24T23:39:24.155 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/docker/ubuntu16.04/Dockerfile 2024-04-24T23:39:24.155 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/docker/ubuntu16.04/run-test.sh 2024-04-24T23:39:24.155 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/mdtest-patterns/ 2024-04-24T23:39:24.155 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/mdtest-patterns/advanced/ 2024-04-24T23:39:24.155 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/mdtest-patterns/advanced/3.txt 2024-04-24T23:39:24.155 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/mdtest-patterns/advanced/4.txt 2024-04-24T23:39:24.155 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/mdtest-patterns/advanced/5.txt 2024-04-24T23:39:24.155 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/mdtest-patterns/basic/ 2024-04-24T23:39:24.155 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/mdtest-patterns/basic/0.txt 2024-04-24T23:39:24.155 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/mdtest-patterns/basic/1.txt 2024-04-24T23:39:24.156 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/mdtest-patterns/basic/2.txt 2024-04-24T23:39:24.156 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/mdtest-patterns/basic/3.txt 2024-04-24T23:39:24.156 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/test-lib.sh 2024-04-24T23:39:24.156 INFO:teuthology.orchestra.run.smithi174.stdout:ior-3.3.0/testing/test_comments.ior 2024-04-24T23:39:24.156 INFO:teuthology.orchestra.run.smithi174.stderr:+ cd ior-3.3.0 2024-04-24T23:39:24.156 INFO:teuthology.orchestra.run.smithi174.stderr:+ ./configure 2024-04-24T23:39:24.236 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up mpich (4.0-3) ... 2024-04-24T23:39:24.298 INFO:teuthology.orchestra.run.smithi174.stdout:checking metadata... yes 2024-04-24T23:39:24.311 INFO:teuthology.orchestra.run.smithi116.stdout:update-alternatives: using /usr/bin/mpicc.mpich to provide /usr/bin/mpicc (mpi) in auto mode 2024-04-24T23:39:24.342 INFO:teuthology.orchestra.run.smithi116.stdout:update-alternatives: using /usr/bin/mpirun.mpich to provide /usr/bin/mpirun (mpirun) in auto mode 2024-04-24T23:39:24.406 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libmpich-dev:amd64 (4.0-3) ... 2024-04-24T23:39:24.497 INFO:teuthology.orchestra.run.smithi116.stdout:update-alternatives: using /usr/include/x86_64-linux-gnu/mpich to provide /usr/include/x86_64-linux-gnu/mpi (mpi-x86_64-linux-gnu) in auto mode 2024-04-24T23:39:24.559 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-24T23:39:24.709 INFO:teuthology.orchestra.run.smithi174.stdout:checking build system type... x86_64-pc-linux-gnu 2024-04-24T23:39:24.709 INFO:teuthology.orchestra.run.smithi174.stdout:checking host system type... x86_64-pc-linux-gnu 2024-04-24T23:39:24.717 INFO:teuthology.orchestra.run.smithi174.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-04-24T23:39:24.720 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether build environment is sane... yes 2024-04-24T23:39:24.729 INFO:teuthology.orchestra.run.smithi174.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-04-24T23:39:24.729 INFO:teuthology.orchestra.run.smithi174.stdout:checking for gawk... gawk 2024-04-24T23:39:24.735 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether make sets $(MAKE)... yes 2024-04-24T23:39:24.741 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether make supports nested variables... yes 2024-04-24T23:39:24.745 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether make supports nested variables... (cached) yes 2024-04-24T23:39:24.745 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether to enable maintainer-specific portions of Makefiles... no 2024-04-24T23:39:24.753 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether make supports the include directive... yes (GNU style) 2024-04-24T23:39:24.753 INFO:teuthology.orchestra.run.smithi174.stdout:checking for mpicc... mpicc 2024-04-24T23:39:24.753 INFO:teuthology.orchestra.run.smithi174.stdout:checking for gcc... (cached) mpicc 2024-04-24T23:39:25.251 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether the C compiler works... yes 2024-04-24T23:39:25.251 INFO:teuthology.orchestra.run.smithi174.stdout:checking for C compiler default output file name... a.out 2024-04-24T23:39:25.324 INFO:teuthology.orchestra.run.smithi174.stdout:checking for suffix of executables... 2024-04-24T23:39:25.464 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether we are cross compiling... no 2024-04-24T23:39:25.486 INFO:teuthology.orchestra.run.smithi174.stdout:checking for suffix of object files... o 2024-04-24T23:39:25.504 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether we are using the GNU C compiler... yes 2024-04-24T23:39:25.523 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether mpicc accepts -g... yes 2024-04-24T23:39:25.616 INFO:teuthology.orchestra.run.smithi174.stdout:checking for mpicc option to accept ISO C89... none needed 2024-04-24T23:39:25.660 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether mpicc understands -c and -o together... yes 2024-04-24T23:39:25.699 INFO:teuthology.orchestra.run.smithi174.stdout:checking dependency style of mpicc... gcc3 2024-04-24T23:39:25.888 INFO:teuthology.orchestra.run.smithi174.stdout:checking for function MPI_Init... yes 2024-04-24T23:39:25.914 INFO:teuthology.orchestra.run.smithi116.stderr:+ wget http://download.ceph.com/qa/ior-3.3.0.tar.bz2 2024-04-24T23:39:25.935 INFO:teuthology.orchestra.run.smithi116.stderr:--2024-04-24 23:39:25-- http://download.ceph.com/qa/ior-3.3.0.tar.bz2 2024-04-24T23:39:25.936 INFO:teuthology.orchestra.run.smithi116.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-04-24T23:39:25.939 INFO:teuthology.orchestra.run.smithi174.stdout:checking for mpi.h... yes 2024-04-24T23:39:25.941 INFO:teuthology.orchestra.run.smithi174.stdout:checking for ranlib... ranlib 2024-04-24T23:39:25.972 INFO:teuthology.orchestra.run.smithi116.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-04-24T23:39:26.009 INFO:teuthology.orchestra.run.smithi116.stderr:HTTP request sent, awaiting response... 200 OK 2024-04-24T23:39:26.009 INFO:teuthology.orchestra.run.smithi116.stderr:Length: 250606 (245K) [application/octet-stream] 2024-04-24T23:39:26.009 INFO:teuthology.orchestra.run.smithi116.stderr:Saving to: 'ior-3.3.0.tar.bz2' 2024-04-24T23:39:26.009 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-04-24T23:39:26.049 INFO:teuthology.orchestra.run.smithi174.stdout:checking for mpicc option to accept ISO C99... none needed 2024-04-24T23:39:26.081 INFO:teuthology.orchestra.run.smithi116.stderr: 0K .......... .......... .......... .......... .......... 20% 701K 0s 2024-04-24T23:39:26.107 INFO:teuthology.orchestra.run.smithi174.stdout:checking how to run the C preprocessor... mpicc -E 2024-04-24T23:39:26.117 INFO:teuthology.orchestra.run.smithi116.stderr: 50K .......... .......... .......... .......... .......... 40% 1.37M 0s 2024-04-24T23:39:26.117 INFO:teuthology.orchestra.run.smithi116.stderr: 100K .......... .......... .......... .......... .......... 61% 115M 0s 2024-04-24T23:39:26.117 INFO:teuthology.orchestra.run.smithi116.stderr: 150K .......... .......... .......... .......... .......... 81% 89.5M 0s 2024-04-24T23:39:26.142 INFO:teuthology.orchestra.run.smithi174.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-04-24T23:39:26.144 INFO:teuthology.orchestra.run.smithi174.stdout:checking for egrep... /usr/bin/grep -E 2024-04-24T23:39:26.152 INFO:teuthology.orchestra.run.smithi116.stderr: 200K .......... .......... .......... .......... .... 100% 1.24M=0.1s 2024-04-24T23:39:26.152 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-04-24T23:39:26.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-24 23:39:26 (1.67 MB/s) - 'ior-3.3.0.tar.bz2' saved [250606/250606] 2024-04-24T23:39:26.152 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-04-24T23:39:26.152 INFO:teuthology.orchestra.run.smithi116.stderr:+ tar xvfj ior-3.3.0.tar.bz2 2024-04-24T23:39:26.185 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/ 2024-04-24T23:39:26.185 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/AUTHORS 2024-04-24T23:39:26.185 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/COPYRIGHT 2024-04-24T23:39:26.185 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/META 2024-04-24T23:39:26.185 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/Makefile.am 2024-04-24T23:39:26.185 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/Makefile.in 2024-04-24T23:39:26.185 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/NEWS 2024-04-24T23:39:26.186 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/README.md 2024-04-24T23:39:26.186 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/aclocal.m4 2024-04-24T23:39:26.186 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/config/ 2024-04-24T23:39:26.187 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/config/ax_prog_cc_mpi.m4 2024-04-24T23:39:26.187 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/config/compile 2024-04-24T23:39:26.187 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/config/config.guess 2024-04-24T23:39:26.187 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/config/config.sub 2024-04-24T23:39:26.187 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/config/depcomp 2024-04-24T23:39:26.188 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/config/install-sh 2024-04-24T23:39:26.188 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/config/missing 2024-04-24T23:39:26.189 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/config/test-driver 2024-04-24T23:39:26.189 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/config/x_ac_meta.m4 2024-04-24T23:39:26.189 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/configure 2024-04-24T23:39:26.193 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/configure.ac 2024-04-24T23:39:26.193 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/contrib/ 2024-04-24T23:39:26.193 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/contrib/Makefile.am 2024-04-24T23:39:26.193 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/contrib/Makefile.in 2024-04-24T23:39:26.193 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/contrib/cbif.c 2024-04-24T23:39:26.193 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/doc/ 2024-04-24T23:39:26.193 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/doc/Makefile.am 2024-04-24T23:39:26.193 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/doc/Makefile.in 2024-04-24T23:39:26.194 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/doc/USER_GUIDE 2024-04-24T23:39:26.194 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/doc/mdtest.1 2024-04-24T23:39:26.194 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/ 2024-04-24T23:39:26.194 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/Makefile.am 2024-04-24T23:39:26.195 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/Makefile.in 2024-04-24T23:39:26.196 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/aiori-CEPHFS.c 2024-04-24T23:39:26.197 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/aiori-DAOS.c 2024-04-24T23:39:26.197 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/aiori-DFS.c 2024-04-24T23:39:26.197 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/aiori-DUMMY.c 2024-04-24T23:39:26.197 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/aiori-Gfarm.c 2024-04-24T23:39:26.197 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/aiori-HDF5.c 2024-04-24T23:39:26.198 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/aiori-HDFS.c 2024-04-24T23:39:26.198 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/aiori-IME.c 2024-04-24T23:39:26.198 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/aiori-MMAP.c 2024-04-24T23:39:26.198 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/aiori-MPIIO.c 2024-04-24T23:39:26.206 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/aiori-NCMPI.c 2024-04-24T23:39:26.206 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/aiori-POSIX.c 2024-04-24T23:39:26.207 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/aiori-RADOS.c 2024-04-24T23:39:26.207 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/aiori-S3.c 2024-04-24T23:39:26.208 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/aiori.c 2024-04-24T23:39:26.208 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/aiori.h 2024-04-24T23:39:26.208 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/config.h.in 2024-04-24T23:39:26.208 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/ior-internal.h 2024-04-24T23:39:26.208 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/ior-main.c 2024-04-24T23:39:26.208 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/ior-output.c 2024-04-24T23:39:26.208 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/ior.c 2024-04-24T23:39:26.209 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/ior.h 2024-04-24T23:39:26.209 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/iordef.h 2024-04-24T23:39:26.209 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/mdtest-main.c 2024-04-24T23:39:26.209 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/mdtest.c 2024-04-24T23:39:26.211 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/mdtest.h 2024-04-24T23:39:26.211 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/option.c 2024-04-24T23:39:26.211 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/option.h 2024-04-24T23:39:26.211 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/parse_options.c 2024-04-24T23:39:26.211 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/parse_options.h 2024-04-24T23:39:26.211 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/test/ 2024-04-24T23:39:26.211 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/test/Makefile.am 2024-04-24T23:39:26.212 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/test/Makefile.in 2024-04-24T23:39:26.212 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/test/example.c 2024-04-24T23:39:26.212 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/test/lib.c 2024-04-24T23:39:26.212 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/utilities.c 2024-04-24T23:39:26.215 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/src/utilities.h 2024-04-24T23:39:26.215 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/ 2024-04-24T23:39:26.216 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/basic-tests.sh 2024-04-24T23:39:26.216 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/bug-multi-node.conf 2024-04-24T23:39:26.216 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/build/ 2024-04-24T23:39:26.216 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/build/test/ 2024-04-24T23:39:26.216 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/complex-tests.sh 2024-04-24T23:39:26.216 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/docker/ 2024-04-24T23:39:26.216 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/docker/README.md 2024-04-24T23:39:26.216 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/docker/centos6/ 2024-04-24T23:39:26.216 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/docker/centos6/Dockerfile 2024-04-24T23:39:26.216 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/docker/centos6/run-test.sh 2024-04-24T23:39:26.216 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/docker/centos7/ 2024-04-24T23:39:26.216 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/docker/centos7/Dockerfile 2024-04-24T23:39:26.216 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/docker/centos7/run-test.sh 2024-04-24T23:39:26.217 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/docker/ceph/ 2024-04-24T23:39:26.217 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/docker/ceph/NOTES 2024-04-24T23:39:26.217 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/docker/prepare.sh 2024-04-24T23:39:26.217 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/docker/run-all-tests.sh 2024-04-24T23:39:26.217 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/docker/ubuntu14.04/ 2024-04-24T23:39:26.217 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/docker/ubuntu14.04/Dockerfile 2024-04-24T23:39:26.217 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/docker/ubuntu14.04/run-test.sh 2024-04-24T23:39:26.217 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/docker/ubuntu16.04/ 2024-04-24T23:39:26.217 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/docker/ubuntu16.04/Dockerfile 2024-04-24T23:39:26.217 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/docker/ubuntu16.04/run-test.sh 2024-04-24T23:39:26.217 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/mdtest-patterns/ 2024-04-24T23:39:26.217 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/mdtest-patterns/advanced/ 2024-04-24T23:39:26.217 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/mdtest-patterns/advanced/3.txt 2024-04-24T23:39:26.217 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/mdtest-patterns/advanced/4.txt 2024-04-24T23:39:26.218 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/mdtest-patterns/advanced/5.txt 2024-04-24T23:39:26.218 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/mdtest-patterns/basic/ 2024-04-24T23:39:26.218 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/mdtest-patterns/basic/0.txt 2024-04-24T23:39:26.218 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/mdtest-patterns/basic/1.txt 2024-04-24T23:39:26.218 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/mdtest-patterns/basic/2.txt 2024-04-24T23:39:26.218 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/mdtest-patterns/basic/3.txt 2024-04-24T23:39:26.218 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/test-lib.sh 2024-04-24T23:39:26.218 INFO:teuthology.orchestra.run.smithi116.stdout:ior-3.3.0/testing/test_comments.ior 2024-04-24T23:39:26.218 INFO:teuthology.orchestra.run.smithi116.stderr:+ cd ior-3.3.0 2024-04-24T23:39:26.218 INFO:teuthology.orchestra.run.smithi116.stderr:+ ./configure 2024-04-24T23:39:26.304 INFO:teuthology.orchestra.run.smithi174.stdout:checking for ANSI C header files... yes 2024-04-24T23:39:26.332 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/types.h... yes 2024-04-24T23:39:26.364 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/stat.h... yes 2024-04-24T23:39:26.367 INFO:teuthology.orchestra.run.smithi116.stdout:checking metadata... yes 2024-04-24T23:39:26.395 INFO:teuthology.orchestra.run.smithi174.stdout:checking for stdlib.h... yes 2024-04-24T23:39:26.429 INFO:teuthology.orchestra.run.smithi174.stdout:checking for string.h... yes 2024-04-24T23:39:26.464 INFO:teuthology.orchestra.run.smithi174.stdout:checking for memory.h... yes 2024-04-24T23:39:26.498 INFO:teuthology.orchestra.run.smithi174.stdout:checking for strings.h... yes 2024-04-24T23:39:26.534 INFO:teuthology.orchestra.run.smithi174.stdout:checking for inttypes.h... yes 2024-04-24T23:39:26.568 INFO:teuthology.orchestra.run.smithi174.stdout:checking for stdint.h... yes 2024-04-24T23:39:26.617 INFO:teuthology.orchestra.run.smithi174.stdout:checking for unistd.h... yes 2024-04-24T23:39:26.658 INFO:teuthology.orchestra.run.smithi174.stdout:checking fcntl.h usability... yes 2024-04-24T23:39:26.671 INFO:teuthology.orchestra.run.smithi174.stdout:checking fcntl.h presence... yes 2024-04-24T23:39:26.671 INFO:teuthology.orchestra.run.smithi174.stdout:checking for fcntl.h... yes 2024-04-24T23:39:26.713 INFO:teuthology.orchestra.run.smithi174.stdout:checking libintl.h usability... yes 2024-04-24T23:39:26.725 INFO:teuthology.orchestra.run.smithi174.stdout:checking libintl.h presence... yes 2024-04-24T23:39:26.725 INFO:teuthology.orchestra.run.smithi174.stdout:checking for libintl.h... yes 2024-04-24T23:39:26.730 INFO:teuthology.orchestra.run.smithi174.stdout:checking for stdlib.h... (cached) yes 2024-04-24T23:39:26.735 INFO:teuthology.orchestra.run.smithi174.stdout:checking for string.h... (cached) yes 2024-04-24T23:39:26.740 INFO:teuthology.orchestra.run.smithi174.stdout:checking for strings.h... (cached) yes 2024-04-24T23:39:26.757 INFO:teuthology.orchestra.run.smithi116.stdout:checking build system type... x86_64-pc-linux-gnu 2024-04-24T23:39:26.757 INFO:teuthology.orchestra.run.smithi116.stdout:checking host system type... x86_64-pc-linux-gnu 2024-04-24T23:39:26.766 INFO:teuthology.orchestra.run.smithi116.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-04-24T23:39:26.769 INFO:teuthology.orchestra.run.smithi116.stdout:checking whether build environment is sane... yes 2024-04-24T23:39:26.777 INFO:teuthology.orchestra.run.smithi116.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-04-24T23:39:26.777 INFO:teuthology.orchestra.run.smithi116.stdout:checking for gawk... gawk 2024-04-24T23:39:26.784 INFO:teuthology.orchestra.run.smithi116.stdout:checking whether make sets $(MAKE)... yes 2024-04-24T23:39:26.788 INFO:teuthology.orchestra.run.smithi116.stdout:checking whether make supports nested variables... yes 2024-04-24T23:39:26.793 INFO:teuthology.orchestra.run.smithi116.stdout:checking whether make supports nested variables... (cached) yes 2024-04-24T23:39:26.793 INFO:teuthology.orchestra.run.smithi116.stdout:checking whether to enable maintainer-specific portions of Makefiles... no 2024-04-24T23:39:26.801 INFO:teuthology.orchestra.run.smithi116.stdout:checking whether make supports the include directive... yes (GNU style) 2024-04-24T23:39:26.801 INFO:teuthology.orchestra.run.smithi116.stdout:checking for mpicc... mpicc 2024-04-24T23:39:26.801 INFO:teuthology.orchestra.run.smithi116.stdout:checking for gcc... (cached) mpicc 2024-04-24T23:39:26.842 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/ioctl.h usability... yes 2024-04-24T23:39:26.854 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/ioctl.h presence... yes 2024-04-24T23:39:26.854 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/ioctl.h... yes 2024-04-24T23:39:26.926 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/param.h usability... yes 2024-04-24T23:39:26.943 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/param.h presence... yes 2024-04-24T23:39:26.943 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/param.h... yes 2024-04-24T23:39:26.985 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/statfs.h usability... yes 2024-04-24T23:39:26.998 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/statfs.h presence... yes 2024-04-24T23:39:26.999 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/statfs.h... yes 2024-04-24T23:39:27.039 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/statvfs.h usability... yes 2024-04-24T23:39:27.050 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/statvfs.h presence... yes 2024-04-24T23:39:27.051 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/statvfs.h... yes 2024-04-24T23:39:27.091 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/time.h usability... yes 2024-04-24T23:39:27.103 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/time.h presence... yes 2024-04-24T23:39:27.103 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/time.h... yes 2024-04-24T23:39:27.108 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/param.h... (cached) yes 2024-04-24T23:39:27.145 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/mount.h usability... yes 2024-04-24T23:39:27.157 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/mount.h presence... yes 2024-04-24T23:39:27.157 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/mount.h... yes 2024-04-24T23:39:27.162 INFO:teuthology.orchestra.run.smithi174.stdout:checking for unistd.h... (cached) yes 2024-04-24T23:39:27.204 INFO:teuthology.orchestra.run.smithi174.stdout:checking wchar.h usability... yes 2024-04-24T23:39:27.216 INFO:teuthology.orchestra.run.smithi174.stdout:checking wchar.h presence... yes 2024-04-24T23:39:27.216 INFO:teuthology.orchestra.run.smithi174.stdout:checking for wchar.h... yes 2024-04-24T23:39:27.252 INFO:teuthology.orchestra.run.smithi174.stdout:checking hdfs.h usability... no 2024-04-24T23:39:27.265 INFO:teuthology.orchestra.run.smithi174.stdout:checking hdfs.h presence... no 2024-04-24T23:39:27.265 INFO:teuthology.orchestra.run.smithi174.stdout:checking for hdfs.h... no 2024-04-24T23:39:27.301 INFO:teuthology.orchestra.run.smithi174.stdout:checking beegfs/beegfs.h usability... no 2024-04-24T23:39:27.314 INFO:teuthology.orchestra.run.smithi174.stdout:checking beegfs/beegfs.h presence... no 2024-04-24T23:39:27.314 INFO:teuthology.orchestra.run.smithi174.stdout:checking for beegfs/beegfs.h... no 2024-04-24T23:39:27.315 INFO:teuthology.orchestra.run.smithi116.stdout:checking whether the C compiler works... yes 2024-04-24T23:39:27.315 INFO:teuthology.orchestra.run.smithi116.stdout:checking for C compiler default output file name... a.out 2024-04-24T23:39:27.382 INFO:teuthology.orchestra.run.smithi174.stdout:checking for size_t... yes 2024-04-24T23:39:27.385 INFO:teuthology.orchestra.run.smithi116.stdout:checking for suffix of executables... 2024-04-24T23:39:27.452 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sysconf... yes 2024-04-24T23:39:27.480 INFO:teuthology.orchestra.run.smithi116.stdout:checking whether we are cross compiling... no 2024-04-24T23:39:27.501 INFO:teuthology.orchestra.run.smithi116.stdout:checking for suffix of object files... o 2024-04-24T23:39:27.519 INFO:teuthology.orchestra.run.smithi116.stdout:checking whether we are using the GNU C compiler... yes 2024-04-24T23:39:27.519 INFO:teuthology.orchestra.run.smithi174.stdout:checking for gettimeofday... yes 2024-04-24T23:39:27.538 INFO:teuthology.orchestra.run.smithi116.stdout:checking whether mpicc accepts -g... yes 2024-04-24T23:39:27.591 INFO:teuthology.orchestra.run.smithi174.stdout:checking for memset... yes 2024-04-24T23:39:27.639 INFO:teuthology.orchestra.run.smithi116.stdout:checking for mpicc option to accept ISO C89... none needed 2024-04-24T23:39:27.660 INFO:teuthology.orchestra.run.smithi174.stdout:checking for mkdir... yes 2024-04-24T23:39:27.680 INFO:teuthology.orchestra.run.smithi116.stdout:checking whether mpicc understands -c and -o together... yes 2024-04-24T23:39:27.719 INFO:teuthology.orchestra.run.smithi116.stdout:checking dependency style of mpicc... gcc3 2024-04-24T23:39:27.732 INFO:teuthology.orchestra.run.smithi174.stdout:checking for pow... no 2024-04-24T23:39:27.800 INFO:teuthology.orchestra.run.smithi174.stdout:checking for putenv... yes 2024-04-24T23:39:27.868 INFO:teuthology.orchestra.run.smithi174.stdout:checking for realpath... yes 2024-04-24T23:39:27.901 INFO:teuthology.orchestra.run.smithi116.stdout:checking for function MPI_Init... yes 2024-04-24T23:39:27.933 INFO:teuthology.orchestra.run.smithi174.stdout:checking for regcomp... yes 2024-04-24T23:39:27.952 INFO:teuthology.orchestra.run.smithi116.stdout:checking for mpi.h... yes 2024-04-24T23:39:27.953 INFO:teuthology.orchestra.run.smithi116.stdout:checking for ranlib... ranlib 2024-04-24T23:39:28.004 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sqrt... no 2024-04-24T23:39:28.050 INFO:teuthology.orchestra.run.smithi116.stdout:checking for mpicc option to accept ISO C99... none needed 2024-04-24T23:39:28.069 INFO:teuthology.orchestra.run.smithi174.stdout:checking for strcasecmp... yes 2024-04-24T23:39:28.132 INFO:teuthology.orchestra.run.smithi116.stdout:checking how to run the C preprocessor... mpicc -E 2024-04-24T23:39:28.137 INFO:teuthology.orchestra.run.smithi174.stdout:checking for strchr... yes 2024-04-24T23:39:28.166 INFO:teuthology.orchestra.run.smithi116.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-04-24T23:39:28.168 INFO:teuthology.orchestra.run.smithi116.stdout:checking for egrep... /usr/bin/grep -E 2024-04-24T23:39:28.203 INFO:teuthology.orchestra.run.smithi174.stdout:checking for strerror... yes 2024-04-24T23:39:28.272 INFO:teuthology.orchestra.run.smithi174.stdout:checking for strncasecmp... yes 2024-04-24T23:39:28.336 INFO:teuthology.orchestra.run.smithi116.stdout:checking for ANSI C header files... yes 2024-04-24T23:39:28.338 INFO:teuthology.orchestra.run.smithi174.stdout:checking for strstr... yes 2024-04-24T23:39:28.365 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sys/types.h... yes 2024-04-24T23:39:28.398 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sys/stat.h... yes 2024-04-24T23:39:28.403 INFO:teuthology.orchestra.run.smithi174.stdout:checking for uname... yes 2024-04-24T23:39:28.428 INFO:teuthology.orchestra.run.smithi116.stdout:checking for stdlib.h... yes 2024-04-24T23:39:28.463 INFO:teuthology.orchestra.run.smithi116.stdout:checking for string.h... yes 2024-04-24T23:39:28.469 INFO:teuthology.orchestra.run.smithi174.stdout:checking for statfs... yes 2024-04-24T23:39:28.500 INFO:teuthology.orchestra.run.smithi116.stdout:checking for memory.h... yes 2024-04-24T23:39:28.535 INFO:teuthology.orchestra.run.smithi116.stdout:checking for strings.h... yes 2024-04-24T23:39:28.535 INFO:teuthology.orchestra.run.smithi174.stdout:checking for statvfs... yes 2024-04-24T23:39:28.570 INFO:teuthology.orchestra.run.smithi116.stdout:checking for inttypes.h... yes 2024-04-24T23:39:28.606 INFO:teuthology.orchestra.run.smithi116.stdout:checking for stdint.h... yes 2024-04-24T23:39:28.650 INFO:teuthology.orchestra.run.smithi116.stdout:checking for unistd.h... yes 2024-04-24T23:39:28.692 INFO:teuthology.orchestra.run.smithi116.stdout:checking fcntl.h usability... yes 2024-04-24T23:39:28.693 INFO:teuthology.orchestra.run.smithi174.stdout:checking for library containing sqrt... -lm 2024-04-24T23:39:28.706 INFO:teuthology.orchestra.run.smithi116.stdout:checking fcntl.h presence... yes 2024-04-24T23:39:28.706 INFO:teuthology.orchestra.run.smithi116.stdout:checking for fcntl.h... yes 2024-04-24T23:39:28.725 INFO:teuthology.orchestra.run.smithi174.stdout:checking gpfs.h usability... no 2024-04-24T23:39:28.739 INFO:teuthology.orchestra.run.smithi174.stdout:checking gpfs.h presence... no 2024-04-24T23:39:28.739 INFO:teuthology.orchestra.run.smithi174.stdout:checking for gpfs.h... no 2024-04-24T23:39:28.747 INFO:teuthology.orchestra.run.smithi116.stdout:checking libintl.h usability... yes 2024-04-24T23:39:28.759 INFO:teuthology.orchestra.run.smithi116.stdout:checking libintl.h presence... yes 2024-04-24T23:39:28.759 INFO:teuthology.orchestra.run.smithi116.stdout:checking for libintl.h... yes 2024-04-24T23:39:28.764 INFO:teuthology.orchestra.run.smithi116.stdout:checking for stdlib.h... (cached) yes 2024-04-24T23:39:28.769 INFO:teuthology.orchestra.run.smithi116.stdout:checking for string.h... (cached) yes 2024-04-24T23:39:28.771 INFO:teuthology.orchestra.run.smithi174.stdout:checking gpfs_fcntl.h usability... no 2024-04-24T23:39:28.774 INFO:teuthology.orchestra.run.smithi116.stdout:checking for strings.h... (cached) yes 2024-04-24T23:39:28.785 INFO:teuthology.orchestra.run.smithi174.stdout:checking gpfs_fcntl.h presence... no 2024-04-24T23:39:28.785 INFO:teuthology.orchestra.run.smithi174.stdout:checking for gpfs_fcntl.h... no 2024-04-24T23:39:28.785 INFO:teuthology.orchestra.run.smithi174.stdout:checking for special C compiler options needed for large files... no 2024-04-24T23:39:28.805 INFO:teuthology.orchestra.run.smithi174.stdout:checking for _FILE_OFFSET_BITS value needed for large files... no 2024-04-24T23:39:28.807 INFO:teuthology.orchestra.run.smithi174.stdout:checking for Gfarm file system... no 2024-04-24T23:39:28.826 INFO:teuthology.orchestra.run.smithi174.stdout:checking that generated files are newer than configure... done 2024-04-24T23:39:28.827 INFO:teuthology.orchestra.run.smithi174.stdout:configure: creating ./config.status 2024-04-24T23:39:28.849 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/ioctl.h usability... yes 2024-04-24T23:39:28.862 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/ioctl.h presence... yes 2024-04-24T23:39:28.862 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sys/ioctl.h... yes 2024-04-24T23:39:28.884 INFO:teuthology.orchestra.run.smithi174.stdout:config.status: creating Makefile 2024-04-24T23:39:28.892 INFO:teuthology.orchestra.run.smithi174.stdout:config.status: creating src/Makefile 2024-04-24T23:39:28.907 INFO:teuthology.orchestra.run.smithi174.stdout:config.status: creating src/test/Makefile 2024-04-24T23:39:28.918 INFO:teuthology.orchestra.run.smithi174.stdout:config.status: creating contrib/Makefile 2024-04-24T23:39:28.930 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/param.h usability... yes 2024-04-24T23:39:28.930 INFO:teuthology.orchestra.run.smithi174.stdout:config.status: creating doc/Makefile 2024-04-24T23:39:28.942 INFO:teuthology.orchestra.run.smithi174.stdout:config.status: creating src/config.h 2024-04-24T23:39:28.947 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/param.h presence... yes 2024-04-24T23:39:28.947 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sys/param.h... yes 2024-04-24T23:39:28.953 INFO:teuthology.orchestra.run.smithi174.stdout:config.status: executing depfiles commands 2024-04-24T23:39:28.988 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/statfs.h usability... yes 2024-04-24T23:39:29.000 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/statfs.h presence... yes 2024-04-24T23:39:29.000 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sys/statfs.h... yes 2024-04-24T23:39:29.040 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/statvfs.h usability... yes 2024-04-24T23:39:29.051 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/statvfs.h presence... yes 2024-04-24T23:39:29.051 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sys/statvfs.h... yes 2024-04-24T23:39:29.097 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/time.h usability... yes 2024-04-24T23:39:29.110 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/time.h presence... yes 2024-04-24T23:39:29.110 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sys/time.h... yes 2024-04-24T23:39:29.115 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sys/param.h... (cached) yes 2024-04-24T23:39:29.155 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/mount.h usability... yes 2024-04-24T23:39:29.168 INFO:teuthology.orchestra.run.smithi116.stdout:checking sys/mount.h presence... yes 2024-04-24T23:39:29.168 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sys/mount.h... yes 2024-04-24T23:39:29.173 INFO:teuthology.orchestra.run.smithi116.stdout:checking for unistd.h... (cached) yes 2024-04-24T23:39:29.213 INFO:teuthology.orchestra.run.smithi116.stdout:checking wchar.h usability... yes 2024-04-24T23:39:29.225 INFO:teuthology.orchestra.run.smithi116.stdout:checking wchar.h presence... yes 2024-04-24T23:39:29.225 INFO:teuthology.orchestra.run.smithi116.stdout:checking for wchar.h... yes 2024-04-24T23:39:29.253 INFO:teuthology.orchestra.run.smithi174.stderr:+ make 2024-04-24T23:39:29.257 INFO:teuthology.orchestra.run.smithi174.stdout:Making all in src 2024-04-24T23:39:29.261 INFO:teuthology.orchestra.run.smithi116.stdout:checking hdfs.h usability... no 2024-04-24T23:39:29.261 INFO:teuthology.orchestra.run.smithi174.stdout:make all-recursive 2024-04-24T23:39:29.267 INFO:teuthology.orchestra.run.smithi174.stdout:Making all in . 2024-04-24T23:39:29.270 INFO:teuthology.orchestra.run.smithi174.stdout: CC ior-ior-main.o 2024-04-24T23:39:29.273 INFO:teuthology.orchestra.run.smithi116.stdout:checking hdfs.h presence... no 2024-04-24T23:39:29.273 INFO:teuthology.orchestra.run.smithi116.stdout:checking for hdfs.h... no 2024-04-24T23:39:29.307 INFO:teuthology.orchestra.run.smithi116.stdout:checking beegfs/beegfs.h usability... no 2024-04-24T23:39:29.319 INFO:teuthology.orchestra.run.smithi116.stdout:checking beegfs/beegfs.h presence... no 2024-04-24T23:39:29.320 INFO:teuthology.orchestra.run.smithi116.stdout:checking for beegfs/beegfs.h... no 2024-04-24T23:39:29.372 INFO:teuthology.orchestra.run.smithi174.stdout: CC ior-aiori.o 2024-04-24T23:39:29.385 INFO:teuthology.orchestra.run.smithi116.stdout:checking for size_t... yes 2024-04-24T23:39:29.451 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sysconf... yes 2024-04-24T23:39:29.506 INFO:teuthology.orchestra.run.smithi174.stdout: CC ior-aiori-DUMMY.o 2024-04-24T23:39:29.519 INFO:teuthology.orchestra.run.smithi116.stdout:checking for gettimeofday... yes 2024-04-24T23:39:29.588 INFO:teuthology.orchestra.run.smithi116.stdout:checking for memset... yes 2024-04-24T23:39:29.619 INFO:teuthology.orchestra.run.smithi174.stdout: CC ior-aiori-MPIIO.o 2024-04-24T23:39:29.656 INFO:teuthology.orchestra.run.smithi116.stdout:checking for mkdir... yes 2024-04-24T23:39:29.728 INFO:teuthology.orchestra.run.smithi116.stdout:checking for pow... no 2024-04-24T23:39:29.793 INFO:teuthology.orchestra.run.smithi116.stdout:checking for putenv... yes 2024-04-24T23:39:29.858 INFO:teuthology.orchestra.run.smithi174.stdout: CC ior-aiori-MMAP.o 2024-04-24T23:39:29.862 INFO:teuthology.orchestra.run.smithi116.stdout:checking for realpath... yes 2024-04-24T23:39:29.931 INFO:teuthology.orchestra.run.smithi116.stdout:checking for regcomp... yes 2024-04-24T23:39:29.989 INFO:teuthology.orchestra.run.smithi174.stdout: CC ior-aiori-POSIX.o 2024-04-24T23:39:30.003 INFO:teuthology.orchestra.run.smithi116.stdout:checking for sqrt... no 2024-04-24T23:39:30.071 INFO:teuthology.orchestra.run.smithi116.stdout:checking for strcasecmp... yes 2024-04-24T23:39:30.138 INFO:teuthology.orchestra.run.smithi116.stdout:checking for strchr... yes 2024-04-24T23:39:30.171 INFO:teuthology.orchestra.run.smithi174.stdout: CC libaiori_a-ior.o 2024-04-24T23:39:30.205 INFO:teuthology.orchestra.run.smithi116.stdout:checking for strerror... yes 2024-04-24T23:39:30.273 INFO:teuthology.orchestra.run.smithi116.stdout:checking for strncasecmp... yes 2024-04-24T23:39:30.341 INFO:teuthology.orchestra.run.smithi116.stdout:checking for strstr... yes 2024-04-24T23:39:30.407 INFO:teuthology.orchestra.run.smithi116.stdout:checking for uname... yes 2024-04-24T23:39:30.472 INFO:teuthology.orchestra.run.smithi116.stdout:checking for statfs... yes 2024-04-24T23:39:30.540 INFO:teuthology.orchestra.run.smithi116.stdout:checking for statvfs... yes 2024-04-24T23:39:30.564 INFO:teuthology.orchestra.run.smithi174.stderr:ior.c: In function 'GetPlatformName': 2024-04-24T23:39:30.564 INFO:teuthology.orchestra.run.smithi174.stderr:ior.c:699:37: warning: ')' directive writing 1 byte into a region of size between 0 and 1023 [-Wformat-overflow=] 2024-04-24T23:39:30.564 INFO:teuthology.orchestra.run.smithi174.stderr: 699 | sprintf(platformName, "%s(%s)", nodeName, sysName); 2024-04-24T23:39:30.564 INFO:teuthology.orchestra.run.smithi174.stderr: | ^ 2024-04-24T23:39:30.564 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:30.564 INFO:teuthology.orchestra.run.smithi174.stderr: from ior.c:15: 2024-04-24T23:39:30.564 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 3 or more bytes (assuming 1026) into a destination of size 1024 2024-04-24T23:39:30.564 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:30.564 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:30.564 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:30.564 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:30.564 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:30.564 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:30.692 INFO:teuthology.orchestra.run.smithi116.stdout:checking for library containing sqrt... -lm 2024-04-24T23:39:30.742 INFO:teuthology.orchestra.run.smithi116.stdout:checking gpfs.h usability... no 2024-04-24T23:39:30.777 INFO:teuthology.orchestra.run.smithi116.stdout:checking gpfs.h presence... no 2024-04-24T23:39:30.777 INFO:teuthology.orchestra.run.smithi116.stdout:checking for gpfs.h... no 2024-04-24T23:39:30.810 INFO:teuthology.orchestra.run.smithi116.stdout:checking gpfs_fcntl.h usability... no 2024-04-24T23:39:30.823 INFO:teuthology.orchestra.run.smithi116.stdout:checking gpfs_fcntl.h presence... no 2024-04-24T23:39:30.823 INFO:teuthology.orchestra.run.smithi116.stdout:checking for gpfs_fcntl.h... no 2024-04-24T23:39:30.823 INFO:teuthology.orchestra.run.smithi116.stdout:checking for special C compiler options needed for large files... no 2024-04-24T23:39:30.844 INFO:teuthology.orchestra.run.smithi116.stdout:checking for _FILE_OFFSET_BITS value needed for large files... no 2024-04-24T23:39:30.846 INFO:teuthology.orchestra.run.smithi116.stdout:checking for Gfarm file system... no 2024-04-24T23:39:30.865 INFO:teuthology.orchestra.run.smithi116.stdout:checking that generated files are newer than configure... done 2024-04-24T23:39:30.865 INFO:teuthology.orchestra.run.smithi116.stdout:configure: creating ./config.status 2024-04-24T23:39:30.917 INFO:teuthology.orchestra.run.smithi174.stdout: CC libaiori_a-mdtest.o 2024-04-24T23:39:30.926 INFO:teuthology.orchestra.run.smithi116.stdout:config.status: creating Makefile 2024-04-24T23:39:30.934 INFO:teuthology.orchestra.run.smithi116.stdout:config.status: creating src/Makefile 2024-04-24T23:39:30.948 INFO:teuthology.orchestra.run.smithi116.stdout:config.status: creating src/test/Makefile 2024-04-24T23:39:30.958 INFO:teuthology.orchestra.run.smithi116.stdout:config.status: creating contrib/Makefile 2024-04-24T23:39:30.969 INFO:teuthology.orchestra.run.smithi116.stdout:config.status: creating doc/Makefile 2024-04-24T23:39:30.979 INFO:teuthology.orchestra.run.smithi116.stdout:config.status: creating src/config.h 2024-04-24T23:39:30.989 INFO:teuthology.orchestra.run.smithi116.stdout:config.status: executing depfiles commands 2024-04-24T23:39:31.104 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c: In function 'create_file': 2024-04-24T23:39:31.104 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:355:33: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2024-04-24T23:39:31.104 INFO:teuthology.orchestra.run.smithi174.stderr: 355 | sprintf(curr_item, "%s/file.%s"LLU"", path, mk_name, itemNum); 2024-04-24T23:39:31.104 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~ 2024-04-24T23:39:31.104 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.105 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.105 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 8 or more bytes (assuming 4103) into a destination of size 4096 2024-04-24T23:39:31.105 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.105 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.105 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.105 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.105 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.105 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.114 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c: In function 'remove_file': 2024-04-24T23:39:31.114 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:339:33: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2024-04-24T23:39:31.114 INFO:teuthology.orchestra.run.smithi174.stderr: 339 | sprintf(curr_item, "%s/file.%s"LLU"", path, rm_name, itemNum); 2024-04-24T23:39:31.115 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~ 2024-04-24T23:39:31.115 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.115 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.115 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 8 or more bytes (assuming 4103) into a destination of size 4096 2024-04-24T23:39:31.115 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.115 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.115 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.115 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.115 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.115 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.119 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c: In function 'create_remove_dirs': 2024-04-24T23:39:31.120 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:317:32: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2024-04-24T23:39:31.120 INFO:teuthology.orchestra.run.smithi174.stderr: 317 | sprintf(curr_item, "%s/dir.%s%" PRIu64, path, create ? mk_name : rm_name, itemNum); 2024-04-24T23:39:31.120 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~ 2024-04-24T23:39:31.120 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.120 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.120 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 7 or more bytes (assuming 4102) into a destination of size 4096 2024-04-24T23:39:31.120 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.120 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.120 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.120 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.120 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.120 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.120 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:317:32: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2024-04-24T23:39:31.121 INFO:teuthology.orchestra.run.smithi174.stderr: 317 | sprintf(curr_item, "%s/dir.%s%" PRIu64, path, create ? mk_name : rm_name, itemNum); 2024-04-24T23:39:31.121 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~ 2024-04-24T23:39:31.121 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.121 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.121 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 7 or more bytes (assuming 4102) into a destination of size 4096 2024-04-24T23:39:31.121 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.121 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.121 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.121 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.121 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.121 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.152 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c: In function 'collective_helper': 2024-04-24T23:39:31.152 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:445:37: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2024-04-24T23:39:31.152 INFO:teuthology.orchestra.run.smithi174.stderr: 445 | sprintf(curr_item, "%s/file.%s"LLU"", path, create ? mk_name : rm_name, itemNum+i); 2024-04-24T23:39:31.152 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~ 2024-04-24T23:39:31.152 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.152 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.152 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 8 or more bytes (assuming 4103) into a destination of size 4096 2024-04-24T23:39:31.153 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.153 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.153 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.153 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.153 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.153 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.153 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:445:37: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2024-04-24T23:39:31.153 INFO:teuthology.orchestra.run.smithi174.stderr: 445 | sprintf(curr_item, "%s/file.%s"LLU"", path, create ? mk_name : rm_name, itemNum+i); 2024-04-24T23:39:31.153 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~ 2024-04-24T23:39:31.153 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.153 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.153 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 8 or more bytes (assuming 4103) into a destination of size 4096 2024-04-24T23:39:31.153 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.153 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.153 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.154 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.154 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.154 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.163 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c: In function 'create_remove_items': 2024-04-24T23:39:31.163 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:509:30: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:31.163 INFO:teuthology.orchestra.run.smithi174.stderr: 509 | sprintf(dir, "%s.%llu/", base_tree_name, currDir); 2024-04-24T23:39:31.163 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~ 2024-04-24T23:39:31.163 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.163 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.163 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 4 and 4118 bytes into a destination of size 4096 2024-04-24T23:39:31.163 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.163 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.164 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.164 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.164 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.164 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.178 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c: In function 'mdtest_stat': 2024-04-24T23:39:31.179 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:593:33: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2024-04-24T23:39:31.179 INFO:teuthology.orchestra.run.smithi174.stderr: 593 | sprintf(item, "file.%s"LLU"", stat_name, item_num); 2024-04-24T23:39:31.179 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~~~ 2024-04-24T23:39:31.179 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.179 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.179 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 7 and 4121 bytes into a destination of size 4096 2024-04-24T23:39:31.179 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.179 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.179 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.179 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.179 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.179 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.180 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:614:30: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-24T23:39:31.180 INFO:teuthology.orchestra.run.smithi174.stderr: 614 | sprintf( temp, "%s/%s", path, item ); 2024-04-24T23:39:31.180 INFO:teuthology.orchestra.run.smithi174.stderr: | ^ 2024-04-24T23:39:31.180 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.180 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.180 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-24T23:39:31.180 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.180 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.180 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.180 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.180 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.180 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.180 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:588:32: warning: '%s' directive writing up to 4095 bytes into a region of size 4092 [-Wformat-overflow=] 2024-04-24T23:39:31.180 INFO:teuthology.orchestra.run.smithi174.stderr: 588 | sprintf(item, "dir.%s"LLU"", stat_name, item_num); 2024-04-24T23:39:31.181 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~~~ 2024-04-24T23:39:31.181 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.181 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.181 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 6 and 4120 bytes into a destination of size 4096 2024-04-24T23:39:31.181 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.181 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.181 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.181 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.181 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.181 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.181 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:602:27: warning: '%lu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:31.181 INFO:teuthology.orchestra.run.smithi174.stderr: 602 | sprintf(temp, "%s."LLU"/%s", base_tree_name, parent_dir, item); 2024-04-24T23:39:31.181 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~ 2024-04-24T23:39:31.181 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:89:14: note: format string is defined here 2024-04-24T23:39:31.182 INFO:teuthology.orchestra.run.smithi174.stderr: 89 | #define LLU "%lu" 2024-04-24T23:39:31.182 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~ 2024-04-24T23:39:31.182 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.182 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.182 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 4 or more bytes (assuming 4099) into a destination of size 4096 2024-04-24T23:39:31.182 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.182 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.182 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.182 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.182 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.182 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.182 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:608:31: warning: '%lu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:31.182 INFO:teuthology.orchestra.run.smithi174.stderr: 608 | sprintf(temp, "%s."LLU"/%s", base_tree_name, parent_dir, item); 2024-04-24T23:39:31.183 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~ 2024-04-24T23:39:31.183 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:89:14: note: format string is defined here 2024-04-24T23:39:31.183 INFO:teuthology.orchestra.run.smithi174.stderr: 89 | #define LLU "%lu" 2024-04-24T23:39:31.183 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~ 2024-04-24T23:39:31.183 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:608:31: note: directive argument in the range [0, 18446744073709551614] 2024-04-24T23:39:31.183 INFO:teuthology.orchestra.run.smithi174.stderr: 608 | sprintf(temp, "%s."LLU"/%s", base_tree_name, parent_dir, item); 2024-04-24T23:39:31.183 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~ 2024-04-24T23:39:31.183 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.183 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.183 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 4 or more bytes (assuming 4118) into a destination of size 4096 2024-04-24T23:39:31.183 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.183 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.183 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.183 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.183 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.184 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.205 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c: In function 'mdtest_read': 2024-04-24T23:39:31.205 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:688:33: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2024-04-24T23:39:31.205 INFO:teuthology.orchestra.run.smithi174.stderr: 688 | sprintf(item, "file.%s"LLU"", read_name, item_num); 2024-04-24T23:39:31.205 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~~~ 2024-04-24T23:39:31.205 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.205 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.205 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 7 and 4121 bytes into a destination of size 4096 2024-04-24T23:39:31.205 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.206 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.206 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.206 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.206 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.206 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.206 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:697:27: warning: '%lu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:31.206 INFO:teuthology.orchestra.run.smithi174.stderr: 697 | sprintf(temp, "%s."LLU"/%s", base_tree_name, parent_dir, item); 2024-04-24T23:39:31.206 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~ 2024-04-24T23:39:31.206 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:89:14: note: format string is defined here 2024-04-24T23:39:31.206 INFO:teuthology.orchestra.run.smithi174.stderr: 89 | #define LLU "%lu" 2024-04-24T23:39:31.206 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~ 2024-04-24T23:39:31.206 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.206 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.206 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 4 and 8213 bytes into a destination of size 4096 2024-04-24T23:39:31.207 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.207 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.207 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.207 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.207 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.207 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.207 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:703:31: warning: '%lu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:31.207 INFO:teuthology.orchestra.run.smithi174.stderr: 703 | sprintf(temp, "%s."LLU"/%s", base_tree_name, parent_dir, item); 2024-04-24T23:39:31.207 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~ 2024-04-24T23:39:31.207 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:89:14: note: format string is defined here 2024-04-24T23:39:31.207 INFO:teuthology.orchestra.run.smithi174.stderr: 89 | #define LLU "%lu" 2024-04-24T23:39:31.207 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~ 2024-04-24T23:39:31.207 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:703:31: note: directive argument in the range [0, 18446744073709551614] 2024-04-24T23:39:31.207 INFO:teuthology.orchestra.run.smithi174.stderr: 703 | sprintf(temp, "%s."LLU"/%s", base_tree_name, parent_dir, item); 2024-04-24T23:39:31.208 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~ 2024-04-24T23:39:31.208 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.208 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.208 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 4 or more bytes (assuming 4118) into a destination of size 4096 2024-04-24T23:39:31.208 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.208 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.208 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.208 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.208 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.208 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.229 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c: In function 'collective_create_remove': 2024-04-24T23:39:31.229 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:775:39: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-24T23:39:31.229 INFO:teuthology.orchestra.run.smithi174.stderr: 775 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:31.229 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~ 2024-04-24T23:39:31.229 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:775:36: note: directive argument in the range [0, 2147483646] 2024-04-24T23:39:31.229 INFO:teuthology.orchestra.run.smithi174.stderr: 775 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:31.229 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.229 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.229 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.229 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4121 bytes into a destination of size 4096 2024-04-24T23:39:31.230 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.230 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.230 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.230 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.230 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.230 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.230 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:777:42: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-24T23:39:31.230 INFO:teuthology.orchestra.run.smithi174.stderr: 777 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:31.230 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~ 2024-04-24T23:39:31.230 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:777:39: note: directive argument in the range [-2147483646, 2147483646] 2024-04-24T23:39:31.230 INFO:teuthology.orchestra.run.smithi174.stderr: 777 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:31.230 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.230 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.231 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.231 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-24T23:39:31.231 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.231 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.231 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.231 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.231 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.231 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.231 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:779:41: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-24T23:39:31.231 INFO:teuthology.orchestra.run.smithi174.stderr: 779 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:31.231 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~ 2024-04-24T23:39:31.231 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:779:38: note: directive argument in the range [-2147483646, 2147483646] 2024-04-24T23:39:31.231 INFO:teuthology.orchestra.run.smithi174.stderr: 779 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:31.231 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.231 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.232 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.232 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-24T23:39:31.232 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.232 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.232 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.232 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.232 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.232 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.232 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:781:41: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-24T23:39:31.232 INFO:teuthology.orchestra.run.smithi174.stderr: 781 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:31.232 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~ 2024-04-24T23:39:31.232 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:781:38: note: directive argument in the range [-2147483646, 2147483646] 2024-04-24T23:39:31.232 INFO:teuthology.orchestra.run.smithi174.stderr: 781 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:31.232 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.232 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.233 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.233 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-24T23:39:31.233 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.233 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.233 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.233 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.233 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.233 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.233 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:783:39: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-24T23:39:31.233 INFO:teuthology.orchestra.run.smithi174.stderr: 783 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:31.233 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~ 2024-04-24T23:39:31.233 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:783:36: note: directive argument in the range [-2147483646, 2147483646] 2024-04-24T23:39:31.233 INFO:teuthology.orchestra.run.smithi174.stderr: 783 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:31.233 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.233 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.234 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.234 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-24T23:39:31.234 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.234 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.234 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.234 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.234 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.234 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.234 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:807:35: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-24T23:39:31.234 INFO:teuthology.orchestra.run.smithi174.stderr: 807 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:31.234 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~ 2024-04-24T23:39:31.234 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.234 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.234 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4112 bytes into a destination of size 4096 2024-04-24T23:39:31.235 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.235 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.235 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.235 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.235 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.235 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.235 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:809:38: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-24T23:39:31.235 INFO:teuthology.orchestra.run.smithi174.stderr: 809 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:31.235 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~ 2024-04-24T23:39:31.235 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:809:35: note: directive argument in the range [-2147483647, 2147483647] 2024-04-24T23:39:31.235 INFO:teuthology.orchestra.run.smithi174.stderr: 809 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:31.235 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.235 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.235 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.235 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-24T23:39:31.236 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.236 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.236 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.236 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.236 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.236 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.236 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:811:37: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-24T23:39:31.236 INFO:teuthology.orchestra.run.smithi174.stderr: 811 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:31.236 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~ 2024-04-24T23:39:31.236 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:811:34: note: directive argument in the range [-2147483647, 2147483647] 2024-04-24T23:39:31.236 INFO:teuthology.orchestra.run.smithi174.stderr: 811 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:31.236 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.236 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.236 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.236 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-24T23:39:31.237 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.237 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.237 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.237 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.237 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.237 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.237 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:813:37: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-24T23:39:31.237 INFO:teuthology.orchestra.run.smithi174.stderr: 813 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:31.237 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~ 2024-04-24T23:39:31.237 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:813:34: note: directive argument in the range [-2147483647, 2147483647] 2024-04-24T23:39:31.237 INFO:teuthology.orchestra.run.smithi174.stderr: 813 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:31.237 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.237 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.237 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.237 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-24T23:39:31.238 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.238 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.238 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.238 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.238 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.238 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.238 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:815:35: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-24T23:39:31.238 INFO:teuthology.orchestra.run.smithi174.stderr: 815 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:31.238 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~ 2024-04-24T23:39:31.238 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:815:32: note: directive argument in the range [-2147483647, 2147483647] 2024-04-24T23:39:31.238 INFO:teuthology.orchestra.run.smithi174.stderr: 815 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:31.238 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.238 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.238 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.239 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-24T23:39:31.239 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.239 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.239 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.239 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.239 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.239 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.257 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c: In function 'directory_test': 2024-04-24T23:39:31.257 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:843:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-24T23:39:31.257 INFO:teuthology.orchestra.run.smithi174.stderr: 843 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-24T23:39:31.257 INFO:teuthology.orchestra.run.smithi174.stderr: | ^ 2024-04-24T23:39:31.257 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.258 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.258 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-24T23:39:31.258 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.258 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.258 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.258 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.258 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.258 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.258 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:295:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:31.258 INFO:teuthology.orchestra.run.smithi174.stderr: 295 | sprintf( to, "%s/%s", testdir, unique_chdir_dir ); 2024-04-24T23:39:31.258 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.258 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.258 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.258 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-24T23:39:31.259 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.259 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.259 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.259 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.259 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.259 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.259 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:873:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-24T23:39:31.259 INFO:teuthology.orchestra.run.smithi174.stderr: 873 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-24T23:39:31.259 INFO:teuthology.orchestra.run.smithi174.stderr: | ^ 2024-04-24T23:39:31.259 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.259 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.259 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-24T23:39:31.259 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.260 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.260 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.260 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.260 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.260 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.260 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:297:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:31.260 INFO:teuthology.orchestra.run.smithi174.stderr: 297 | sprintf( to, "%s/%s", testdir, unique_stat_dir ); 2024-04-24T23:39:31.260 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.260 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.260 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.260 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-24T23:39:31.260 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.260 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.260 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.260 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.261 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.261 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.261 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:899:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-24T23:39:31.261 INFO:teuthology.orchestra.run.smithi174.stderr: 899 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-24T23:39:31.261 INFO:teuthology.orchestra.run.smithi174.stderr: | ^ 2024-04-24T23:39:31.261 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.261 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.261 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-24T23:39:31.261 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.261 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.261 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.261 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.261 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.261 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.262 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:299:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:31.262 INFO:teuthology.orchestra.run.smithi174.stderr: 299 | sprintf( to, "%s/%s", testdir, unique_read_dir ); 2024-04-24T23:39:31.262 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.262 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.262 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.262 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-24T23:39:31.262 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.262 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.262 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.262 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.262 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.262 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.262 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:925:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-24T23:39:31.262 INFO:teuthology.orchestra.run.smithi174.stderr: 925 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-24T23:39:31.263 INFO:teuthology.orchestra.run.smithi174.stderr: | ^ 2024-04-24T23:39:31.263 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.263 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.263 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-24T23:39:31.263 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.263 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.263 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.263 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.263 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.263 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.263 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:301:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:31.263 INFO:teuthology.orchestra.run.smithi174.stderr: 301 | sprintf( to, "%s/%s", testdir, unique_rm_dir ); 2024-04-24T23:39:31.263 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~~~~~~~ 2024-04-24T23:39:31.263 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.263 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.264 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-24T23:39:31.264 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.264 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.264 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.264 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.264 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.264 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.264 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:948:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-24T23:39:31.264 INFO:teuthology.orchestra.run.smithi174.stderr: 948 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-24T23:39:31.264 INFO:teuthology.orchestra.run.smithi174.stderr: | ^ 2024-04-24T23:39:31.264 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.264 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.264 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-24T23:39:31.264 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.265 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.265 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.265 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.265 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.265 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.265 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:303:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:31.265 INFO:teuthology.orchestra.run.smithi174.stderr: 303 | sprintf( to, "%s/%s", testdir, unique_rm_uni_dir ); 2024-04-24T23:39:31.265 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.265 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.265 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.265 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-24T23:39:31.265 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.265 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.265 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.266 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.266 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.266 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.271 INFO:teuthology.orchestra.run.smithi116.stderr:+ make 2024-04-24T23:39:31.275 INFO:teuthology.orchestra.run.smithi116.stdout:Making all in src 2024-04-24T23:39:31.280 INFO:teuthology.orchestra.run.smithi116.stdout:make all-recursive 2024-04-24T23:39:31.285 INFO:teuthology.orchestra.run.smithi116.stdout:Making all in . 2024-04-24T23:39:31.288 INFO:teuthology.orchestra.run.smithi116.stdout: CC ior-ior-main.o 2024-04-24T23:39:31.307 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c: In function 'file_test': 2024-04-24T23:39:31.307 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1043:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-24T23:39:31.307 INFO:teuthology.orchestra.run.smithi174.stderr: 1043 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-24T23:39:31.307 INFO:teuthology.orchestra.run.smithi174.stderr: | ^ 2024-04-24T23:39:31.307 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.307 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.307 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-24T23:39:31.308 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.308 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.308 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.308 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.308 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.308 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.308 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:295:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:31.308 INFO:teuthology.orchestra.run.smithi174.stderr: 295 | sprintf( to, "%s/%s", testdir, unique_chdir_dir ); 2024-04-24T23:39:31.308 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.308 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.308 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.308 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-24T23:39:31.308 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.309 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.309 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.309 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.309 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.309 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.309 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1110:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-24T23:39:31.309 INFO:teuthology.orchestra.run.smithi174.stderr: 1110 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-24T23:39:31.309 INFO:teuthology.orchestra.run.smithi174.stderr: | ^ 2024-04-24T23:39:31.309 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.309 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.309 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-24T23:39:31.309 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.309 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.309 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.310 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.310 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.310 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.310 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:297:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:31.310 INFO:teuthology.orchestra.run.smithi174.stderr: 297 | sprintf( to, "%s/%s", testdir, unique_stat_dir ); 2024-04-24T23:39:31.310 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.310 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.310 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.310 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-24T23:39:31.310 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.310 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.310 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.310 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.310 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.311 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.311 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1133:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-24T23:39:31.311 INFO:teuthology.orchestra.run.smithi174.stderr: 1133 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-24T23:39:31.311 INFO:teuthology.orchestra.run.smithi174.stderr: | ^ 2024-04-24T23:39:31.311 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.311 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.311 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-24T23:39:31.311 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.311 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.311 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.311 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.311 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.311 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.311 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:299:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:31.312 INFO:teuthology.orchestra.run.smithi174.stderr: 299 | sprintf( to, "%s/%s", testdir, unique_read_dir ); 2024-04-24T23:39:31.312 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.312 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.312 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.312 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-24T23:39:31.312 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.312 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.312 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.312 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.312 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.312 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.312 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1161:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-24T23:39:31.312 INFO:teuthology.orchestra.run.smithi174.stderr: 1161 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-24T23:39:31.312 INFO:teuthology.orchestra.run.smithi174.stderr: | ^ 2024-04-24T23:39:31.312 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.313 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.313 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-24T23:39:31.313 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.313 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.313 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.313 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.313 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.313 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.313 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:301:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:31.313 INFO:teuthology.orchestra.run.smithi174.stderr: 301 | sprintf( to, "%s/%s", testdir, unique_rm_dir ); 2024-04-24T23:39:31.313 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~~~~~~~ 2024-04-24T23:39:31.313 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.313 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.313 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-24T23:39:31.314 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.314 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.314 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.314 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.314 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.314 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.314 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:303:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:31.314 INFO:teuthology.orchestra.run.smithi174.stderr: 303 | sprintf( to, "%s/%s", testdir, unique_rm_uni_dir ); 2024-04-24T23:39:31.314 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.314 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.314 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.314 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-24T23:39:31.315 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.315 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.315 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.315 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.315 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.315 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.379 INFO:teuthology.orchestra.run.smithi116.stdout: CC ior-aiori.o 2024-04-24T23:39:31.436 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c: In function 'create_remove_directory_tree': 2024-04-24T23:39:31.436 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1612:30: warning: '%d' directive writing between 1 and 11 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:31.436 INFO:teuthology.orchestra.run.smithi174.stderr: 1612 | sprintf(dir, "%s.%d/", base_tree_name, currDir); 2024-04-24T23:39:31.436 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ 2024-04-24T23:39:31.436 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.436 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.436 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 4 and 4109 bytes into a destination of size 4096 2024-04-24T23:39:31.436 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.436 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.436 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.436 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.436 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.437 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.437 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1579:28: warning: '.' directive writing 1 byte into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:31.437 INFO:teuthology.orchestra.run.smithi174.stderr: 1579 | sprintf(dir, "%s/%s.%d/", path, base_tree_name, dirNum); 2024-04-24T23:39:31.437 INFO:teuthology.orchestra.run.smithi174.stderr: | ^ 2024-04-24T23:39:31.437 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.437 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.437 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 5 or more bytes (assuming 4100) into a destination of size 4096 2024-04-24T23:39:31.437 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.437 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.437 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.437 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.437 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.437 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.493 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c: In function 'mdtest_run': 2024-04-24T23:39:31.493 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1920:35: warning: '%s' directive writing up to 1023 bytes into a region of size 1011 [-Wformat-overflow=] 2024-04-24T23:39:31.493 INFO:teuthology.orchestra.run.smithi174.stderr: 1920 | sprintf(apiStr, "API for I/O [%s]", APIs); 2024-04-24T23:39:31.493 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~ 2024-04-24T23:39:31.494 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.494 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.494 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 15 and 1038 bytes into a destination of size 1024 2024-04-24T23:39:31.494 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.494 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.494 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.494 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.494 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.494 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.495 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1727:29: warning: '.0' directive writing 2 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-24T23:39:31.495 INFO:teuthology.orchestra.run.smithi174.stderr: 1727 | sprintf(unique_mk_dir, "%s.0", base_tree_name); 2024-04-24T23:39:31.495 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ 2024-04-24T23:39:31.496 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.496 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.496 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 3 and 4098 bytes into a destination of size 4096 2024-04-24T23:39:31.496 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.496 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.496 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.496 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.496 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.496 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.497 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1728:32: warning: '.0' directive writing 2 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-24T23:39:31.497 INFO:teuthology.orchestra.run.smithi174.stderr: 1728 | sprintf(unique_chdir_dir, "%s.0", base_tree_name); 2024-04-24T23:39:31.497 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ 2024-04-24T23:39:31.497 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.497 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.497 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 3 and 4098 bytes into a destination of size 4096 2024-04-24T23:39:31.497 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.497 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.497 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.497 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.498 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.498 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.498 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1729:31: warning: '.0' directive writing 2 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-24T23:39:31.498 INFO:teuthology.orchestra.run.smithi174.stderr: 1729 | sprintf(unique_stat_dir, "%s.0", base_tree_name); 2024-04-24T23:39:31.498 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ 2024-04-24T23:39:31.498 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.498 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.498 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 3 and 4098 bytes into a destination of size 4096 2024-04-24T23:39:31.498 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.499 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.499 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.499 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.499 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.499 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.499 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1730:31: warning: '.0' directive writing 2 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-24T23:39:31.499 INFO:teuthology.orchestra.run.smithi174.stderr: 1730 | sprintf(unique_read_dir, "%s.0", base_tree_name); 2024-04-24T23:39:31.499 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ 2024-04-24T23:39:31.499 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.500 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.500 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 3 and 4098 bytes into a destination of size 4096 2024-04-24T23:39:31.500 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.500 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.500 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.500 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.500 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.500 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.500 INFO:teuthology.orchestra.run.smithi174.stderr:mdtest.c:1731:29: warning: '.0' directive writing 2 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-24T23:39:31.500 INFO:teuthology.orchestra.run.smithi174.stderr: 1731 | sprintf(unique_rm_dir, "%s.0", base_tree_name); 2024-04-24T23:39:31.501 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ 2024-04-24T23:39:31.501 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:31.501 INFO:teuthology.orchestra.run.smithi174.stderr: from mdtest.c:33: 2024-04-24T23:39:31.501 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 3 and 4098 bytes into a destination of size 4096 2024-04-24T23:39:31.501 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:31.501 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.501 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:31.501 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.501 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:31.501 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:31.522 INFO:teuthology.orchestra.run.smithi116.stdout: CC ior-aiori-DUMMY.o 2024-04-24T23:39:31.644 INFO:teuthology.orchestra.run.smithi116.stdout: CC ior-aiori-MPIIO.o 2024-04-24T23:39:31.693 INFO:teuthology.orchestra.run.smithi174.stdout: CC libaiori_a-utilities.o 2024-04-24T23:39:31.885 INFO:teuthology.orchestra.run.smithi116.stdout: CC ior-aiori-MMAP.o 2024-04-24T23:39:32.006 INFO:teuthology.orchestra.run.smithi116.stdout: CC ior-aiori-POSIX.o 2024-04-24T23:39:32.025 INFO:teuthology.orchestra.run.smithi174.stdout: CC libaiori_a-parse_options.o 2024-04-24T23:39:32.181 INFO:teuthology.orchestra.run.smithi116.stdout: CC libaiori_a-ior.o 2024-04-24T23:39:32.203 INFO:teuthology.orchestra.run.smithi174.stderr:parse_options.c: In function 'createGlobalOptions': 2024-04-24T23:39:32.203 INFO:teuthology.orchestra.run.smithi174.stderr:parse_options.c:469:33: warning: '%s' directive writing up to 1023 bytes into a region of size 1011 [-Wformat-overflow=] 2024-04-24T23:39:32.203 INFO:teuthology.orchestra.run.smithi174.stderr: 469 | sprintf(apiStr, "API for I/O [%s]", APIs); 2024-04-24T23:39:32.203 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~ ~~~~ 2024-04-24T23:39:32.203 INFO:teuthology.orchestra.run.smithi174.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:32.204 INFO:teuthology.orchestra.run.smithi174.stderr: from parse_options.c:19: 2024-04-24T23:39:32.204 INFO:teuthology.orchestra.run.smithi174.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 15 and 1038 bytes into a destination of size 1024 2024-04-24T23:39:32.204 INFO:teuthology.orchestra.run.smithi174.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:32.204 INFO:teuthology.orchestra.run.smithi174.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:32.204 INFO:teuthology.orchestra.run.smithi174.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:32.204 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:32.204 INFO:teuthology.orchestra.run.smithi174.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:32.204 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:32.315 INFO:teuthology.orchestra.run.smithi174.stdout: CC libaiori_a-ior-output.o 2024-04-24T23:39:32.543 INFO:teuthology.orchestra.run.smithi116.stderr:ior.c: In function 'GetPlatformName': 2024-04-24T23:39:32.543 INFO:teuthology.orchestra.run.smithi116.stderr:ior.c:699:37: warning: ')' directive writing 1 byte into a region of size between 0 and 1023 [-Wformat-overflow=] 2024-04-24T23:39:32.543 INFO:teuthology.orchestra.run.smithi116.stderr: 699 | sprintf(platformName, "%s(%s)", nodeName, sysName); 2024-04-24T23:39:32.544 INFO:teuthology.orchestra.run.smithi116.stderr: | ^ 2024-04-24T23:39:32.544 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:32.544 INFO:teuthology.orchestra.run.smithi116.stderr: from ior.c:15: 2024-04-24T23:39:32.544 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 3 or more bytes (assuming 1026) into a destination of size 1024 2024-04-24T23:39:32.544 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:32.544 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:32.544 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:32.544 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:32.544 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:32.544 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:32.621 INFO:teuthology.orchestra.run.smithi174.stdout: CC libaiori_a-option.o 2024-04-24T23:39:32.729 INFO:teuthology.orchestra.run.smithi174.stderr:option.c: In function 'option_parse_token': 2024-04-24T23:39:32.730 INFO:teuthology.orchestra.run.smithi174.stderr:option.c:335:19: warning: writing 1 byte into a region of size 0 [-Wstringop-overflow=] 2024-04-24T23:39:32.730 INFO:teuthology.orchestra.run.smithi174.stderr: 335 | arg[-1] = '='; 2024-04-24T23:39:32.730 INFO:teuthology.orchestra.run.smithi174.stderr: | ~~~~~~~~^~~~~ 2024-04-24T23:39:32.784 INFO:teuthology.orchestra.run.smithi174.stdout: CC libaiori_a-aiori.o 2024-04-24T23:39:32.877 INFO:teuthology.orchestra.run.smithi116.stdout: CC libaiori_a-mdtest.o 2024-04-24T23:39:32.932 INFO:teuthology.orchestra.run.smithi174.stdout: CC libaiori_a-aiori-DUMMY.o 2024-04-24T23:39:33.051 INFO:teuthology.orchestra.run.smithi174.stdout: CC libaiori_a-aiori-MPIIO.o 2024-04-24T23:39:33.060 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c: In function 'create_file': 2024-04-24T23:39:33.061 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:355:33: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2024-04-24T23:39:33.061 INFO:teuthology.orchestra.run.smithi116.stderr: 355 | sprintf(curr_item, "%s/file.%s"LLU"", path, mk_name, itemNum); 2024-04-24T23:39:33.061 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~ ~~~~~~~ 2024-04-24T23:39:33.061 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.061 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.061 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 8 or more bytes (assuming 4103) into a destination of size 4096 2024-04-24T23:39:33.061 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.061 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.061 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.061 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.061 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.061 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.071 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c: In function 'remove_file': 2024-04-24T23:39:33.071 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:339:33: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2024-04-24T23:39:33.071 INFO:teuthology.orchestra.run.smithi116.stderr: 339 | sprintf(curr_item, "%s/file.%s"LLU"", path, rm_name, itemNum); 2024-04-24T23:39:33.071 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~ ~~~~~~~ 2024-04-24T23:39:33.071 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.071 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.071 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 8 or more bytes (assuming 4103) into a destination of size 4096 2024-04-24T23:39:33.072 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.072 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.072 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.072 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.072 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.072 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.076 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c: In function 'create_remove_dirs': 2024-04-24T23:39:33.076 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:317:32: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2024-04-24T23:39:33.076 INFO:teuthology.orchestra.run.smithi116.stderr: 317 | sprintf(curr_item, "%s/dir.%s%" PRIu64, path, create ? mk_name : rm_name, itemNum); 2024-04-24T23:39:33.077 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~ ~~~~~~~ 2024-04-24T23:39:33.077 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.077 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.077 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 7 or more bytes (assuming 4102) into a destination of size 4096 2024-04-24T23:39:33.077 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.077 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.077 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.077 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.077 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.077 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.077 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:317:32: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2024-04-24T23:39:33.077 INFO:teuthology.orchestra.run.smithi116.stderr: 317 | sprintf(curr_item, "%s/dir.%s%" PRIu64, path, create ? mk_name : rm_name, itemNum); 2024-04-24T23:39:33.077 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~ ~~~~~~~ 2024-04-24T23:39:33.078 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.078 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.078 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 7 or more bytes (assuming 4102) into a destination of size 4096 2024-04-24T23:39:33.078 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.078 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.078 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.078 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.078 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.078 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.109 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c: In function 'collective_helper': 2024-04-24T23:39:33.109 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:445:37: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2024-04-24T23:39:33.109 INFO:teuthology.orchestra.run.smithi116.stderr: 445 | sprintf(curr_item, "%s/file.%s"LLU"", path, create ? mk_name : rm_name, itemNum+i); 2024-04-24T23:39:33.109 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~ ~~~~~~~ 2024-04-24T23:39:33.109 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.110 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.110 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 8 or more bytes (assuming 4103) into a destination of size 4096 2024-04-24T23:39:33.110 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.110 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.110 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.110 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.110 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.110 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.110 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:445:37: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2024-04-24T23:39:33.110 INFO:teuthology.orchestra.run.smithi116.stderr: 445 | sprintf(curr_item, "%s/file.%s"LLU"", path, create ? mk_name : rm_name, itemNum+i); 2024-04-24T23:39:33.110 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~ ~~~~~~~ 2024-04-24T23:39:33.110 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.111 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.111 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 8 or more bytes (assuming 4103) into a destination of size 4096 2024-04-24T23:39:33.111 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.111 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.111 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.111 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.111 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.111 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.120 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c: In function 'create_remove_items': 2024-04-24T23:39:33.120 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:509:30: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:33.120 INFO:teuthology.orchestra.run.smithi116.stderr: 509 | sprintf(dir, "%s.%llu/", base_tree_name, currDir); 2024-04-24T23:39:33.120 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~ 2024-04-24T23:39:33.120 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.120 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.121 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 4 and 4118 bytes into a destination of size 4096 2024-04-24T23:39:33.121 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.121 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.121 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.121 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.121 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.121 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.136 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c: In function 'mdtest_stat': 2024-04-24T23:39:33.136 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:593:33: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2024-04-24T23:39:33.136 INFO:teuthology.orchestra.run.smithi116.stderr: 593 | sprintf(item, "file.%s"LLU"", stat_name, item_num); 2024-04-24T23:39:33.136 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~ ~~~~~~~~~ 2024-04-24T23:39:33.137 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.137 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.137 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 7 and 4121 bytes into a destination of size 4096 2024-04-24T23:39:33.137 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.137 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.137 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.137 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.137 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.137 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.137 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:614:30: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-24T23:39:33.137 INFO:teuthology.orchestra.run.smithi116.stderr: 614 | sprintf( temp, "%s/%s", path, item ); 2024-04-24T23:39:33.137 INFO:teuthology.orchestra.run.smithi116.stderr: | ^ 2024-04-24T23:39:33.137 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.138 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.138 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-24T23:39:33.138 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.138 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.138 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.138 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.138 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.138 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.138 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:588:32: warning: '%s' directive writing up to 4095 bytes into a region of size 4092 [-Wformat-overflow=] 2024-04-24T23:39:33.138 INFO:teuthology.orchestra.run.smithi116.stderr: 588 | sprintf(item, "dir.%s"LLU"", stat_name, item_num); 2024-04-24T23:39:33.138 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~ ~~~~~~~~~ 2024-04-24T23:39:33.138 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.139 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.139 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 6 and 4120 bytes into a destination of size 4096 2024-04-24T23:39:33.139 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.139 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.139 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.139 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.139 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.139 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.139 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:602:27: warning: '%lu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:33.139 INFO:teuthology.orchestra.run.smithi116.stderr: 602 | sprintf(temp, "%s."LLU"/%s", base_tree_name, parent_dir, item); 2024-04-24T23:39:33.139 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~ 2024-04-24T23:39:33.139 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:89:14: note: format string is defined here 2024-04-24T23:39:33.139 INFO:teuthology.orchestra.run.smithi116.stderr: 89 | #define LLU "%lu" 2024-04-24T23:39:33.140 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~ 2024-04-24T23:39:33.140 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.140 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.140 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 4 or more bytes (assuming 4099) into a destination of size 4096 2024-04-24T23:39:33.140 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.140 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.140 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.140 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.140 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.140 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.140 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:608:31: warning: '%lu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:33.140 INFO:teuthology.orchestra.run.smithi116.stderr: 608 | sprintf(temp, "%s."LLU"/%s", base_tree_name, parent_dir, item); 2024-04-24T23:39:33.140 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~ 2024-04-24T23:39:33.140 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:89:14: note: format string is defined here 2024-04-24T23:39:33.141 INFO:teuthology.orchestra.run.smithi116.stderr: 89 | #define LLU "%lu" 2024-04-24T23:39:33.141 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~ 2024-04-24T23:39:33.141 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:608:31: note: directive argument in the range [0, 18446744073709551614] 2024-04-24T23:39:33.141 INFO:teuthology.orchestra.run.smithi116.stderr: 608 | sprintf(temp, "%s."LLU"/%s", base_tree_name, parent_dir, item); 2024-04-24T23:39:33.141 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~ 2024-04-24T23:39:33.141 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.141 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.141 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 4 or more bytes (assuming 4118) into a destination of size 4096 2024-04-24T23:39:33.141 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.141 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.141 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.141 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.141 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.141 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.164 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c: In function 'mdtest_read': 2024-04-24T23:39:33.164 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:688:33: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2024-04-24T23:39:33.164 INFO:teuthology.orchestra.run.smithi116.stderr: 688 | sprintf(item, "file.%s"LLU"", read_name, item_num); 2024-04-24T23:39:33.164 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~ ~~~~~~~~~ 2024-04-24T23:39:33.164 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.164 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.164 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 7 and 4121 bytes into a destination of size 4096 2024-04-24T23:39:33.164 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.164 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.164 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.164 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.164 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.165 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.165 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:697:27: warning: '%lu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:33.165 INFO:teuthology.orchestra.run.smithi116.stderr: 697 | sprintf(temp, "%s."LLU"/%s", base_tree_name, parent_dir, item); 2024-04-24T23:39:33.165 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~ 2024-04-24T23:39:33.165 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:89:14: note: format string is defined here 2024-04-24T23:39:33.165 INFO:teuthology.orchestra.run.smithi116.stderr: 89 | #define LLU "%lu" 2024-04-24T23:39:33.165 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~ 2024-04-24T23:39:33.165 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.165 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.165 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 4 and 8213 bytes into a destination of size 4096 2024-04-24T23:39:33.165 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.165 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.165 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.165 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.165 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.165 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.166 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:703:31: warning: '%lu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:33.166 INFO:teuthology.orchestra.run.smithi116.stderr: 703 | sprintf(temp, "%s."LLU"/%s", base_tree_name, parent_dir, item); 2024-04-24T23:39:33.166 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~ 2024-04-24T23:39:33.166 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:89:14: note: format string is defined here 2024-04-24T23:39:33.166 INFO:teuthology.orchestra.run.smithi116.stderr: 89 | #define LLU "%lu" 2024-04-24T23:39:33.166 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~ 2024-04-24T23:39:33.166 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:703:31: note: directive argument in the range [0, 18446744073709551614] 2024-04-24T23:39:33.166 INFO:teuthology.orchestra.run.smithi116.stderr: 703 | sprintf(temp, "%s."LLU"/%s", base_tree_name, parent_dir, item); 2024-04-24T23:39:33.166 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~ 2024-04-24T23:39:33.166 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.166 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.166 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 4 or more bytes (assuming 4118) into a destination of size 4096 2024-04-24T23:39:33.167 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.167 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.167 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.167 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.167 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.167 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.188 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c: In function 'collective_create_remove': 2024-04-24T23:39:33.188 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:775:39: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-24T23:39:33.188 INFO:teuthology.orchestra.run.smithi116.stderr: 775 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:33.188 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~ 2024-04-24T23:39:33.188 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:775:36: note: directive argument in the range [0, 2147483646] 2024-04-24T23:39:33.188 INFO:teuthology.orchestra.run.smithi116.stderr: 775 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:33.188 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.189 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.189 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.189 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4121 bytes into a destination of size 4096 2024-04-24T23:39:33.189 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.189 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.189 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.189 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.189 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.189 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.189 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:777:42: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-24T23:39:33.189 INFO:teuthology.orchestra.run.smithi116.stderr: 777 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:33.189 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~ 2024-04-24T23:39:33.189 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:777:39: note: directive argument in the range [-2147483646, 2147483646] 2024-04-24T23:39:33.189 INFO:teuthology.orchestra.run.smithi116.stderr: 777 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:33.190 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.190 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.190 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.190 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-24T23:39:33.190 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.190 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.190 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.190 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.190 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.190 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.190 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:779:41: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-24T23:39:33.190 INFO:teuthology.orchestra.run.smithi116.stderr: 779 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:33.190 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~ 2024-04-24T23:39:33.191 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:779:38: note: directive argument in the range [-2147483646, 2147483646] 2024-04-24T23:39:33.191 INFO:teuthology.orchestra.run.smithi116.stderr: 779 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:33.191 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.191 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.191 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.191 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-24T23:39:33.191 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.191 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.191 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.191 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.191 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.191 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.191 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:781:41: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-24T23:39:33.191 INFO:teuthology.orchestra.run.smithi116.stderr: 781 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:33.192 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~ 2024-04-24T23:39:33.192 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:781:38: note: directive argument in the range [-2147483646, 2147483646] 2024-04-24T23:39:33.192 INFO:teuthology.orchestra.run.smithi116.stderr: 781 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:33.192 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.192 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.192 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.192 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-24T23:39:33.192 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.192 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.192 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.192 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.192 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.192 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.192 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:783:39: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-24T23:39:33.192 INFO:teuthology.orchestra.run.smithi116.stderr: 783 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:33.193 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~ 2024-04-24T23:39:33.193 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:783:36: note: directive argument in the range [-2147483646, 2147483646] 2024-04-24T23:39:33.193 INFO:teuthology.orchestra.run.smithi116.stderr: 783 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:33.193 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.193 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.193 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.193 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-24T23:39:33.193 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.193 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.193 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.193 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.193 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.193 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.194 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:807:35: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-24T23:39:33.194 INFO:teuthology.orchestra.run.smithi116.stderr: 807 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:33.194 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~ 2024-04-24T23:39:33.194 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.194 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.194 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4112 bytes into a destination of size 4096 2024-04-24T23:39:33.194 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.194 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.194 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.194 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.194 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.194 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.194 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:809:38: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-24T23:39:33.195 INFO:teuthology.orchestra.run.smithi116.stderr: 809 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:33.195 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~ 2024-04-24T23:39:33.195 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:809:35: note: directive argument in the range [-2147483647, 2147483647] 2024-04-24T23:39:33.195 INFO:teuthology.orchestra.run.smithi116.stderr: 809 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:33.195 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.195 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.195 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.195 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-24T23:39:33.195 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.195 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.195 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.195 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.195 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.195 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.196 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:811:37: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-24T23:39:33.196 INFO:teuthology.orchestra.run.smithi116.stderr: 811 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:33.196 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~ 2024-04-24T23:39:33.196 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:811:34: note: directive argument in the range [-2147483647, 2147483647] 2024-04-24T23:39:33.196 INFO:teuthology.orchestra.run.smithi116.stderr: 811 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:33.196 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.196 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.196 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.196 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-24T23:39:33.196 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.196 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.196 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.196 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.196 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.197 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.197 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:813:37: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-24T23:39:33.197 INFO:teuthology.orchestra.run.smithi116.stderr: 813 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:33.197 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~ 2024-04-24T23:39:33.197 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:813:34: note: directive argument in the range [-2147483647, 2147483647] 2024-04-24T23:39:33.197 INFO:teuthology.orchestra.run.smithi116.stderr: 813 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:33.197 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.197 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.197 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.197 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-24T23:39:33.197 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.197 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.197 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.197 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.197 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.198 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.198 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:815:35: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-24T23:39:33.198 INFO:teuthology.orchestra.run.smithi116.stderr: 815 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:33.198 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~ 2024-04-24T23:39:33.198 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:815:32: note: directive argument in the range [-2147483647, 2147483647] 2024-04-24T23:39:33.198 INFO:teuthology.orchestra.run.smithi116.stderr: 815 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2024-04-24T23:39:33.198 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.198 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.198 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.198 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 17 and 4122 bytes into a destination of size 4096 2024-04-24T23:39:33.198 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.198 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.198 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.198 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.199 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.199 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.218 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c: In function 'directory_test': 2024-04-24T23:39:33.218 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:843:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-24T23:39:33.218 INFO:teuthology.orchestra.run.smithi116.stderr: 843 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-24T23:39:33.218 INFO:teuthology.orchestra.run.smithi116.stderr: | ^ 2024-04-24T23:39:33.218 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.219 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.219 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-24T23:39:33.219 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.219 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.219 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.219 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.219 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.219 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.219 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:295:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:33.219 INFO:teuthology.orchestra.run.smithi116.stderr: 295 | sprintf( to, "%s/%s", testdir, unique_chdir_dir ); 2024-04-24T23:39:33.219 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~ ~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.219 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.219 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.219 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-24T23:39:33.220 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.220 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.220 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.220 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.220 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.220 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.220 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:873:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-24T23:39:33.220 INFO:teuthology.orchestra.run.smithi116.stderr: 873 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-24T23:39:33.220 INFO:teuthology.orchestra.run.smithi116.stderr: | ^ 2024-04-24T23:39:33.220 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.220 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.220 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-24T23:39:33.220 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.220 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.221 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.221 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.221 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.221 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.221 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:297:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:33.221 INFO:teuthology.orchestra.run.smithi116.stderr: 297 | sprintf( to, "%s/%s", testdir, unique_stat_dir ); 2024-04-24T23:39:33.221 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~ ~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.221 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.221 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.221 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-24T23:39:33.221 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.221 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.221 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.221 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.222 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.222 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.222 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:899:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-24T23:39:33.222 INFO:teuthology.orchestra.run.smithi116.stderr: 899 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-24T23:39:33.222 INFO:teuthology.orchestra.run.smithi116.stderr: | ^ 2024-04-24T23:39:33.222 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.222 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.222 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-24T23:39:33.222 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.222 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.222 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.222 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.222 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.223 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.223 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:299:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:33.223 INFO:teuthology.orchestra.run.smithi116.stderr: 299 | sprintf( to, "%s/%s", testdir, unique_read_dir ); 2024-04-24T23:39:33.223 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~ ~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.223 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.223 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.223 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-24T23:39:33.223 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.223 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.223 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.223 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.223 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.223 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.223 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:925:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-24T23:39:33.223 INFO:teuthology.orchestra.run.smithi116.stderr: 925 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-24T23:39:33.224 INFO:teuthology.orchestra.run.smithi116.stderr: | ^ 2024-04-24T23:39:33.224 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.224 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.224 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-24T23:39:33.224 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.224 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.224 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.224 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.224 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.224 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.224 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:301:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:33.224 INFO:teuthology.orchestra.run.smithi116.stderr: 301 | sprintf( to, "%s/%s", testdir, unique_rm_dir ); 2024-04-24T23:39:33.224 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~ ~~~~~~~~~~~~~ 2024-04-24T23:39:33.224 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.224 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.225 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-24T23:39:33.225 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.225 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.225 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.225 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.225 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.225 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.225 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:948:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-24T23:39:33.225 INFO:teuthology.orchestra.run.smithi116.stderr: 948 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-24T23:39:33.225 INFO:teuthology.orchestra.run.smithi116.stderr: | ^ 2024-04-24T23:39:33.225 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.225 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.225 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-24T23:39:33.225 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.226 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.226 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.226 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.226 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.226 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.226 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:303:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:33.226 INFO:teuthology.orchestra.run.smithi116.stderr: 303 | sprintf( to, "%s/%s", testdir, unique_rm_uni_dir ); 2024-04-24T23:39:33.226 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~ ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.226 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.226 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.226 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-24T23:39:33.226 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.226 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.226 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.227 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.227 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.227 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.252 INFO:teuthology.orchestra.run.smithi174.stdout: CC libaiori_a-aiori-MMAP.o 2024-04-24T23:39:33.273 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c: In function 'file_test': 2024-04-24T23:39:33.273 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:1043:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-24T23:39:33.273 INFO:teuthology.orchestra.run.smithi116.stderr: 1043 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-24T23:39:33.273 INFO:teuthology.orchestra.run.smithi116.stderr: | ^ 2024-04-24T23:39:33.273 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.273 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.273 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-24T23:39:33.273 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.273 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.273 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.274 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.274 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.274 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.274 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:295:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:33.274 INFO:teuthology.orchestra.run.smithi116.stderr: 295 | sprintf( to, "%s/%s", testdir, unique_chdir_dir ); 2024-04-24T23:39:33.274 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~ ~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.274 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.274 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.274 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-24T23:39:33.274 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.274 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.274 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.274 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.274 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.275 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.275 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:1110:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-24T23:39:33.275 INFO:teuthology.orchestra.run.smithi116.stderr: 1110 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-24T23:39:33.275 INFO:teuthology.orchestra.run.smithi116.stderr: | ^ 2024-04-24T23:39:33.275 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.275 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.275 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-24T23:39:33.275 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.275 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.275 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.275 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.275 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.275 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.275 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:297:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:33.276 INFO:teuthology.orchestra.run.smithi116.stderr: 297 | sprintf( to, "%s/%s", testdir, unique_stat_dir ); 2024-04-24T23:39:33.276 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~ ~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.276 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.276 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.276 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-24T23:39:33.276 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.276 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.276 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.276 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.276 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.276 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.276 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:1133:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-24T23:39:33.276 INFO:teuthology.orchestra.run.smithi116.stderr: 1133 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-24T23:39:33.276 INFO:teuthology.orchestra.run.smithi116.stderr: | ^ 2024-04-24T23:39:33.276 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.277 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.277 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-24T23:39:33.277 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.277 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.277 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.277 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.277 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.277 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.277 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:299:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:33.277 INFO:teuthology.orchestra.run.smithi116.stderr: 299 | sprintf( to, "%s/%s", testdir, unique_read_dir ); 2024-04-24T23:39:33.277 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~ ~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.277 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.277 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.278 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-24T23:39:33.278 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.278 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.278 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.278 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.278 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.278 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.278 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:1161:39: warning: '__builtin___sprintf_chk' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2024-04-24T23:39:33.278 INFO:teuthology.orchestra.run.smithi116.stderr: 1161 | sprintf( temp_path, "%s/%s", testdir, path ); 2024-04-24T23:39:33.278 INFO:teuthology.orchestra.run.smithi116.stderr: | ^ 2024-04-24T23:39:33.278 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.278 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.278 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 2 or more bytes (assuming 4097) into a destination of size 4096 2024-04-24T23:39:33.278 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.279 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.279 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.279 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.279 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.279 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.279 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:301:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:33.279 INFO:teuthology.orchestra.run.smithi116.stderr: 301 | sprintf( to, "%s/%s", testdir, unique_rm_dir ); 2024-04-24T23:39:33.279 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~ ~~~~~~~~~~~~~ 2024-04-24T23:39:33.279 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.279 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.279 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-24T23:39:33.279 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.279 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.279 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.279 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.280 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.280 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.280 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:303:26: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:33.280 INFO:teuthology.orchestra.run.smithi116.stderr: 303 | sprintf( to, "%s/%s", testdir, unique_rm_uni_dir ); 2024-04-24T23:39:33.280 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~ ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.280 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.280 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.280 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 2 and 8192 bytes into a destination of size 4096 2024-04-24T23:39:33.280 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.280 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.280 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.280 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.280 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.280 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.375 INFO:teuthology.orchestra.run.smithi174.stdout: CC libaiori_a-aiori-POSIX.o 2024-04-24T23:39:33.410 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c: In function 'create_remove_directory_tree': 2024-04-24T23:39:33.411 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:1612:30: warning: '%d' directive writing between 1 and 11 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:33.411 INFO:teuthology.orchestra.run.smithi116.stderr: 1612 | sprintf(dir, "%s.%d/", base_tree_name, currDir); 2024-04-24T23:39:33.411 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~ 2024-04-24T23:39:33.411 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.411 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.411 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 4 and 4109 bytes into a destination of size 4096 2024-04-24T23:39:33.411 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.411 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.411 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.411 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.411 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.411 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.411 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:1579:28: warning: '.' directive writing 1 byte into a region of size between 0 and 4095 [-Wformat-overflow=] 2024-04-24T23:39:33.412 INFO:teuthology.orchestra.run.smithi116.stderr: 1579 | sprintf(dir, "%s/%s.%d/", path, base_tree_name, dirNum); 2024-04-24T23:39:33.412 INFO:teuthology.orchestra.run.smithi116.stderr: | ^ 2024-04-24T23:39:33.412 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.412 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.412 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output 5 or more bytes (assuming 4100) into a destination of size 4096 2024-04-24T23:39:33.412 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.412 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.412 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.412 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.412 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.412 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.468 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c: In function 'mdtest_run': 2024-04-24T23:39:33.468 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:1920:35: warning: '%s' directive writing up to 1023 bytes into a region of size 1011 [-Wformat-overflow=] 2024-04-24T23:39:33.468 INFO:teuthology.orchestra.run.smithi116.stderr: 1920 | sprintf(apiStr, "API for I/O [%s]", APIs); 2024-04-24T23:39:33.468 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~ ~~~~ 2024-04-24T23:39:33.468 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.468 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.468 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 15 and 1038 bytes into a destination of size 1024 2024-04-24T23:39:33.468 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.468 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.468 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.468 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.469 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.469 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.470 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:1727:29: warning: '.0' directive writing 2 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-24T23:39:33.470 INFO:teuthology.orchestra.run.smithi116.stderr: 1727 | sprintf(unique_mk_dir, "%s.0", base_tree_name); 2024-04-24T23:39:33.470 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~ 2024-04-24T23:39:33.470 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.470 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.470 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 3 and 4098 bytes into a destination of size 4096 2024-04-24T23:39:33.470 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.470 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.470 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.470 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.470 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.471 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.471 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:1728:32: warning: '.0' directive writing 2 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-24T23:39:33.471 INFO:teuthology.orchestra.run.smithi116.stderr: 1728 | sprintf(unique_chdir_dir, "%s.0", base_tree_name); 2024-04-24T23:39:33.471 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~ 2024-04-24T23:39:33.471 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.471 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.471 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 3 and 4098 bytes into a destination of size 4096 2024-04-24T23:39:33.471 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.471 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.471 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.471 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.471 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.471 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.471 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:1729:31: warning: '.0' directive writing 2 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-24T23:39:33.472 INFO:teuthology.orchestra.run.smithi116.stderr: 1729 | sprintf(unique_stat_dir, "%s.0", base_tree_name); 2024-04-24T23:39:33.472 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~ 2024-04-24T23:39:33.472 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.472 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.472 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 3 and 4098 bytes into a destination of size 4096 2024-04-24T23:39:33.472 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.472 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.472 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.472 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.472 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.472 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.472 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:1730:31: warning: '.0' directive writing 2 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-24T23:39:33.472 INFO:teuthology.orchestra.run.smithi116.stderr: 1730 | sprintf(unique_read_dir, "%s.0", base_tree_name); 2024-04-24T23:39:33.472 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~ 2024-04-24T23:39:33.472 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.473 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.473 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 3 and 4098 bytes into a destination of size 4096 2024-04-24T23:39:33.473 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.473 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.473 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.473 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.473 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.473 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.473 INFO:teuthology.orchestra.run.smithi116.stderr:mdtest.c:1731:29: warning: '.0' directive writing 2 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2024-04-24T23:39:33.473 INFO:teuthology.orchestra.run.smithi116.stderr: 1731 | sprintf(unique_rm_dir, "%s.0", base_tree_name); 2024-04-24T23:39:33.473 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~ 2024-04-24T23:39:33.473 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:33.473 INFO:teuthology.orchestra.run.smithi116.stderr: from mdtest.c:33: 2024-04-24T23:39:33.473 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 3 and 4098 bytes into a destination of size 4096 2024-04-24T23:39:33.474 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:33.474 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.474 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:33.474 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.474 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:33.474 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:33.552 INFO:teuthology.orchestra.run.smithi174.stdout: AR libaiori.a 2024-04-24T23:39:33.567 INFO:teuthology.orchestra.run.smithi174.stderr:ar: `u' modifier ignored since `D' is the default (see `U') 2024-04-24T23:39:33.599 INFO:teuthology.orchestra.run.smithi174.stdout: CCLD ior 2024-04-24T23:39:33.656 INFO:teuthology.orchestra.run.smithi174.stdout: CC mdtest-mdtest-main.o 2024-04-24T23:39:33.668 INFO:teuthology.orchestra.run.smithi116.stdout: CC libaiori_a-utilities.o 2024-04-24T23:39:33.737 INFO:teuthology.orchestra.run.smithi174.stdout: CC mdtest-aiori.o 2024-04-24T23:39:33.877 INFO:teuthology.orchestra.run.smithi174.stdout: CC mdtest-aiori-DUMMY.o 2024-04-24T23:39:33.988 INFO:teuthology.orchestra.run.smithi174.stdout: CC mdtest-aiori-MPIIO.o 2024-04-24T23:39:34.018 INFO:teuthology.orchestra.run.smithi116.stdout: CC libaiori_a-parse_options.o 2024-04-24T23:39:34.207 INFO:teuthology.orchestra.run.smithi116.stderr:parse_options.c: In function 'createGlobalOptions': 2024-04-24T23:39:34.207 INFO:teuthology.orchestra.run.smithi116.stderr:parse_options.c:469:33: warning: '%s' directive writing up to 1023 bytes into a region of size 1011 [-Wformat-overflow=] 2024-04-24T23:39:34.207 INFO:teuthology.orchestra.run.smithi116.stderr: 469 | sprintf(apiStr, "API for I/O [%s]", APIs); 2024-04-24T23:39:34.207 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~ ~~~~ 2024-04-24T23:39:34.207 INFO:teuthology.orchestra.run.smithi116.stderr:In file included from /usr/include/stdio.h:894, 2024-04-24T23:39:34.207 INFO:teuthology.orchestra.run.smithi116.stderr: from parse_options.c:19: 2024-04-24T23:39:34.207 INFO:teuthology.orchestra.run.smithi116.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 15 and 1038 bytes into a destination of size 1024 2024-04-24T23:39:34.207 INFO:teuthology.orchestra.run.smithi116.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-24T23:39:34.208 INFO:teuthology.orchestra.run.smithi116.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:34.208 INFO:teuthology.orchestra.run.smithi116.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-24T23:39:34.208 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:34.208 INFO:teuthology.orchestra.run.smithi116.stderr: 40 | __va_arg_pack ()); 2024-04-24T23:39:34.208 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-24T23:39:34.215 INFO:teuthology.orchestra.run.smithi174.stdout: CC mdtest-aiori-MMAP.o 2024-04-24T23:39:34.316 INFO:teuthology.orchestra.run.smithi116.stdout: CC libaiori_a-ior-output.o 2024-04-24T23:39:34.347 INFO:teuthology.orchestra.run.smithi174.stdout: CC mdtest-aiori-POSIX.o 2024-04-24T23:39:34.523 INFO:teuthology.orchestra.run.smithi174.stdout: CCLD mdtest 2024-04-24T23:39:34.576 INFO:teuthology.orchestra.run.smithi174.stdout:Making all in test 2024-04-24T23:39:34.577 INFO:teuthology.orchestra.run.smithi174.stdout:make[3]: Nothing to be done for 'all'. 2024-04-24T23:39:34.578 INFO:teuthology.orchestra.run.smithi174.stdout:Making all in doc 2024-04-24T23:39:34.581 INFO:teuthology.orchestra.run.smithi174.stdout:make[1]: Nothing to be done for 'all'. 2024-04-24T23:39:34.581 INFO:teuthology.orchestra.run.smithi174.stdout:Making all in contrib 2024-04-24T23:39:34.583 INFO:teuthology.orchestra.run.smithi174.stdout: CC cbif.o 2024-04-24T23:39:34.621 INFO:teuthology.orchestra.run.smithi116.stdout: CC libaiori_a-option.o 2024-04-24T23:39:34.665 INFO:teuthology.orchestra.run.smithi174.stdout: CCLD cbif 2024-04-24T23:39:34.692 INFO:teuthology.orchestra.run.smithi174.stdout:make[1]: Nothing to be done for 'all-am'. 2024-04-24T23:39:34.692 INFO:teuthology.orchestra.run.smithi174.stderr:+ make install DESTDIR=/home/ubuntu/cephtest/binary/ 2024-04-24T23:39:34.697 INFO:teuthology.orchestra.run.smithi174.stdout:Making install in src 2024-04-24T23:39:34.710 INFO:teuthology.orchestra.run.smithi174.stdout:Making install in . 2024-04-24T23:39:34.725 INFO:teuthology.orchestra.run.smithi116.stderr:option.c: In function 'option_parse_token': 2024-04-24T23:39:34.725 INFO:teuthology.orchestra.run.smithi116.stderr:option.c:335:19: warning: writing 1 byte into a region of size 0 [-Wstringop-overflow=] 2024-04-24T23:39:34.725 INFO:teuthology.orchestra.run.smithi116.stderr: 335 | arg[-1] = '='; 2024-04-24T23:39:34.725 INFO:teuthology.orchestra.run.smithi116.stderr: | ~~~~~~~~^~~~~ 2024-04-24T23:39:34.785 INFO:teuthology.orchestra.run.smithi116.stdout: CC libaiori_a-aiori.o 2024-04-24T23:39:34.786 INFO:teuthology.orchestra.run.smithi174.stdout: /usr/bin/mkdir -p '/home/ubuntu/cephtest/binary//usr/local/bin' 2024-04-24T23:39:34.790 INFO:teuthology.orchestra.run.smithi174.stdout: /usr/bin/install -c ior mdtest '/home/ubuntu/cephtest/binary//usr/local/bin' 2024-04-24T23:39:34.793 INFO:teuthology.orchestra.run.smithi174.stdout: /usr/bin/mkdir -p '/home/ubuntu/cephtest/binary//usr/local/lib' 2024-04-24T23:39:34.794 INFO:teuthology.orchestra.run.smithi174.stdout: /usr/bin/install -c -m 644 libaiori.a '/home/ubuntu/cephtest/binary//usr/local/lib' 2024-04-24T23:39:34.798 INFO:teuthology.orchestra.run.smithi174.stdout: ( cd '/home/ubuntu/cephtest/binary//usr/local/lib' && ranlib libaiori.a ) 2024-04-24T23:39:34.805 INFO:teuthology.orchestra.run.smithi174.stdout:make[3]: Nothing to be done for 'install-data-am'. 2024-04-24T23:39:34.805 INFO:teuthology.orchestra.run.smithi174.stdout:Making install in test 2024-04-24T23:39:34.809 INFO:teuthology.orchestra.run.smithi174.stdout:make[3]: Nothing to be done for 'install-exec-am'. 2024-04-24T23:39:34.809 INFO:teuthology.orchestra.run.smithi174.stdout:make[3]: Nothing to be done for 'install-data-am'. 2024-04-24T23:39:34.810 INFO:teuthology.orchestra.run.smithi174.stdout:Making install in doc 2024-04-24T23:39:34.813 INFO:teuthology.orchestra.run.smithi174.stdout:make[2]: Nothing to be done for 'install-exec-am'. 2024-04-24T23:39:34.814 INFO:teuthology.orchestra.run.smithi174.stdout: /usr/bin/mkdir -p '/home/ubuntu/cephtest/binary//usr/local/share' 2024-04-24T23:39:34.816 INFO:teuthology.orchestra.run.smithi174.stdout: /usr/bin/install -c -m 644 USER_GUIDE '/home/ubuntu/cephtest/binary//usr/local/share' 2024-04-24T23:39:34.818 INFO:teuthology.orchestra.run.smithi174.stdout: /usr/bin/mkdir -p '/home/ubuntu/cephtest/binary//usr/local/share/man/man1' 2024-04-24T23:39:34.822 INFO:teuthology.orchestra.run.smithi174.stdout: /usr/bin/install -c -m 644 mdtest.1 '/home/ubuntu/cephtest/binary//usr/local/share/man/man1' 2024-04-24T23:39:34.824 INFO:teuthology.orchestra.run.smithi174.stdout:Making install in contrib 2024-04-24T23:39:34.830 INFO:teuthology.orchestra.run.smithi174.stdout:make[2]: Nothing to be done for 'install-exec-am'. 2024-04-24T23:39:34.830 INFO:teuthology.orchestra.run.smithi174.stdout:make[2]: Nothing to be done for 'install-data-am'. 2024-04-24T23:39:34.833 INFO:teuthology.orchestra.run.smithi174.stdout:make[2]: Nothing to be done for 'install-exec-am'. 2024-04-24T23:39:34.833 INFO:teuthology.orchestra.run.smithi174.stdout:make[2]: Nothing to be done for 'install-data-am'. 2024-04-24T23:39:34.833 INFO:teuthology.orchestra.run.smithi174.stderr:+ cd /home/ubuntu/cephtest/ 2024-04-24T23:39:34.833 INFO:teuthology.orchestra.run.smithi174.stderr:+ sudo apt install -y tree 2024-04-24T23:39:34.842 INFO:teuthology.orchestra.run.smithi174.stderr: 2024-04-24T23:39:34.842 INFO:teuthology.orchestra.run.smithi174.stderr:WARNING: apt does not have a stable CLI interface. Use with caution in scripts. 2024-04-24T23:39:34.842 INFO:teuthology.orchestra.run.smithi174.stderr: 2024-04-24T23:39:34.882 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2024-04-24T23:39:34.930 INFO:teuthology.orchestra.run.smithi116.stdout: CC libaiori_a-aiori-DUMMY.o 2024-04-24T23:39:35.052 INFO:teuthology.orchestra.run.smithi116.stdout: CC libaiori_a-aiori-MPIIO.o 2024-04-24T23:39:35.083 INFO:teuthology.orchestra.run.smithi174.stdout:Building dependency tree... 2024-04-24T23:39:35.084 INFO:teuthology.orchestra.run.smithi174.stdout:Reading state information... 2024-04-24T23:39:35.250 INFO:teuthology.orchestra.run.smithi174.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T23:39:35.250 INFO:teuthology.orchestra.run.smithi174.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T23:39:35.250 INFO:teuthology.orchestra.run.smithi174.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T23:39:35.250 INFO:teuthology.orchestra.run.smithi174.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T23:39:35.251 INFO:teuthology.orchestra.run.smithi174.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-24T23:39:35.251 INFO:teuthology.orchestra.run.smithi174.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-24T23:39:35.251 INFO:teuthology.orchestra.run.smithi174.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T23:39:35.279 INFO:teuthology.orchestra.run.smithi174.stdout:The following NEW packages will be installed: 2024-04-24T23:39:35.279 INFO:teuthology.orchestra.run.smithi174.stdout: tree 2024-04-24T23:39:35.279 INFO:teuthology.orchestra.run.smithi116.stdout: CC libaiori_a-aiori-MMAP.o 2024-04-24T23:39:35.350 INFO:teuthology.orchestra.run.smithi174.stdout:0 upgraded, 1 newly installed, 0 to remove and 298 not upgraded. 2024-04-24T23:39:35.350 INFO:teuthology.orchestra.run.smithi174.stdout:Need to get 47.9 kB of archives. 2024-04-24T23:39:35.350 INFO:teuthology.orchestra.run.smithi174.stdout:After this operation, 116 kB of additional disk space will be used. 2024-04-24T23:39:35.350 INFO:teuthology.orchestra.run.smithi174.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 tree amd64 2.0.2-1 [47.9 kB] 2024-04-24T23:39:35.406 INFO:teuthology.orchestra.run.smithi116.stdout: CC libaiori_a-aiori-POSIX.o 2024-04-24T23:39:35.585 INFO:teuthology.orchestra.run.smithi116.stdout: AR libaiori.a 2024-04-24T23:39:35.593 INFO:teuthology.orchestra.run.smithi116.stderr:ar: `u' modifier ignored since `D' is the default (see `U') 2024-04-24T23:39:35.625 INFO:teuthology.orchestra.run.smithi174.stderr:debconf: unable to initialize frontend: Dialog 2024-04-24T23:39:35.625 INFO:teuthology.orchestra.run.smithi174.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-04-24T23:39:35.625 INFO:teuthology.orchestra.run.smithi174.stderr:debconf: falling back to frontend: Readline 2024-04-24T23:39:35.631 INFO:teuthology.orchestra.run.smithi116.stdout: CCLD ior 2024-04-24T23:39:35.631 INFO:teuthology.orchestra.run.smithi174.stderr:debconf: unable to initialize frontend: Readline 2024-04-24T23:39:35.631 INFO:teuthology.orchestra.run.smithi174.stderr:debconf: (This frontend requires a controlling tty.) 2024-04-24T23:39:35.632 INFO:teuthology.orchestra.run.smithi174.stderr:debconf: falling back to frontend: Teletype 2024-04-24T23:39:35.635 INFO:teuthology.orchestra.run.smithi174.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-04-24T23:39:35.665 INFO:teuthology.orchestra.run.smithi174.stdout:Fetched 47.9 kB in 0s (452 kB/s) 2024-04-24T23:39:35.684 INFO:teuthology.orchestra.run.smithi116.stdout: CC mdtest-mdtest-main.o 2024-04-24T23:39:35.751 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package tree. 2024-04-24T23:39:35.777 INFO:teuthology.orchestra.run.smithi116.stdout: CC mdtest-aiori.o 2024-04-24T23:39:35.810 INFO:teuthology.orchestra.run.smithi174.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176786 files and directories currently installed.) 2024-04-24T23:39:35.815 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../tree_2.0.2-1_amd64.deb ... 2024-04-24T23:39:35.859 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking tree (2.0.2-1) ... 2024-04-24T23:39:35.918 INFO:teuthology.orchestra.run.smithi116.stdout: CC mdtest-aiori-DUMMY.o 2024-04-24T23:39:36.033 INFO:teuthology.orchestra.run.smithi116.stdout: CC mdtest-aiori-MPIIO.o 2024-04-24T23:39:36.211 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up tree (2.0.2-1) ... 2024-04-24T23:39:36.255 INFO:teuthology.orchestra.run.smithi116.stdout: CC mdtest-aiori-MMAP.o 2024-04-24T23:39:36.338 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-24T23:39:36.381 INFO:teuthology.orchestra.run.smithi116.stdout: CC mdtest-aiori-POSIX.o 2024-04-24T23:39:36.559 INFO:teuthology.orchestra.run.smithi116.stdout: CCLD mdtest 2024-04-24T23:39:36.614 INFO:teuthology.orchestra.run.smithi116.stdout:Making all in test 2024-04-24T23:39:36.614 INFO:teuthology.orchestra.run.smithi116.stdout:make[3]: Nothing to be done for 'all'. 2024-04-24T23:39:36.614 INFO:teuthology.orchestra.run.smithi116.stdout:Making all in doc 2024-04-24T23:39:36.615 INFO:teuthology.orchestra.run.smithi116.stdout:make[1]: Nothing to be done for 'all'. 2024-04-24T23:39:36.615 INFO:teuthology.orchestra.run.smithi116.stdout:Making all in contrib 2024-04-24T23:39:36.618 INFO:teuthology.orchestra.run.smithi116.stdout: CC cbif.o 2024-04-24T23:39:36.697 INFO:teuthology.orchestra.run.smithi116.stdout: CCLD cbif 2024-04-24T23:39:36.723 INFO:teuthology.orchestra.run.smithi116.stdout:make[1]: Nothing to be done for 'all-am'. 2024-04-24T23:39:36.723 INFO:teuthology.orchestra.run.smithi116.stderr:+ make install DESTDIR=/home/ubuntu/cephtest/binary/ 2024-04-24T23:39:36.728 INFO:teuthology.orchestra.run.smithi116.stdout:Making install in src 2024-04-24T23:39:36.738 INFO:teuthology.orchestra.run.smithi116.stdout:Making install in . 2024-04-24T23:39:36.785 INFO:teuthology.orchestra.run.smithi116.stdout: /usr/bin/mkdir -p '/home/ubuntu/cephtest/binary//usr/local/bin' 2024-04-24T23:39:36.788 INFO:teuthology.orchestra.run.smithi116.stdout: /usr/bin/install -c ior mdtest '/home/ubuntu/cephtest/binary//usr/local/bin' 2024-04-24T23:39:36.791 INFO:teuthology.orchestra.run.smithi116.stdout: /usr/bin/mkdir -p '/home/ubuntu/cephtest/binary//usr/local/lib' 2024-04-24T23:39:36.791 INFO:teuthology.orchestra.run.smithi116.stdout: /usr/bin/install -c -m 644 libaiori.a '/home/ubuntu/cephtest/binary//usr/local/lib' 2024-04-24T23:39:36.796 INFO:teuthology.orchestra.run.smithi116.stdout: ( cd '/home/ubuntu/cephtest/binary//usr/local/lib' && ranlib libaiori.a ) 2024-04-24T23:39:36.802 INFO:teuthology.orchestra.run.smithi116.stdout:make[3]: Nothing to be done for 'install-data-am'. 2024-04-24T23:39:36.803 INFO:teuthology.orchestra.run.smithi116.stdout:Making install in test 2024-04-24T23:39:36.806 INFO:teuthology.orchestra.run.smithi116.stdout:make[3]: Nothing to be done for 'install-exec-am'. 2024-04-24T23:39:36.806 INFO:teuthology.orchestra.run.smithi116.stdout:make[3]: Nothing to be done for 'install-data-am'. 2024-04-24T23:39:36.807 INFO:teuthology.orchestra.run.smithi116.stdout:Making install in doc 2024-04-24T23:39:36.810 INFO:teuthology.orchestra.run.smithi116.stdout:make[2]: Nothing to be done for 'install-exec-am'. 2024-04-24T23:39:36.810 INFO:teuthology.orchestra.run.smithi116.stdout: /usr/bin/mkdir -p '/home/ubuntu/cephtest/binary//usr/local/share' 2024-04-24T23:39:36.812 INFO:teuthology.orchestra.run.smithi116.stdout: /usr/bin/install -c -m 644 USER_GUIDE '/home/ubuntu/cephtest/binary//usr/local/share' 2024-04-24T23:39:36.815 INFO:teuthology.orchestra.run.smithi116.stdout: /usr/bin/mkdir -p '/home/ubuntu/cephtest/binary//usr/local/share/man/man1' 2024-04-24T23:39:36.818 INFO:teuthology.orchestra.run.smithi116.stdout: /usr/bin/install -c -m 644 mdtest.1 '/home/ubuntu/cephtest/binary//usr/local/share/man/man1' 2024-04-24T23:39:36.820 INFO:teuthology.orchestra.run.smithi116.stdout:Making install in contrib 2024-04-24T23:39:36.826 INFO:teuthology.orchestra.run.smithi116.stdout:make[2]: Nothing to be done for 'install-exec-am'. 2024-04-24T23:39:36.826 INFO:teuthology.orchestra.run.smithi116.stdout:make[2]: Nothing to be done for 'install-data-am'. 2024-04-24T23:39:36.829 INFO:teuthology.orchestra.run.smithi116.stdout:make[2]: Nothing to be done for 'install-exec-am'. 2024-04-24T23:39:36.829 INFO:teuthology.orchestra.run.smithi116.stdout:make[2]: Nothing to be done for 'install-data-am'. 2024-04-24T23:39:36.829 INFO:teuthology.orchestra.run.smithi116.stderr:+ cd /home/ubuntu/cephtest/ 2024-04-24T23:39:36.829 INFO:teuthology.orchestra.run.smithi116.stderr:+ sudo apt install -y tree 2024-04-24T23:39:36.837 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-04-24T23:39:36.837 INFO:teuthology.orchestra.run.smithi116.stderr:WARNING: apt does not have a stable CLI interface. Use with caution in scripts. 2024-04-24T23:39:36.837 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-04-24T23:39:36.878 INFO:teuthology.orchestra.run.smithi116.stdout:Reading package lists... 2024-04-24T23:39:37.079 INFO:teuthology.orchestra.run.smithi116.stdout:Building dependency tree... 2024-04-24T23:39:37.080 INFO:teuthology.orchestra.run.smithi116.stdout:Reading state information... 2024-04-24T23:39:37.257 INFO:teuthology.orchestra.run.smithi116.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T23:39:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T23:39:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T23:39:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T23:39:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-24T23:39:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-24T23:39:37.257 INFO:teuthology.orchestra.run.smithi116.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T23:39:37.284 INFO:teuthology.orchestra.run.smithi116.stdout:The following NEW packages will be installed: 2024-04-24T23:39:37.284 INFO:teuthology.orchestra.run.smithi116.stdout: tree 2024-04-24T23:39:37.342 INFO:teuthology.orchestra.run.smithi116.stdout:0 upgraded, 1 newly installed, 0 to remove and 298 not upgraded. 2024-04-24T23:39:37.342 INFO:teuthology.orchestra.run.smithi116.stdout:Need to get 47.9 kB of archives. 2024-04-24T23:39:37.342 INFO:teuthology.orchestra.run.smithi116.stdout:After this operation, 116 kB of additional disk space will be used. 2024-04-24T23:39:37.342 INFO:teuthology.orchestra.run.smithi116.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 tree amd64 2.0.2-1 [47.9 kB] 2024-04-24T23:39:37.421 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:39:37.424 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:39:37.427 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:39:37.429 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:39:37.588 INFO:teuthology.orchestra.run.smithi174.stderr:+ tree binary/ 2024-04-24T23:39:37.588 INFO:teuthology.orchestra.run.smithi174.stdout:binary/ 2024-04-24T23:39:37.588 INFO:teuthology.orchestra.run.smithi174.stdout:`-- usr 2024-04-24T23:39:37.588 INFO:teuthology.orchestra.run.smithi174.stdout: `-- local 2024-04-24T23:39:37.589 INFO:teuthology.orchestra.run.smithi174.stdout: |-- bin 2024-04-24T23:39:37.589 INFO:teuthology.orchestra.run.smithi174.stdout: | |-- ior 2024-04-24T23:39:37.589 INFO:teuthology.orchestra.run.smithi174.stdout: | `-- mdtest 2024-04-24T23:39:37.589 INFO:teuthology.orchestra.run.smithi174.stdout: |-- lib 2024-04-24T23:39:37.589 INFO:teuthology.orchestra.run.smithi174.stdout: | `-- libaiori.a 2024-04-24T23:39:37.589 INFO:teuthology.orchestra.run.smithi174.stdout: `-- share 2024-04-24T23:39:37.589 INFO:teuthology.orchestra.run.smithi174.stdout: |-- man 2024-04-24T23:39:37.589 INFO:teuthology.orchestra.run.smithi174.stdout: | `-- man1 2024-04-24T23:39:37.589 INFO:teuthology.orchestra.run.smithi174.stdout: | `-- mdtest.1 2024-04-24T23:39:37.589 INFO:teuthology.orchestra.run.smithi174.stdout: `-- USER_GUIDE 2024-04-24T23:39:37.589 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-24T23:39:37.589 INFO:teuthology.orchestra.run.smithi174.stdout:7 directories, 5 files 2024-04-24T23:39:37.590 INFO:teuthology.orchestra.run.smithi174.stderr:+ rm ior-3.3.0.tar.bz2 2024-04-24T23:39:37.590 INFO:teuthology.orchestra.run.smithi174.stderr:+ rm -r ior-3.3.0 2024-04-24T23:39:37.593 INFO:teuthology.orchestra.run.smithi174.stderr:+ ln -s /home/ubuntu/cephtest/mnt.1 /home/ubuntu/cephtest/gmnt 2024-04-24T23:39:37.594 DEBUG:teuthology.parallel:result is None 2024-04-24T23:39:37.611 INFO:teuthology.orchestra.run.smithi116.stderr:debconf: unable to initialize frontend: Dialog 2024-04-24T23:39:37.612 INFO:teuthology.orchestra.run.smithi116.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-04-24T23:39:37.612 INFO:teuthology.orchestra.run.smithi116.stderr:debconf: falling back to frontend: Readline 2024-04-24T23:39:37.617 INFO:teuthology.orchestra.run.smithi116.stderr:debconf: unable to initialize frontend: Readline 2024-04-24T23:39:37.617 INFO:teuthology.orchestra.run.smithi116.stderr:debconf: (This frontend requires a controlling tty.) 2024-04-24T23:39:37.617 INFO:teuthology.orchestra.run.smithi116.stderr:debconf: falling back to frontend: Teletype 2024-04-24T23:39:37.621 INFO:teuthology.orchestra.run.smithi116.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-04-24T23:39:37.651 INFO:teuthology.orchestra.run.smithi116.stdout:Fetched 47.9 kB in 0s (537 kB/s) 2024-04-24T23:39:37.739 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package tree. 2024-04-24T23:39:37.799 INFO:teuthology.orchestra.run.smithi116.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176786 files and directories currently installed.) 2024-04-24T23:39:37.805 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../tree_2.0.2-1_amd64.deb ... 2024-04-24T23:39:37.847 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking tree (2.0.2-1) ... 2024-04-24T23:39:38.183 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up tree (2.0.2-1) ... 2024-04-24T23:39:38.285 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-24T23:39:39.695 INFO:teuthology.orchestra.run.smithi116.stderr:+ tree binary/ 2024-04-24T23:39:39.696 INFO:teuthology.orchestra.run.smithi116.stdout:binary/ 2024-04-24T23:39:39.696 INFO:teuthology.orchestra.run.smithi116.stdout:`-- usr 2024-04-24T23:39:39.696 INFO:teuthology.orchestra.run.smithi116.stdout: `-- local 2024-04-24T23:39:39.696 INFO:teuthology.orchestra.run.smithi116.stdout: |-- bin 2024-04-24T23:39:39.696 INFO:teuthology.orchestra.run.smithi116.stdout: | |-- ior 2024-04-24T23:39:39.696 INFO:teuthology.orchestra.run.smithi116.stdout: | `-- mdtest 2024-04-24T23:39:39.696 INFO:teuthology.orchestra.run.smithi116.stdout: |-- lib 2024-04-24T23:39:39.696 INFO:teuthology.orchestra.run.smithi116.stdout: | `-- libaiori.a 2024-04-24T23:39:39.697 INFO:teuthology.orchestra.run.smithi116.stdout: `-- share 2024-04-24T23:39:39.697 INFO:teuthology.orchestra.run.smithi116.stdout: |-- man 2024-04-24T23:39:39.697 INFO:teuthology.orchestra.run.smithi116.stdout: | `-- man1 2024-04-24T23:39:39.697 INFO:teuthology.orchestra.run.smithi116.stdout: | `-- mdtest.1 2024-04-24T23:39:39.697 INFO:teuthology.orchestra.run.smithi116.stdout: `-- USER_GUIDE 2024-04-24T23:39:39.697 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:39:39.697 INFO:teuthology.orchestra.run.smithi116.stdout:7 directories, 5 files 2024-04-24T23:39:39.698 INFO:teuthology.orchestra.run.smithi116.stderr:+ rm ior-3.3.0.tar.bz2 2024-04-24T23:39:39.698 INFO:teuthology.orchestra.run.smithi116.stderr:+ rm -r ior-3.3.0 2024-04-24T23:39:39.702 INFO:teuthology.orchestra.run.smithi116.stderr:+ ln -s /home/ubuntu/cephtest/mnt.0 /home/ubuntu/cephtest/gmnt 2024-04-24T23:39:39.703 DEBUG:teuthology.parallel:result is None 2024-04-24T23:39:39.703 INFO:teuthology.run_tasks:Running task ssh_keys... 2024-04-24T23:39:39.820 DEBUG:teuthology.orchestra.run.smithi057:> echo 'StrictHostKeyChecking no 2024-04-24T23:39:39.820 DEBUG:teuthology.orchestra.run.smithi057:> ' > /home/ubuntu/.ssh/config && echo 'UserKnownHostsFile ' /dev/null >> /home/ubuntu/.ssh/config && chmod 600 /home/ubuntu/.ssh/config 2024-04-24T23:39:39.823 DEBUG:teuthology.orchestra.run.smithi088:> echo 'StrictHostKeyChecking no 2024-04-24T23:39:39.823 DEBUG:teuthology.orchestra.run.smithi088:> ' > /home/ubuntu/.ssh/config && echo 'UserKnownHostsFile ' /dev/null >> /home/ubuntu/.ssh/config && chmod 600 /home/ubuntu/.ssh/config 2024-04-24T23:39:39.826 DEBUG:teuthology.orchestra.run.smithi116:> echo 'StrictHostKeyChecking no 2024-04-24T23:39:39.826 DEBUG:teuthology.orchestra.run.smithi116:> ' > /home/ubuntu/.ssh/config && echo 'UserKnownHostsFile ' /dev/null >> /home/ubuntu/.ssh/config && chmod 600 /home/ubuntu/.ssh/config 2024-04-24T23:39:39.829 DEBUG:teuthology.orchestra.run.smithi174:> echo 'StrictHostKeyChecking no 2024-04-24T23:39:39.829 DEBUG:teuthology.orchestra.run.smithi174:> ' > /home/ubuntu/.ssh/config && echo 'UserKnownHostsFile ' /dev/null >> /home/ubuntu/.ssh/config && chmod 600 /home/ubuntu/.ssh/config 2024-04-24T23:39:39.835 INFO:teuthology.task.ssh_keys:generated public key AAAAB3NzaC1yc2EAAAADAQABAAABAQC0wyLnfn30G78ztWG3aUbMO2TXRB5voEhRzZxFAJvOG9NgO+gBDRDcNGhgHZWnDCbxscxeEM/QOj40kjtQmNorXgQXjPXugLrbjMKJM4I7pz0Df015tfOK8YRd3WwSDJ9FS1CU9VMq7t/4Yc4T0fwEGKfci3kO4IUMIiQpy9aZv7Ik6dqJ9aX2niUdqR7rsQptu1MzTjNwZZz4BxkGIzKsKgzhBTh0Lh72gVeyfyBWLsP4xhfZge4DkhbSwlm/5Wkk2awIODWmrJxY2x+2WzYe9d2ppPXk9sAFRYFLQ+oyfMT3HDcVksEdJrXJpGCgpuM1IdLVrWvtiREdnBkKcLyz 2024-04-24T23:39:39.835 INFO:teuthology.task.ssh_keys:pushing keys to smithi057.front.sepia.ceph.com for ubuntu 2024-04-24T23:39:39.836 DEBUG:teuthology.orchestra.run.smithi057:> rm -f -- /home/ubuntu/.ssh/id_rsa 2024-04-24T23:39:39.877 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T23:39:39.877 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/.ssh/id_rsa 2024-04-24T23:39:39.877 DEBUG:teuthology.orchestra.run.smithi057:> chmod 0500 /home/ubuntu/.ssh/id_rsa 2024-04-24T23:39:39.926 DEBUG:teuthology.orchestra.run.smithi057:> rm -f -- /home/ubuntu/.ssh/id_rsa.pub 2024-04-24T23:39:39.972 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T23:39:39.972 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/.ssh/id_rsa.pub 2024-04-24T23:39:40.021 DEBUG:teuthology.orchestra.run.smithi057:> cp -v -a /home/ubuntu/.ssh/authorized_keys /home/ubuntu/.ssh/authorized_keys_2024-04-24_23:39:40:021190 2024-04-24T23:39:40.070 INFO:teuthology.orchestra.run.smithi057.stdout:'/home/ubuntu/.ssh/authorized_keys' -> '/home/ubuntu/.ssh/authorized_keys_2024-04-24_23:39:40:021190' 2024-04-24T23:39:40.070 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T23:39:40.070 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/.ssh/authorized_keys conv=notrunc oflag=append 2024-04-24T23:39:40.117 INFO:teuthology.task.ssh_keys:pushing keys to smithi088.front.sepia.ceph.com for ubuntu 2024-04-24T23:39:40.117 DEBUG:teuthology.orchestra.run.smithi088:> rm -f -- /home/ubuntu/.ssh/id_rsa 2024-04-24T23:39:40.123 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T23:39:40.123 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/.ssh/id_rsa 2024-04-24T23:39:40.123 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0500 /home/ubuntu/.ssh/id_rsa 2024-04-24T23:39:40.172 DEBUG:teuthology.orchestra.run.smithi088:> rm -f -- /home/ubuntu/.ssh/id_rsa.pub 2024-04-24T23:39:40.219 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T23:39:40.219 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/.ssh/id_rsa.pub 2024-04-24T23:39:40.266 DEBUG:teuthology.orchestra.run.smithi088:> cp -v -a /home/ubuntu/.ssh/authorized_keys /home/ubuntu/.ssh/authorized_keys_2024-04-24_23:39:40:266617 2024-04-24T23:39:40.315 INFO:teuthology.orchestra.run.smithi088.stdout:'/home/ubuntu/.ssh/authorized_keys' -> '/home/ubuntu/.ssh/authorized_keys_2024-04-24_23:39:40:266617' 2024-04-24T23:39:40.316 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-24T23:39:40.316 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/.ssh/authorized_keys conv=notrunc oflag=append 2024-04-24T23:39:40.362 INFO:teuthology.task.ssh_keys:pushing keys to smithi116.front.sepia.ceph.com for ubuntu 2024-04-24T23:39:40.362 DEBUG:teuthology.orchestra.run.smithi116:> rm -f -- /home/ubuntu/.ssh/id_rsa 2024-04-24T23:39:40.368 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-24T23:39:40.368 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/.ssh/id_rsa 2024-04-24T23:39:40.368 DEBUG:teuthology.orchestra.run.smithi116:> chmod 0500 /home/ubuntu/.ssh/id_rsa 2024-04-24T23:39:40.417 DEBUG:teuthology.orchestra.run.smithi116:> rm -f -- /home/ubuntu/.ssh/id_rsa.pub 2024-04-24T23:39:40.464 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-24T23:39:40.464 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/.ssh/id_rsa.pub 2024-04-24T23:39:40.514 DEBUG:teuthology.orchestra.run.smithi116:> cp -v -a /home/ubuntu/.ssh/authorized_keys /home/ubuntu/.ssh/authorized_keys_2024-04-24_23:39:40:514482 2024-04-24T23:39:40.560 INFO:teuthology.orchestra.run.smithi116.stdout:'/home/ubuntu/.ssh/authorized_keys' -> '/home/ubuntu/.ssh/authorized_keys_2024-04-24_23:39:40:514482' 2024-04-24T23:39:40.561 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-24T23:39:40.561 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/.ssh/authorized_keys conv=notrunc oflag=append 2024-04-24T23:39:40.608 INFO:teuthology.task.ssh_keys:pushing keys to smithi174.front.sepia.ceph.com for ubuntu 2024-04-24T23:39:40.608 DEBUG:teuthology.orchestra.run.smithi174:> rm -f -- /home/ubuntu/.ssh/id_rsa 2024-04-24T23:39:40.613 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-24T23:39:40.613 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/.ssh/id_rsa 2024-04-24T23:39:40.613 DEBUG:teuthology.orchestra.run.smithi174:> chmod 0500 /home/ubuntu/.ssh/id_rsa 2024-04-24T23:39:40.660 DEBUG:teuthology.orchestra.run.smithi174:> rm -f -- /home/ubuntu/.ssh/id_rsa.pub 2024-04-24T23:39:40.708 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-24T23:39:40.708 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/.ssh/id_rsa.pub 2024-04-24T23:39:40.759 DEBUG:teuthology.orchestra.run.smithi174:> cp -v -a /home/ubuntu/.ssh/authorized_keys /home/ubuntu/.ssh/authorized_keys_2024-04-24_23:39:40:759041 2024-04-24T23:39:40.812 INFO:teuthology.orchestra.run.smithi174.stdout:'/home/ubuntu/.ssh/authorized_keys' -> '/home/ubuntu/.ssh/authorized_keys_2024-04-24_23:39:40:759041' 2024-04-24T23:39:40.812 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-24T23:39:40.812 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/.ssh/authorized_keys conv=notrunc oflag=append 2024-04-24T23:39:40.859 INFO:teuthology.run_tasks:Running task mpi... 2024-04-24T23:39:40.894 DEBUG:teuthology.orchestra.run.smithi116:> mpiexec --version 2024-04-24T23:39:40.935 INFO:teuthology.orchestra.run.smithi116.stdout:HYDRA build details: 2024-04-24T23:39:40.935 INFO:teuthology.orchestra.run.smithi116.stdout: Version: 4.0 2024-04-24T23:39:40.935 INFO:teuthology.orchestra.run.smithi116.stdout: Release Date: Fri Jan 21 10:42:29 CST 2022 2024-04-24T23:39:40.936 INFO:teuthology.orchestra.run.smithi116.stdout: CC: gcc -Wdate-time -D_FORTIFY_SOURCE=2 -g -O2 -ffile-prefix-map=/build/mpich-0xgrG5/mpich-4.0=. -flto=auto -ffat-lto-objects -flto=auto -ffat-lto-objects -fstack-protector-strong -Wformat -Werror=format-security -Wl,-Bsymbolic-functions -flto=auto -ffat-lto-objects -flto=auto -Wl,-z,relro 2024-04-24T23:39:40.936 INFO:teuthology.orchestra.run.smithi116.stdout: Configure options: '--with-hwloc-prefix=/usr' '--with-device=ch4:ofi' 'FFLAGS=-O2 -ffile-prefix-map=/build/mpich-0xgrG5/mpich-4.0=. -flto=auto -ffat-lto-objects -flto=auto -ffat-lto-objects -fstack-protector-strong -fallow-invalid-boz -fallow-argument-mismatch' '--prefix=/usr' 'CFLAGS=-g -O2 -ffile-prefix-map=/build/mpich-0xgrG5/mpich-4.0=. -flto=auto -ffat-lto-objects -flto=auto -ffat-lto-objects -fstack-protector-strong -Wformat -Werror=format-security' 'LDFLAGS=-Wl,-Bsymbolic-functions -flto=auto -ffat-lto-objects -flto=auto -Wl,-z,relro' 'CPPFLAGS=-Wdate-time -D_FORTIFY_SOURCE=2' 2024-04-24T23:39:40.936 INFO:teuthology.orchestra.run.smithi116.stdout: Process Manager: pmi 2024-04-24T23:39:40.936 INFO:teuthology.orchestra.run.smithi116.stdout: Launchers available: ssh rsh fork slurm ll lsf sge manual persist 2024-04-24T23:39:40.936 INFO:teuthology.orchestra.run.smithi116.stdout: Topology libraries available: hwloc 2024-04-24T23:39:40.936 INFO:teuthology.orchestra.run.smithi116.stdout: Resource management kernels available: user slurm ll lsf sge pbs cobalt 2024-04-24T23:39:40.936 INFO:teuthology.orchestra.run.smithi116.stdout: Demux engines available: poll select 2024-04-24T23:39:40.937 DEBUG:teuthology.orchestra.run.smithi174:> mpiexec --version 2024-04-24T23:39:40.976 INFO:teuthology.orchestra.run.smithi174.stdout:HYDRA build details: 2024-04-24T23:39:40.977 INFO:teuthology.orchestra.run.smithi174.stdout: Version: 4.0 2024-04-24T23:39:40.977 INFO:teuthology.orchestra.run.smithi174.stdout: Release Date: Fri Jan 21 10:42:29 CST 2022 2024-04-24T23:39:40.977 INFO:teuthology.orchestra.run.smithi174.stdout: CC: gcc -Wdate-time -D_FORTIFY_SOURCE=2 -g -O2 -ffile-prefix-map=/build/mpich-0xgrG5/mpich-4.0=. -flto=auto -ffat-lto-objects -flto=auto -ffat-lto-objects -fstack-protector-strong -Wformat -Werror=format-security -Wl,-Bsymbolic-functions -flto=auto -ffat-lto-objects -flto=auto -Wl,-z,relro 2024-04-24T23:39:40.977 INFO:teuthology.orchestra.run.smithi174.stdout: Configure options: '--with-hwloc-prefix=/usr' '--with-device=ch4:ofi' 'FFLAGS=-O2 -ffile-prefix-map=/build/mpich-0xgrG5/mpich-4.0=. -flto=auto -ffat-lto-objects -flto=auto -ffat-lto-objects -fstack-protector-strong -fallow-invalid-boz -fallow-argument-mismatch' '--prefix=/usr' 'CFLAGS=-g -O2 -ffile-prefix-map=/build/mpich-0xgrG5/mpich-4.0=. -flto=auto -ffat-lto-objects -flto=auto -ffat-lto-objects -fstack-protector-strong -Wformat -Werror=format-security' 'LDFLAGS=-Wl,-Bsymbolic-functions -flto=auto -ffat-lto-objects -flto=auto -Wl,-z,relro' 'CPPFLAGS=-Wdate-time -D_FORTIFY_SOURCE=2' 2024-04-24T23:39:40.977 INFO:teuthology.orchestra.run.smithi174.stdout: Process Manager: pmi 2024-04-24T23:39:40.977 INFO:teuthology.orchestra.run.smithi174.stdout: Launchers available: ssh rsh fork slurm ll lsf sge manual persist 2024-04-24T23:39:40.977 INFO:teuthology.orchestra.run.smithi174.stdout: Topology libraries available: hwloc 2024-04-24T23:39:40.977 INFO:teuthology.orchestra.run.smithi174.stdout: Resource management kernels available: user slurm ll lsf sge pbs cobalt 2024-04-24T23:39:40.977 INFO:teuthology.orchestra.run.smithi174.stdout: Demux engines available: poll select 2024-04-24T23:39:40.977 INFO:teuthology.task.mpi:MPI version 4.0 2024-04-24T23:39:40.978 INFO:teuthology.task.mpi:mpi rank 0 is: ubuntu@smithi116.front.sepia.ceph.com 2024-04-24T23:39:40.978 INFO:teuthology.task.mpi:mpi nodes: [172.21.15.116, 172.21.15.174] 2024-04-24T23:39:40.978 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-24T23:39:40.978 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/mpi-hosts 2024-04-24T23:39:40.984 INFO:teuthology.task.mpi:mpiexec on ubuntu@smithi116.front.sepia.ceph.com: /home/ubuntu/cephtest/binary/usr/local/bin/ior -e -w -r -W -b 10m -a POSIX -o /home/ubuntu/cephtest/gmnt/ior.testfile 2024-04-24T23:39:40.985 DEBUG:teuthology.orchestra.run.smithi116:> mpiexec -f /home/ubuntu/cephtest/mpi-hosts /home/ubuntu/cephtest/binary/usr/local/bin/ior -e -w -r -W -b 10m -a POSIX -o /home/ubuntu/cephtest/gmnt/ior.testfile 2024-04-24T23:39:41.124 INFO:teuthology.orchestra.run.smithi116.stderr:Warning: Permanently added '172.21.15.174' (ED25519) to the list of known hosts. 2024-04-24T23:39:41.819 INFO:teuthology.orchestra.run.smithi116.stdout:IOR-3.3.0: MPI Coordinated Test of Parallel I/O 2024-04-24T23:39:41.819 INFO:teuthology.orchestra.run.smithi116.stdout:Began : Wed Apr 24 23:39:41 2024 2024-04-24T23:39:41.819 INFO:teuthology.orchestra.run.smithi116.stdout:Command line : /home/ubuntu/cephtest/binary/usr/local/bin/ior -e -w -r -W -b 10m -a POSIX -o /home/ubuntu/cephtest/gmnt/ior.testfile 2024-04-24T23:39:41.819 INFO:teuthology.orchestra.run.smithi116.stdout:Machine : Linux smithi116 2024-04-24T23:39:41.819 INFO:teuthology.orchestra.run.smithi116.stdout:TestID : 0 2024-04-24T23:39:41.820 INFO:teuthology.orchestra.run.smithi116.stdout:StartTime : Wed Apr 24 23:39:41 2024 2024-04-24T23:39:41.820 INFO:teuthology.orchestra.run.smithi116.stdout:Path : /home/ubuntu/cephtest/mnt.0 2024-04-24T23:39:41.820 INFO:teuthology.orchestra.run.smithi116.stdout:FS : 720.0 GiB Used FS: 0.0% Inodes: 0.0 Mi Used Inodes: 200.0% 2024-04-24T23:39:41.821 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:39:41.821 INFO:teuthology.orchestra.run.smithi116.stdout:Options: 2024-04-24T23:39:41.821 INFO:teuthology.orchestra.run.smithi116.stdout:api : POSIX 2024-04-24T23:39:41.821 INFO:teuthology.orchestra.run.smithi116.stdout:apiVersion : 2024-04-24T23:39:41.821 INFO:teuthology.orchestra.run.smithi116.stdout:test filename : /home/ubuntu/cephtest/gmnt/ior.testfile 2024-04-24T23:39:41.821 INFO:teuthology.orchestra.run.smithi116.stdout:access : single-shared-file 2024-04-24T23:39:41.821 INFO:teuthology.orchestra.run.smithi116.stdout:type : independent 2024-04-24T23:39:41.821 INFO:teuthology.orchestra.run.smithi116.stdout:segments : 1 2024-04-24T23:39:41.821 INFO:teuthology.orchestra.run.smithi116.stdout:ordering in a file : sequential 2024-04-24T23:39:41.822 INFO:teuthology.orchestra.run.smithi116.stdout:ordering inter file : no tasks offsets 2024-04-24T23:39:41.822 INFO:teuthology.orchestra.run.smithi116.stdout:nodes : 2 2024-04-24T23:39:41.822 INFO:teuthology.orchestra.run.smithi116.stdout:tasks : 2 2024-04-24T23:39:41.822 INFO:teuthology.orchestra.run.smithi116.stdout:clients per node : 1 2024-04-24T23:39:41.822 INFO:teuthology.orchestra.run.smithi116.stdout:repetitions : 1 2024-04-24T23:39:41.822 INFO:teuthology.orchestra.run.smithi116.stdout:xfersize : 262144 bytes 2024-04-24T23:39:41.822 INFO:teuthology.orchestra.run.smithi116.stdout:blocksize : 10 MiB 2024-04-24T23:39:41.822 INFO:teuthology.orchestra.run.smithi116.stdout:aggregate filesize : 20 MiB 2024-04-24T23:39:41.822 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:39:41.822 INFO:teuthology.orchestra.run.smithi116.stdout:Results: 2024-04-24T23:39:41.822 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:39:41.822 INFO:teuthology.orchestra.run.smithi116.stdout:access bw(MiB/s) IOPS Latency(s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter 2024-04-24T23:39:41.822 INFO:teuthology.orchestra.run.smithi116.stdout:------ --------- ---- ---------- ---------- --------- -------- -------- -------- -------- ---- 2024-04-24T23:39:42.369 INFO:teuthology.orchestra.run.smithi116.stdout:write 38.18 155.61 0.012730 10240 256.00 0.010184 0.514092 0.004477 0.523878 0 2024-04-24T23:39:42.566 INFO:teuthology.orchestra.run.smithi116.stdout:read 753.51 4043 0.000077 10240 256.00 0.007435 0.019789 0.016804 0.026542 0 2024-04-24T23:39:42.585 INFO:teuthology.orchestra.run.smithi116.stdout:remove - - - - - - - - 0.017806 0 2024-04-24T23:39:42.585 INFO:teuthology.orchestra.run.smithi116.stdout:Max Write: 38.18 MiB/sec (40.03 MB/sec) 2024-04-24T23:39:42.585 INFO:teuthology.orchestra.run.smithi116.stdout:Max Read: 753.51 MiB/sec (790.12 MB/sec) 2024-04-24T23:39:42.585 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-24T23:39:42.585 INFO:teuthology.orchestra.run.smithi116.stdout:Summary of all tests: 2024-04-24T23:39:42.585 INFO:teuthology.orchestra.run.smithi116.stdout:Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum 2024-04-24T23:39:42.585 INFO:teuthology.orchestra.run.smithi116.stdout:write 38.18 38.18 38.18 0.00 152.71 152.71 152.71 0.00 0.52388 NA NA 0 2 1 1 0 0 1 0 0 1 10485760 262144 20.0 POSIX 0 2024-04-24T23:39:42.585 INFO:teuthology.orchestra.run.smithi116.stdout:read 753.51 753.51 753.51 0.00 3014.06 3014.06 3014.06 0.00 0.02654 NA NA 0 2 1 1 0 0 1 0 0 1 10485760 262144 20.0 POSIX 0 2024-04-24T23:39:42.585 INFO:teuthology.orchestra.run.smithi116.stdout:Finished : Wed Apr 24 23:39:42 2024 2024-04-24T23:39:42.599 INFO:teuthology.task.mpi:mpi task completed 2024-04-24T23:39:42.599 DEBUG:teuthology.orchestra.run.smithi116:> rm /home/ubuntu/cephtest/mpi-hosts 2024-04-24T23:39:42.605 INFO:teuthology.run_tasks:Running task pexec... 2024-04-24T23:39:42.614 INFO:teuthology.task.pexec:Executing custom commands... 2024-04-24T23:39:42.614 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi116.front.sepia.ceph.com 2024-04-24T23:39:42.614 DEBUG:teuthology.orchestra.run.smithi116:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-04-24T23:39:42.615 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi174.front.sepia.ceph.com 2024-04-24T23:39:42.615 DEBUG:teuthology.orchestra.run.smithi174:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-04-24T23:39:42.677 DEBUG:teuthology.parallel:result is None 2024-04-24T23:39:42.702 DEBUG:teuthology.parallel:result is None 2024-04-24T23:39:42.702 DEBUG:teuthology.run_tasks:Unwinding manager ssh_keys 2024-04-24T23:39:42.711 INFO:teuthology.task.ssh_keys:Cleaning up SSH keys 2024-04-24T23:39:42.711 INFO:teuthology.task.ssh_keys:cleaning up keys added for testing 2024-04-24T23:39:42.711 INFO:teuthology.task.ssh_keys: cleaning up keys for user ubuntu on smithi057.front.sepia.ceph.com 2024-04-24T23:39:42.711 DEBUG:teuthology.orchestra.run.smithi057:> rm -- /home/ubuntu/.ssh/id_rsa 2024-04-24T23:39:42.718 DEBUG:teuthology.orchestra.run.smithi057:> rm -- /home/ubuntu/.ssh/id_rsa.pub 2024-04-24T23:39:42.765 DEBUG:teuthology.orchestra.run.smithi057:> stat -c '"%a"' /home/ubuntu/.ssh/authorized_keys 2024-04-24T23:39:42.817 INFO:teuthology.orchestra.run.smithi057.stdout:"600" 2024-04-24T23:39:42.817 DEBUG:teuthology.orchestra.run.smithi057:> mv -- /home/ubuntu/.ssh/authorized_keys_2024-04-24_23:39:40:021190 /home/ubuntu/.ssh/authorized_keys 2024-04-24T23:39:42.865 DEBUG:teuthology.orchestra.run.smithi057:> chmod 600 /home/ubuntu/.ssh/authorized_keys 2024-04-24T23:39:42.913 INFO:teuthology.task.ssh_keys: cleaning up keys for user ubuntu on smithi088.front.sepia.ceph.com 2024-04-24T23:39:42.913 DEBUG:teuthology.orchestra.run.smithi088:> rm -- /home/ubuntu/.ssh/id_rsa 2024-04-24T23:39:42.919 DEBUG:teuthology.orchestra.run.smithi088:> rm -- /home/ubuntu/.ssh/id_rsa.pub 2024-04-24T23:39:42.966 DEBUG:teuthology.orchestra.run.smithi088:> stat -c '"%a"' /home/ubuntu/.ssh/authorized_keys 2024-04-24T23:39:43.015 INFO:teuthology.orchestra.run.smithi088.stdout:"600" 2024-04-24T23:39:43.015 DEBUG:teuthology.orchestra.run.smithi088:> mv -- /home/ubuntu/.ssh/authorized_keys_2024-04-24_23:39:40:266617 /home/ubuntu/.ssh/authorized_keys 2024-04-24T23:39:43.063 DEBUG:teuthology.orchestra.run.smithi088:> chmod 600 /home/ubuntu/.ssh/authorized_keys 2024-04-24T23:39:43.110 INFO:teuthology.task.ssh_keys: cleaning up keys for user ubuntu on smithi116.front.sepia.ceph.com 2024-04-24T23:39:43.111 DEBUG:teuthology.orchestra.run.smithi116:> rm -- /home/ubuntu/.ssh/id_rsa 2024-04-24T23:39:43.116 DEBUG:teuthology.orchestra.run.smithi116:> rm -- /home/ubuntu/.ssh/id_rsa.pub 2024-04-24T23:39:43.164 DEBUG:teuthology.orchestra.run.smithi116:> stat -c '"%a"' /home/ubuntu/.ssh/authorized_keys 2024-04-24T23:39:43.212 INFO:teuthology.orchestra.run.smithi116.stdout:"600" 2024-04-24T23:39:43.212 DEBUG:teuthology.orchestra.run.smithi116:> mv -- /home/ubuntu/.ssh/authorized_keys_2024-04-24_23:39:40:514482 /home/ubuntu/.ssh/authorized_keys 2024-04-24T23:39:43.260 DEBUG:teuthology.orchestra.run.smithi116:> chmod 600 /home/ubuntu/.ssh/authorized_keys 2024-04-24T23:39:43.308 INFO:teuthology.task.ssh_keys: cleaning up keys for user ubuntu on smithi174.front.sepia.ceph.com 2024-04-24T23:39:43.308 DEBUG:teuthology.orchestra.run.smithi174:> rm -- /home/ubuntu/.ssh/id_rsa 2024-04-24T23:39:43.313 DEBUG:teuthology.orchestra.run.smithi174:> rm -- /home/ubuntu/.ssh/id_rsa.pub 2024-04-24T23:39:43.359 DEBUG:teuthology.orchestra.run.smithi174:> stat -c '"%a"' /home/ubuntu/.ssh/authorized_keys 2024-04-24T23:39:43.407 INFO:teuthology.orchestra.run.smithi174.stdout:"600" 2024-04-24T23:39:43.407 DEBUG:teuthology.orchestra.run.smithi174:> mv -- /home/ubuntu/.ssh/authorized_keys_2024-04-24_23:39:40:759041 /home/ubuntu/.ssh/authorized_keys 2024-04-24T23:39:43.460 DEBUG:teuthology.orchestra.run.smithi174:> chmod 600 /home/ubuntu/.ssh/authorized_keys 2024-04-24T23:39:43.507 DEBUG:teuthology.orchestra.run.smithi057:> rm /home/ubuntu/.ssh/config 2024-04-24T23:39:43.509 DEBUG:teuthology.orchestra.run.smithi088:> rm /home/ubuntu/.ssh/config 2024-04-24T23:39:43.512 DEBUG:teuthology.orchestra.run.smithi116:> rm /home/ubuntu/.ssh/config 2024-04-24T23:39:43.514 DEBUG:teuthology.orchestra.run.smithi174:> rm /home/ubuntu/.ssh/config 2024-04-24T23:39:43.555 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-24T23:39:43.565 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-24T23:39:43.565 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-24T23:39:43.566 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:39:43.571 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-24T23:39:43.571 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:39:43.620 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:39:43.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9ded545640 1 Processor -- start 2024-04-24T23:39:43.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9ded545640 1 -- start start 2024-04-24T23:39:43.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9ded545640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9de80c00d0 0x7f9de80a6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:43.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9ded545640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9de80a39c0 con 0x7f9de80a6350 2024-04-24T23:39:43.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9ded545640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9de81528c0 con 0x7f9de80c3240 2024-04-24T23:39:43.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9ded545640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f9de80c0ca0 con 0x7f9de80c00d0 2024-04-24T23:39:43.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9de6ffd640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9de80a6350 0x7f9de80c1130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:41150/0 (socket says 172.21.15.57:41150) 2024-04-24T23:39:43.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9de6ffd640 1 -- 172.21.15.57:0/1517051243 learned_addr learned my addr 172.21.15.57:0/1517051243 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:43.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9de77fe640 1 --2- 172.21.15.57:0/1517051243 >> v2:172.21.15.88:3300/0 conn(0x7f9de80c00d0 0x7f9de80a6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:43.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9de5ffb640 1 -- 172.21.15.57:0/1517051243 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2298831875 0 0) 0x7f9de80a39c0 con 0x7f9de80a6350 2024-04-24T23:39:43.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9de5ffb640 1 -- 172.21.15.57:0/1517051243 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9dd0003530 con 0x7f9de80a6350 2024-04-24T23:39:43.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9de5ffb640 1 -- 172.21.15.57:0/1517051243 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 909635385 0 0) 0x7f9dd0003530 con 0x7f9de80a6350 2024-04-24T23:39:43.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9de5ffb640 1 -- 172.21.15.57:0/1517051243 >> v2:172.21.15.88:3300/0 conn(0x7f9de80c00d0 msgr2=0x7f9de80a6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:43.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9de5ffb640 1 --2- 172.21.15.57:0/1517051243 >> v2:172.21.15.88:3300/0 conn(0x7f9de80c00d0 0x7f9de80a6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:43.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9de5ffb640 1 -- 172.21.15.57:0/1517051243 >> v1:172.21.15.88:6789/0 conn(0x7f9de80c3240 legacy=0x7f9de80bf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:43.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9de5ffb640 1 -- 172.21.15.57:0/1517051243 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de80c0930 con 0x7f9de80a6350 2024-04-24T23:39:43.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9de5ffb640 1 -- 172.21.15.57:0/1517051243 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7f9dd8001680 con 0x7f9de80a6350 2024-04-24T23:39:43.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9de5ffb640 1 -- 172.21.15.57:0/1517051243 >> v1:172.21.15.57:6789/0 conn(0x7f9de80a6350 legacy=0x7f9de80c1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:43.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9de5ffb640 1 --2- 172.21.15.57:0/1517051243 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9dd00039c0 0x7f9dd0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:43.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9de5ffb640 1 --2- 172.21.15.57:0/1517051243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9dd0004810 0x7f9dd0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:43.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9de5ffb640 1 --2- 172.21.15.57:0/1517051243 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9dd00051d0 0x7f9dd000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:43.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9de5ffb640 1 -- 172.21.15.57:0/1517051243 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9de80c0ca0 con 0x7f9dd00051d0 2024-04-24T23:39:43.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9de5ffb640 1 -- 172.21.15.57:0/1517051243 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd000c170 con 0x7f9dd0004810 2024-04-24T23:39:43.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9de5ffb640 1 -- 172.21.15.57:0/1517051243 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f9dd000c370 con 0x7f9dd00039c0 2024-04-24T23:39:43.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9de77fe640 1 --2- 172.21.15.57:0/1517051243 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9dd00051d0 0x7f9dd000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:43.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9de67fc640 1 --2- 172.21.15.57:0/1517051243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9dd0004810 0x7f9dd0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:43.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9de6ffd640 1 --2- 172.21.15.57:0/1517051243 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9dd00039c0 0x7f9dd0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:43.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9de77fe640 1 -- 172.21.15.57:0/1517051243 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9dd00039c0 msgr2=0x7f9dd0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:43.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9de77fe640 1 --2- 172.21.15.57:0/1517051243 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9dd00039c0 0x7f9dd0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:43.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9de77fe640 1 -- 172.21.15.57:0/1517051243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9dd0004810 msgr2=0x7f9dd0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:43.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9de77fe640 1 --2- 172.21.15.57:0/1517051243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9dd0004810 0x7f9dd0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:43.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.756+0000 7f9de77fe640 1 -- 172.21.15.57:0/1517051243 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd0003530 con 0x7f9dd00051d0 2024-04-24T23:39:43.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.760+0000 7f9de77fe640 1 -- 172.21.15.57:0/1517051243 reap_dead start 2024-04-24T23:39:43.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.760+0000 7f9de77fe640 1 --2- 172.21.15.57:0/1517051243 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9dd00051d0 0x7f9dd000b9d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9de0009fc0 tx=0x7f9de001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=badc721cd220a03f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:43.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.760+0000 7f9de5ffb640 1 -- 172.21.15.57:0/1517051243 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de0009c10 con 0x7f9dd00051d0 2024-04-24T23:39:43.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.760+0000 7f9de5ffb640 1 -- 172.21.15.57:0/1517051243 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9de00a5c00 con 0x7f9dd00051d0 2024-04-24T23:39:43.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.760+0000 7f9de5ffb640 1 -- 172.21.15.57:0/1517051243 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de00039a0 con 0x7f9dd00051d0 2024-04-24T23:39:43.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.760+0000 7f9ded545640 1 -- 172.21.15.57:0/1517051243 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9dd00051d0 msgr2=0x7f9dd000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:43.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.760+0000 7f9ded545640 1 --2- 172.21.15.57:0/1517051243 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9dd00051d0 0x7f9dd000b9d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9de0009fc0 tx=0x7f9de001ccc0 comp rx=0 tx=0).stop 2024-04-24T23:39:43.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.760+0000 7f9ded545640 1 -- 172.21.15.57:0/1517051243 shutdown_connections 2024-04-24T23:39:43.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.760+0000 7f9ded545640 1 --2- 172.21.15.57:0/1517051243 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9dd00051d0 0x7f9dd000b9d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:43.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.760+0000 7f9ded545640 1 -- 172.21.15.57:0/1517051243 >> 172.21.15.57:0/1517051243 conn(0x7f9de806b8a0 msgr2=0x7f9de80a5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:43.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.760+0000 7f9ded545640 1 -- 172.21.15.57:0/1517051243 shutdown_connections 2024-04-24T23:39:43.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.760+0000 7f9ded545640 1 -- 172.21.15.57:0/1517051243 wait complete. 2024-04-24T23:39:43.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.760+0000 7f9ded545640 1 Processor -- start 2024-04-24T23:39:43.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.760+0000 7f9ded545640 1 -- start start 2024-04-24T23:39:43.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.760+0000 7f9ded545640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9dd00051d0 0x7f9de806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:43.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.760+0000 7f9ded545640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9de814d110 0x7f9de80bd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:43.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.760+0000 7f9ded545640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9de814e8e0 0x7f9de814ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:43.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.760+0000 7f9ded545640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9de80a33b0 con 0x7f9dd00051d0 2024-04-24T23:39:43.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.760+0000 7f9ded545640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9de80a3230 con 0x7f9de814d110 2024-04-24T23:39:43.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.760+0000 7f9ded545640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f9de80a3530 con 0x7f9de814e8e0 2024-04-24T23:39:43.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.760+0000 7f9de6ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9dd00051d0 0x7f9de806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:43.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.760+0000 7f9de6ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9dd00051d0 0x7f9de806d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40076/0 (socket says 172.21.15.57:40076) 2024-04-24T23:39:43.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.760+0000 7f9de6ffd640 1 -- 172.21.15.57:0/1545670079 learned_addr learned my addr 172.21.15.57:0/1545670079 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:43.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.760+0000 7f9de67fc640 1 --2- 172.21.15.57:0/1545670079 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9de814d110 0x7f9de80bd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:43.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.760+0000 7f9de77fe640 1 --2- 172.21.15.57:0/1545670079 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9de814e8e0 0x7f9de814ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:43.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.764+0000 7f9de6ffd640 1 -- 172.21.15.57:0/1545670079 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9de814e8e0 msgr2=0x7f9de814ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:43.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.764+0000 7f9de6ffd640 1 --2- 172.21.15.57:0/1545670079 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9de814e8e0 0x7f9de814ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:43.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.764+0000 7f9de6ffd640 1 -- 172.21.15.57:0/1545670079 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9de814d110 msgr2=0x7f9de80bd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:43.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.764+0000 7f9de6ffd640 1 --2- 172.21.15.57:0/1545670079 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9de814d110 0x7f9de80bd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:43.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.764+0000 7f9de6ffd640 1 -- 172.21.15.57:0/1545670079 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de806d1c0 con 0x7f9dd00051d0 2024-04-24T23:39:43.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.764+0000 7f9de77fe640 1 --2- 172.21.15.57:0/1545670079 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9de814e8e0 0x7f9de814ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:39:43.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.764+0000 7f9de67fc640 1 --2- 172.21.15.57:0/1545670079 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9de814d110 0x7f9de80bd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:39:43.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.764+0000 7f9de6ffd640 1 --2- 172.21.15.57:0/1545670079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9dd00051d0 0x7f9de806d990 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9dd80117c0 tx=0x7f9dd8011c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:43.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.764+0000 7f9dcf7fe640 1 -- 172.21.15.57:0/1545670079 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8010040 con 0x7f9dd00051d0 2024-04-24T23:39:43.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.764+0000 7f9dcf7fe640 1 -- 172.21.15.57:0/1545670079 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dd801a070 con 0x7f9dd00051d0 2024-04-24T23:39:43.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.764+0000 7f9ded545640 1 -- 172.21.15.57:0/1545670079 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9de80bda60 con 0x7f9dd00051d0 2024-04-24T23:39:43.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.764+0000 7f9dcf7fe640 1 -- 172.21.15.57:0/1545670079 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd800fcc0 con 0x7f9dd00051d0 2024-04-24T23:39:43.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.764+0000 7f9ded545640 1 -- 172.21.15.57:0/1545670079 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9de814c950 con 0x7f9dd00051d0 2024-04-24T23:39:43.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.764+0000 7f9ded545640 1 -- 172.21.15.57:0/1545670079 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9de8068930 con 0x7f9dd00051d0 2024-04-24T23:39:43.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.764+0000 7f9dcf7fe640 1 -- 172.21.15.57:0/1545670079 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9dd801f460 con 0x7f9dd00051d0 2024-04-24T23:39:43.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.764+0000 7f9dcf7fe640 1 --2- 172.21.15.57:0/1545670079 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f9dd40678c0 0x7f9dd4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:43.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.764+0000 7f9dcf7fe640 1 -- 172.21.15.57:0/1545670079 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f9dd8089cf0 con 0x7f9dd00051d0 2024-04-24T23:39:43.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.764+0000 7f9de67fc640 1 --2- 172.21.15.57:0/1545670079 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f9dd40678c0 0x7f9dd4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:43.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.764+0000 7f9de67fc640 1 --2- 172.21.15.57:0/1545670079 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f9dd40678c0 0x7f9dd4069d80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9de80a82e0 tx=0x7f9ddc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:43.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.768+0000 7f9dcf7fe640 1 -- 172.21.15.57:0/1545670079 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f9de80bda60 con 0x7f9dd00051d0 2024-04-24T23:39:43.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.928+0000 7f9ded545640 1 -- 172.21.15.57:0/1545670079 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9de80c3cb0 con 0x7f9dd00051d0 2024-04-24T23:39:43.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.932+0000 7f9dcf7fe640 1 -- 172.21.15.57:0/1545670079 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18853 (secure 0 0 0) 0x7f9dd805a410 con 0x7f9dd00051d0 2024-04-24T23:39:43.933 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:39:43.933 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"fsid":"1ea31698-444a-4667-bcd9-b2608ad103c3","created":"2024-04-24T23:38:16.748774+0000","modified":"2024-04-24T23:39:22.806760+0000","last_up_change":"2024-04-24T23:38:26.956537+0000","last_in_change":"2024-04-24T23:38:18.972175+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:38:27.611782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:38:31.718061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:38:32.469413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:38:36.215724+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"35ce67bc-9b25-416e-ab1e-774c717631f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6825","nonce":671364028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6827","nonce":671364028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6831","nonce":671364028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6829","nonce":671364028}]},"public_addr":"172.21.15.57:6825/671364028","cluster_addr":"172.21.15.57:6827/671364028","heartbeat_back_addr":"172.21.15.57:6831/671364028","heartbeat_front_addr":"172.21.15.57:6829/671364028","state":["exists","up"]},{"osd":1,"uuid":"38f6f4ef-3bc2-4453-9946-7d1d17e735ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6801","nonce":2653552037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6803","nonce":2653552037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6807","nonce":2653552037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6805","nonce":2653552037}]},"public_addr":"172.21.15.57:6801/2653552037","cluster_addr":"172.21.15.57:6803/2653552037","heartbeat_back_addr":"172.21.15.57:6807/2653552037","heartbeat_front_addr":"172.21.15.57:6805/2653552037","state":["exists","up"]},{"osd":2,"uuid":"d77a0a49-b39a-464e-a1c9-49e19280c440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6816","nonce":1565874109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6819","nonce":1565874109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6823","nonce":1565874109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6821","nonce":1565874109}]},"public_addr":"172.21.15.57:6816/1565874109","cluster_addr":"172.21.15.57:6819/1565874109","heartbeat_back_addr":"172.21.15.57:6823/1565874109","heartbeat_front_addr":"172.21.15.57:6821/1565874109","state":["exists","up"]},{"osd":3,"uuid":"f8ea9bfe-d839-44a6-a185-0f0985da314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6809","nonce":3474703186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6811","nonce":3474703186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6817","nonce":3474703186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6813","nonce":3474703186}]},"public_addr":"172.21.15.57:6809/3474703186","cluster_addr":"172.21.15.57:6811/3474703186","heartbeat_back_addr":"172.21.15.57:6817/3474703186","heartbeat_front_addr":"172.21.15.57:6813/3474703186","state":["exists","up"]},{"osd":4,"uuid":"454647d4-6ac2-46b4-8451-320eb951a87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6801","nonce":1271707713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6803","nonce":1271707713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6807","nonce":1271707713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6805","nonce":1271707713}]},"public_addr":"172.21.15.88:6801/1271707713","cluster_addr":"172.21.15.88:6803/1271707713","heartbeat_back_addr":"172.21.15.88:6807/1271707713","heartbeat_front_addr":"172.21.15.88:6805/1271707713","state":["exists","up"]},{"osd":5,"uuid":"f71c03a3-7ad8-46d3-89c9-d61de102586b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6809","nonce":2035054888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6813","nonce":2035054888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6820","nonce":2035054888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6816","nonce":2035054888}]},"public_addr":"172.21.15.88:6809/2035054888","cluster_addr":"172.21.15.88:6813/2035054888","heartbeat_back_addr":"172.21.15.88:6820/2035054888","heartbeat_front_addr":"172.21.15.88:6816/2035054888","state":["exists","up"]},{"osd":6,"uuid":"ec7ae2b7-9cb4-4059-8f98-0022c9763f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6825","nonce":1752291242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6827","nonce":1752291242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6831","nonce":1752291242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6829","nonce":1752291242}]},"public_addr":"172.21.15.88:6825/1752291242","cluster_addr":"172.21.15.88:6827/1752291242","heartbeat_back_addr":"172.21.15.88:6831/1752291242","heartbeat_front_addr":"172.21.15.88:6829/1752291242","state":["exists","up"]},{"osd":7,"uuid":"c0ee7505-60c1-40ba-9902-47313a04dafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6812","nonce":1782800372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6817","nonce":1782800372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6823","nonce":1782800372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6821","nonce":1782800372}]},"public_addr":"172.21.15.88:6812/1782800372","cluster_addr":"172.21.15.88:6817/1782800372","heartbeat_back_addr":"172.21.15.88:6823/1782800372","heartbeat_front_addr":"172.21.15.88:6821/1782800372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.698562+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.682587+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.680197+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.561753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.011095+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.493320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.353451+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.423877+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:39:43.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.932+0000 7f9ded545640 1 -- 172.21.15.57:0/1545670079 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f9dd40678c0 msgr2=0x7f9dd4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:43.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.932+0000 7f9ded545640 1 --2- 172.21.15.57:0/1545670079 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f9dd40678c0 0x7f9dd4069d80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9de80a82e0 tx=0x7f9ddc009040 comp rx=0 tx=0).stop 2024-04-24T23:39:43.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.932+0000 7f9ded545640 1 -- 172.21.15.57:0/1545670079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9dd00051d0 msgr2=0x7f9de806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:43.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.932+0000 7f9ded545640 1 --2- 172.21.15.57:0/1545670079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9dd00051d0 0x7f9de806d990 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9dd80117c0 tx=0x7f9dd8011c80 comp rx=0 tx=0).stop 2024-04-24T23:39:43.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.932+0000 7f9ded545640 1 -- 172.21.15.57:0/1545670079 shutdown_connections 2024-04-24T23:39:43.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.932+0000 7f9ded545640 1 --2- 172.21.15.57:0/1545670079 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f9dd40678c0 0x7f9dd4069d80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:43.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.932+0000 7f9ded545640 1 --2- 172.21.15.57:0/1545670079 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9de814e8e0 0x7f9de814ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:43.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.932+0000 7f9ded545640 1 --2- 172.21.15.57:0/1545670079 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9de814d110 0x7f9de80bd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:43.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.932+0000 7f9ded545640 1 --2- 172.21.15.57:0/1545670079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9dd00051d0 0x7f9de806d990 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:43.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.932+0000 7f9ded545640 1 -- 172.21.15.57:0/1545670079 >> 172.21.15.57:0/1545670079 conn(0x7f9de806b8a0 msgr2=0x7f9de80a5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:43.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.932+0000 7f9ded545640 1 -- 172.21.15.57:0/1545670079 shutdown_connections 2024-04-24T23:39:43.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:43.932+0000 7f9ded545640 1 -- 172.21.15.57:0/1545670079 wait complete. 2024-04-24T23:39:43.953 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:38:27.611782+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:38:31.718061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:38:32.469413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-24T23:38:36.215724+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-24T23:39:43.953 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:39:44.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f844a309640 1 Processor -- start 2024-04-24T23:39:44.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f844a309640 1 -- start start 2024-04-24T23:39:44.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f844a309640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f84440be620 0x7f8444151c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:44.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f844a309640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84440bdc50 con 0x7f84440bd430 2024-04-24T23:39:44.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f844a309640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84440bdef0 con 0x7f844406b470 2024-04-24T23:39:44.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f844a309640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f84440a67a0 con 0x7f84440be620 2024-04-24T23:39:44.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f84488a6640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f84440bd430 0x7f84441521d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:41160/0 (socket says 172.21.15.57:41160) 2024-04-24T23:39:44.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f84488a6640 1 -- 172.21.15.57:0/770178897 learned_addr learned my addr 172.21.15.57:0/770178897 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:44.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f843bfff640 1 --2- 172.21.15.57:0/770178897 >> v2:172.21.15.88:3300/0 conn(0x7f84440be620 0x7f8444151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:44.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f84437fe640 1 -- 172.21.15.57:0/770178897 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3580194449 0 0) 0x7f84440bdc50 con 0x7f84440bd430 2024-04-24T23:39:44.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f84437fe640 1 -- 172.21.15.57:0/770178897 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8430003530 con 0x7f84440bd430 2024-04-24T23:39:44.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f84437fe640 1 -- 172.21.15.57:0/770178897 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3664518861 0 0) 0x7f8430003530 con 0x7f84440bd430 2024-04-24T23:39:44.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f84437fe640 1 -- 172.21.15.57:0/770178897 >> v2:172.21.15.88:3300/0 conn(0x7f84440be620 msgr2=0x7f8444151c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:44.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f84437fe640 1 --2- 172.21.15.57:0/770178897 >> v2:172.21.15.88:3300/0 conn(0x7f84440be620 0x7f8444151c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f84437fe640 1 -- 172.21.15.57:0/770178897 >> v1:172.21.15.88:6789/0 conn(0x7f844406b470 legacy=0x7f844414bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:44.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f84437fe640 1 -- 172.21.15.57:0/770178897 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84440be1d0 con 0x7f84440bd430 2024-04-24T23:39:44.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f84437fe640 1 -- 172.21.15.57:0/770178897 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7f843c001a00 con 0x7f84440bd430 2024-04-24T23:39:44.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f84437fe640 1 -- 172.21.15.57:0/770178897 >> v1:172.21.15.57:6789/0 conn(0x7f84440bd430 legacy=0x7f84441521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:44.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f843bfff640 1 --2- 172.21.15.57:0/770178897 >> v2:172.21.15.88:3300/0 conn(0x7f84440be620 0x7f8444151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:39:44.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f84437fe640 1 --2- 172.21.15.57:0/770178897 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84300039f0 0x7f8430003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:44.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f84437fe640 1 --2- 172.21.15.57:0/770178897 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8430004810 0x7f8430004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:44.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f84437fe640 1 --2- 172.21.15.57:0/770178897 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84300051d0 0x7f843000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:44.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f84437fe640 1 -- 172.21.15.57:0/770178897 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f84440a67a0 con 0x7f84300051d0 2024-04-24T23:39:44.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f84437fe640 1 -- 172.21.15.57:0/770178897 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f843000c0a0 con 0x7f84300039f0 2024-04-24T23:39:44.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f84437fe640 1 -- 172.21.15.57:0/770178897 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f843000c2a0 con 0x7f8430004810 2024-04-24T23:39:44.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f84488a6640 1 --2- 172.21.15.57:0/770178897 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84300051d0 0x7f843000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:44.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f8443fff640 1 --2- 172.21.15.57:0/770178897 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84300039f0 0x7f8430003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:44.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f843bfff640 1 --2- 172.21.15.57:0/770178897 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8430004810 0x7f8430004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:44.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f84488a6640 1 -- 172.21.15.57:0/770178897 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8430004810 msgr2=0x7f8430004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:44.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f84488a6640 1 --2- 172.21.15.57:0/770178897 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8430004810 0x7f8430004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f84488a6640 1 -- 172.21.15.57:0/770178897 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84300039f0 msgr2=0x7f8430003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:44.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f84488a6640 1 --2- 172.21.15.57:0/770178897 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84300039f0 0x7f8430003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f84488a6640 1 -- 172.21.15.57:0/770178897 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8430003530 con 0x7f84300051d0 2024-04-24T23:39:44.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.084+0000 7f843bfff640 1 --2- 172.21.15.57:0/770178897 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8430004810 0x7f8430004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:39:44.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.088+0000 7f84488a6640 1 -- 172.21.15.57:0/770178897 reap_dead start 2024-04-24T23:39:44.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.088+0000 7f84488a6640 1 --2- 172.21.15.57:0/770178897 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84300051d0 0x7f843000b9d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f843c00a810 tx=0x7f843c01d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca64189fb9a4795 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:44.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.088+0000 7f84437fe640 1 -- 172.21.15.57:0/770178897 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843c00a460 con 0x7f84300051d0 2024-04-24T23:39:44.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.088+0000 7f84437fe640 1 -- 172.21.15.57:0/770178897 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f843c0ac640 con 0x7f84300051d0 2024-04-24T23:39:44.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.088+0000 7f84437fe640 1 -- 172.21.15.57:0/770178897 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843c0aca30 con 0x7f84300051d0 2024-04-24T23:39:44.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.088+0000 7f844a309640 1 -- 172.21.15.57:0/770178897 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84300051d0 msgr2=0x7f843000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:44.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.088+0000 7f844a309640 1 --2- 172.21.15.57:0/770178897 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84300051d0 0x7f843000b9d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f843c00a810 tx=0x7f843c01d340 comp rx=0 tx=0).stop 2024-04-24T23:39:44.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.088+0000 7f844a309640 1 -- 172.21.15.57:0/770178897 shutdown_connections 2024-04-24T23:39:44.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.088+0000 7f844a309640 1 --2- 172.21.15.57:0/770178897 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84300051d0 0x7f843000b9d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.088+0000 7f844a309640 1 -- 172.21.15.57:0/770178897 >> 172.21.15.57:0/770178897 conn(0x7f84440c30c0 msgr2=0x7f84440c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:44.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.088+0000 7f844a309640 1 -- 172.21.15.57:0/770178897 shutdown_connections 2024-04-24T23:39:44.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.088+0000 7f844a309640 1 -- 172.21.15.57:0/770178897 wait complete. 2024-04-24T23:39:44.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.088+0000 7f844a309640 1 Processor -- start 2024-04-24T23:39:44.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.088+0000 7f844a309640 1 -- start start 2024-04-24T23:39:44.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.088+0000 7f844a309640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f84300051d0 0x7f84440c1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:44.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.088+0000 7f844a309640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84440bbfa0 0x7f8444142420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:44.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.088+0000 7f844a309640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8444142960 0x7f84441e3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:44.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.088+0000 7f844a309640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f844406b9d0 con 0x7f84440bbfa0 2024-04-24T23:39:44.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.088+0000 7f844a309640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f844406b850 con 0x7f8444142960 2024-04-24T23:39:44.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.088+0000 7f844a309640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f844414bae0 con 0x7f84300051d0 2024-04-24T23:39:44.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.092+0000 7f843bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84440bbfa0 0x7f8444142420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:44.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.092+0000 7f843bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84440bbfa0 0x7f8444142420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40098/0 (socket says 172.21.15.57:40098) 2024-04-24T23:39:44.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.092+0000 7f843bfff640 1 -- 172.21.15.57:0/2323294654 learned_addr learned my addr 172.21.15.57:0/2323294654 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:44.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.092+0000 7f8443fff640 1 --2- 172.21.15.57:0/2323294654 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f84300051d0 0x7f84440c1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:44.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.092+0000 7f84488a6640 1 --2- 172.21.15.57:0/2323294654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8444142960 0x7f84441e3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:44.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.092+0000 7f843bfff640 1 -- 172.21.15.57:0/2323294654 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f84300051d0 msgr2=0x7f84440c1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:44.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.092+0000 7f843bfff640 1 --2- 172.21.15.57:0/2323294654 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f84300051d0 0x7f84440c1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.092+0000 7f843bfff640 1 -- 172.21.15.57:0/2323294654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8444142960 msgr2=0x7f84441e3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:44.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.092+0000 7f843bfff640 1 --2- 172.21.15.57:0/2323294654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8444142960 0x7f84441e3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.092+0000 7f843bfff640 1 -- 172.21.15.57:0/2323294654 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84440c24a0 con 0x7f84440bbfa0 2024-04-24T23:39:44.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.092+0000 7f843bfff640 1 --2- 172.21.15.57:0/2323294654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84440bbfa0 0x7f8444142420 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f842c0118d0 tx=0x7f842c011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:44.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.092+0000 7f84417fa640 1 -- 172.21.15.57:0/2323294654 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842c00f9c0 con 0x7f84440bbfa0 2024-04-24T23:39:44.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.092+0000 7f84417fa640 1 -- 172.21.15.57:0/2323294654 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f842c00fb60 con 0x7f84440bbfa0 2024-04-24T23:39:44.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.092+0000 7f844a309640 1 -- 172.21.15.57:0/2323294654 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84440b98b0 con 0x7f84440bbfa0 2024-04-24T23:39:44.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.092+0000 7f84417fa640 1 -- 172.21.15.57:0/2323294654 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842c015460 con 0x7f84440bbfa0 2024-04-24T23:39:44.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.092+0000 7f844a309640 1 -- 172.21.15.57:0/2323294654 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84440b9b50 con 0x7f84440bbfa0 2024-04-24T23:39:44.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.092+0000 7f844a309640 1 -- 172.21.15.57:0/2323294654 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8444068930 con 0x7f84440bbfa0 2024-04-24T23:39:44.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.092+0000 7f84417fa640 1 -- 172.21.15.57:0/2323294654 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f842c015600 con 0x7f84440bbfa0 2024-04-24T23:39:44.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.092+0000 7f84417fa640 1 --2- 172.21.15.57:0/2323294654 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f84240678c0 0x7f8424069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:44.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.092+0000 7f84417fa640 1 -- 172.21.15.57:0/2323294654 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f842c086c10 con 0x7f84440bbfa0 2024-04-24T23:39:44.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.092+0000 7f8443fff640 1 --2- 172.21.15.57:0/2323294654 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f84240678c0 0x7f8424069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:44.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.096+0000 7f8443fff640 1 --2- 172.21.15.57:0/2323294654 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f84240678c0 0x7f8424069d80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8434000c10 tx=0x7f8434009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:44.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.096+0000 7f84417fa640 1 -- 172.21.15.57:0/2323294654 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f84440c24a0 con 0x7f84440bbfa0 2024-04-24T23:39:44.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.264+0000 7f844a309640 1 -- 172.21.15.57:0/2323294654 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8444146080 con 0x7f84440bbfa0 2024-04-24T23:39:44.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.268+0000 7f84417fa640 1 -- 172.21.15.57:0/2323294654 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f842c019030 con 0x7f84440bbfa0 2024-04-24T23:39:44.268 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-04-24T23:39:44.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.268+0000 7f844a309640 1 -- 172.21.15.57:0/2323294654 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f84240678c0 msgr2=0x7f8424069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:44.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.268+0000 7f844a309640 1 --2- 172.21.15.57:0/2323294654 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f84240678c0 0x7f8424069d80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8434000c10 tx=0x7f8434009040 comp rx=0 tx=0).stop 2024-04-24T23:39:44.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.268+0000 7f844a309640 1 -- 172.21.15.57:0/2323294654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84440bbfa0 msgr2=0x7f8444142420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:44.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.268+0000 7f844a309640 1 --2- 172.21.15.57:0/2323294654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84440bbfa0 0x7f8444142420 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f842c0118d0 tx=0x7f842c011cd0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.268+0000 7f844a309640 1 -- 172.21.15.57:0/2323294654 shutdown_connections 2024-04-24T23:39:44.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.268+0000 7f844a309640 1 --2- 172.21.15.57:0/2323294654 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f84240678c0 0x7f8424069d80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.268+0000 7f844a309640 1 --2- 172.21.15.57:0/2323294654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8444142960 0x7f84441e3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.268+0000 7f844a309640 1 --2- 172.21.15.57:0/2323294654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84440bbfa0 0x7f8444142420 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.268+0000 7f844a309640 1 --2- 172.21.15.57:0/2323294654 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f84300051d0 0x7f84440c1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.268+0000 7f844a309640 1 -- 172.21.15.57:0/2323294654 >> 172.21.15.57:0/2323294654 conn(0x7f84440c30c0 msgr2=0x7f84440c34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:44.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.268+0000 7f844a309640 1 -- 172.21.15.57:0/2323294654 shutdown_connections 2024-04-24T23:39:44.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.268+0000 7f844a309640 1 -- 172.21.15.57:0/2323294654 wait complete. 2024-04-24T23:39:44.287 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:39:44.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.408+0000 7fe1a6527640 1 Processor -- start 2024-04-24T23:39:44.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.408+0000 7fe1a6527640 1 -- start start 2024-04-24T23:39:44.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.408+0000 7fe1a6527640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe1a00be300 0x7fe1a00c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:44.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.408+0000 7fe1a6527640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe1a014de00 0x7fe1a014e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:44.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.408+0000 7fe1a6527640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1a00be9c0 con 0x7fe1a00c46b0 2024-04-24T23:39:44.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.408+0000 7fe1a6527640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fe1a014e780 con 0x7fe1a014de00 2024-04-24T23:39:44.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.408+0000 7fe1a6527640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fe1a00beca0 con 0x7fe1a00be300 2024-04-24T23:39:44.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.408+0000 7fe1a4ac4640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe1a014de00 0x7fe1a014e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:44.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.408+0000 7fe1a4ac4640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe1a014de00 0x7fe1a014e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40112/0 (socket says 172.21.15.57:40112) 2024-04-24T23:39:44.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.408+0000 7fe1a4ac4640 1 -- 172.21.15.57:0/1611606723 learned_addr learned my addr 172.21.15.57:0/1611606723 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:44.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.408+0000 7fe19f7fe640 1 --2- 172.21.15.57:0/1611606723 >> v2:172.21.15.88:3300/0 conn(0x7fe1a00be300 0x7fe1a00c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:44.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.408+0000 7fe1a4ac4640 1 -- 172.21.15.57:0/1611606723 >> v2:172.21.15.88:3300/0 conn(0x7fe1a00be300 msgr2=0x7fe1a00c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:44.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.408+0000 7fe1a4ac4640 1 --2- 172.21.15.57:0/1611606723 >> v2:172.21.15.88:3300/0 conn(0x7fe1a00be300 0x7fe1a00c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.408+0000 7fe1a4ac4640 1 -- 172.21.15.57:0/1611606723 >> v1:172.21.15.88:6789/0 conn(0x7fe1a00c46b0 legacy=0x7fe1a00c36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:44.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.408+0000 7fe1a4ac4640 1 -- 172.21.15.57:0/1611606723 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a00bef80 con 0x7fe1a014de00 2024-04-24T23:39:44.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.412+0000 7fe1a4ac4640 1 --2- 172.21.15.57:0/1611606723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1a014de00 0x7fe1a014e240 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe1a00bd3f0 tx=0x7fe19801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eafab271b5cb6c79 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:44.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.412+0000 7fe19effd640 1 -- 172.21.15.57:0/1611606723 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1980b0070 con 0x7fe1a014de00 2024-04-24T23:39:44.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.412+0000 7fe19effd640 1 -- 172.21.15.57:0/1611606723 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1980ab600 con 0x7fe1a014de00 2024-04-24T23:39:44.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.412+0000 7fe19effd640 1 -- 172.21.15.57:0/1611606723 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1980ab9d0 con 0x7fe1a014de00 2024-04-24T23:39:44.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.412+0000 7fe1a6527640 1 -- 172.21.15.57:0/1611606723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1a014de00 msgr2=0x7fe1a014e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:44.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.412+0000 7fe1a6527640 1 --2- 172.21.15.57:0/1611606723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1a014de00 0x7fe1a014e240 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe1a00bd3f0 tx=0x7fe19801c490 comp rx=0 tx=0).stop 2024-04-24T23:39:44.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.412+0000 7fe1a6527640 1 -- 172.21.15.57:0/1611606723 shutdown_connections 2024-04-24T23:39:44.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.412+0000 7fe1a6527640 1 --2- 172.21.15.57:0/1611606723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1a014de00 0x7fe1a014e240 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.412+0000 7fe1a6527640 1 --2- 172.21.15.57:0/1611606723 >> v2:172.21.15.88:3300/0 conn(0x7fe1a00be300 0x7fe1a00c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.412+0000 7fe1a6527640 1 -- 172.21.15.57:0/1611606723 >> 172.21.15.57:0/1611606723 conn(0x7fe1a006b840 msgr2=0x7fe1a00c3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:44.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.412+0000 7fe1a6527640 1 -- 172.21.15.57:0/1611606723 shutdown_connections 2024-04-24T23:39:44.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.412+0000 7fe1a6527640 1 -- 172.21.15.57:0/1611606723 wait complete. 2024-04-24T23:39:44.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.412+0000 7fe1a6527640 1 Processor -- start 2024-04-24T23:39:44.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.412+0000 7fe1a6527640 1 -- start start 2024-04-24T23:39:44.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.412+0000 7fe1a6527640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1a00be300 0x7fe1a0140ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:44.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.412+0000 7fe1a6527640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1a00c46b0 0x7fe1a014c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:44.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.412+0000 7fe1a6527640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1a014de00 0x7fe1a01ec5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:44.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.412+0000 7fe1a6527640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a0151a00 con 0x7fe1a00c46b0 2024-04-24T23:39:44.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.412+0000 7fe1a6527640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a0151880 con 0x7fe1a00be300 2024-04-24T23:39:44.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.412+0000 7fe1a6527640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fe1a015d3c0 con 0x7fe1a014de00 2024-04-24T23:39:44.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.412+0000 7fe19f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1a00c46b0 0x7fe1a014c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:44.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.412+0000 7fe19f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1a00c46b0 0x7fe1a014c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40126/0 (socket says 172.21.15.57:40126) 2024-04-24T23:39:44.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.412+0000 7fe19f7fe640 1 -- 172.21.15.57:0/872028817 learned_addr learned my addr 172.21.15.57:0/872028817 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:44.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.416+0000 7fe19ffff640 1 --2- 172.21.15.57:0/872028817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1a00be300 0x7fe1a0140ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:44.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.416+0000 7fe1a4ac4640 1 --2- 172.21.15.57:0/872028817 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1a014de00 0x7fe1a01ec5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:44.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.416+0000 7fe19f7fe640 1 -- 172.21.15.57:0/872028817 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1a014de00 msgr2=0x7fe1a01ec5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:44.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.416+0000 7fe19f7fe640 1 --2- 172.21.15.57:0/872028817 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1a014de00 0x7fe1a01ec5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.416+0000 7fe19f7fe640 1 -- 172.21.15.57:0/872028817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1a00be300 msgr2=0x7fe1a0140ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:44.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.416+0000 7fe19f7fe640 1 --2- 172.21.15.57:0/872028817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1a00be300 0x7fe1a0140ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.416+0000 7fe19f7fe640 1 -- 172.21.15.57:0/872028817 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a014ccc0 con 0x7fe1a00c46b0 2024-04-24T23:39:44.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.416+0000 7fe19f7fe640 1 --2- 172.21.15.57:0/872028817 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1a00c46b0 0x7fe1a014c780 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe18800d800 tx=0x7fe18800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:44.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.416+0000 7fe19cff9640 1 -- 172.21.15.57:0/872028817 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18800b6c0 con 0x7fe1a00c46b0 2024-04-24T23:39:44.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.416+0000 7fe19cff9640 1 -- 172.21.15.57:0/872028817 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe188019070 con 0x7fe1a00c46b0 2024-04-24T23:39:44.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.416+0000 7fe1a6527640 1 -- 172.21.15.57:0/872028817 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1a0150160 con 0x7fe1a00c46b0 2024-04-24T23:39:44.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.416+0000 7fe19cff9640 1 -- 172.21.15.57:0/872028817 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18800ba60 con 0x7fe1a00c46b0 2024-04-24T23:39:44.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.416+0000 7fe1a6527640 1 -- 172.21.15.57:0/872028817 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1a0147890 con 0x7fe1a00c46b0 2024-04-24T23:39:44.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.416+0000 7fe1a6527640 1 -- 172.21.15.57:0/872028817 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1a0148220 con 0x7fe1a00c46b0 2024-04-24T23:39:44.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.416+0000 7fe19cff9640 1 -- 172.21.15.57:0/872028817 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe18800bc00 con 0x7fe1a00c46b0 2024-04-24T23:39:44.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.416+0000 7fe19cff9640 1 --2- 172.21.15.57:0/872028817 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fe1800678c0 0x7fe180069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:44.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.416+0000 7fe19cff9640 1 -- 172.21.15.57:0/872028817 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fe188086570 con 0x7fe1a00c46b0 2024-04-24T23:39:44.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.416+0000 7fe19ffff640 1 --2- 172.21.15.57:0/872028817 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fe1800678c0 0x7fe180069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:44.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.416+0000 7fe19ffff640 1 --2- 172.21.15.57:0/872028817 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fe1800678c0 0x7fe180069d80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe1900012f0 tx=0x7fe190009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:44.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.420+0000 7fe19cff9640 1 -- 172.21.15.57:0/872028817 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fe1a014ccc0 con 0x7fe1a00c46b0 2024-04-24T23:39:44.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.584+0000 7fe1a6527640 1 -- 172.21.15.57:0/872028817 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe1a0068290 con 0x7fe1a00c46b0 2024-04-24T23:39:44.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.584+0000 7fe19cff9640 1 -- 172.21.15.57:0/872028817 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7fe188056ca0 con 0x7fe1a00c46b0 2024-04-24T23:39:44.586 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-04-24T23:39:44.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.588+0000 7fe1a6527640 1 -- 172.21.15.57:0/872028817 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fe1800678c0 msgr2=0x7fe180069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:44.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.588+0000 7fe1a6527640 1 --2- 172.21.15.57:0/872028817 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fe1800678c0 0x7fe180069d80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe1900012f0 tx=0x7fe190009040 comp rx=0 tx=0).stop 2024-04-24T23:39:44.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.588+0000 7fe1a6527640 1 -- 172.21.15.57:0/872028817 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1a00c46b0 msgr2=0x7fe1a014c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:44.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.588+0000 7fe1a6527640 1 --2- 172.21.15.57:0/872028817 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1a00c46b0 0x7fe1a014c780 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe18800d800 tx=0x7fe18800dcc0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.588+0000 7fe1a6527640 1 -- 172.21.15.57:0/872028817 shutdown_connections 2024-04-24T23:39:44.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.588+0000 7fe1a6527640 1 --2- 172.21.15.57:0/872028817 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fe1800678c0 0x7fe180069d80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.588+0000 7fe1a6527640 1 --2- 172.21.15.57:0/872028817 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1a014de00 0x7fe1a01ec5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.588+0000 7fe1a6527640 1 --2- 172.21.15.57:0/872028817 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1a00c46b0 0x7fe1a014c780 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.588+0000 7fe1a6527640 1 --2- 172.21.15.57:0/872028817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1a00be300 0x7fe1a0140ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.588+0000 7fe1a6527640 1 -- 172.21.15.57:0/872028817 >> 172.21.15.57:0/872028817 conn(0x7fe1a006b840 msgr2=0x7fe1a00c05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:44.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.588+0000 7fe1a6527640 1 -- 172.21.15.57:0/872028817 shutdown_connections 2024-04-24T23:39:44.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.588+0000 7fe1a6527640 1 -- 172.21.15.57:0/872028817 wait complete. 2024-04-24T23:39:44.606 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:39:44.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f141a284640 1 Processor -- start 2024-04-24T23:39:44.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f141a284640 1 -- start start 2024-04-24T23:39:44.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f141a284640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f141406c480 0x7f141406fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:44.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f141a284640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1414070390 con 0x7f14140675b0 2024-04-24T23:39:44.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f141a284640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1414071b60 con 0x7f141414bc70 2024-04-24T23:39:44.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f141a284640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f1414072d70 con 0x7f141406c480 2024-04-24T23:39:44.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f140bfff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f14140675b0 0x7f141414f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:41172/0 (socket says 172.21.15.57:41172) 2024-04-24T23:39:44.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f140bfff640 1 -- 172.21.15.57:0/1935378285 learned_addr learned my addr 172.21.15.57:0/1935378285 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:44.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f1413fff640 1 --2- 172.21.15.57:0/1935378285 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f141406c480 0x7f141406fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:44.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f14137fe640 1 -- 172.21.15.57:0/1935378285 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3248170404 0 0) 0x7f1414070390 con 0x7f14140675b0 2024-04-24T23:39:44.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f14137fe640 1 -- 172.21.15.57:0/1935378285 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1400003530 con 0x7f14140675b0 2024-04-24T23:39:44.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f14137fe640 1 -- 172.21.15.57:0/1935378285 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3031884529 0 0) 0x7f1400003530 con 0x7f14140675b0 2024-04-24T23:39:44.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f14137fe640 1 -- 172.21.15.57:0/1935378285 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f141406c480 msgr2=0x7f141406fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:44.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f14137fe640 1 --2- 172.21.15.57:0/1935378285 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f141406c480 0x7f141406fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f14137fe640 1 -- 172.21.15.57:0/1935378285 >> v1:172.21.15.88:6789/0 conn(0x7f141414bc70 legacy=0x7f14141590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:44.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f14137fe640 1 -- 172.21.15.57:0/1935378285 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14140a7cc0 con 0x7f14140675b0 2024-04-24T23:39:44.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f14137fe640 1 -- 172.21.15.57:0/1935378285 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7f13fc001680 con 0x7f14140675b0 2024-04-24T23:39:44.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f14137fe640 1 -- 172.21.15.57:0/1935378285 >> v1:172.21.15.57:6789/0 conn(0x7f14140675b0 legacy=0x7f141414f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:44.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f14137fe640 1 --2- 172.21.15.57:0/1935378285 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f141406c480 0x7f14000039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:44.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f14137fe640 1 --2- 172.21.15.57:0/1935378285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1400003f70 0x7f1400004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:44.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f14137fe640 1 --2- 172.21.15.57:0/1935378285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1400004d50 0x7f14000051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:44.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f14137fe640 1 -- 172.21.15.57:0/1935378285 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1414072d70 con 0x7f1400003f70 2024-04-24T23:39:44.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f14137fe640 1 -- 172.21.15.57:0/1935378285 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f140000bab0 con 0x7f1400004d50 2024-04-24T23:39:44.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f14137fe640 1 -- 172.21.15.57:0/1935378285 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f140000bcb0 con 0x7f141406c480 2024-04-24T23:39:44.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f140bfff640 1 --2- 172.21.15.57:0/1935378285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1400003f70 0x7f1400004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:44.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f1413fff640 1 --2- 172.21.15.57:0/1935378285 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f141406c480 0x7f14000039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:44.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f1418821640 1 --2- 172.21.15.57:0/1935378285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1400004d50 0x7f14000051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:44.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f140bfff640 1 -- 172.21.15.57:0/1935378285 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f141406c480 msgr2=0x7f14000039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:44.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f140bfff640 1 --2- 172.21.15.57:0/1935378285 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f141406c480 0x7f14000039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f140bfff640 1 -- 172.21.15.57:0/1935378285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1400004d50 msgr2=0x7f14000051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:44.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f140bfff640 1 --2- 172.21.15.57:0/1935378285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1400004d50 0x7f14000051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f140bfff640 1 -- 172.21.15.57:0/1935378285 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1400003530 con 0x7f1400003f70 2024-04-24T23:39:44.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.728+0000 7f1413fff640 1 --2- 172.21.15.57:0/1935378285 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f141406c480 0x7f14000039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:39:44.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.732+0000 7f140bfff640 1 --2- 172.21.15.57:0/1935378285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1400003f70 0x7f1400004810 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00c210 tx=0x7f13fc01f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44303444e0af75d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:44.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.732+0000 7f14137fe640 1 -- 172.21.15.57:0/1935378285 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc007d40 con 0x7f1400003f70 2024-04-24T23:39:44.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.732+0000 7f14137fe640 1 -- 172.21.15.57:0/1935378285 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13fc005b00 con 0x7f1400003f70 2024-04-24T23:39:44.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.732+0000 7f14137fe640 1 -- 172.21.15.57:0/1935378285 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc007070 con 0x7f1400003f70 2024-04-24T23:39:44.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.732+0000 7f141a284640 1 -- 172.21.15.57:0/1935378285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1400003f70 msgr2=0x7f1400004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:44.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.732+0000 7f141a284640 1 --2- 172.21.15.57:0/1935378285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1400003f70 0x7f1400004810 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00c210 tx=0x7f13fc01f3f0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.732+0000 7f1418821640 1 -- 172.21.15.57:0/1935378285 reap_dead start 2024-04-24T23:39:44.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.732+0000 7f141a284640 1 -- 172.21.15.57:0/1935378285 shutdown_connections 2024-04-24T23:39:44.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.732+0000 7f141a284640 1 -- 172.21.15.57:0/1935378285 >> 172.21.15.57:0/1935378285 conn(0x7f14140bf370 msgr2=0x7f14140bf780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:44.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.732+0000 7f141a284640 1 -- 172.21.15.57:0/1935378285 shutdown_connections 2024-04-24T23:39:44.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.732+0000 7f141a284640 1 -- 172.21.15.57:0/1935378285 wait complete. 2024-04-24T23:39:44.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.732+0000 7f141a284640 1 Processor -- start 2024-04-24T23:39:44.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.732+0000 7f141a284640 1 -- start start 2024-04-24T23:39:44.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.736+0000 7f141a284640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1400003f70 0x7f14140a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:44.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.736+0000 7f141a284640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f14141e63f0 0x7f1414143bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:44.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.736+0000 7f141a284640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14140a77e0 0x7f1414144110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:44.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.736+0000 7f141a284640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f141406c860 con 0x7f1400003f70 2024-04-24T23:39:44.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.736+0000 7f141a284640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f14140728e0 con 0x7f14140a77e0 2024-04-24T23:39:44.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.736+0000 7f141a284640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f141406c9e0 con 0x7f14141e63f0 2024-04-24T23:39:44.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.736+0000 7f1413fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1400003f70 0x7f14140a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:44.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.736+0000 7f1413fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1400003f70 0x7f14140a5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40144/0 (socket says 172.21.15.57:40144) 2024-04-24T23:39:44.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.736+0000 7f1413fff640 1 -- 172.21.15.57:0/108754206 learned_addr learned my addr 172.21.15.57:0/108754206 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:44.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.736+0000 7f1418821640 1 --2- 172.21.15.57:0/108754206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14140a77e0 0x7f1414144110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:44.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.736+0000 7f140bfff640 1 --2- 172.21.15.57:0/108754206 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f14141e63f0 0x7f1414143bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:44.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.736+0000 7f1413fff640 1 -- 172.21.15.57:0/108754206 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f14141e63f0 msgr2=0x7f1414143bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:44.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.736+0000 7f1413fff640 1 --2- 172.21.15.57:0/108754206 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f14141e63f0 0x7f1414143bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.736+0000 7f1413fff640 1 -- 172.21.15.57:0/108754206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14140a77e0 msgr2=0x7f1414144110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:44.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.736+0000 7f1413fff640 1 --2- 172.21.15.57:0/108754206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14140a77e0 0x7f1414144110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.736+0000 7f1413fff640 1 -- 172.21.15.57:0/108754206 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14140bbca0 con 0x7f1400003f70 2024-04-24T23:39:44.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.736+0000 7f140bfff640 1 --2- 172.21.15.57:0/108754206 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f14141e63f0 0x7f1414143bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:39:44.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.736+0000 7f1413fff640 1 --2- 172.21.15.57:0/108754206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1400003f70 0x7f14140a5d30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1404009fd0 tx=0x7f1404011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:44.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.736+0000 7f14117fa640 1 -- 172.21.15.57:0/108754206 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140400f9c0 con 0x7f1400003f70 2024-04-24T23:39:44.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.736+0000 7f14117fa640 1 -- 172.21.15.57:0/108754206 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f140400fb60 con 0x7f1400003f70 2024-04-24T23:39:44.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.736+0000 7f141a284640 1 -- 172.21.15.57:0/108754206 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14140a6270 con 0x7f1400003f70 2024-04-24T23:39:44.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.736+0000 7f14117fa640 1 -- 172.21.15.57:0/108754206 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1404015460 con 0x7f1400003f70 2024-04-24T23:39:44.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.736+0000 7f141a284640 1 -- 172.21.15.57:0/108754206 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14140bbf20 con 0x7f1400003f70 2024-04-24T23:39:44.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.736+0000 7f141a284640 1 -- 172.21.15.57:0/108754206 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1414068290 con 0x7f1400003f70 2024-04-24T23:39:44.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.736+0000 7f14117fa640 1 -- 172.21.15.57:0/108754206 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1404015600 con 0x7f1400003f70 2024-04-24T23:39:44.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.736+0000 7f14117fa640 1 --2- 172.21.15.57:0/108754206 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f13f40678c0 0x7f13f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:44.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.736+0000 7f14117fa640 1 -- 172.21.15.57:0/108754206 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f1404086a50 con 0x7f1400003f70 2024-04-24T23:39:44.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.736+0000 7f140bfff640 1 --2- 172.21.15.57:0/108754206 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f13f40678c0 0x7f13f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:44.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.740+0000 7f140bfff640 1 --2- 172.21.15.57:0/108754206 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f13f40678c0 0x7f13f4069d80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f13fc0af000 tx=0x7f13fc0aa000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:44.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.740+0000 7f14117fa640 1 -- 172.21.15.57:0/108754206 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f14140a6270 con 0x7f1400003f70 2024-04-24T23:39:44.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.904+0000 7f141a284640 1 -- 172.21.15.57:0/108754206 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f141414c1a0 con 0x7f1400003f70 2024-04-24T23:39:44.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.904+0000 7f14117fa640 1 -- 172.21.15.57:0/108754206 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f14140bbca0 con 0x7f1400003f70 2024-04-24T23:39:44.907 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-24T23:39:44.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.908+0000 7f141a284640 1 -- 172.21.15.57:0/108754206 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f13f40678c0 msgr2=0x7f13f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:44.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.908+0000 7f141a284640 1 --2- 172.21.15.57:0/108754206 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f13f40678c0 0x7f13f4069d80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f13fc0af000 tx=0x7f13fc0aa000 comp rx=0 tx=0).stop 2024-04-24T23:39:44.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.908+0000 7f141a284640 1 -- 172.21.15.57:0/108754206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1400003f70 msgr2=0x7f14140a5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:44.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.908+0000 7f141a284640 1 --2- 172.21.15.57:0/108754206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1400003f70 0x7f14140a5d30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1404009fd0 tx=0x7f1404011b30 comp rx=0 tx=0).stop 2024-04-24T23:39:44.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.908+0000 7f141a284640 1 -- 172.21.15.57:0/108754206 shutdown_connections 2024-04-24T23:39:44.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.908+0000 7f141a284640 1 --2- 172.21.15.57:0/108754206 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f13f40678c0 0x7f13f4069d80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.908+0000 7f141a284640 1 --2- 172.21.15.57:0/108754206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14140a77e0 0x7f1414144110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.908+0000 7f141a284640 1 --2- 172.21.15.57:0/108754206 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f14141e63f0 0x7f1414143bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.908+0000 7f141a284640 1 --2- 172.21.15.57:0/108754206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1400003f70 0x7f14140a5d30 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:44.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.908+0000 7f141a284640 1 -- 172.21.15.57:0/108754206 >> 172.21.15.57:0/108754206 conn(0x7f14140bf370 msgr2=0x7f14140be440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:44.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.908+0000 7f141a284640 1 -- 172.21.15.57:0/108754206 shutdown_connections 2024-04-24T23:39:44.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:44.908+0000 7f141a284640 1 -- 172.21.15.57:0/108754206 wait complete. 2024-04-24T23:39:44.926 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-24T23:39:45.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.052+0000 7f1f84f54640 1 Processor -- start 2024-04-24T23:39:45.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.052+0000 7f1f84f54640 1 -- start start 2024-04-24T23:39:45.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.052+0000 7f1f84f54640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1f80071350 0x7f1f8006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:45.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.052+0000 7f1f84f54640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1f800bcea0 0x7f1f8006dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:45.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.052+0000 7f1f84f54640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1f800bd340 0x7f1f80155420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:45.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.052+0000 7f1f84f54640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f1f8006e150 con 0x7f1f800bd340 2024-04-24T23:39:45.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.052+0000 7f1f84f54640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f1f800bc760 con 0x7f1f800bcea0 2024-04-24T23:39:45.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.052+0000 7f1f84f54640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f1f800a4850 con 0x7f1f80071350 2024-04-24T23:39:45.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.052+0000 7f1f7ed9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1f800bd340 0x7f1f80155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:45.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.052+0000 7f1f7ed9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1f800bd340 0x7f1f80155420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40150/0 (socket says 172.21.15.57:40150) 2024-04-24T23:39:45.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.052+0000 7f1f7ed9d640 1 -- 172.21.15.57:0/1198173700 learned_addr learned my addr 172.21.15.57:0/1198173700 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:45.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.052+0000 7f1f7dd9b640 1 --2- 172.21.15.57:0/1198173700 >> v2:172.21.15.88:3300/0 conn(0x7f1f800bcea0 0x7f1f8006dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:45.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.052+0000 7f1f7e59c640 1 --2- 172.21.15.57:0/1198173700 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1f80071350 0x7f1f8006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:45.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.052+0000 7f1f7ed9d640 1 -- 172.21.15.57:0/1198173700 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1f80071350 msgr2=0x7f1f8006d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:45.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.052+0000 7f1f7ed9d640 1 --2- 172.21.15.57:0/1198173700 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1f80071350 0x7f1f8006d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:45.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.052+0000 7f1f7ed9d640 1 -- 172.21.15.57:0/1198173700 >> v2:172.21.15.88:3300/0 conn(0x7f1f800bcea0 msgr2=0x7f1f8006dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:45.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.052+0000 7f1f7ed9d640 1 --2- 172.21.15.57:0/1198173700 >> v2:172.21.15.88:3300/0 conn(0x7f1f800bcea0 0x7f1f8006dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:45.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.052+0000 7f1f7ed9d640 1 -- 172.21.15.57:0/1198173700 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f800bda10 con 0x7f1f800bd340 2024-04-24T23:39:45.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.052+0000 7f1f7e59c640 1 --2- 172.21.15.57:0/1198173700 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1f80071350 0x7f1f8006d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:39:45.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.052+0000 7f1f7dd9b640 1 --2- 172.21.15.57:0/1198173700 >> v2:172.21.15.88:3300/0 conn(0x7f1f800bcea0 0x7f1f8006dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:39:45.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.056+0000 7f1f7ed9d640 1 --2- 172.21.15.57:0/1198173700 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f800bd340 0x7f1f80155420 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1f8006f4e0 tx=0x7f1f7001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e4d48af4ebf0c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:45.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.056+0000 7f1f7d59a640 1 -- 172.21.15.57:0/1198173700 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f700b0070 con 0x7f1f800bd340 2024-04-24T23:39:45.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.056+0000 7f1f7d59a640 1 -- 172.21.15.57:0/1198173700 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f700a4e50 con 0x7f1f800bd340 2024-04-24T23:39:45.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.056+0000 7f1f7d59a640 1 -- 172.21.15.57:0/1198173700 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f700ab820 con 0x7f1f800bd340 2024-04-24T23:39:45.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.056+0000 7f1f84f54640 1 -- 172.21.15.57:0/1198173700 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f800bd340 msgr2=0x7f1f80155420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:45.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.056+0000 7f1f84f54640 1 --2- 172.21.15.57:0/1198173700 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f800bd340 0x7f1f80155420 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1f8006f4e0 tx=0x7f1f7001c400 comp rx=0 tx=0).stop 2024-04-24T23:39:45.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.056+0000 7f1f84f54640 1 -- 172.21.15.57:0/1198173700 shutdown_connections 2024-04-24T23:39:45.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.056+0000 7f1f84f54640 1 --2- 172.21.15.57:0/1198173700 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f800bd340 0x7f1f80155420 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:45.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.056+0000 7f1f84f54640 1 --2- 172.21.15.57:0/1198173700 >> v2:172.21.15.88:3300/0 conn(0x7f1f800bcea0 0x7f1f8006dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:45.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.056+0000 7f1f84f54640 1 --2- 172.21.15.57:0/1198173700 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1f80071350 0x7f1f8006d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:45.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.056+0000 7f1f84f54640 1 -- 172.21.15.57:0/1198173700 >> 172.21.15.57:0/1198173700 conn(0x7f1f8006b920 msgr2=0x7f1f800c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:45.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.056+0000 7f1f84f54640 1 -- 172.21.15.57:0/1198173700 shutdown_connections 2024-04-24T23:39:45.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.056+0000 7f1f84f54640 1 -- 172.21.15.57:0/1198173700 wait complete. 2024-04-24T23:39:45.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.056+0000 7f1f84f54640 1 Processor -- start 2024-04-24T23:39:45.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.056+0000 7f1f84f54640 1 -- start start 2024-04-24T23:39:45.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.056+0000 7f1f84f54640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f80071350 0x7f1f801f08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:45.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.056+0000 7f1f84f54640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1f800bcea0 0x7f1f800a64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:45.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.056+0000 7f1f84f54640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f800bd340 0x7f1f8014dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:45.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.056+0000 7f1f84f54640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1f80158dd0 con 0x7f1f800bd340 2024-04-24T23:39:45.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.056+0000 7f1f84f54640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1f80158c50 con 0x7f1f80071350 2024-04-24T23:39:45.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.056+0000 7f1f84f54640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f1f80158f50 con 0x7f1f800bcea0 2024-04-24T23:39:45.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.056+0000 7f1f7e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f80071350 0x7f1f801f08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:45.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.056+0000 7f1f7dd9b640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1f800bcea0 0x7f1f800a64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:45.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.056+0000 7f1f7dd9b640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1f800bcea0 0x7f1f800a64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.57:49550/0 (socket says 172.21.15.57:49550) 2024-04-24T23:39:45.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.056+0000 7f1f7e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f80071350 0x7f1f801f08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.57:49454/0 (socket says 172.21.15.57:49454) 2024-04-24T23:39:45.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.056+0000 7f1f7dd9b640 1 -- 172.21.15.57:0/2363269572 learned_addr learned my addr 172.21.15.57:0/2363269572 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:45.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.056+0000 7f1f7ed9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f800bd340 0x7f1f8014dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:45.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.060+0000 7f1f7ed9d640 1 -- 172.21.15.57:0/2363269572 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1f800bcea0 msgr2=0x7f1f800a64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:45.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.060+0000 7f1f7ed9d640 1 --2- 172.21.15.57:0/2363269572 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1f800bcea0 0x7f1f800a64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:45.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.060+0000 7f1f7ed9d640 1 -- 172.21.15.57:0/2363269572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f80071350 msgr2=0x7f1f801f08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:45.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.060+0000 7f1f7ed9d640 1 --2- 172.21.15.57:0/2363269572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f80071350 0x7f1f801f08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:45.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.060+0000 7f1f7ed9d640 1 -- 172.21.15.57:0/2363269572 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f80152d20 con 0x7f1f800bd340 2024-04-24T23:39:45.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.060+0000 7f1f7ed9d640 1 --2- 172.21.15.57:0/2363269572 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f800bd340 0x7f1f8014dd40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1f700ab000 tx=0x7f1f7001ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:45.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.060+0000 7f1f76ffd640 1 -- 172.21.15.57:0/2363269572 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f700ba020 con 0x7f1f800bd340 2024-04-24T23:39:45.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.060+0000 7f1f76ffd640 1 -- 172.21.15.57:0/2363269572 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f700b6420 con 0x7f1f800bd340 2024-04-24T23:39:45.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.060+0000 7f1f84f54640 1 -- 172.21.15.57:0/2363269572 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f8014aaf0 con 0x7f1f800bd340 2024-04-24T23:39:45.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.060+0000 7f1f76ffd640 1 -- 172.21.15.57:0/2363269572 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f700b0040 con 0x7f1f800bd340 2024-04-24T23:39:45.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.060+0000 7f1f84f54640 1 -- 172.21.15.57:0/2363269572 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f800c11a0 con 0x7f1f800bd340 2024-04-24T23:39:45.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.060+0000 7f1f84f54640 1 -- 172.21.15.57:0/2363269572 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f80068270 con 0x7f1f800bd340 2024-04-24T23:39:45.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.060+0000 7f1f76ffd640 1 -- 172.21.15.57:0/2363269572 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1f700bd020 con 0x7f1f800bd340 2024-04-24T23:39:45.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.060+0000 7f1f76ffd640 1 --2- 172.21.15.57:0/2363269572 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f1f600678c0 0x7f1f60069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:45.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.060+0000 7f1f76ffd640 1 -- 172.21.15.57:0/2363269572 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f1f7011feb0 con 0x7f1f800bd340 2024-04-24T23:39:45.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.060+0000 7f1f7e59c640 1 --2- 172.21.15.57:0/2363269572 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f1f600678c0 0x7f1f60069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:45.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.060+0000 7f1f7e59c640 1 --2- 172.21.15.57:0/2363269572 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f1f600678c0 0x7f1f60069d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1f78003ab0 tx=0x7f1f78009810 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:45.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.064+0000 7f1f76ffd640 1 -- 172.21.15.57:0/2363269572 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f1f700c4030 con 0x7f1f800bd340 2024-04-24T23:39:45.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.228+0000 7f1f84f54640 1 -- 172.21.15.57:0/2363269572 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f1f800be280 con 0x7f1f800bd340 2024-04-24T23:39:45.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.228+0000 7f1f76ffd640 1 -- 172.21.15.57:0/2363269572 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f1f70016110 con 0x7f1f800bd340 2024-04-24T23:39:45.231 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-04-24T23:39:45.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.232+0000 7f1f84f54640 1 -- 172.21.15.57:0/2363269572 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f1f600678c0 msgr2=0x7f1f60069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:45.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.232+0000 7f1f84f54640 1 --2- 172.21.15.57:0/2363269572 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f1f600678c0 0x7f1f60069d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1f78003ab0 tx=0x7f1f78009810 comp rx=0 tx=0).stop 2024-04-24T23:39:45.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.232+0000 7f1f84f54640 1 -- 172.21.15.57:0/2363269572 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f800bd340 msgr2=0x7f1f8014dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:45.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.232+0000 7f1f84f54640 1 --2- 172.21.15.57:0/2363269572 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f800bd340 0x7f1f8014dd40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1f700ab000 tx=0x7f1f7001ac40 comp rx=0 tx=0).stop 2024-04-24T23:39:45.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.232+0000 7f1f84f54640 1 -- 172.21.15.57:0/2363269572 shutdown_connections 2024-04-24T23:39:45.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.232+0000 7f1f84f54640 1 --2- 172.21.15.57:0/2363269572 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f1f600678c0 0x7f1f60069d80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:45.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.232+0000 7f1f84f54640 1 --2- 172.21.15.57:0/2363269572 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f800bd340 0x7f1f8014dd40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:45.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.232+0000 7f1f84f54640 1 --2- 172.21.15.57:0/2363269572 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1f800bcea0 0x7f1f800a64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:45.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.232+0000 7f1f84f54640 1 --2- 172.21.15.57:0/2363269572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f80071350 0x7f1f801f08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:45.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.232+0000 7f1f84f54640 1 -- 172.21.15.57:0/2363269572 >> 172.21.15.57:0/2363269572 conn(0x7f1f8006b920 msgr2=0x7f1f800a3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:45.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.232+0000 7f1f84f54640 1 -- 172.21.15.57:0/2363269572 shutdown_connections 2024-04-24T23:39:45.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.232+0000 7f1f84f54640 1 -- 172.21.15.57:0/2363269572 wait complete. 2024-04-24T23:39:45.251 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:39:45.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.376+0000 7f7336540640 1 Processor -- start 2024-04-24T23:39:45.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.376+0000 7f7336540640 1 -- start start 2024-04-24T23:39:45.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.376+0000 7f7336540640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f73301541d0 0x7f73300c5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:45.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.376+0000 7f7336540640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73300c0f70 con 0x7f73300c11e0 2024-04-24T23:39:45.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.376+0000 7f7336540640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73300c0a90 con 0x7f73300b9810 2024-04-24T23:39:45.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.376+0000 7f7336540640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f73300c44f0 con 0x7f73301541d0 2024-04-24T23:39:45.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.376+0000 7f7334add640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f73300c11e0 0x7f73301545b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:41186/0 (socket says 172.21.15.57:41186) 2024-04-24T23:39:45.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.376+0000 7f7334add640 1 -- 172.21.15.57:0/1937886941 learned_addr learned my addr 172.21.15.57:0/1937886941 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:45.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.376+0000 7f732ffff640 1 --2- 172.21.15.57:0/1937886941 >> v2:172.21.15.57:3300/0 conn(0x7f73301541d0 0x7f73300c5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:45.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.380+0000 7f732ffff640 1 -- 172.21.15.57:0/1937886941 >> v1:172.21.15.88:6789/0 conn(0x7f73300b9810 legacy=0x7f73300ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:45.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.380+0000 7f732ffff640 1 -- 172.21.15.57:0/1937886941 >> v1:172.21.15.57:6789/0 conn(0x7f73300c11e0 legacy=0x7f73301545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:45.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.380+0000 7f732ffff640 1 -- 172.21.15.57:0/1937886941 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73300c47d0 con 0x7f73301541d0 2024-04-24T23:39:45.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.380+0000 7f732effd640 1 -- 172.21.15.57:0/1937886941 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 272206299 0 0) 0x7f73300c0f70 con 0x7f73300c11e0 2024-04-24T23:39:45.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.380+0000 7f732ffff640 1 --2- 172.21.15.57:0/1937886941 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73301541d0 0x7f73300c5540 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7320009d90 tx=0x7f732001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d66caba717437fb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:45.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.380+0000 7f732effd640 1 -- 172.21.15.57:0/1937886941 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73200b2070 con 0x7f73301541d0 2024-04-24T23:39:45.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.380+0000 7f732effd640 1 -- 172.21.15.57:0/1937886941 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73200a58b0 con 0x7f73301541d0 2024-04-24T23:39:45.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.380+0000 7f732effd640 1 -- 172.21.15.57:0/1937886941 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73200a5c80 con 0x7f73301541d0 2024-04-24T23:39:45.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.380+0000 7f7336540640 1 -- 172.21.15.57:0/1937886941 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73301541d0 msgr2=0x7f73300c5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:45.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.380+0000 7f7336540640 1 --2- 172.21.15.57:0/1937886941 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73301541d0 0x7f73300c5540 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7320009d90 tx=0x7f732001c8e0 comp rx=0 tx=0).stop 2024-04-24T23:39:45.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.380+0000 7f7336540640 1 -- 172.21.15.57:0/1937886941 shutdown_connections 2024-04-24T23:39:45.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.380+0000 7f7336540640 1 --2- 172.21.15.57:0/1937886941 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73301541d0 0x7f73300c5540 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:45.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.380+0000 7f7336540640 1 -- 172.21.15.57:0/1937886941 >> 172.21.15.57:0/1937886941 conn(0x7f73300c6110 msgr2=0x7f73300c6520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:45.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.380+0000 7f7336540640 1 -- 172.21.15.57:0/1937886941 shutdown_connections 2024-04-24T23:39:45.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.380+0000 7f7336540640 1 -- 172.21.15.57:0/1937886941 wait complete. 2024-04-24T23:39:45.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.384+0000 7f7336540640 1 Processor -- start 2024-04-24T23:39:45.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.384+0000 7f7336540640 1 -- start start 2024-04-24T23:39:45.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.384+0000 7f7336540640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73300b9810 0x7f73300bdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:45.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.384+0000 7f7336540640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f73300c11e0 0x7f73301ecb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:45.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.384+0000 7f7336540640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73301541d0 0x7f73301ed090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:45.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.384+0000 7f7336540640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f733015ead0 con 0x7f73300b9810 2024-04-24T23:39:45.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.384+0000 7f7336540640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f733015ec50 con 0x7f73301541d0 2024-04-24T23:39:45.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.384+0000 7f7336540640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f733015edd0 con 0x7f73300c11e0 2024-04-24T23:39:45.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.384+0000 7f732ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73300b9810 0x7f73300bdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:45.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.384+0000 7f732ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73300b9810 0x7f73300bdbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40176/0 (socket says 172.21.15.57:40176) 2024-04-24T23:39:45.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.384+0000 7f732ffff640 1 -- 172.21.15.57:0/4028247960 learned_addr learned my addr 172.21.15.57:0/4028247960 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:45.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.384+0000 7f7334add640 1 --2- 172.21.15.57:0/4028247960 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73301541d0 0x7f73301ed090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:45.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.384+0000 7f732f7fe640 1 --2- 172.21.15.57:0/4028247960 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f73300c11e0 0x7f73301ecb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:45.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.384+0000 7f732ffff640 1 -- 172.21.15.57:0/4028247960 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f73300c11e0 msgr2=0x7f73301ecb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:45.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.384+0000 7f732ffff640 1 --2- 172.21.15.57:0/4028247960 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f73300c11e0 0x7f73301ecb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:45.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.384+0000 7f732ffff640 1 -- 172.21.15.57:0/4028247960 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73301541d0 msgr2=0x7f73301ed090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:45.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.384+0000 7f732ffff640 1 --2- 172.21.15.57:0/4028247960 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73301541d0 0x7f73301ed090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:45.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.384+0000 7f732ffff640 1 -- 172.21.15.57:0/4028247960 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73300c04b0 con 0x7f73300b9810 2024-04-24T23:39:45.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.384+0000 7f732ffff640 1 --2- 172.21.15.57:0/4028247960 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73300b9810 0x7f73300bdbf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7320009d90 tx=0x7f7320019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:45.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.384+0000 7f732cff9640 1 -- 172.21.15.57:0/4028247960 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73200bd030 con 0x7f73300b9810 2024-04-24T23:39:45.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.384+0000 7f732cff9640 1 -- 172.21.15.57:0/4028247960 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73200b8530 con 0x7f73300b9810 2024-04-24T23:39:45.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.384+0000 7f7336540640 1 -- 172.21.15.57:0/4028247960 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73300bffb0 con 0x7f73300b9810 2024-04-24T23:39:45.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.384+0000 7f732cff9640 1 -- 172.21.15.57:0/4028247960 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73200b2040 con 0x7f73300b9810 2024-04-24T23:39:45.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.384+0000 7f7336540640 1 -- 172.21.15.57:0/4028247960 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73300be870 con 0x7f73300b9810 2024-04-24T23:39:45.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.384+0000 7f7336540640 1 -- 172.21.15.57:0/4028247960 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73300bce40 con 0x7f73300b9810 2024-04-24T23:39:45.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.384+0000 7f732cff9640 1 -- 172.21.15.57:0/4028247960 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f73200c0070 con 0x7f73300b9810 2024-04-24T23:39:45.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.388+0000 7f732cff9640 1 --2- 172.21.15.57:0/4028247960 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f731c0678c0 0x7f731c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:45.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.388+0000 7f732cff9640 1 -- 172.21.15.57:0/4028247960 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f7320120d60 con 0x7f73300b9810 2024-04-24T23:39:45.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.388+0000 7f732f7fe640 1 --2- 172.21.15.57:0/4028247960 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f731c0678c0 0x7f731c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:45.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.388+0000 7f732f7fe640 1 --2- 172.21.15.57:0/4028247960 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f731c0678c0 0x7f731c069d80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f73300aa860 tx=0x7f7324009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:45.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.392+0000 7f732cff9640 1 -- 172.21.15.57:0/4028247960 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f73200c7070 con 0x7f73300b9810 2024-04-24T23:39:45.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.564+0000 7f7336540640 1 -- 172.21.15.57:0/4028247960 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7330068220 con 0x7f73300b9810 2024-04-24T23:39:45.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.564+0000 7f732cff9640 1 -- 172.21.15.57:0/4028247960 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f7320016560 con 0x7f73300b9810 2024-04-24T23:39:45.567 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2024-04-24T23:39:45.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.568+0000 7f7336540640 1 -- 172.21.15.57:0/4028247960 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f731c0678c0 msgr2=0x7f731c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:45.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.568+0000 7f7336540640 1 --2- 172.21.15.57:0/4028247960 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f731c0678c0 0x7f731c069d80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f73300aa860 tx=0x7f7324009040 comp rx=0 tx=0).stop 2024-04-24T23:39:45.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.568+0000 7f7336540640 1 -- 172.21.15.57:0/4028247960 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73300b9810 msgr2=0x7f73300bdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:45.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.568+0000 7f7336540640 1 --2- 172.21.15.57:0/4028247960 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73300b9810 0x7f73300bdbf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7320009d90 tx=0x7f7320019680 comp rx=0 tx=0).stop 2024-04-24T23:39:45.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.568+0000 7f7336540640 1 -- 172.21.15.57:0/4028247960 shutdown_connections 2024-04-24T23:39:45.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.568+0000 7f7336540640 1 --2- 172.21.15.57:0/4028247960 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f731c0678c0 0x7f731c069d80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:45.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.568+0000 7f7336540640 1 --2- 172.21.15.57:0/4028247960 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73301541d0 0x7f73301ed090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:45.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.568+0000 7f7336540640 1 --2- 172.21.15.57:0/4028247960 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f73300c11e0 0x7f73301ecb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:45.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.568+0000 7f7336540640 1 --2- 172.21.15.57:0/4028247960 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73300b9810 0x7f73300bdbf0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:45.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.568+0000 7f7336540640 1 -- 172.21.15.57:0/4028247960 >> 172.21.15.57:0/4028247960 conn(0x7f73300c6110 msgr2=0x7f73300a6240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:45.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.568+0000 7f7336540640 1 -- 172.21.15.57:0/4028247960 shutdown_connections 2024-04-24T23:39:45.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.568+0000 7f7336540640 1 -- 172.21.15.57:0/4028247960 wait complete. 2024-04-24T23:39:45.586 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-24T23:39:45.586 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:39:45.593 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:39:45.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.704+0000 7fbd4e796640 1 Processor -- start 2024-04-24T23:39:45.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.704+0000 7fbd4e796640 1 -- start start 2024-04-24T23:39:45.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.708+0000 7fbd4e796640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbd4814ada0 0x7fbd480b7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:45.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.708+0000 7fbd4e796640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbd48072980 0x7fbd480be3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:45.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.708+0000 7fbd4e796640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd480b8fa0 con 0x7fbd480bde80 2024-04-24T23:39:45.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.708+0000 7fbd4e796640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fbd480be920 con 0x7fbd4814ada0 2024-04-24T23:39:45.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.708+0000 7fbd4e796640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fbd48072e10 con 0x7fbd48072980 2024-04-24T23:39:45.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.708+0000 7fbd47fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbd4814ada0 0x7fbd480b7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:45.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.708+0000 7fbd47fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbd4814ada0 0x7fbd480b7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40186/0 (socket says 172.21.15.57:40186) 2024-04-24T23:39:45.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.708+0000 7fbd47fff640 1 -- 172.21.15.57:0/2542860021 learned_addr learned my addr 172.21.15.57:0/2542860021 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:45.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.708+0000 7fbd477fe640 1 --2- 172.21.15.57:0/2542860021 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbd48072980 0x7fbd480be3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:45.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.708+0000 7fbd47fff640 1 -- 172.21.15.57:0/2542860021 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbd48072980 msgr2=0x7fbd480be3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:45.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.708+0000 7fbd47fff640 1 --2- 172.21.15.57:0/2542860021 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbd48072980 0x7fbd480be3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:45.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.708+0000 7fbd47fff640 1 -- 172.21.15.57:0/2542860021 >> v1:172.21.15.88:6789/0 conn(0x7fbd480bde80 legacy=0x7fbd4806eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:45.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.708+0000 7fbd47fff640 1 -- 172.21.15.57:0/2542860021 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd4806f260 con 0x7fbd4814ada0 2024-04-24T23:39:45.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.712+0000 7fbd47fff640 1 --2- 172.21.15.57:0/2542860021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd4814ada0 0x7fbd480b7470 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbd3800bb10 tx=0x7fbd3801eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fcbfd9af3bffed9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:45.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.712+0000 7fbd46ffd640 1 -- 172.21.15.57:0/2542860021 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd380b4070 con 0x7fbd4814ada0 2024-04-24T23:39:45.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.712+0000 7fbd46ffd640 1 -- 172.21.15.57:0/2542860021 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd380a7a00 con 0x7fbd4814ada0 2024-04-24T23:39:45.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.712+0000 7fbd46ffd640 1 -- 172.21.15.57:0/2542860021 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd380a7dd0 con 0x7fbd4814ada0 2024-04-24T23:39:45.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.712+0000 7fbd4e796640 1 -- 172.21.15.57:0/2542860021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd4814ada0 msgr2=0x7fbd480b7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:45.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.712+0000 7fbd4e796640 1 --2- 172.21.15.57:0/2542860021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd4814ada0 0x7fbd480b7470 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbd3800bb10 tx=0x7fbd3801eb60 comp rx=0 tx=0).stop 2024-04-24T23:39:45.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.712+0000 7fbd4e796640 1 -- 172.21.15.57:0/2542860021 shutdown_connections 2024-04-24T23:39:45.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.712+0000 7fbd4e796640 1 --2- 172.21.15.57:0/2542860021 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbd48072980 0x7fbd480be3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:45.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.712+0000 7fbd4e796640 1 --2- 172.21.15.57:0/2542860021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd4814ada0 0x7fbd480b7470 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:45.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.712+0000 7fbd4e796640 1 -- 172.21.15.57:0/2542860021 >> 172.21.15.57:0/2542860021 conn(0x7fbd480beab0 msgr2=0x7fbd480beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:45.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.712+0000 7fbd4e796640 1 -- 172.21.15.57:0/2542860021 shutdown_connections 2024-04-24T23:39:45.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.712+0000 7fbd4e796640 1 -- 172.21.15.57:0/2542860021 wait complete. 2024-04-24T23:39:45.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.716+0000 7fbd4e796640 1 Processor -- start 2024-04-24T23:39:45.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.716+0000 7fbd4e796640 1 -- start start 2024-04-24T23:39:45.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.716+0000 7fbd4e796640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd48072980 0x7fbd4813aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:45.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.716+0000 7fbd4e796640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd480bde80 0x7fbd4813c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:45.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.716+0000 7fbd4e796640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbd4814ada0 0x7fbd4813ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:45.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.716+0000 7fbd4e796640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbd480bd340 con 0x7fbd480bde80 2024-04-24T23:39:45.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.716+0000 7fbd4e796640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbd480bd1c0 con 0x7fbd48072980 2024-04-24T23:39:45.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.716+0000 7fbd4e796640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fbd480bd4c0 con 0x7fbd4814ada0 2024-04-24T23:39:45.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.716+0000 7fbd477fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd480bde80 0x7fbd4813c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:45.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.716+0000 7fbd477fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd480bde80 0x7fbd4813c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40192/0 (socket says 172.21.15.57:40192) 2024-04-24T23:39:45.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.716+0000 7fbd477fe640 1 -- 172.21.15.57:0/2524016351 learned_addr learned my addr 172.21.15.57:0/2524016351 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:45.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.716+0000 7fbd47fff640 1 --2- 172.21.15.57:0/2524016351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd48072980 0x7fbd4813aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:45.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.716+0000 7fbd4cd33640 1 --2- 172.21.15.57:0/2524016351 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbd4814ada0 0x7fbd4813ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:45.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.716+0000 7fbd477fe640 1 -- 172.21.15.57:0/2524016351 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbd4814ada0 msgr2=0x7fbd4813ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:45.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.716+0000 7fbd477fe640 1 --2- 172.21.15.57:0/2524016351 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbd4814ada0 0x7fbd4813ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:45.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.716+0000 7fbd477fe640 1 -- 172.21.15.57:0/2524016351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd48072980 msgr2=0x7fbd4813aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:45.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.716+0000 7fbd477fe640 1 --2- 172.21.15.57:0/2524016351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd48072980 0x7fbd4813aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:45.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.716+0000 7fbd477fe640 1 -- 172.21.15.57:0/2524016351 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd4813d210 con 0x7fbd480bde80 2024-04-24T23:39:45.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.716+0000 7fbd477fe640 1 --2- 172.21.15.57:0/2524016351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd480bde80 0x7fbd4813c790 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c00d800 tx=0x7fbd3c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:45.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.716+0000 7fbd44ff9640 1 -- 172.21.15.57:0/2524016351 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c004020 con 0x7fbd480bde80 2024-04-24T23:39:45.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.716+0000 7fbd44ff9640 1 -- 172.21.15.57:0/2524016351 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd3c0041c0 con 0x7fbd480bde80 2024-04-24T23:39:45.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.716+0000 7fbd44ff9640 1 -- 172.21.15.57:0/2524016351 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c0043b0 con 0x7fbd480bde80 2024-04-24T23:39:45.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.716+0000 7fbd4e796640 1 -- 172.21.15.57:0/2524016351 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd480c1c10 con 0x7fbd480bde80 2024-04-24T23:39:45.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.716+0000 7fbd4e796640 1 -- 172.21.15.57:0/2524016351 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd480bfd40 con 0x7fbd480bde80 2024-04-24T23:39:45.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.716+0000 7fbd4e796640 1 -- 172.21.15.57:0/2524016351 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd48068220 con 0x7fbd480bde80 2024-04-24T23:39:45.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.716+0000 7fbd44ff9640 1 -- 172.21.15.57:0/2524016351 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbd3c01b020 con 0x7fbd480bde80 2024-04-24T23:39:45.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.720+0000 7fbd44ff9640 1 --2- 172.21.15.57:0/2524016351 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fbd340678c0 0x7fbd34069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:45.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.720+0000 7fbd44ff9640 1 -- 172.21.15.57:0/2524016351 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fbd3c085eb0 con 0x7fbd480bde80 2024-04-24T23:39:45.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.720+0000 7fbd47fff640 1 --2- 172.21.15.57:0/2524016351 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fbd340678c0 0x7fbd34069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:45.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.720+0000 7fbd47fff640 1 --2- 172.21.15.57:0/2524016351 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fbd340678c0 0x7fbd34069d80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbd380b1000 tx=0x7fbd380a9070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:45.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.724+0000 7fbd44ff9640 1 -- 172.21.15.57:0/2524016351 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fbd4813d210 con 0x7fbd480bde80 2024-04-24T23:39:45.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.880+0000 7fbd4e796640 1 -- 172.21.15.57:0/2524016351 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbd4814d700 con 0x7fbd480bde80 2024-04-24T23:39:45.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.884+0000 7fbd44ff9640 1 -- 172.21.15.57:0/2524016351 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18853 (secure 0 0 0) 0x7fbd3c0565f0 con 0x7fbd480bde80 2024-04-24T23:39:45.941 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:39:45.942 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"fsid":"1ea31698-444a-4667-bcd9-b2608ad103c3","created":"2024-04-24T23:38:16.748774+0000","modified":"2024-04-24T23:39:22.806760+0000","last_up_change":"2024-04-24T23:38:26.956537+0000","last_in_change":"2024-04-24T23:38:18.972175+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:38:27.611782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:38:31.718061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:38:32.469413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:38:36.215724+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"35ce67bc-9b25-416e-ab1e-774c717631f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6825","nonce":671364028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6827","nonce":671364028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6831","nonce":671364028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6829","nonce":671364028}]},"public_addr":"172.21.15.57:6825/671364028","cluster_addr":"172.21.15.57:6827/671364028","heartbeat_back_addr":"172.21.15.57:6831/671364028","heartbeat_front_addr":"172.21.15.57:6829/671364028","state":["exists","up"]},{"osd":1,"uuid":"38f6f4ef-3bc2-4453-9946-7d1d17e735ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6801","nonce":2653552037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6803","nonce":2653552037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6807","nonce":2653552037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6805","nonce":2653552037}]},"public_addr":"172.21.15.57:6801/2653552037","cluster_addr":"172.21.15.57:6803/2653552037","heartbeat_back_addr":"172.21.15.57:6807/2653552037","heartbeat_front_addr":"172.21.15.57:6805/2653552037","state":["exists","up"]},{"osd":2,"uuid":"d77a0a49-b39a-464e-a1c9-49e19280c440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6816","nonce":1565874109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6819","nonce":1565874109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6823","nonce":1565874109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6821","nonce":1565874109}]},"public_addr":"172.21.15.57:6816/1565874109","cluster_addr":"172.21.15.57:6819/1565874109","heartbeat_back_addr":"172.21.15.57:6823/1565874109","heartbeat_front_addr":"172.21.15.57:6821/1565874109","state":["exists","up"]},{"osd":3,"uuid":"f8ea9bfe-d839-44a6-a185-0f0985da314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6809","nonce":3474703186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6811","nonce":3474703186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6817","nonce":3474703186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6813","nonce":3474703186}]},"public_addr":"172.21.15.57:6809/3474703186","cluster_addr":"172.21.15.57:6811/3474703186","heartbeat_back_addr":"172.21.15.57:6817/3474703186","heartbeat_front_addr":"172.21.15.57:6813/3474703186","state":["exists","up"]},{"osd":4,"uuid":"454647d4-6ac2-46b4-8451-320eb951a87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6801","nonce":1271707713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6803","nonce":1271707713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6807","nonce":1271707713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6805","nonce":1271707713}]},"public_addr":"172.21.15.88:6801/1271707713","cluster_addr":"172.21.15.88:6803/1271707713","heartbeat_back_addr":"172.21.15.88:6807/1271707713","heartbeat_front_addr":"172.21.15.88:6805/1271707713","state":["exists","up"]},{"osd":5,"uuid":"f71c03a3-7ad8-46d3-89c9-d61de102586b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6809","nonce":2035054888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6813","nonce":2035054888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6820","nonce":2035054888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6816","nonce":2035054888}]},"public_addr":"172.21.15.88:6809/2035054888","cluster_addr":"172.21.15.88:6813/2035054888","heartbeat_back_addr":"172.21.15.88:6820/2035054888","heartbeat_front_addr":"172.21.15.88:6816/2035054888","state":["exists","up"]},{"osd":6,"uuid":"ec7ae2b7-9cb4-4059-8f98-0022c9763f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6825","nonce":1752291242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6827","nonce":1752291242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6831","nonce":1752291242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6829","nonce":1752291242}]},"public_addr":"172.21.15.88:6825/1752291242","cluster_addr":"172.21.15.88:6827/1752291242","heartbeat_back_addr":"172.21.15.88:6831/1752291242","heartbeat_front_addr":"172.21.15.88:6829/1752291242","state":["exists","up"]},{"osd":7,"uuid":"c0ee7505-60c1-40ba-9902-47313a04dafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6812","nonce":1782800372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6817","nonce":1782800372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6823","nonce":1782800372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6821","nonce":1782800372}]},"public_addr":"172.21.15.88:6812/1782800372","cluster_addr":"172.21.15.88:6817/1782800372","heartbeat_back_addr":"172.21.15.88:6823/1782800372","heartbeat_front_addr":"172.21.15.88:6821/1782800372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.698562+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.682587+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.680197+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.561753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.011095+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.493320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.353451+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.423877+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:39:45.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.888+0000 7fbd4e796640 1 -- 172.21.15.57:0/2524016351 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fbd340678c0 msgr2=0x7fbd34069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:45.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.888+0000 7fbd4e796640 1 --2- 172.21.15.57:0/2524016351 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fbd340678c0 0x7fbd34069d80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbd380b1000 tx=0x7fbd380a9070 comp rx=0 tx=0).stop 2024-04-24T23:39:45.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.888+0000 7fbd4e796640 1 -- 172.21.15.57:0/2524016351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd480bde80 msgr2=0x7fbd4813c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:45.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.888+0000 7fbd4e796640 1 --2- 172.21.15.57:0/2524016351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd480bde80 0x7fbd4813c790 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c00d800 tx=0x7fbd3c00dcc0 comp rx=0 tx=0).stop 2024-04-24T23:39:45.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.888+0000 7fbd4e796640 1 -- 172.21.15.57:0/2524016351 shutdown_connections 2024-04-24T23:39:45.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.888+0000 7fbd4e796640 1 --2- 172.21.15.57:0/2524016351 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fbd340678c0 0x7fbd34069d80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:45.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.888+0000 7fbd4e796640 1 --2- 172.21.15.57:0/2524016351 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbd4814ada0 0x7fbd4813ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:45.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.888+0000 7fbd4e796640 1 --2- 172.21.15.57:0/2524016351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd480bde80 0x7fbd4813c790 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:45.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.888+0000 7fbd4e796640 1 --2- 172.21.15.57:0/2524016351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd48072980 0x7fbd4813aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:45.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.888+0000 7fbd4e796640 1 -- 172.21.15.57:0/2524016351 >> 172.21.15.57:0/2524016351 conn(0x7fbd480beab0 msgr2=0x7fbd48071090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:45.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.888+0000 7fbd4e796640 1 -- 172.21.15.57:0/2524016351 shutdown_connections 2024-04-24T23:39:45.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:45.888+0000 7fbd4e796640 1 -- 172.21.15.57:0/2524016351 wait complete. 2024-04-24T23:39:45.944 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:38:27.611782+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:38:31.718061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:38:32.469413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-24T23:38:36.215724+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-24T23:39:45.945 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:39:46.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.056+0000 7f94875cb640 1 Processor -- start 2024-04-24T23:39:46.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.056+0000 7f94875cb640 1 -- start start 2024-04-24T23:39:46.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.060+0000 7f94875cb640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f948014deb0 0x7f94800c2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:46.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.060+0000 7f94875cb640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f94800c3490 0x7f94800c1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:46.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.060+0000 7f94875cb640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9480151270 con 0x7f94800b8660 2024-04-24T23:39:46.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.060+0000 7f94875cb640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f94800c0a90 con 0x7f94800c3490 2024-04-24T23:39:46.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.060+0000 7f94875cb640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f94800c0d70 con 0x7f948014deb0 2024-04-24T23:39:46.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.060+0000 7f9484b66640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f94800c3490 0x7f94800c1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:46.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.060+0000 7f9485367640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f948014deb0 0x7f94800c2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:46.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.060+0000 7f9485367640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f948014deb0 0x7f94800c2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.57:49596/0 (socket says 172.21.15.57:49596) 2024-04-24T23:39:46.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.060+0000 7f9485367640 1 -- 172.21.15.57:0/3598811535 learned_addr learned my addr 172.21.15.57:0/3598811535 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:46.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.060+0000 7f9485367640 1 -- 172.21.15.57:0/3598811535 >> v2:172.21.15.88:3300/0 conn(0x7f94800c3490 msgr2=0x7f94800c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:46.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.060+0000 7f9485367640 1 --2- 172.21.15.57:0/3598811535 >> v2:172.21.15.88:3300/0 conn(0x7f94800c3490 0x7f94800c1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.060+0000 7f9485367640 1 -- 172.21.15.57:0/3598811535 >> v1:172.21.15.88:6789/0 conn(0x7f94800b8660 legacy=0x7f9480153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:46.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.060+0000 7f9485367640 1 -- 172.21.15.57:0/3598811535 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9480151550 con 0x7f948014deb0 2024-04-24T23:39:46.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f9485367640 1 --2- 172.21.15.57:0/3598811535 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f948014deb0 0x7f94800c2f50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f947c009870 tx=0x7f947c01ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9021762ac9588a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:46.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f9477fff640 1 -- 172.21.15.57:0/3598811535 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c0b5070 con 0x7f948014deb0 2024-04-24T23:39:46.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f9477fff640 1 -- 172.21.15.57:0/3598811535 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f947c0a8a50 con 0x7f948014deb0 2024-04-24T23:39:46.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f9477fff640 1 -- 172.21.15.57:0/3598811535 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c0a8e20 con 0x7f948014deb0 2024-04-24T23:39:46.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f94875cb640 1 -- 172.21.15.57:0/3598811535 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f948014deb0 msgr2=0x7f94800c2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:46.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f94875cb640 1 --2- 172.21.15.57:0/3598811535 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f948014deb0 0x7f94800c2f50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f947c009870 tx=0x7f947c01ed50 comp rx=0 tx=0).stop 2024-04-24T23:39:46.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f94875cb640 1 -- 172.21.15.57:0/3598811535 shutdown_connections 2024-04-24T23:39:46.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f94875cb640 1 --2- 172.21.15.57:0/3598811535 >> v2:172.21.15.88:3300/0 conn(0x7f94800c3490 0x7f94800c1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f94875cb640 1 --2- 172.21.15.57:0/3598811535 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f948014deb0 0x7f94800c2f50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f94875cb640 1 -- 172.21.15.57:0/3598811535 >> 172.21.15.57:0/3598811535 conn(0x7f9480067120 msgr2=0x7f9480067530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:46.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f94875cb640 1 -- 172.21.15.57:0/3598811535 shutdown_connections 2024-04-24T23:39:46.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f94875cb640 1 -- 172.21.15.57:0/3598811535 wait complete. 2024-04-24T23:39:46.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f94875cb640 1 Processor -- start 2024-04-24T23:39:46.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f94875cb640 1 -- start start 2024-04-24T23:39:46.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f94875cb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94800b8660 0x7f94801dd680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:46.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f94875cb640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94800c3490 0x7f94801da5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:46.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f94875cb640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f948014deb0 0x7f94800be380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:46.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f94875cb640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f94800c1740 con 0x7f94800c3490 2024-04-24T23:39:46.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f94875cb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f948014e290 con 0x7f94800b8660 2024-04-24T23:39:46.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f94875cb640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f94800c18c0 con 0x7f948014deb0 2024-04-24T23:39:46.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f9484b66640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94800c3490 0x7f94801da5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:46.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f9484b66640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94800c3490 0x7f94801da5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40202/0 (socket says 172.21.15.57:40202) 2024-04-24T23:39:46.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f9484b66640 1 -- 172.21.15.57:0/4008973748 learned_addr learned my addr 172.21.15.57:0/4008973748 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:46.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f9485b68640 1 --2- 172.21.15.57:0/4008973748 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f948014deb0 0x7f94800be380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:46.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f9485367640 1 --2- 172.21.15.57:0/4008973748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94800b8660 0x7f94801dd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:46.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f9484b66640 1 -- 172.21.15.57:0/4008973748 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f948014deb0 msgr2=0x7f94800be380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:46.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f9484b66640 1 --2- 172.21.15.57:0/4008973748 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f948014deb0 0x7f94800be380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f9484b66640 1 -- 172.21.15.57:0/4008973748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94800b8660 msgr2=0x7f94801dd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:46.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f9484b66640 1 --2- 172.21.15.57:0/4008973748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94800b8660 0x7f94801dd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f9484b66640 1 -- 172.21.15.57:0/4008973748 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94800be8c0 con 0x7f94800c3490 2024-04-24T23:39:46.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f9484b66640 1 --2- 172.21.15.57:0/4008973748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94800c3490 0x7f94801da5e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f947000e960 tx=0x7f947000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:46.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f9475ffb640 1 -- 172.21.15.57:0/4008973748 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9470017070 con 0x7f94800c3490 2024-04-24T23:39:46.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f9475ffb640 1 -- 172.21.15.57:0/4008973748 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f947000c9a0 con 0x7f94800c3490 2024-04-24T23:39:46.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f94875cb640 1 -- 172.21.15.57:0/4008973748 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94801548b0 con 0x7f94800c3490 2024-04-24T23:39:46.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f9475ffb640 1 -- 172.21.15.57:0/4008973748 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947000cd50 con 0x7f94800c3490 2024-04-24T23:39:46.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.064+0000 7f94875cb640 1 -- 172.21.15.57:0/4008973748 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94801d9de0 con 0x7f94800c3490 2024-04-24T23:39:46.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.068+0000 7f94875cb640 1 -- 172.21.15.57:0/4008973748 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9480068290 con 0x7f94800c3490 2024-04-24T23:39:46.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.068+0000 7f9475ffb640 1 -- 172.21.15.57:0/4008973748 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f947001a070 con 0x7f94800c3490 2024-04-24T23:39:46.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.068+0000 7f9475ffb640 1 --2- 172.21.15.57:0/4008973748 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f94640678c0 0x7f9464069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:46.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.068+0000 7f9475ffb640 1 -- 172.21.15.57:0/4008973748 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f94700862f0 con 0x7f94800c3490 2024-04-24T23:39:46.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.068+0000 7f9485367640 1 --2- 172.21.15.57:0/4008973748 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f94640678c0 0x7f9464069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:46.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.068+0000 7f9485367640 1 --2- 172.21.15.57:0/4008973748 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f94640678c0 0x7f9464069d80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f947c0b2000 tx=0x7f947c0aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:46.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.072+0000 7f9475ffb640 1 -- 172.21.15.57:0/4008973748 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f94800be8c0 con 0x7f94800c3490 2024-04-24T23:39:46.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.228+0000 7f94875cb640 1 -- 172.21.15.57:0/4008973748 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f94800c23d0 con 0x7f94800c3490 2024-04-24T23:39:46.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.228+0000 7f9475ffb640 1 -- 172.21.15.57:0/4008973748 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f94700563e0 con 0x7f94800c3490 2024-04-24T23:39:46.232 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-04-24T23:39:46.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.232+0000 7f94875cb640 1 -- 172.21.15.57:0/4008973748 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f94640678c0 msgr2=0x7f9464069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:46.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.232+0000 7f94875cb640 1 --2- 172.21.15.57:0/4008973748 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f94640678c0 0x7f9464069d80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f947c0b2000 tx=0x7f947c0aa070 comp rx=0 tx=0).stop 2024-04-24T23:39:46.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.232+0000 7f94875cb640 1 -- 172.21.15.57:0/4008973748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94800c3490 msgr2=0x7f94801da5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:46.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.232+0000 7f94875cb640 1 --2- 172.21.15.57:0/4008973748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94800c3490 0x7f94801da5e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f947000e960 tx=0x7f947000ee20 comp rx=0 tx=0).stop 2024-04-24T23:39:46.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.232+0000 7f94875cb640 1 -- 172.21.15.57:0/4008973748 shutdown_connections 2024-04-24T23:39:46.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.232+0000 7f94875cb640 1 --2- 172.21.15.57:0/4008973748 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f94640678c0 0x7f9464069d80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.232+0000 7f94875cb640 1 --2- 172.21.15.57:0/4008973748 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f948014deb0 0x7f94800be380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.232+0000 7f94875cb640 1 --2- 172.21.15.57:0/4008973748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94800c3490 0x7f94801da5e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.232+0000 7f94875cb640 1 --2- 172.21.15.57:0/4008973748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94800b8660 0x7f94801dd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.232+0000 7f94875cb640 1 -- 172.21.15.57:0/4008973748 >> 172.21.15.57:0/4008973748 conn(0x7f9480067120 msgr2=0x7f94800ba290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:46.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.232+0000 7f94875cb640 1 -- 172.21.15.57:0/4008973748 shutdown_connections 2024-04-24T23:39:46.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.232+0000 7f94875cb640 1 -- 172.21.15.57:0/4008973748 wait complete. 2024-04-24T23:39:46.250 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:39:46.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.360+0000 7f2b892ec640 1 Processor -- start 2024-04-24T23:39:46.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.360+0000 7f2b892ec640 1 -- start start 2024-04-24T23:39:46.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.364+0000 7f2b892ec640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2b8414a320 0x7f2b84150d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:46.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.364+0000 7f2b892ec640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2b840bc330 0x7f2b8414d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:46.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.364+0000 7f2b892ec640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b840722c0 con 0x7f2b8406d6d0 2024-04-24T23:39:46.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.364+0000 7f2b892ec640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f2b840725a0 con 0x7f2b8414a320 2024-04-24T23:39:46.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.364+0000 7f2b892ec640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f2b8414cfa0 con 0x7f2b840bc330 2024-04-24T23:39:46.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.364+0000 7f2b82ffd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2b8414a320 0x7f2b84150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:46.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.364+0000 7f2b82ffd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2b8414a320 0x7f2b84150d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40210/0 (socket says 172.21.15.57:40210) 2024-04-24T23:39:46.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.364+0000 7f2b82ffd640 1 -- 172.21.15.57:0/1879565644 learned_addr learned my addr 172.21.15.57:0/1879565644 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:46.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.364+0000 7f2b82ffd640 1 -- 172.21.15.57:0/1879565644 >> v2:172.21.15.88:3300/0 conn(0x7f2b840bc330 msgr2=0x7f2b8414d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:46.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.364+0000 7f2b82ffd640 1 --2- 172.21.15.57:0/1879565644 >> v2:172.21.15.88:3300/0 conn(0x7f2b840bc330 0x7f2b8414d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.364+0000 7f2b82ffd640 1 -- 172.21.15.57:0/1879565644 >> v1:172.21.15.88:6789/0 conn(0x7f2b8406d6d0 legacy=0x7f2b840bd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:46.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.364+0000 7f2b82ffd640 1 -- 172.21.15.57:0/1879565644 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b840be020 con 0x7f2b8414a320 2024-04-24T23:39:46.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.364+0000 7f2b82ffd640 1 --2- 172.21.15.57:0/1879565644 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b8414a320 0x7f2b84150d90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2b8406d120 tx=0x7f2b740202b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f52f511c176cb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:46.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.364+0000 7f2b81ffb640 1 -- 172.21.15.57:0/1879565644 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b740b5070 con 0x7f2b8414a320 2024-04-24T23:39:46.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.364+0000 7f2b81ffb640 1 -- 172.21.15.57:0/1879565644 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b740b0400 con 0x7f2b8414a320 2024-04-24T23:39:46.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.364+0000 7f2b81ffb640 1 -- 172.21.15.57:0/1879565644 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b740b07d0 con 0x7f2b8414a320 2024-04-24T23:39:46.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.364+0000 7f2b892ec640 1 -- 172.21.15.57:0/1879565644 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b8414a320 msgr2=0x7f2b84150d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:46.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.364+0000 7f2b892ec640 1 --2- 172.21.15.57:0/1879565644 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b8414a320 0x7f2b84150d90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2b8406d120 tx=0x7f2b740202b0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.368+0000 7f2b892ec640 1 -- 172.21.15.57:0/1879565644 shutdown_connections 2024-04-24T23:39:46.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.368+0000 7f2b892ec640 1 --2- 172.21.15.57:0/1879565644 >> v2:172.21.15.88:3300/0 conn(0x7f2b840bc330 0x7f2b8414d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.368+0000 7f2b892ec640 1 --2- 172.21.15.57:0/1879565644 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b8414a320 0x7f2b84150d90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.368+0000 7f2b892ec640 1 -- 172.21.15.57:0/1879565644 >> 172.21.15.57:0/1879565644 conn(0x7f2b8406b920 msgr2=0x7f2b840c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:46.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.368+0000 7f2b892ec640 1 -- 172.21.15.57:0/1879565644 shutdown_connections 2024-04-24T23:39:46.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.368+0000 7f2b892ec640 1 -- 172.21.15.57:0/1879565644 wait complete. 2024-04-24T23:39:46.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.368+0000 7f2b892ec640 1 Processor -- start 2024-04-24T23:39:46.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.368+0000 7f2b892ec640 1 -- start start 2024-04-24T23:39:46.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.368+0000 7f2b892ec640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2b8406d6d0 0x7f2b8414c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:46.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.368+0000 7f2b892ec640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b840bc330 0x7f2b84146c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:46.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.368+0000 7f2b892ec640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b8414a320 0x7f2b841dace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:46.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.368+0000 7f2b892ec640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8414db80 con 0x7f2b840bc330 2024-04-24T23:39:46.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.368+0000 7f2b892ec640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8414da00 con 0x7f2b8414a320 2024-04-24T23:39:46.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.368+0000 7f2b892ec640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f2b8414dd00 con 0x7f2b8406d6d0 2024-04-24T23:39:46.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.368+0000 7f2b827fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b840bc330 0x7f2b84146c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:46.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.368+0000 7f2b827fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b840bc330 0x7f2b84146c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40220/0 (socket says 172.21.15.57:40220) 2024-04-24T23:39:46.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.368+0000 7f2b827fc640 1 -- 172.21.15.57:0/999185276 learned_addr learned my addr 172.21.15.57:0/999185276 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:46.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.368+0000 7f2b827fc640 1 -- 172.21.15.57:0/999185276 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2b8406d6d0 msgr2=0x7f2b8414c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:46.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.368+0000 7f2b827fc640 1 --2- 172.21.15.57:0/999185276 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2b8406d6d0 0x7f2b8414c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.368+0000 7f2b827fc640 1 -- 172.21.15.57:0/999185276 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b8414a320 msgr2=0x7f2b841dace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:46.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.368+0000 7f2b827fc640 1 --2- 172.21.15.57:0/999185276 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b8414a320 0x7f2b841dace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.368+0000 7f2b827fc640 1 -- 172.21.15.57:0/999185276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b84147190 con 0x7f2b840bc330 2024-04-24T23:39:46.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.368+0000 7f2b827fc640 1 --2- 172.21.15.57:0/999185276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b840bc330 0x7f2b84146c50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800c410 tx=0x7f2b7800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:46.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.368+0000 7f2b6b7fe640 1 -- 172.21.15.57:0/999185276 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b78017070 con 0x7f2b840bc330 2024-04-24T23:39:46.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.368+0000 7f2b6b7fe640 1 -- 172.21.15.57:0/999185276 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b78003600 con 0x7f2b840bc330 2024-04-24T23:39:46.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.368+0000 7f2b6b7fe640 1 -- 172.21.15.57:0/999185276 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b780039f0 con 0x7f2b840bc330 2024-04-24T23:39:46.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.368+0000 7f2b892ec640 1 -- 172.21.15.57:0/999185276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b8414f710 con 0x7f2b840bc330 2024-04-24T23:39:46.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.368+0000 7f2b892ec640 1 -- 172.21.15.57:0/999185276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b84147510 con 0x7f2b840bc330 2024-04-24T23:39:46.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.368+0000 7f2b892ec640 1 -- 172.21.15.57:0/999185276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b84068290 con 0x7f2b840bc330 2024-04-24T23:39:46.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.372+0000 7f2b6b7fe640 1 -- 172.21.15.57:0/999185276 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2b78003b90 con 0x7f2b840bc330 2024-04-24T23:39:46.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.372+0000 7f2b6b7fe640 1 --2- 172.21.15.57:0/999185276 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f2b700678c0 0x7f2b70069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:46.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.372+0000 7f2b6b7fe640 1 -- 172.21.15.57:0/999185276 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f2b78085460 con 0x7f2b840bc330 2024-04-24T23:39:46.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.372+0000 7f2b82ffd640 1 --2- 172.21.15.57:0/999185276 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f2b700678c0 0x7f2b70069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:46.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.372+0000 7f2b82ffd640 1 --2- 172.21.15.57:0/999185276 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f2b700678c0 0x7f2b70069d80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2b740b2000 tx=0x7f2b7400d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:46.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.376+0000 7f2b6b7fe640 1 -- 172.21.15.57:0/999185276 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f2b84147190 con 0x7f2b840bc330 2024-04-24T23:39:46.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.528+0000 7f2b892ec640 1 -- 172.21.15.57:0/999185276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2b840be8b0 con 0x7f2b840bc330 2024-04-24T23:39:46.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.528+0000 7f2b6b7fe640 1 -- 172.21.15.57:0/999185276 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f2b78055ba0 con 0x7f2b840bc330 2024-04-24T23:39:46.531 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-04-24T23:39:46.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.532+0000 7f2b892ec640 1 -- 172.21.15.57:0/999185276 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f2b700678c0 msgr2=0x7f2b70069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:46.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.532+0000 7f2b892ec640 1 --2- 172.21.15.57:0/999185276 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f2b700678c0 0x7f2b70069d80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2b740b2000 tx=0x7f2b7400d040 comp rx=0 tx=0).stop 2024-04-24T23:39:46.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.532+0000 7f2b892ec640 1 -- 172.21.15.57:0/999185276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b840bc330 msgr2=0x7f2b84146c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:46.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.532+0000 7f2b892ec640 1 --2- 172.21.15.57:0/999185276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b840bc330 0x7f2b84146c50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800c410 tx=0x7f2b7800c8d0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.532+0000 7f2b892ec640 1 -- 172.21.15.57:0/999185276 shutdown_connections 2024-04-24T23:39:46.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.532+0000 7f2b892ec640 1 --2- 172.21.15.57:0/999185276 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f2b700678c0 0x7f2b70069d80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.532+0000 7f2b892ec640 1 --2- 172.21.15.57:0/999185276 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b8414a320 0x7f2b841dace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.532+0000 7f2b892ec640 1 --2- 172.21.15.57:0/999185276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b840bc330 0x7f2b84146c50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.532+0000 7f2b892ec640 1 --2- 172.21.15.57:0/999185276 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2b8406d6d0 0x7f2b8414c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.532+0000 7f2b892ec640 1 -- 172.21.15.57:0/999185276 >> 172.21.15.57:0/999185276 conn(0x7f2b8406b920 msgr2=0x7f2b8406dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:46.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.532+0000 7f2b892ec640 1 -- 172.21.15.57:0/999185276 shutdown_connections 2024-04-24T23:39:46.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.532+0000 7f2b892ec640 1 -- 172.21.15.57:0/999185276 wait complete. 2024-04-24T23:39:46.548 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:39:46.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.660+0000 7fb6386b1640 1 Processor -- start 2024-04-24T23:39:46.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.660+0000 7fb6386b1640 1 -- start start 2024-04-24T23:39:46.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.664+0000 7fb6386b1640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb63014bc60 0x7fb6300c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:46.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.664+0000 7fb6386b1640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb6300c2d00 0x7fb630151c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:46.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.664+0000 7fb6386b1640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6300bd200 con 0x7fb6300bd5f0 2024-04-24T23:39:46.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.664+0000 7fb6386b1640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fb6300bde20 con 0x7fb6300c2d00 2024-04-24T23:39:46.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.664+0000 7fb6386b1640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fb6300be070 con 0x7fb63014bc60 2024-04-24T23:39:46.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.664+0000 7fb635c4c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb6300c2d00 0x7fb630151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:46.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.664+0000 7fb636c4e640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb6300bd5f0 0x7fb63006d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:41194/0 (socket says 172.21.15.57:41194) 2024-04-24T23:39:46.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.664+0000 7fb636c4e640 1 -- 172.21.15.57:0/3614280706 learned_addr learned my addr 172.21.15.57:0/3614280706 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:46.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.664+0000 7fb635c4c640 1 --2- 172.21.15.57:0/3614280706 >> v2:172.21.15.57:3300/0 conn(0x7fb6300c2d00 0x7fb630151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40230/0 (socket says 172.21.15.57:40230) 2024-04-24T23:39:46.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.664+0000 7fb635c4c640 1 -- 172.21.15.57:0/3614280706 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb63014bc60 msgr2=0x7fb6300c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:46.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.664+0000 7fb63644d640 1 --2- 172.21.15.57:0/3614280706 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb63014bc60 0x7fb6300c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:46.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.664+0000 7fb635c4c640 1 --2- 172.21.15.57:0/3614280706 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb63014bc60 0x7fb6300c27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.664+0000 7fb635c4c640 1 -- 172.21.15.57:0/3614280706 >> v1:172.21.15.57:6789/0 conn(0x7fb6300bd5f0 legacy=0x7fb63006d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:46.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.664+0000 7fb635c4c640 1 -- 172.21.15.57:0/3614280706 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6300be350 con 0x7fb6300c2d00 2024-04-24T23:39:46.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.664+0000 7fb63544b640 1 -- 172.21.15.57:0/3614280706 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3787612962 0 0) 0x7fb6300bd200 con 0x7fb6300bd5f0 2024-04-24T23:39:46.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.664+0000 7fb63644d640 1 --2- 172.21.15.57:0/3614280706 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb63014bc60 0x7fb6300c27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:39:46.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.664+0000 7fb635c4c640 1 --2- 172.21.15.57:0/3614280706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6300c2d00 0x7fb630151c20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb6200097c0 tx=0x7fb62001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e46d1a01dbe2b04 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:46.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.664+0000 7fb63544b640 1 -- 172.21.15.57:0/3614280706 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6200b0070 con 0x7fb6300c2d00 2024-04-24T23:39:46.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.664+0000 7fb63544b640 1 -- 172.21.15.57:0/3614280706 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6200ab600 con 0x7fb6300c2d00 2024-04-24T23:39:46.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.664+0000 7fb63544b640 1 -- 172.21.15.57:0/3614280706 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6200a4e60 con 0x7fb6300c2d00 2024-04-24T23:39:46.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb6386b1640 1 -- 172.21.15.57:0/3614280706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6300c2d00 msgr2=0x7fb630151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:46.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb6386b1640 1 --2- 172.21.15.57:0/3614280706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6300c2d00 0x7fb630151c20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb6200097c0 tx=0x7fb62001c380 comp rx=0 tx=0).stop 2024-04-24T23:39:46.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb6386b1640 1 -- 172.21.15.57:0/3614280706 shutdown_connections 2024-04-24T23:39:46.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb6386b1640 1 --2- 172.21.15.57:0/3614280706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6300c2d00 0x7fb630151c20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb6386b1640 1 --2- 172.21.15.57:0/3614280706 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb63014bc60 0x7fb6300c27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb6386b1640 1 -- 172.21.15.57:0/3614280706 >> 172.21.15.57:0/3614280706 conn(0x7fb63006b920 msgr2=0x7fb6300c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:46.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb6386b1640 1 -- 172.21.15.57:0/3614280706 shutdown_connections 2024-04-24T23:39:46.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb6386b1640 1 -- 172.21.15.57:0/3614280706 wait complete. 2024-04-24T23:39:46.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb6386b1640 1 Processor -- start 2024-04-24T23:39:46.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb6386b1640 1 -- start start 2024-04-24T23:39:46.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb6386b1640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb6300bd5f0 0x7fb6300bff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:46.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb6386b1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6300c2d00 0x7fb63014c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:46.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb6386b1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb63014bc60 0x7fb6300c0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:46.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb6386b1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb6300bcfe0 con 0x7fb6300c2d00 2024-04-24T23:39:46.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb6386b1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb6300bce60 con 0x7fb63014bc60 2024-04-24T23:39:46.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb6386b1640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fb63015bfb0 con 0x7fb6300bd5f0 2024-04-24T23:39:46.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb635c4c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6300c2d00 0x7fb63014c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:46.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb635c4c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6300c2d00 0x7fb63014c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40236/0 (socket says 172.21.15.57:40236) 2024-04-24T23:39:46.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb635c4c640 1 -- 172.21.15.57:0/581403308 learned_addr learned my addr 172.21.15.57:0/581403308 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:46.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb635c4c640 1 -- 172.21.15.57:0/581403308 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb6300bd5f0 msgr2=0x7fb6300bff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:46.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb635c4c640 1 --2- 172.21.15.57:0/581403308 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb6300bd5f0 0x7fb6300bff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb635c4c640 1 -- 172.21.15.57:0/581403308 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb63014bc60 msgr2=0x7fb6300c0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:46.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb635c4c640 1 --2- 172.21.15.57:0/581403308 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb63014bc60 0x7fb6300c0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb635c4c640 1 -- 172.21.15.57:0/581403308 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6300c1090 con 0x7fb6300c2d00 2024-04-24T23:39:46.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb635c4c640 1 --2- 172.21.15.57:0/581403308 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6300c2d00 0x7fb63014c520 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb6200ae040 tx=0x7fb62001abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:46.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb626ffd640 1 -- 172.21.15.57:0/581403308 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6200bc070 con 0x7fb6300c2d00 2024-04-24T23:39:46.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb626ffd640 1 -- 172.21.15.57:0/581403308 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6200b1040 con 0x7fb6300c2d00 2024-04-24T23:39:46.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb626ffd640 1 -- 172.21.15.57:0/581403308 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6200b0050 con 0x7fb6300c2d00 2024-04-24T23:39:46.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb6386b1640 1 -- 172.21.15.57:0/581403308 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6300c1870 con 0x7fb6300c2d00 2024-04-24T23:39:46.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb6386b1640 1 -- 172.21.15.57:0/581403308 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6301e73e0 con 0x7fb6300c2d00 2024-04-24T23:39:46.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.668+0000 7fb6386b1640 1 -- 172.21.15.57:0/581403308 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb630068290 con 0x7fb6300c2d00 2024-04-24T23:39:46.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.672+0000 7fb626ffd640 1 -- 172.21.15.57:0/581403308 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb620004250 con 0x7fb6300c2d00 2024-04-24T23:39:46.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.672+0000 7fb626ffd640 1 --2- 172.21.15.57:0/581403308 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fb6140678f0 0x7fb614069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:46.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.672+0000 7fb626ffd640 1 -- 172.21.15.57:0/581403308 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fb62011fb00 con 0x7fb6300c2d00 2024-04-24T23:39:46.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.672+0000 7fb63644d640 1 --2- 172.21.15.57:0/581403308 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fb6140678f0 0x7fb614069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:46.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.672+0000 7fb63644d640 1 --2- 172.21.15.57:0/581403308 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fb6140678f0 0x7fb614069db0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb62800a890 tx=0x7fb628008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:46.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.676+0000 7fb626ffd640 1 -- 172.21.15.57:0/581403308 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fb6300c1090 con 0x7fb6300c2d00 2024-04-24T23:39:46.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.832+0000 7fb6386b1640 1 -- 172.21.15.57:0/581403308 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb63006ef70 con 0x7fb6300c2d00 2024-04-24T23:39:46.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.832+0000 7fb626ffd640 1 -- 172.21.15.57:0/581403308 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fb620016090 con 0x7fb6300c2d00 2024-04-24T23:39:46.835 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-24T23:39:46.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.836+0000 7fb6386b1640 1 -- 172.21.15.57:0/581403308 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fb6140678f0 msgr2=0x7fb614069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:46.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.836+0000 7fb6386b1640 1 --2- 172.21.15.57:0/581403308 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fb6140678f0 0x7fb614069db0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb62800a890 tx=0x7fb628008040 comp rx=0 tx=0).stop 2024-04-24T23:39:46.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.836+0000 7fb6386b1640 1 -- 172.21.15.57:0/581403308 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6300c2d00 msgr2=0x7fb63014c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:46.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.836+0000 7fb6386b1640 1 --2- 172.21.15.57:0/581403308 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6300c2d00 0x7fb63014c520 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb6200ae040 tx=0x7fb62001abc0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.836+0000 7fb6386b1640 1 -- 172.21.15.57:0/581403308 shutdown_connections 2024-04-24T23:39:46.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.836+0000 7fb6386b1640 1 --2- 172.21.15.57:0/581403308 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fb6140678f0 0x7fb614069db0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.836+0000 7fb6386b1640 1 --2- 172.21.15.57:0/581403308 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb63014bc60 0x7fb6300c0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.836+0000 7fb6386b1640 1 --2- 172.21.15.57:0/581403308 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6300c2d00 0x7fb63014c520 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.836+0000 7fb6386b1640 1 --2- 172.21.15.57:0/581403308 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb6300bd5f0 0x7fb6300bff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.836+0000 7fb6386b1640 1 -- 172.21.15.57:0/581403308 >> 172.21.15.57:0/581403308 conn(0x7fb63006b920 msgr2=0x7fb6301591d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:46.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.836+0000 7fb6386b1640 1 -- 172.21.15.57:0/581403308 shutdown_connections 2024-04-24T23:39:46.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.836+0000 7fb6386b1640 1 -- 172.21.15.57:0/581403308 wait complete. 2024-04-24T23:39:46.853 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-24T23:39:46.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.976+0000 7f854a7c6640 1 Processor -- start 2024-04-24T23:39:46.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.976+0000 7f854a7c6640 1 -- start start 2024-04-24T23:39:46.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.976+0000 7f854a7c6640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f854414bc60 0x7f85440c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:46.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.976+0000 7f854a7c6640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f85440c2d00 0x7f8544151c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:46.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.976+0000 7f854a7c6640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85440bd200 con 0x7f85440bd5f0 2024-04-24T23:39:46.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.976+0000 7f854a7c6640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f85440bde20 con 0x7f85440c2d00 2024-04-24T23:39:46.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.976+0000 7f854a7c6640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f85440be070 con 0x7f854414bc60 2024-04-24T23:39:46.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.976+0000 7f85437fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f85440c2d00 0x7f8544151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:46.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.976+0000 7f8548d63640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f85440bd5f0 0x7f854406d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:41200/0 (socket says 172.21.15.57:41200) 2024-04-24T23:39:46.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.976+0000 7f8548d63640 1 -- 172.21.15.57:0/1874776285 learned_addr learned my addr 172.21.15.57:0/1874776285 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:46.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.976+0000 7f8543fff640 1 --2- 172.21.15.57:0/1874776285 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f854414bc60 0x7f85440c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:46.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.976+0000 7f85437fe640 1 -- 172.21.15.57:0/1874776285 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f854414bc60 msgr2=0x7f85440c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:46.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.976+0000 7f85437fe640 1 --2- 172.21.15.57:0/1874776285 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f854414bc60 0x7f85440c27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.976+0000 7f85437fe640 1 -- 172.21.15.57:0/1874776285 >> v1:172.21.15.57:6789/0 conn(0x7f85440bd5f0 legacy=0x7f854406d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:46.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.976+0000 7f8542ffd640 1 -- 172.21.15.57:0/1874776285 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3727047405 0 0) 0x7f85440bd200 con 0x7f85440bd5f0 2024-04-24T23:39:46.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.976+0000 7f85437fe640 1 -- 172.21.15.57:0/1874776285 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85440be350 con 0x7f85440c2d00 2024-04-24T23:39:46.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.980+0000 7f85437fe640 1 --2- 172.21.15.57:0/1874776285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85440c2d00 0x7f8544151c20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f85380097c0 tx=0x7f853801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8344477be2532e63 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:46.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.980+0000 7f8542ffd640 1 -- 172.21.15.57:0/1874776285 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85380b0070 con 0x7f85440c2d00 2024-04-24T23:39:46.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.980+0000 7f8542ffd640 1 -- 172.21.15.57:0/1874776285 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85380ab600 con 0x7f85440c2d00 2024-04-24T23:39:46.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.980+0000 7f8542ffd640 1 -- 172.21.15.57:0/1874776285 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85380a4e60 con 0x7f85440c2d00 2024-04-24T23:39:46.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.980+0000 7f854a7c6640 1 -- 172.21.15.57:0/1874776285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85440c2d00 msgr2=0x7f8544151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:46.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.980+0000 7f854a7c6640 1 --2- 172.21.15.57:0/1874776285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85440c2d00 0x7f8544151c20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f85380097c0 tx=0x7f853801c380 comp rx=0 tx=0).stop 2024-04-24T23:39:46.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.980+0000 7f854a7c6640 1 -- 172.21.15.57:0/1874776285 shutdown_connections 2024-04-24T23:39:46.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.980+0000 7f854a7c6640 1 --2- 172.21.15.57:0/1874776285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85440c2d00 0x7f8544151c20 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.980+0000 7f854a7c6640 1 --2- 172.21.15.57:0/1874776285 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f854414bc60 0x7f85440c27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.980+0000 7f854a7c6640 1 -- 172.21.15.57:0/1874776285 >> 172.21.15.57:0/1874776285 conn(0x7f854406b920 msgr2=0x7f85440c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:46.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.980+0000 7f854a7c6640 1 -- 172.21.15.57:0/1874776285 shutdown_connections 2024-04-24T23:39:46.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.980+0000 7f854a7c6640 1 -- 172.21.15.57:0/1874776285 wait complete. 2024-04-24T23:39:46.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.980+0000 7f854a7c6640 1 Processor -- start 2024-04-24T23:39:46.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.980+0000 7f854a7c6640 1 -- start start 2024-04-24T23:39:46.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.980+0000 7f854a7c6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85440bd5f0 0x7f85440bb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:46.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.980+0000 7f854a7c6640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f85440c2d00 0x7f85441ecdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:46.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.980+0000 7f854a7c6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f854414bc60 0x7f854413f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:46.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.980+0000 7f854a7c6640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f85440bcfe0 con 0x7f85440bd5f0 2024-04-24T23:39:46.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.980+0000 7f854a7c6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f85440bce60 con 0x7f854414bc60 2024-04-24T23:39:46.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.984+0000 7f854a7c6640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f854415bfb0 con 0x7f85440c2d00 2024-04-24T23:39:46.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.984+0000 7f8543fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85440bd5f0 0x7f85440bb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:46.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.984+0000 7f8543fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85440bd5f0 0x7f85440bb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40260/0 (socket says 172.21.15.57:40260) 2024-04-24T23:39:46.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.984+0000 7f8543fff640 1 -- 172.21.15.57:0/4141843563 learned_addr learned my addr 172.21.15.57:0/4141843563 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:46.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.984+0000 7f8548d63640 1 --2- 172.21.15.57:0/4141843563 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f854414bc60 0x7f854413f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:46.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.984+0000 7f8543fff640 1 -- 172.21.15.57:0/4141843563 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f85440c2d00 msgr2=0x7f85441ecdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:46.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.984+0000 7f85437fe640 1 --2- 172.21.15.57:0/4141843563 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f85440c2d00 0x7f85441ecdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:46.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.984+0000 7f8543fff640 1 --2- 172.21.15.57:0/4141843563 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f85440c2d00 0x7f85441ecdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.984+0000 7f8543fff640 1 -- 172.21.15.57:0/4141843563 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f854414bc60 msgr2=0x7f854413f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:46.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.984+0000 7f8543fff640 1 --2- 172.21.15.57:0/4141843563 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f854414bc60 0x7f854413f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:46.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.984+0000 7f8543fff640 1 -- 172.21.15.57:0/4141843563 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85440bbc80 con 0x7f85440bd5f0 2024-04-24T23:39:46.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.984+0000 7f8543fff640 1 --2- 172.21.15.57:0/4141843563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85440bd5f0 0x7f85440bb740 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f853c007e40 tx=0x7f853c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:46.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.984+0000 7f8540ff9640 1 -- 172.21.15.57:0/4141843563 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c014620 con 0x7f85440bd5f0 2024-04-24T23:39:46.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.984+0000 7f8540ff9640 1 -- 172.21.15.57:0/4141843563 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f853c019070 con 0x7f85440bd5f0 2024-04-24T23:39:46.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.984+0000 7f854a7c6640 1 -- 172.21.15.57:0/4141843563 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f854406eb70 con 0x7f85440bd5f0 2024-04-24T23:39:46.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.984+0000 7f8540ff9640 1 -- 172.21.15.57:0/4141843563 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c014a00 con 0x7f85440bd5f0 2024-04-24T23:39:46.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.984+0000 7f854a7c6640 1 -- 172.21.15.57:0/4141843563 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8544071e30 con 0x7f85440bd5f0 2024-04-24T23:39:46.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.984+0000 7f854a7c6640 1 -- 172.21.15.57:0/4141843563 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85440717b0 con 0x7f85440bd5f0 2024-04-24T23:39:46.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.984+0000 7f8540ff9640 1 -- 172.21.15.57:0/4141843563 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f853c014ba0 con 0x7f85440bd5f0 2024-04-24T23:39:46.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.984+0000 7f8540ff9640 1 --2- 172.21.15.57:0/4141843563 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f85300678f0 0x7f8530069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:46.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.984+0000 7f8540ff9640 1 -- 172.21.15.57:0/4141843563 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f853c086940 con 0x7f85440bd5f0 2024-04-24T23:39:46.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.984+0000 7f85437fe640 1 --2- 172.21.15.57:0/4141843563 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f85300678f0 0x7f8530069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:46.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.984+0000 7f85437fe640 1 --2- 172.21.15.57:0/4141843563 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f85300678f0 0x7f8530069db0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f85380ad000 tx=0x7f8538008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:46.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:46.988+0000 7f8540ff9640 1 -- 172.21.15.57:0/4141843563 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f85440717b0 con 0x7f85440bd5f0 2024-04-24T23:39:47.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.144+0000 7f854a7c6640 1 -- 172.21.15.57:0/4141843563 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f8544068290 con 0x7f85440bd5f0 2024-04-24T23:39:47.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.144+0000 7f8540ff9640 1 -- 172.21.15.57:0/4141843563 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f85440bbc80 con 0x7f85440bd5f0 2024-04-24T23:39:47.147 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-04-24T23:39:47.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.148+0000 7f854a7c6640 1 -- 172.21.15.57:0/4141843563 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f85300678f0 msgr2=0x7f8530069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:47.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.148+0000 7f854a7c6640 1 --2- 172.21.15.57:0/4141843563 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f85300678f0 0x7f8530069db0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f85380ad000 tx=0x7f8538008040 comp rx=0 tx=0).stop 2024-04-24T23:39:47.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.148+0000 7f854a7c6640 1 -- 172.21.15.57:0/4141843563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85440bd5f0 msgr2=0x7f85440bb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:47.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.148+0000 7f854a7c6640 1 --2- 172.21.15.57:0/4141843563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85440bd5f0 0x7f85440bb740 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f853c007e40 tx=0x7f853c00e4b0 comp rx=0 tx=0).stop 2024-04-24T23:39:47.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.148+0000 7f854a7c6640 1 -- 172.21.15.57:0/4141843563 shutdown_connections 2024-04-24T23:39:47.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.148+0000 7f854a7c6640 1 --2- 172.21.15.57:0/4141843563 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f85300678f0 0x7f8530069db0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:47.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.148+0000 7f854a7c6640 1 --2- 172.21.15.57:0/4141843563 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f854414bc60 0x7f854413f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:47.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.148+0000 7f854a7c6640 1 --2- 172.21.15.57:0/4141843563 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f85440c2d00 0x7f85441ecdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:47.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.148+0000 7f854a7c6640 1 --2- 172.21.15.57:0/4141843563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85440bd5f0 0x7f85440bb740 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:47.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.148+0000 7f854a7c6640 1 -- 172.21.15.57:0/4141843563 >> 172.21.15.57:0/4141843563 conn(0x7f854406b920 msgr2=0x7f854406d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:47.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.148+0000 7f854a7c6640 1 -- 172.21.15.57:0/4141843563 shutdown_connections 2024-04-24T23:39:47.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.148+0000 7f854a7c6640 1 -- 172.21.15.57:0/4141843563 wait complete. 2024-04-24T23:39:47.166 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:39:47.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.276+0000 7f9ca990c640 1 Processor -- start 2024-04-24T23:39:47.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.276+0000 7f9ca990c640 1 -- start start 2024-04-24T23:39:47.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.276+0000 7f9ca990c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9ca4070080 0x7f9ca4151210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:47.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.276+0000 7f9ca990c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9ca40bc590 0x7f9ca406f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:47.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.276+0000 7f9ca990c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ca4154a70 con 0x7f9ca406b210 2024-04-24T23:39:47.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.276+0000 7f9ca990c640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f9ca4070460 con 0x7f9ca40bc590 2024-04-24T23:39:47.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.276+0000 7f9ca990c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f9ca406ecf0 con 0x7f9ca4070080 2024-04-24T23:39:47.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.276+0000 7f9ca27fc640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9ca40bc590 0x7f9ca406f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:47.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.276+0000 7f9ca27fc640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9ca40bc590 0x7f9ca406f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40272/0 (socket says 172.21.15.57:40272) 2024-04-24T23:39:47.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.276+0000 7f9ca27fc640 1 -- 172.21.15.57:0/2281599433 learned_addr learned my addr 172.21.15.57:0/2281599433 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:47.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.276+0000 7f9ca2ffd640 1 --2- 172.21.15.57:0/2281599433 >> v2:172.21.15.88:3300/0 conn(0x7f9ca4070080 0x7f9ca4151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:47.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.276+0000 7f9ca27fc640 1 -- 172.21.15.57:0/2281599433 >> v2:172.21.15.88:3300/0 conn(0x7f9ca4070080 msgr2=0x7f9ca4151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:47.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.276+0000 7f9ca27fc640 1 --2- 172.21.15.57:0/2281599433 >> v2:172.21.15.88:3300/0 conn(0x7f9ca4070080 0x7f9ca4151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:47.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.276+0000 7f9ca27fc640 1 -- 172.21.15.57:0/2281599433 >> v1:172.21.15.88:6789/0 conn(0x7f9ca406b210 legacy=0x7f9ca4071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:47.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.276+0000 7f9ca27fc640 1 -- 172.21.15.57:0/2281599433 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca4150a10 con 0x7f9ca40bc590 2024-04-24T23:39:47.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.280+0000 7f9ca27fc640 1 --2- 172.21.15.57:0/2281599433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ca40bc590 0x7f9ca406f1f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9ca406bf20 tx=0x7f9c9001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf996ab183f5113e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:47.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.280+0000 7f9ca1ffb640 1 -- 172.21.15.57:0/2281599433 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c900b0070 con 0x7f9ca40bc590 2024-04-24T23:39:47.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.280+0000 7f9ca1ffb640 1 -- 172.21.15.57:0/2281599433 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c900ab600 con 0x7f9ca40bc590 2024-04-24T23:39:47.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.280+0000 7f9ca1ffb640 1 -- 172.21.15.57:0/2281599433 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c900ab9d0 con 0x7f9ca40bc590 2024-04-24T23:39:47.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.280+0000 7f9ca990c640 1 -- 172.21.15.57:0/2281599433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ca40bc590 msgr2=0x7f9ca406f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:47.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.280+0000 7f9ca990c640 1 --2- 172.21.15.57:0/2281599433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ca40bc590 0x7f9ca406f1f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9ca406bf20 tx=0x7f9c9001c520 comp rx=0 tx=0).stop 2024-04-24T23:39:47.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.280+0000 7f9ca990c640 1 -- 172.21.15.57:0/2281599433 shutdown_connections 2024-04-24T23:39:47.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.280+0000 7f9ca990c640 1 --2- 172.21.15.57:0/2281599433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ca40bc590 0x7f9ca406f1f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:47.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.280+0000 7f9ca990c640 1 --2- 172.21.15.57:0/2281599433 >> v2:172.21.15.88:3300/0 conn(0x7f9ca4070080 0x7f9ca4151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:47.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.280+0000 7f9ca990c640 1 -- 172.21.15.57:0/2281599433 >> 172.21.15.57:0/2281599433 conn(0x7f9ca40c2e70 msgr2=0x7f9ca40c3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:47.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.280+0000 7f9ca990c640 1 -- 172.21.15.57:0/2281599433 shutdown_connections 2024-04-24T23:39:47.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.280+0000 7f9ca990c640 1 -- 172.21.15.57:0/2281599433 wait complete. 2024-04-24T23:39:47.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.280+0000 7f9ca990c640 1 Processor -- start 2024-04-24T23:39:47.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.280+0000 7f9ca990c640 1 -- start start 2024-04-24T23:39:47.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.284+0000 7f9ca990c640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ca406b210 0x7f9ca4144e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:47.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.284+0000 7f9ca990c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ca4070080 0x7f9ca4149b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:47.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.284+0000 7f9ca990c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ca40bc590 0x7f9ca4144270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:47.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.284+0000 7f9ca990c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca4154830 con 0x7f9ca4070080 2024-04-24T23:39:47.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.284+0000 7f9ca990c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca41546b0 con 0x7f9ca40bc590 2024-04-24T23:39:47.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.284+0000 7f9ca990c640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f9ca406f730 con 0x7f9ca406b210 2024-04-24T23:39:47.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.284+0000 7f9ca27fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ca4070080 0x7f9ca4149b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:47.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.284+0000 7f9ca27fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ca4070080 0x7f9ca4149b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40274/0 (socket says 172.21.15.57:40274) 2024-04-24T23:39:47.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.284+0000 7f9ca27fc640 1 -- 172.21.15.57:0/2439362991 learned_addr learned my addr 172.21.15.57:0/2439362991 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:47.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.284+0000 7f9ca27fc640 1 -- 172.21.15.57:0/2439362991 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ca406b210 msgr2=0x7f9ca4144e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:47.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.284+0000 7f9ca27fc640 1 --2- 172.21.15.57:0/2439362991 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ca406b210 0x7f9ca4144e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:47.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.284+0000 7f9ca27fc640 1 -- 172.21.15.57:0/2439362991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ca40bc590 msgr2=0x7f9ca4144270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:47.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.284+0000 7f9ca27fc640 1 --2- 172.21.15.57:0/2439362991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ca40bc590 0x7f9ca4144270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:47.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.284+0000 7f9ca27fc640 1 -- 172.21.15.57:0/2439362991 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca40c01d0 con 0x7f9ca4070080 2024-04-24T23:39:47.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.284+0000 7f9ca27fc640 1 --2- 172.21.15.57:0/2439362991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ca4070080 0x7f9ca4149b20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9c900ae040 tx=0x7f9c900192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:47.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.284+0000 7f9c9bfff640 1 -- 172.21.15.57:0/2439362991 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c900b0040 con 0x7f9ca4070080 2024-04-24T23:39:47.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.284+0000 7f9c9bfff640 1 -- 172.21.15.57:0/2439362991 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c900ab400 con 0x7f9ca4070080 2024-04-24T23:39:47.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.284+0000 7f9c9bfff640 1 -- 172.21.15.57:0/2439362991 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c900b6640 con 0x7f9ca4070080 2024-04-24T23:39:47.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.284+0000 7f9ca990c640 1 -- 172.21.15.57:0/2439362991 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca4073590 con 0x7f9ca4070080 2024-04-24T23:39:47.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.284+0000 7f9ca990c640 1 -- 172.21.15.57:0/2439362991 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca4146ef0 con 0x7f9ca4070080 2024-04-24T23:39:47.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.284+0000 7f9ca990c640 1 -- 172.21.15.57:0/2439362991 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ca4068930 con 0x7f9ca4070080 2024-04-24T23:39:47.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.284+0000 7f9c9bfff640 1 -- 172.21.15.57:0/2439362991 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9c900be020 con 0x7f9ca4070080 2024-04-24T23:39:47.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.284+0000 7f9c9bfff640 1 --2- 172.21.15.57:0/2439362991 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f9c8c0678c0 0x7f9c8c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:47.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.284+0000 7f9c9bfff640 1 -- 172.21.15.57:0/2439362991 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f9c9011fcb0 con 0x7f9ca4070080 2024-04-24T23:39:47.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.284+0000 7f9ca2ffd640 1 --2- 172.21.15.57:0/2439362991 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f9c8c0678c0 0x7f9c8c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:47.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.288+0000 7f9ca2ffd640 1 --2- 172.21.15.57:0/2439362991 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f9c8c0678c0 0x7f9c8c069d80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c0070b0 tx=0x7f9c9c007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:47.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.288+0000 7f9c9bfff640 1 -- 172.21.15.57:0/2439362991 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f9c90016110 con 0x7f9ca4070080 2024-04-24T23:39:47.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.464+0000 7f9ca990c640 1 -- 172.21.15.57:0/2439362991 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9ca40bc370 con 0x7f9ca4070080 2024-04-24T23:39:47.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.464+0000 7f9c9bfff640 1 -- 172.21.15.57:0/2439362991 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f9c900f03f0 con 0x7f9ca4070080 2024-04-24T23:39:47.465 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2024-04-24T23:39:47.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.464+0000 7f9ca990c640 1 -- 172.21.15.57:0/2439362991 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f9c8c0678c0 msgr2=0x7f9c8c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:47.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.464+0000 7f9ca990c640 1 --2- 172.21.15.57:0/2439362991 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f9c8c0678c0 0x7f9c8c069d80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c0070b0 tx=0x7f9c9c007040 comp rx=0 tx=0).stop 2024-04-24T23:39:47.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.464+0000 7f9ca990c640 1 -- 172.21.15.57:0/2439362991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ca4070080 msgr2=0x7f9ca4149b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:47.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.464+0000 7f9ca990c640 1 --2- 172.21.15.57:0/2439362991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ca4070080 0x7f9ca4149b20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9c900ae040 tx=0x7f9c900192c0 comp rx=0 tx=0).stop 2024-04-24T23:39:47.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.464+0000 7f9ca990c640 1 -- 172.21.15.57:0/2439362991 shutdown_connections 2024-04-24T23:39:47.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.464+0000 7f9ca990c640 1 --2- 172.21.15.57:0/2439362991 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f9c8c0678c0 0x7f9c8c069d80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:47.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.464+0000 7f9ca990c640 1 --2- 172.21.15.57:0/2439362991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ca40bc590 0x7f9ca4144270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:47.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.464+0000 7f9ca990c640 1 --2- 172.21.15.57:0/2439362991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ca4070080 0x7f9ca4149b20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:47.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.464+0000 7f9ca990c640 1 --2- 172.21.15.57:0/2439362991 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ca406b210 0x7f9ca4144e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:47.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.464+0000 7f9ca990c640 1 -- 172.21.15.57:0/2439362991 >> 172.21.15.57:0/2439362991 conn(0x7f9ca40c2e70 msgr2=0x7f9ca4153840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:47.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.464+0000 7f9ca990c640 1 -- 172.21.15.57:0/2439362991 shutdown_connections 2024-04-24T23:39:47.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:47.464+0000 7f9ca990c640 1 -- 172.21.15.57:0/2439362991 wait complete. 2024-04-24T23:39:47.483 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi116.front.sepia.ceph.com... 2024-04-24T23:39:47.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:39:47.484 DEBUG:teuthology.orchestra.run.smithi116:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-24T23:39:47.496 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi116.stderr:ceph-fuse[23030]: fuse finished with error 0 and tester_r 0 2024-04-24T23:39:47.498 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:39:53.599 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi116.front.sepia.ceph.com 2024-04-24T23:39:53.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:39:53.599 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-24T23:39:53.607 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-24T23:39:53.607 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:39:53.614 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-24T23:39:53.614 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:39:53.663 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:39:53.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.800+0000 7f093ffdc640 1 Processor -- start 2024-04-24T23:39:53.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.800+0000 7f093ffdc640 1 -- start start 2024-04-24T23:39:53.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.800+0000 7f093ffdc640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f09380bdbe0 0x7f09380b6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:53.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.800+0000 7f093ffdc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f09380b7510 0x7f0938159050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:53.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.800+0000 7f093ffdc640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f093814e8e0 con 0x7f093814bc60 2024-04-24T23:39:53.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.800+0000 7f093ffdc640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f0938152c20 con 0x7f09380bdbe0 2024-04-24T23:39:53.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.800+0000 7f093ffdc640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f093814ebc0 con 0x7f09380b7510 2024-04-24T23:39:53.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.800+0000 7f093d577640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f09380bdbe0 0x7f09380b6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:53.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.800+0000 7f093d577640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f09380bdbe0 0x7f09380b6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35692/0 (socket says 172.21.15.57:35692) 2024-04-24T23:39:53.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.800+0000 7f093d577640 1 -- 172.21.15.57:0/3950495750 learned_addr learned my addr 172.21.15.57:0/3950495750 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:53.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.800+0000 7f093e579640 1 --2- 172.21.15.57:0/3950495750 >> v2:172.21.15.88:3300/0 conn(0x7f09380b7510 0x7f0938159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:53.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.800+0000 7f093d577640 1 -- 172.21.15.57:0/3950495750 >> v2:172.21.15.88:3300/0 conn(0x7f09380b7510 msgr2=0x7f0938159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:53.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.800+0000 7f093d577640 1 --2- 172.21.15.57:0/3950495750 >> v2:172.21.15.88:3300/0 conn(0x7f09380b7510 0x7f0938159050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:53.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.800+0000 7f093d577640 1 -- 172.21.15.57:0/3950495750 >> v1:172.21.15.88:6789/0 conn(0x7f093814bc60 legacy=0x7f093806eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:53.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.800+0000 7f093d577640 1 -- 172.21.15.57:0/3950495750 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f093806f260 con 0x7f09380bdbe0 2024-04-24T23:39:53.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.800+0000 7f093e579640 1 --2- 172.21.15.57:0/3950495750 >> v2:172.21.15.88:3300/0 conn(0x7f09380b7510 0x7f0938159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:39:53.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.804+0000 7f093d577640 1 --2- 172.21.15.57:0/3950495750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09380bdbe0 0x7f09380b6fd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f093806d390 tx=0x7f092801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b72f53842cc728 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:53.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.804+0000 7f093cd76640 1 -- 172.21.15.57:0/3950495750 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09280b0070 con 0x7f09380bdbe0 2024-04-24T23:39:53.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.804+0000 7f093cd76640 1 -- 172.21.15.57:0/3950495750 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09280ab600 con 0x7f09380bdbe0 2024-04-24T23:39:53.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.804+0000 7f093cd76640 1 -- 172.21.15.57:0/3950495750 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09280ab9d0 con 0x7f09380bdbe0 2024-04-24T23:39:53.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.804+0000 7f093ffdc640 1 -- 172.21.15.57:0/3950495750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09380bdbe0 msgr2=0x7f09380b6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:53.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.804+0000 7f093ffdc640 1 --2- 172.21.15.57:0/3950495750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09380bdbe0 0x7f09380b6fd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f093806d390 tx=0x7f092801c4e0 comp rx=0 tx=0).stop 2024-04-24T23:39:53.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.804+0000 7f093ffdc640 1 -- 172.21.15.57:0/3950495750 shutdown_connections 2024-04-24T23:39:53.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.804+0000 7f093ffdc640 1 --2- 172.21.15.57:0/3950495750 >> v2:172.21.15.88:3300/0 conn(0x7f09380b7510 0x7f0938159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:53.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.804+0000 7f093ffdc640 1 --2- 172.21.15.57:0/3950495750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09380bdbe0 0x7f09380b6fd0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:53.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.804+0000 7f093ffdc640 1 -- 172.21.15.57:0/3950495750 >> 172.21.15.57:0/3950495750 conn(0x7f09380beab0 msgr2=0x7f09380beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:53.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.804+0000 7f093ffdc640 1 -- 172.21.15.57:0/3950495750 shutdown_connections 2024-04-24T23:39:53.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.804+0000 7f093ffdc640 1 -- 172.21.15.57:0/3950495750 wait complete. 2024-04-24T23:39:53.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.804+0000 7f093ffdc640 1 Processor -- start 2024-04-24T23:39:53.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.804+0000 7f093ffdc640 1 -- start start 2024-04-24T23:39:53.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.804+0000 7f093ffdc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09380b7510 0x7f093813f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:53.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.804+0000 7f093ffdc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09380bdbe0 0x7f093814fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:53.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.804+0000 7f093ffdc640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f093814bc60 0x7f0938150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:53.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.804+0000 7f093ffdc640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f093815bf30 con 0x7f09380bdbe0 2024-04-24T23:39:53.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.804+0000 7f093ffdc640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f093815bdb0 con 0x7f09380b7510 2024-04-24T23:39:53.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.804+0000 7f093ffdc640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f093815c0b0 con 0x7f093814bc60 2024-04-24T23:39:53.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.804+0000 7f093d577640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09380bdbe0 0x7f093814fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:53.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.804+0000 7f093d577640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09380bdbe0 0x7f093814fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35704/0 (socket says 172.21.15.57:35704) 2024-04-24T23:39:53.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.804+0000 7f093d577640 1 -- 172.21.15.57:0/2118359799 learned_addr learned my addr 172.21.15.57:0/2118359799 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:53.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.808+0000 7f093dd78640 1 --2- 172.21.15.57:0/2118359799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09380b7510 0x7f093813f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:53.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.808+0000 7f093e579640 1 --2- 172.21.15.57:0/2118359799 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f093814bc60 0x7f0938150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:53.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.808+0000 7f093d577640 1 -- 172.21.15.57:0/2118359799 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f093814bc60 msgr2=0x7f0938150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:53.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.808+0000 7f093d577640 1 --2- 172.21.15.57:0/2118359799 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f093814bc60 0x7f0938150000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:53.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.808+0000 7f093d577640 1 -- 172.21.15.57:0/2118359799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09380b7510 msgr2=0x7f093813f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:53.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.808+0000 7f093d577640 1 --2- 172.21.15.57:0/2118359799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09380b7510 0x7f093813f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:53.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.808+0000 7f093d577640 1 -- 172.21.15.57:0/2118359799 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09380bfef0 con 0x7f09380bdbe0 2024-04-24T23:39:53.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.808+0000 7f093dd78640 1 --2- 172.21.15.57:0/2118359799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09380b7510 0x7f093813f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:39:53.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.808+0000 7f093d577640 1 --2- 172.21.15.57:0/2118359799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09380bdbe0 0x7f093814fac0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f092801ab90 tx=0x7f092801ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:53.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.808+0000 7f092e7fc640 1 -- 172.21.15.57:0/2118359799 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09280ba020 con 0x7f09380bdbe0 2024-04-24T23:39:53.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.808+0000 7f092e7fc640 1 -- 172.21.15.57:0/2118359799 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09280b6640 con 0x7f09380bdbe0 2024-04-24T23:39:53.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.808+0000 7f092e7fc640 1 -- 172.21.15.57:0/2118359799 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09280b0040 con 0x7f09380bdbe0 2024-04-24T23:39:53.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.808+0000 7f093ffdc640 1 -- 172.21.15.57:0/2118359799 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f093813f790 con 0x7f09380bdbe0 2024-04-24T23:39:53.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.808+0000 7f093ffdc640 1 -- 172.21.15.57:0/2118359799 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0938150ed0 con 0x7f09380bdbe0 2024-04-24T23:39:53.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.808+0000 7f093ffdc640 1 -- 172.21.15.57:0/2118359799 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0938068220 con 0x7f09380bdbe0 2024-04-24T23:39:53.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.808+0000 7f092e7fc640 1 -- 172.21.15.57:0/2118359799 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f09280bd020 con 0x7f09380bdbe0 2024-04-24T23:39:53.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.808+0000 7f092e7fc640 1 --2- 172.21.15.57:0/2118359799 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f091c0678f0 0x7f091c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:53.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.808+0000 7f092e7fc640 1 -- 172.21.15.57:0/2118359799 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f09281202c0 con 0x7f09380bdbe0 2024-04-24T23:39:53.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.808+0000 7f093dd78640 1 --2- 172.21.15.57:0/2118359799 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f091c0678f0 0x7f091c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:53.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.812+0000 7f093dd78640 1 --2- 172.21.15.57:0/2118359799 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f091c0678f0 0x7f091c069db0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f09340098b0 tx=0x7f0934008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:53.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.812+0000 7f092e7fc640 1 -- 172.21.15.57:0/2118359799 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f09280c4030 con 0x7f09380bdbe0 2024-04-24T23:39:53.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.976+0000 7f093ffdc640 1 -- 172.21.15.57:0/2118359799 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f093814acc0 con 0x7f09380bdbe0 2024-04-24T23:39:53.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.980+0000 7f092e7fc640 1 -- 172.21.15.57:0/2118359799 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18853 (secure 0 0 0) 0x7f093813f790 con 0x7f09380bdbe0 2024-04-24T23:39:53.982 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:39:53.982 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"fsid":"1ea31698-444a-4667-bcd9-b2608ad103c3","created":"2024-04-24T23:38:16.748774+0000","modified":"2024-04-24T23:39:22.806760+0000","last_up_change":"2024-04-24T23:38:26.956537+0000","last_in_change":"2024-04-24T23:38:18.972175+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:38:27.611782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:38:31.718061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:38:32.469413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:38:36.215724+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"35ce67bc-9b25-416e-ab1e-774c717631f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6825","nonce":671364028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6827","nonce":671364028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6831","nonce":671364028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6829","nonce":671364028}]},"public_addr":"172.21.15.57:6825/671364028","cluster_addr":"172.21.15.57:6827/671364028","heartbeat_back_addr":"172.21.15.57:6831/671364028","heartbeat_front_addr":"172.21.15.57:6829/671364028","state":["exists","up"]},{"osd":1,"uuid":"38f6f4ef-3bc2-4453-9946-7d1d17e735ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6801","nonce":2653552037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6803","nonce":2653552037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6807","nonce":2653552037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6805","nonce":2653552037}]},"public_addr":"172.21.15.57:6801/2653552037","cluster_addr":"172.21.15.57:6803/2653552037","heartbeat_back_addr":"172.21.15.57:6807/2653552037","heartbeat_front_addr":"172.21.15.57:6805/2653552037","state":["exists","up"]},{"osd":2,"uuid":"d77a0a49-b39a-464e-a1c9-49e19280c440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6816","nonce":1565874109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6819","nonce":1565874109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6823","nonce":1565874109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6821","nonce":1565874109}]},"public_addr":"172.21.15.57:6816/1565874109","cluster_addr":"172.21.15.57:6819/1565874109","heartbeat_back_addr":"172.21.15.57:6823/1565874109","heartbeat_front_addr":"172.21.15.57:6821/1565874109","state":["exists","up"]},{"osd":3,"uuid":"f8ea9bfe-d839-44a6-a185-0f0985da314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6809","nonce":3474703186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6811","nonce":3474703186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6817","nonce":3474703186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6813","nonce":3474703186}]},"public_addr":"172.21.15.57:6809/3474703186","cluster_addr":"172.21.15.57:6811/3474703186","heartbeat_back_addr":"172.21.15.57:6817/3474703186","heartbeat_front_addr":"172.21.15.57:6813/3474703186","state":["exists","up"]},{"osd":4,"uuid":"454647d4-6ac2-46b4-8451-320eb951a87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6801","nonce":1271707713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6803","nonce":1271707713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6807","nonce":1271707713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6805","nonce":1271707713}]},"public_addr":"172.21.15.88:6801/1271707713","cluster_addr":"172.21.15.88:6803/1271707713","heartbeat_back_addr":"172.21.15.88:6807/1271707713","heartbeat_front_addr":"172.21.15.88:6805/1271707713","state":["exists","up"]},{"osd":5,"uuid":"f71c03a3-7ad8-46d3-89c9-d61de102586b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6809","nonce":2035054888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6813","nonce":2035054888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6820","nonce":2035054888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6816","nonce":2035054888}]},"public_addr":"172.21.15.88:6809/2035054888","cluster_addr":"172.21.15.88:6813/2035054888","heartbeat_back_addr":"172.21.15.88:6820/2035054888","heartbeat_front_addr":"172.21.15.88:6816/2035054888","state":["exists","up"]},{"osd":6,"uuid":"ec7ae2b7-9cb4-4059-8f98-0022c9763f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6825","nonce":1752291242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6827","nonce":1752291242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6831","nonce":1752291242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6829","nonce":1752291242}]},"public_addr":"172.21.15.88:6825/1752291242","cluster_addr":"172.21.15.88:6827/1752291242","heartbeat_back_addr":"172.21.15.88:6831/1752291242","heartbeat_front_addr":"172.21.15.88:6829/1752291242","state":["exists","up"]},{"osd":7,"uuid":"c0ee7505-60c1-40ba-9902-47313a04dafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6812","nonce":1782800372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6817","nonce":1782800372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6823","nonce":1782800372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6821","nonce":1782800372}]},"public_addr":"172.21.15.88:6812/1782800372","cluster_addr":"172.21.15.88:6817/1782800372","heartbeat_back_addr":"172.21.15.88:6823/1782800372","heartbeat_front_addr":"172.21.15.88:6821/1782800372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.698562+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.682587+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.680197+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.561753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.011095+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.493320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.353451+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.423877+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:39:53.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.980+0000 7f093ffdc640 1 -- 172.21.15.57:0/2118359799 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f091c0678f0 msgr2=0x7f091c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:53.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.980+0000 7f093ffdc640 1 --2- 172.21.15.57:0/2118359799 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f091c0678f0 0x7f091c069db0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f09340098b0 tx=0x7f0934008040 comp rx=0 tx=0).stop 2024-04-24T23:39:53.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.980+0000 7f093ffdc640 1 -- 172.21.15.57:0/2118359799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09380bdbe0 msgr2=0x7f093814fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:53.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.980+0000 7f093ffdc640 1 --2- 172.21.15.57:0/2118359799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09380bdbe0 0x7f093814fac0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f092801ab90 tx=0x7f092801ad20 comp rx=0 tx=0).stop 2024-04-24T23:39:53.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.980+0000 7f093ffdc640 1 -- 172.21.15.57:0/2118359799 shutdown_connections 2024-04-24T23:39:53.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.980+0000 7f093ffdc640 1 --2- 172.21.15.57:0/2118359799 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f091c0678f0 0x7f091c069db0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:53.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.980+0000 7f093ffdc640 1 --2- 172.21.15.57:0/2118359799 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f093814bc60 0x7f0938150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:53.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.980+0000 7f093ffdc640 1 --2- 172.21.15.57:0/2118359799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09380bdbe0 0x7f093814fac0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:53.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.980+0000 7f093ffdc640 1 --2- 172.21.15.57:0/2118359799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09380b7510 0x7f093813f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:53.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.980+0000 7f093ffdc640 1 -- 172.21.15.57:0/2118359799 >> 172.21.15.57:0/2118359799 conn(0x7f09380beab0 msgr2=0x7f09380b79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:53.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.984+0000 7f093ffdc640 1 -- 172.21.15.57:0/2118359799 shutdown_connections 2024-04-24T23:39:53.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:53.984+0000 7f093ffdc640 1 -- 172.21.15.57:0/2118359799 wait complete. 2024-04-24T23:39:54.001 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:38:27.611782+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:38:31.718061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:38:32.469413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-24T23:38:36.215724+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-24T23:39:54.002 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:39:54.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.128+0000 7fd3884ad640 1 Processor -- start 2024-04-24T23:39:54.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.132+0000 7fd3884ad640 1 -- start start 2024-04-24T23:39:54.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.132+0000 7fd3884ad640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd3800bc3f0 0x7fd38014a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:54.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.132+0000 7fd3884ad640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3800be040 con 0x7fd38006ea40 2024-04-24T23:39:54.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.132+0000 7fd3884ad640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3800be320 con 0x7fd38014ade0 2024-04-24T23:39:54.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.132+0000 7fd3884ad640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fd38014b210 con 0x7fd3800bc3f0 2024-04-24T23:39:54.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.132+0000 7fd386249640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd38006ea40 0x7fd3801514f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:32846/0 (socket says 172.21.15.57:32846) 2024-04-24T23:39:54.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.132+0000 7fd386249640 1 -- 172.21.15.57:0/1535410336 learned_addr learned my addr 172.21.15.57:0/1535410336 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:54.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.132+0000 7fd385a48640 1 --2- 172.21.15.57:0/1535410336 >> v2:172.21.15.57:3300/0 conn(0x7fd3800bc3f0 0x7fd38014a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:54.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.132+0000 7fd385247640 1 -- 172.21.15.57:0/1535410336 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1008748691 0 0) 0x7fd3800be040 con 0x7fd38006ea40 2024-04-24T23:39:54.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.132+0000 7fd385247640 1 -- 172.21.15.57:0/1535410336 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd36c003530 con 0x7fd38006ea40 2024-04-24T23:39:54.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.132+0000 7fd385a48640 1 -- 172.21.15.57:0/1535410336 >> v1:172.21.15.88:6789/0 conn(0x7fd38014ade0 legacy=0x7fd38014dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:54.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.132+0000 7fd385a48640 1 -- 172.21.15.57:0/1535410336 >> v1:172.21.15.57:6789/0 conn(0x7fd38006ea40 legacy=0x7fd3801514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:54.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.132+0000 7fd385a48640 1 -- 172.21.15.57:0/1535410336 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3800be600 con 0x7fd3800bc3f0 2024-04-24T23:39:54.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.132+0000 7fd385a48640 1 --2- 172.21.15.57:0/1535410336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3800bc3f0 0x7fd38014a8a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd3700097c0 tx=0x7fd37001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d30c585652dcf47 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:54.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.132+0000 7fd385247640 1 -- 172.21.15.57:0/1535410336 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3700b0070 con 0x7fd3800bc3f0 2024-04-24T23:39:54.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd385247640 1 -- 172.21.15.57:0/1535410336 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3700ab600 con 0x7fd3800bc3f0 2024-04-24T23:39:54.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd385247640 1 -- 172.21.15.57:0/1535410336 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3700ab9d0 con 0x7fd3800bc3f0 2024-04-24T23:39:54.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd3884ad640 1 -- 172.21.15.57:0/1535410336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3800bc3f0 msgr2=0x7fd38014a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:54.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd3884ad640 1 --2- 172.21.15.57:0/1535410336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3800bc3f0 0x7fd38014a8a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd3700097c0 tx=0x7fd37001c4a0 comp rx=0 tx=0).stop 2024-04-24T23:39:54.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd3884ad640 1 -- 172.21.15.57:0/1535410336 shutdown_connections 2024-04-24T23:39:54.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd3884ad640 1 --2- 172.21.15.57:0/1535410336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3800bc3f0 0x7fd38014a8a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:54.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd3884ad640 1 -- 172.21.15.57:0/1535410336 >> 172.21.15.57:0/1535410336 conn(0x7fd38006b920 msgr2=0x7fd3800c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:54.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd3884ad640 1 -- 172.21.15.57:0/1535410336 shutdown_connections 2024-04-24T23:39:54.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd3884ad640 1 -- 172.21.15.57:0/1535410336 wait complete. 2024-04-24T23:39:54.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd3884ad640 1 Processor -- start 2024-04-24T23:39:54.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd3884ad640 1 -- start start 2024-04-24T23:39:54.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd3884ad640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd38006ea40 0x7fd3800726e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:54.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd3884ad640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3800bc3f0 0x7fd380149350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:54.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd3884ad640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd38014ade0 0x7fd380149890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:54.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd3884ad640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd38006dae0 con 0x7fd3800bc3f0 2024-04-24T23:39:54.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd3884ad640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd38006d960 con 0x7fd38014ade0 2024-04-24T23:39:54.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd3884ad640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fd38006dc60 con 0x7fd38006ea40 2024-04-24T23:39:54.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd385a48640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3800bc3f0 0x7fd380149350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:54.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd385a48640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3800bc3f0 0x7fd380149350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35732/0 (socket says 172.21.15.57:35732) 2024-04-24T23:39:54.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd385a48640 1 -- 172.21.15.57:0/169245346 learned_addr learned my addr 172.21.15.57:0/169245346 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:54.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd386249640 1 --2- 172.21.15.57:0/169245346 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd38006ea40 0x7fd3800726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:54.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd385a48640 1 -- 172.21.15.57:0/169245346 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd38006ea40 msgr2=0x7fd3800726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:54.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd385a48640 1 --2- 172.21.15.57:0/169245346 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd38006ea40 0x7fd3800726e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:54.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd385a48640 1 -- 172.21.15.57:0/169245346 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd38014ade0 msgr2=0x7fd380149890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:54.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd386a4a640 1 --2- 172.21.15.57:0/169245346 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd38014ade0 0x7fd380149890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:54.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd385a48640 1 --2- 172.21.15.57:0/169245346 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd38014ade0 0x7fd380149890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:54.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd385a48640 1 -- 172.21.15.57:0/169245346 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd380072c20 con 0x7fd3800bc3f0 2024-04-24T23:39:54.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd386249640 1 --2- 172.21.15.57:0/169245346 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd38006ea40 0x7fd3800726e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:39:54.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd385a48640 1 --2- 172.21.15.57:0/169245346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3800bc3f0 0x7fd380149350 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd3700190b0 tx=0x7fd370019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:54.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd376ffd640 1 -- 172.21.15.57:0/169245346 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3700ba070 con 0x7fd3800bc3f0 2024-04-24T23:39:54.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.136+0000 7fd376ffd640 1 -- 172.21.15.57:0/169245346 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3700b43f0 con 0x7fd3800bc3f0 2024-04-24T23:39:54.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.140+0000 7fd3884ad640 1 -- 172.21.15.57:0/169245346 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd380149dd0 con 0x7fd3800bc3f0 2024-04-24T23:39:54.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.140+0000 7fd376ffd640 1 -- 172.21.15.57:0/169245346 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3700b0040 con 0x7fd3800bc3f0 2024-04-24T23:39:54.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.140+0000 7fd3884ad640 1 -- 172.21.15.57:0/169245346 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd38014a110 con 0x7fd3800bc3f0 2024-04-24T23:39:54.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.140+0000 7fd3884ad640 1 -- 172.21.15.57:0/169245346 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd380068290 con 0x7fd3800bc3f0 2024-04-24T23:39:54.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.140+0000 7fd376ffd640 1 -- 172.21.15.57:0/169245346 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd3700bd070 con 0x7fd3800bc3f0 2024-04-24T23:39:54.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.140+0000 7fd376ffd640 1 --2- 172.21.15.57:0/169245346 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd3640678f0 0x7fd364069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:54.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.140+0000 7fd376ffd640 1 -- 172.21.15.57:0/169245346 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fd37011efe0 con 0x7fd3800bc3f0 2024-04-24T23:39:54.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.140+0000 7fd386249640 1 --2- 172.21.15.57:0/169245346 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd3640678f0 0x7fd364069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:54.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.140+0000 7fd386249640 1 --2- 172.21.15.57:0/169245346 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd3640678f0 0x7fd364069db0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0011f0 tx=0x7fd37c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:54.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.144+0000 7fd376ffd640 1 -- 172.21.15.57:0/169245346 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fd380072c20 con 0x7fd3800bc3f0 2024-04-24T23:39:54.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.308+0000 7fd3884ad640 1 -- 172.21.15.57:0/169245346 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd38014dfc0 con 0x7fd3800bc3f0 2024-04-24T23:39:54.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.312+0000 7fd376ffd640 1 -- 172.21.15.57:0/169245346 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fd370016090 con 0x7fd3800bc3f0 2024-04-24T23:39:54.313 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-04-24T23:39:54.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.312+0000 7fd3884ad640 1 -- 172.21.15.57:0/169245346 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd3640678f0 msgr2=0x7fd364069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:54.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.312+0000 7fd3884ad640 1 --2- 172.21.15.57:0/169245346 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd3640678f0 0x7fd364069db0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0011f0 tx=0x7fd37c009040 comp rx=0 tx=0).stop 2024-04-24T23:39:54.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.312+0000 7fd3884ad640 1 -- 172.21.15.57:0/169245346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3800bc3f0 msgr2=0x7fd380149350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:54.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.312+0000 7fd3884ad640 1 --2- 172.21.15.57:0/169245346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3800bc3f0 0x7fd380149350 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd3700190b0 tx=0x7fd370019240 comp rx=0 tx=0).stop 2024-04-24T23:39:54.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.312+0000 7fd3884ad640 1 -- 172.21.15.57:0/169245346 shutdown_connections 2024-04-24T23:39:54.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.312+0000 7fd3884ad640 1 --2- 172.21.15.57:0/169245346 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd3640678f0 0x7fd364069db0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:54.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.312+0000 7fd3884ad640 1 --2- 172.21.15.57:0/169245346 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd38014ade0 0x7fd380149890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:54.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.312+0000 7fd3884ad640 1 --2- 172.21.15.57:0/169245346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3800bc3f0 0x7fd380149350 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:54.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.312+0000 7fd3884ad640 1 --2- 172.21.15.57:0/169245346 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd38006ea40 0x7fd3800726e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:54.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.312+0000 7fd3884ad640 1 -- 172.21.15.57:0/169245346 >> 172.21.15.57:0/169245346 conn(0x7fd38006b920 msgr2=0x7fd3800bcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:54.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.312+0000 7fd3884ad640 1 -- 172.21.15.57:0/169245346 shutdown_connections 2024-04-24T23:39:54.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.312+0000 7fd3884ad640 1 -- 172.21.15.57:0/169245346 wait complete. 2024-04-24T23:39:54.332 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:39:54.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.452+0000 7f52de705640 1 Processor -- start 2024-04-24T23:39:54.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.452+0000 7f52de705640 1 -- start start 2024-04-24T23:39:54.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.456+0000 7f52de705640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f52d80bd5f0 0x7f52d8151c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:54.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.456+0000 7f52de705640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f52d80bc3b0 0x7f52d8152160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:54.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.456+0000 7f52de705640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52d80bd200 con 0x7f52d814bc60 2024-04-24T23:39:54.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.456+0000 7f52de705640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f52d81526a0 con 0x7f52d80bd5f0 2024-04-24T23:39:54.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.456+0000 7f52de705640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f52d80bde20 con 0x7f52d80bc3b0 2024-04-24T23:39:54.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.456+0000 7f52d77fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f52d80bd5f0 0x7f52d8151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:54.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.456+0000 7f52d77fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f52d80bd5f0 0x7f52d8151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35748/0 (socket says 172.21.15.57:35748) 2024-04-24T23:39:54.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.456+0000 7f52d77fe640 1 -- 172.21.15.57:0/2244954993 learned_addr learned my addr 172.21.15.57:0/2244954993 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:54.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.456+0000 7f52dcca2640 1 --2- 172.21.15.57:0/2244954993 >> v2:172.21.15.88:3300/0 conn(0x7f52d80bc3b0 0x7f52d8152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:54.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.456+0000 7f52d77fe640 1 -- 172.21.15.57:0/2244954993 >> v2:172.21.15.88:3300/0 conn(0x7f52d80bc3b0 msgr2=0x7f52d8152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:54.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.456+0000 7f52d77fe640 1 --2- 172.21.15.57:0/2244954993 >> v2:172.21.15.88:3300/0 conn(0x7f52d80bc3b0 0x7f52d8152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:54.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.456+0000 7f52d77fe640 1 -- 172.21.15.57:0/2244954993 >> v1:172.21.15.88:6789/0 conn(0x7f52d814bc60 legacy=0x7f52d80c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:54.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.456+0000 7f52d77fe640 1 -- 172.21.15.57:0/2244954993 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d80be070 con 0x7f52d80bd5f0 2024-04-24T23:39:54.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.456+0000 7f52d77fe640 1 --2- 172.21.15.57:0/2244954993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52d80bd5f0 0x7f52d8151c20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f52d8152c50 tx=0x7f52c001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b022797e0e255a48 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:54.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.456+0000 7f52d6ffd640 1 -- 172.21.15.57:0/2244954993 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c00b0070 con 0x7f52d80bd5f0 2024-04-24T23:39:54.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.456+0000 7f52d6ffd640 1 -- 172.21.15.57:0/2244954993 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52c00ab600 con 0x7f52d80bd5f0 2024-04-24T23:39:54.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.456+0000 7f52d6ffd640 1 -- 172.21.15.57:0/2244954993 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c00ab9d0 con 0x7f52d80bd5f0 2024-04-24T23:39:54.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52de705640 1 -- 172.21.15.57:0/2244954993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52d80bd5f0 msgr2=0x7f52d8151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:54.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52de705640 1 --2- 172.21.15.57:0/2244954993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52d80bd5f0 0x7f52d8151c20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f52d8152c50 tx=0x7f52c001c400 comp rx=0 tx=0).stop 2024-04-24T23:39:54.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52de705640 1 -- 172.21.15.57:0/2244954993 shutdown_connections 2024-04-24T23:39:54.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52de705640 1 --2- 172.21.15.57:0/2244954993 >> v2:172.21.15.88:3300/0 conn(0x7f52d80bc3b0 0x7f52d8152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:54.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52de705640 1 --2- 172.21.15.57:0/2244954993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52d80bd5f0 0x7f52d8151c20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:54.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52de705640 1 -- 172.21.15.57:0/2244954993 >> 172.21.15.57:0/2244954993 conn(0x7f52d806b920 msgr2=0x7f52d80c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:54.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52de705640 1 -- 172.21.15.57:0/2244954993 shutdown_connections 2024-04-24T23:39:54.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52de705640 1 -- 172.21.15.57:0/2244954993 wait complete. 2024-04-24T23:39:54.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52de705640 1 Processor -- start 2024-04-24T23:39:54.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52de705640 1 -- start start 2024-04-24T23:39:54.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52de705640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52d80bc3b0 0x7f52d81516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:54.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52de705640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52d80bd5f0 0x7f52d8145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:54.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52de705640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f52d814bc60 0x7f52d814fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:54.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52de705640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f52d80bce60 con 0x7f52d80bd5f0 2024-04-24T23:39:54.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52de705640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f52d814c040 con 0x7f52d80bc3b0 2024-04-24T23:39:54.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52de705640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f52d80bcfe0 con 0x7f52d814bc60 2024-04-24T23:39:54.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52d77fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52d80bd5f0 0x7f52d8145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:54.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52d77fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52d80bd5f0 0x7f52d8145cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35764/0 (socket says 172.21.15.57:35764) 2024-04-24T23:39:54.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52d77fe640 1 -- 172.21.15.57:0/473818771 learned_addr learned my addr 172.21.15.57:0/473818771 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:54.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52dcca2640 1 --2- 172.21.15.57:0/473818771 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f52d814bc60 0x7f52d814fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:54.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52d7fff640 1 --2- 172.21.15.57:0/473818771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52d80bc3b0 0x7f52d81516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:54.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52d77fe640 1 -- 172.21.15.57:0/473818771 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f52d814bc60 msgr2=0x7f52d814fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:54.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52d77fe640 1 --2- 172.21.15.57:0/473818771 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f52d814bc60 0x7f52d814fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:54.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52d77fe640 1 -- 172.21.15.57:0/473818771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52d80bc3b0 msgr2=0x7f52d81516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:54.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52d77fe640 1 --2- 172.21.15.57:0/473818771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52d80bc3b0 0x7f52d81516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:54.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52d77fe640 1 -- 172.21.15.57:0/473818771 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d8146200 con 0x7f52d80bd5f0 2024-04-24T23:39:54.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52d7fff640 1 --2- 172.21.15.57:0/473818771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52d80bc3b0 0x7f52d81516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:39:54.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52d77fe640 1 --2- 172.21.15.57:0/473818771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52d80bd5f0 0x7f52d8145cc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f52c0000c10 tx=0x7f52c00191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:54.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52d4ff9640 1 -- 172.21.15.57:0/473818771 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c00b0040 con 0x7f52d80bd5f0 2024-04-24T23:39:54.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52d4ff9640 1 -- 172.21.15.57:0/473818771 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52c00b9070 con 0x7f52d80bd5f0 2024-04-24T23:39:54.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52de705640 1 -- 172.21.15.57:0/473818771 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52d814e040 con 0x7f52d80bd5f0 2024-04-24T23:39:54.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52d4ff9640 1 -- 172.21.15.57:0/473818771 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c00b4830 con 0x7f52d80bd5f0 2024-04-24T23:39:54.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.460+0000 7f52de705640 1 -- 172.21.15.57:0/473818771 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52d81510d0 con 0x7f52d80bd5f0 2024-04-24T23:39:54.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.464+0000 7f52de705640 1 -- 172.21.15.57:0/473818771 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52d806ef70 con 0x7f52d80bd5f0 2024-04-24T23:39:54.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.464+0000 7f52d4ff9640 1 -- 172.21.15.57:0/473818771 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f52c00ab480 con 0x7f52d80bd5f0 2024-04-24T23:39:54.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.464+0000 7f52d4ff9640 1 --2- 172.21.15.57:0/473818771 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f52b80678c0 0x7f52b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:54.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.464+0000 7f52d4ff9640 1 -- 172.21.15.57:0/473818771 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f52c011fbf0 con 0x7f52d80bd5f0 2024-04-24T23:39:54.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.464+0000 7f52d7fff640 1 --2- 172.21.15.57:0/473818771 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f52b80678c0 0x7f52b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:54.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.464+0000 7f52d7fff640 1 --2- 172.21.15.57:0/473818771 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f52b80678c0 0x7f52b8069d80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f52d0001d70 tx=0x7f52d0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:54.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.468+0000 7f52d4ff9640 1 -- 172.21.15.57:0/473818771 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f52d8146200 con 0x7f52d80bd5f0 2024-04-24T23:39:54.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.628+0000 7f52de705640 1 -- 172.21.15.57:0/473818771 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f52d80bcc40 con 0x7f52d80bd5f0 2024-04-24T23:39:54.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.628+0000 7f52d4ff9640 1 -- 172.21.15.57:0/473818771 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f52c0016110 con 0x7f52d80bd5f0 2024-04-24T23:39:54.632 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-04-24T23:39:54.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.632+0000 7f52de705640 1 -- 172.21.15.57:0/473818771 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f52b80678c0 msgr2=0x7f52b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:54.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.632+0000 7f52de705640 1 --2- 172.21.15.57:0/473818771 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f52b80678c0 0x7f52b8069d80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f52d0001d70 tx=0x7f52d0009040 comp rx=0 tx=0).stop 2024-04-24T23:39:54.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.632+0000 7f52de705640 1 -- 172.21.15.57:0/473818771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52d80bd5f0 msgr2=0x7f52d8145cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:54.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.632+0000 7f52de705640 1 --2- 172.21.15.57:0/473818771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52d80bd5f0 0x7f52d8145cc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f52c0000c10 tx=0x7f52c00191a0 comp rx=0 tx=0).stop 2024-04-24T23:39:54.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.632+0000 7f52de705640 1 -- 172.21.15.57:0/473818771 shutdown_connections 2024-04-24T23:39:54.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.632+0000 7f52de705640 1 --2- 172.21.15.57:0/473818771 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f52b80678c0 0x7f52b8069d80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:54.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.632+0000 7f52de705640 1 --2- 172.21.15.57:0/473818771 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f52d814bc60 0x7f52d814fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:54.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.632+0000 7f52de705640 1 --2- 172.21.15.57:0/473818771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52d80bd5f0 0x7f52d8145cc0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:54.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.632+0000 7f52de705640 1 --2- 172.21.15.57:0/473818771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52d80bc3b0 0x7f52d81516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:54.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.632+0000 7f52de705640 1 -- 172.21.15.57:0/473818771 >> 172.21.15.57:0/473818771 conn(0x7f52d806b920 msgr2=0x7f52d814a480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:54.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.632+0000 7f52de705640 1 -- 172.21.15.57:0/473818771 shutdown_connections 2024-04-24T23:39:54.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.632+0000 7f52de705640 1 -- 172.21.15.57:0/473818771 wait complete. 2024-04-24T23:39:54.651 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:39:54.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.772+0000 7feaa9a82640 1 Processor -- start 2024-04-24T23:39:54.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.772+0000 7feaa9a82640 1 -- start start 2024-04-24T23:39:54.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.772+0000 7feaa9a82640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7feaa4070b50 0x7feaa4150f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:54.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.772+0000 7feaa9a82640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaa40718f0 con 0x7feaa40bd590 2024-04-24T23:39:54.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.772+0000 7feaa9a82640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaa4071330 con 0x7feaa40c37b0 2024-04-24T23:39:54.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.772+0000 7feaa9a82640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7feaa4071610 con 0x7feaa4070b50 2024-04-24T23:39:54.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.772+0000 7feaa2ffd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7feaa4070b50 0x7feaa4150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:54.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.772+0000 7feaa37fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7feaa40bd590 0x7feaa414da60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:32850/0 (socket says 172.21.15.57:32850) 2024-04-24T23:39:54.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.772+0000 7feaa37fe640 1 -- 172.21.15.57:0/1406900945 learned_addr learned my addr 172.21.15.57:0/1406900945 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:54.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.772+0000 7feaa2ffd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7feaa4070b50 0x7feaa4150f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35778/0 (socket says 172.21.15.57:35778) 2024-04-24T23:39:54.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.772+0000 7feaa2ffd640 1 -- 172.21.15.57:0/1406900945 >> v1:172.21.15.88:6789/0 conn(0x7feaa40c37b0 legacy=0x7feaa415b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:54.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.772+0000 7feaa2ffd640 1 -- 172.21.15.57:0/1406900945 >> v1:172.21.15.57:6789/0 conn(0x7feaa40bd590 legacy=0x7feaa414da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:54.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.772+0000 7feaa2ffd640 1 -- 172.21.15.57:0/1406900945 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa4150a50 con 0x7feaa4070b50 2024-04-24T23:39:54.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.776+0000 7feaa2ffd640 1 --2- 172.21.15.57:0/1406900945 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feaa4070b50 0x7feaa4150f70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fea980097c0 tx=0x7fea9801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e601c7e767ef0e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:54.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.776+0000 7feaa27fc640 1 -- 172.21.15.57:0/1406900945 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea980b0070 con 0x7feaa4070b50 2024-04-24T23:39:54.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.776+0000 7feaa27fc640 1 -- 172.21.15.57:0/1406900945 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea980ab600 con 0x7feaa4070b50 2024-04-24T23:39:54.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.776+0000 7feaa27fc640 1 -- 172.21.15.57:0/1406900945 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea980a4e60 con 0x7feaa4070b50 2024-04-24T23:39:54.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.776+0000 7feaa9a82640 1 -- 172.21.15.57:0/1406900945 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feaa4070b50 msgr2=0x7feaa4150f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:54.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.776+0000 7feaa9a82640 1 --2- 172.21.15.57:0/1406900945 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feaa4070b50 0x7feaa4150f70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fea980097c0 tx=0x7fea9801c3d0 comp rx=0 tx=0).stop 2024-04-24T23:39:54.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.776+0000 7feaa9a82640 1 -- 172.21.15.57:0/1406900945 shutdown_connections 2024-04-24T23:39:54.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.776+0000 7feaa9a82640 1 --2- 172.21.15.57:0/1406900945 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feaa4070b50 0x7feaa4150f70 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:54.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.776+0000 7feaa9a82640 1 -- 172.21.15.57:0/1406900945 >> 172.21.15.57:0/1406900945 conn(0x7feaa40c0a00 msgr2=0x7feaa40c0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:54.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.776+0000 7feaa9a82640 1 -- 172.21.15.57:0/1406900945 shutdown_connections 2024-04-24T23:39:54.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.776+0000 7feaa9a82640 1 -- 172.21.15.57:0/1406900945 wait complete. 2024-04-24T23:39:54.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.776+0000 7feaa9a82640 1 Processor -- start 2024-04-24T23:39:54.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.776+0000 7feaa9a82640 1 -- start start 2024-04-24T23:39:54.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.776+0000 7feaa9a82640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feaa4070b50 0x7feaa41eda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:54.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.776+0000 7feaa9a82640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feaa40bd590 0x7feaa41ed290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:54.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.776+0000 7feaa9a82640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feaa40c37b0 0x7feaa406d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:54.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.776+0000 7feaa9a82640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7feaa414e2f0 con 0x7feaa40bd590 2024-04-24T23:39:54.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.776+0000 7feaa9a82640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7feaa414e170 con 0x7feaa40c37b0 2024-04-24T23:39:54.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.776+0000 7feaa9a82640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7feaa415f5a0 con 0x7feaa4070b50 2024-04-24T23:39:54.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.776+0000 7feaa2ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feaa40bd590 0x7feaa41ed290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:54.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.776+0000 7feaa2ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feaa40bd590 0x7feaa41ed290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35794/0 (socket says 172.21.15.57:35794) 2024-04-24T23:39:54.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.776+0000 7feaa2ffd640 1 -- 172.21.15.57:0/3119322775 learned_addr learned my addr 172.21.15.57:0/3119322775 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:54.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.776+0000 7feaa37fe640 1 --2- 172.21.15.57:0/3119322775 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feaa4070b50 0x7feaa41eda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:54.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.776+0000 7feaa3fff640 1 --2- 172.21.15.57:0/3119322775 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feaa40c37b0 0x7feaa406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:54.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.780+0000 7feaa2ffd640 1 -- 172.21.15.57:0/3119322775 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feaa4070b50 msgr2=0x7feaa41eda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:54.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.780+0000 7feaa2ffd640 1 --2- 172.21.15.57:0/3119322775 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feaa4070b50 0x7feaa41eda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:54.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.780+0000 7feaa2ffd640 1 -- 172.21.15.57:0/3119322775 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feaa40c37b0 msgr2=0x7feaa406d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:54.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.780+0000 7feaa2ffd640 1 --2- 172.21.15.57:0/3119322775 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feaa40c37b0 0x7feaa406d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:54.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.780+0000 7feaa2ffd640 1 -- 172.21.15.57:0/3119322775 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa41435c0 con 0x7feaa40bd590 2024-04-24T23:39:54.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.780+0000 7feaa2ffd640 1 --2- 172.21.15.57:0/3119322775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feaa40bd590 0x7feaa41ed290 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fea98018fe0 tx=0x7fea98019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:54.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.780+0000 7fea8bfff640 1 -- 172.21.15.57:0/3119322775 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea980b8070 con 0x7feaa40bd590 2024-04-24T23:39:54.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.780+0000 7fea8bfff640 1 -- 172.21.15.57:0/3119322775 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea980b4410 con 0x7feaa40bd590 2024-04-24T23:39:54.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.780+0000 7feaa9a82640 1 -- 172.21.15.57:0/3119322775 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaa41ed7d0 con 0x7feaa40bd590 2024-04-24T23:39:54.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.780+0000 7fea8bfff640 1 -- 172.21.15.57:0/3119322775 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea980b0040 con 0x7feaa40bd590 2024-04-24T23:39:54.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.780+0000 7feaa9a82640 1 -- 172.21.15.57:0/3119322775 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaa4141e80 con 0x7feaa40bd590 2024-04-24T23:39:54.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.780+0000 7feaa9a82640 1 -- 172.21.15.57:0/3119322775 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaa4068930 con 0x7feaa40bd590 2024-04-24T23:39:54.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.780+0000 7fea8bfff640 1 -- 172.21.15.57:0/3119322775 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fea980bb070 con 0x7feaa40bd590 2024-04-24T23:39:54.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.780+0000 7fea8bfff640 1 --2- 172.21.15.57:0/3119322775 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fea900678c0 0x7fea90069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:54.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.780+0000 7fea8bfff640 1 -- 172.21.15.57:0/3119322775 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fea981200f0 con 0x7feaa40bd590 2024-04-24T23:39:54.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.780+0000 7feaa37fe640 1 --2- 172.21.15.57:0/3119322775 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fea900678c0 0x7fea90069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:54.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.780+0000 7feaa37fe640 1 --2- 172.21.15.57:0/3119322775 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fea900678c0 0x7fea90069d80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fea9c0012f0 tx=0x7fea9c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:54.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.784+0000 7fea8bfff640 1 -- 172.21.15.57:0/3119322775 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7feaa41ed7d0 con 0x7feaa40bd590 2024-04-24T23:39:54.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.944+0000 7feaa9a82640 1 -- 172.21.15.57:0/3119322775 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7feaa40be140 con 0x7feaa40bd590 2024-04-24T23:39:54.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.944+0000 7fea8bfff640 1 -- 172.21.15.57:0/3119322775 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fea98016050 con 0x7feaa40bd590 2024-04-24T23:39:54.947 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-24T23:39:54.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.948+0000 7feaa9a82640 1 -- 172.21.15.57:0/3119322775 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fea900678c0 msgr2=0x7fea90069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:54.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.948+0000 7feaa9a82640 1 --2- 172.21.15.57:0/3119322775 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fea900678c0 0x7fea90069d80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fea9c0012f0 tx=0x7fea9c009040 comp rx=0 tx=0).stop 2024-04-24T23:39:54.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.948+0000 7feaa9a82640 1 -- 172.21.15.57:0/3119322775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feaa40bd590 msgr2=0x7feaa41ed290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:54.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.948+0000 7feaa9a82640 1 --2- 172.21.15.57:0/3119322775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feaa40bd590 0x7feaa41ed290 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fea98018fe0 tx=0x7fea98019170 comp rx=0 tx=0).stop 2024-04-24T23:39:54.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.948+0000 7feaa9a82640 1 -- 172.21.15.57:0/3119322775 shutdown_connections 2024-04-24T23:39:54.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.948+0000 7feaa9a82640 1 --2- 172.21.15.57:0/3119322775 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fea900678c0 0x7fea90069d80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:54.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.948+0000 7feaa9a82640 1 --2- 172.21.15.57:0/3119322775 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feaa40c37b0 0x7feaa406d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:54.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.948+0000 7feaa9a82640 1 --2- 172.21.15.57:0/3119322775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feaa40bd590 0x7feaa41ed290 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:54.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.948+0000 7feaa9a82640 1 --2- 172.21.15.57:0/3119322775 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feaa4070b50 0x7feaa41eda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:54.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.948+0000 7feaa9a82640 1 -- 172.21.15.57:0/3119322775 >> 172.21.15.57:0/3119322775 conn(0x7feaa40c0a00 msgr2=0x7feaa414cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:54.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.948+0000 7feaa9a82640 1 -- 172.21.15.57:0/3119322775 shutdown_connections 2024-04-24T23:39:54.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:54.948+0000 7feaa9a82640 1 -- 172.21.15.57:0/3119322775 wait complete. 2024-04-24T23:39:54.966 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-24T23:39:55.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.096+0000 7fb262165640 1 Processor -- start 2024-04-24T23:39:55.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.096+0000 7fb262165640 1 -- start start 2024-04-24T23:39:55.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.096+0000 7fb262165640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb25c14bc00 0x7fb25c0c0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:55.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.096+0000 7fb262165640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb25c14e7f0 0x7fb25c14ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:55.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.096+0000 7fb262165640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb25c14bfe0 con 0x7fb25c0be390 2024-04-24T23:39:55.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.096+0000 7fb262165640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fb25c1529e0 con 0x7fb25c14bc00 2024-04-24T23:39:55.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.096+0000 7fb262165640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fb25c0c32f0 con 0x7fb25c14e7f0 2024-04-24T23:39:55.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.096+0000 7fb25bfff640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb25c14e7f0 0x7fb25c14ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:55.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.096+0000 7fb25bfff640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb25c14e7f0 0x7fb25c14ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.57:45612/0 (socket says 172.21.15.57:45612) 2024-04-24T23:39:55.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.096+0000 7fb25bfff640 1 -- 172.21.15.57:0/2963394886 learned_addr learned my addr 172.21.15.57:0/2963394886 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:55.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.096+0000 7fb25b7fe640 1 --2- 172.21.15.57:0/2963394886 >> v2:172.21.15.88:3300/0 conn(0x7fb25c14bc00 0x7fb25c0c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:55.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.096+0000 7fb25bfff640 1 -- 172.21.15.57:0/2963394886 >> v2:172.21.15.88:3300/0 conn(0x7fb25c14bc00 msgr2=0x7fb25c0c0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:55.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.096+0000 7fb25bfff640 1 --2- 172.21.15.57:0/2963394886 >> v2:172.21.15.88:3300/0 conn(0x7fb25c14bc00 0x7fb25c0c0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:55.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.096+0000 7fb25bfff640 1 -- 172.21.15.57:0/2963394886 >> v1:172.21.15.88:6789/0 conn(0x7fb25c0be390 legacy=0x7fb25c0c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:55.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.096+0000 7fb25bfff640 1 -- 172.21.15.57:0/2963394886 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb25c0c35d0 con 0x7fb25c14e7f0 2024-04-24T23:39:55.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.100+0000 7fb25bfff640 1 --2- 172.21.15.57:0/2963394886 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb25c14e7f0 0x7fb25c14ec20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb254009e50 tx=0x7fb25401ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd034f255478e701 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:55.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.100+0000 7fb25a7fc640 1 -- 172.21.15.57:0/2963394886 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2540a5700 con 0x7fb25c14e7f0 2024-04-24T23:39:55.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.100+0000 7fb25a7fc640 1 -- 172.21.15.57:0/2963394886 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2540a58a0 con 0x7fb25c14e7f0 2024-04-24T23:39:55.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.100+0000 7fb25a7fc640 1 -- 172.21.15.57:0/2963394886 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2540a5c70 con 0x7fb25c14e7f0 2024-04-24T23:39:55.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.100+0000 7fb262165640 1 -- 172.21.15.57:0/2963394886 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb25c14e7f0 msgr2=0x7fb25c14ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:55.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.100+0000 7fb262165640 1 --2- 172.21.15.57:0/2963394886 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb25c14e7f0 0x7fb25c14ec20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb254009e50 tx=0x7fb25401ca30 comp rx=0 tx=0).stop 2024-04-24T23:39:55.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.100+0000 7fb262165640 1 -- 172.21.15.57:0/2963394886 shutdown_connections 2024-04-24T23:39:55.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.100+0000 7fb262165640 1 --2- 172.21.15.57:0/2963394886 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb25c14e7f0 0x7fb25c14ec20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:55.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.100+0000 7fb262165640 1 --2- 172.21.15.57:0/2963394886 >> v2:172.21.15.88:3300/0 conn(0x7fb25c14bc00 0x7fb25c0c0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:55.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.100+0000 7fb262165640 1 -- 172.21.15.57:0/2963394886 >> 172.21.15.57:0/2963394886 conn(0x7fb25c06b810 msgr2=0x7fb25c0c4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:55.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.100+0000 7fb262165640 1 -- 172.21.15.57:0/2963394886 shutdown_connections 2024-04-24T23:39:55.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.100+0000 7fb262165640 1 -- 172.21.15.57:0/2963394886 wait complete. 2024-04-24T23:39:55.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.100+0000 7fb262165640 1 Processor -- start 2024-04-24T23:39:55.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.100+0000 7fb262165640 1 -- start start 2024-04-24T23:39:55.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.100+0000 7fb262165640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb25c0be390 0x7fb25c153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:55.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.100+0000 7fb262165640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb25c14bc00 0x7fb25c149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:55.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.100+0000 7fb262165640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb25c14e7f0 0x7fb25c14a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:55.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.100+0000 7fb262165640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c15bb00 con 0x7fb25c14e7f0 2024-04-24T23:39:55.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.100+0000 7fb262165640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c15b980 con 0x7fb25c14bc00 2024-04-24T23:39:55.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.100+0000 7fb262165640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fb25c15bc80 con 0x7fb25c0be390 2024-04-24T23:39:55.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.100+0000 7fb25bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb25c14e7f0 0x7fb25c14a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:55.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.100+0000 7fb25bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb25c14e7f0 0x7fb25c14a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35806/0 (socket says 172.21.15.57:35806) 2024-04-24T23:39:55.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.100+0000 7fb25bfff640 1 -- 172.21.15.57:0/99212638 learned_addr learned my addr 172.21.15.57:0/99212638 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:55.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.100+0000 7fb25b7fe640 1 --2- 172.21.15.57:0/99212638 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb25c0be390 0x7fb25c153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:55.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.100+0000 7fb25affd640 1 --2- 172.21.15.57:0/99212638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb25c14bc00 0x7fb25c149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:55.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.104+0000 7fb25bfff640 1 -- 172.21.15.57:0/99212638 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb25c0be390 msgr2=0x7fb25c153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:55.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.104+0000 7fb25bfff640 1 --2- 172.21.15.57:0/99212638 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb25c0be390 0x7fb25c153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:55.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.104+0000 7fb25bfff640 1 -- 172.21.15.57:0/99212638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb25c14bc00 msgr2=0x7fb25c149ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:55.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.104+0000 7fb25bfff640 1 --2- 172.21.15.57:0/99212638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb25c14bc00 0x7fb25c149ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:55.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.104+0000 7fb25bfff640 1 -- 172.21.15.57:0/99212638 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb25c153770 con 0x7fb25c14e7f0 2024-04-24T23:39:55.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.104+0000 7fb25bfff640 1 --2- 172.21.15.57:0/99212638 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb25c14e7f0 0x7fb25c14a010 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb25401a660 tx=0x7fb2540197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:55.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.104+0000 7fb243fff640 1 -- 172.21.15.57:0/99212638 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb254009510 con 0x7fb25c14e7f0 2024-04-24T23:39:55.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.104+0000 7fb243fff640 1 -- 172.21.15.57:0/99212638 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2540be070 con 0x7fb25c14e7f0 2024-04-24T23:39:55.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.104+0000 7fb262165640 1 -- 172.21.15.57:0/99212638 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb25c0bb680 con 0x7fb25c14e7f0 2024-04-24T23:39:55.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.104+0000 7fb243fff640 1 -- 172.21.15.57:0/99212638 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2540b8890 con 0x7fb25c14e7f0 2024-04-24T23:39:55.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.104+0000 7fb262165640 1 -- 172.21.15.57:0/99212638 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb25c153ec0 con 0x7fb25c14e7f0 2024-04-24T23:39:55.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.104+0000 7fb262165640 1 -- 172.21.15.57:0/99212638 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb25c068930 con 0x7fb25c14e7f0 2024-04-24T23:39:55.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.104+0000 7fb243fff640 1 -- 172.21.15.57:0/99212638 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb2540b8a30 con 0x7fb25c14e7f0 2024-04-24T23:39:55.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.104+0000 7fb243fff640 1 --2- 172.21.15.57:0/99212638 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fb2480678c0 0x7fb248069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:55.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.104+0000 7fb243fff640 1 -- 172.21.15.57:0/99212638 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fb254121080 con 0x7fb25c14e7f0 2024-04-24T23:39:55.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.104+0000 7fb25b7fe640 1 --2- 172.21.15.57:0/99212638 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fb2480678c0 0x7fb248069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:55.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.104+0000 7fb25b7fe640 1 --2- 172.21.15.57:0/99212638 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fb2480678c0 0x7fb248069d80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb24c009b60 tx=0x7fb24c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:55.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.108+0000 7fb243fff640 1 -- 172.21.15.57:0/99212638 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fb25c153770 con 0x7fb25c14e7f0 2024-04-24T23:39:55.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.268+0000 7fb262165640 1 -- 172.21.15.57:0/99212638 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fb25c1580d0 con 0x7fb25c14e7f0 2024-04-24T23:39:55.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.272+0000 7fb243fff640 1 -- 172.21.15.57:0/99212638 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fb254016620 con 0x7fb25c14e7f0 2024-04-24T23:39:55.272 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-04-24T23:39:55.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.272+0000 7fb262165640 1 -- 172.21.15.57:0/99212638 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fb2480678c0 msgr2=0x7fb248069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:55.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.272+0000 7fb262165640 1 --2- 172.21.15.57:0/99212638 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fb2480678c0 0x7fb248069d80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb24c009b60 tx=0x7fb24c009190 comp rx=0 tx=0).stop 2024-04-24T23:39:55.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.272+0000 7fb262165640 1 -- 172.21.15.57:0/99212638 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb25c14e7f0 msgr2=0x7fb25c14a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:55.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.272+0000 7fb262165640 1 --2- 172.21.15.57:0/99212638 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb25c14e7f0 0x7fb25c14a010 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb25401a660 tx=0x7fb2540197d0 comp rx=0 tx=0).stop 2024-04-24T23:39:55.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.272+0000 7fb262165640 1 -- 172.21.15.57:0/99212638 shutdown_connections 2024-04-24T23:39:55.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.272+0000 7fb262165640 1 --2- 172.21.15.57:0/99212638 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fb2480678c0 0x7fb248069d80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:55.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.272+0000 7fb262165640 1 --2- 172.21.15.57:0/99212638 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb25c14e7f0 0x7fb25c14a010 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:55.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.272+0000 7fb262165640 1 --2- 172.21.15.57:0/99212638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb25c14bc00 0x7fb25c149ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:55.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.272+0000 7fb262165640 1 --2- 172.21.15.57:0/99212638 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb25c0be390 0x7fb25c153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:55.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.272+0000 7fb262165640 1 -- 172.21.15.57:0/99212638 >> 172.21.15.57:0/99212638 conn(0x7fb25c06b810 msgr2=0x7fb25c14c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:55.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.272+0000 7fb262165640 1 -- 172.21.15.57:0/99212638 shutdown_connections 2024-04-24T23:39:55.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.272+0000 7fb262165640 1 -- 172.21.15.57:0/99212638 wait complete. 2024-04-24T23:39:55.292 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:39:55.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.412+0000 7feda0e3e640 1 Processor -- start 2024-04-24T23:39:55.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.412+0000 7feda0e3e640 1 -- start start 2024-04-24T23:39:55.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.412+0000 7feda0e3e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fed9c146e00 0x7fed9c06e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:55.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.412+0000 7feda0e3e640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fed9c06e750 0x7fed9c0bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:55.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.412+0000 7feda0e3e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed9c0bdbb0 con 0x7fed9c0a7160 2024-04-24T23:39:55.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.412+0000 7feda0e3e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fed9c0bc7f0 con 0x7fed9c146e00 2024-04-24T23:39:55.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.412+0000 7feda0e3e640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fed9c14d8c0 con 0x7fed9c06e750 2024-04-24T23:39:55.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.412+0000 7fed9a59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fed9c146e00 0x7fed9c06e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:55.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.412+0000 7fed99d9b640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fed9c0a7160 0x7fed9c0bcf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.57:47204/0 (socket says 172.21.15.57:47204) 2024-04-24T23:39:55.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.412+0000 7fed99d9b640 1 -- 172.21.15.57:0/799250806 learned_addr learned my addr 172.21.15.57:0/799250806 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:55.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.412+0000 7fed9ad9d640 1 --2- 172.21.15.57:0/799250806 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fed9c06e750 0x7fed9c0bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:55.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.412+0000 7fed9a59c640 1 -- 172.21.15.57:0/799250806 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fed9c06e750 msgr2=0x7fed9c0bd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:55.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.412+0000 7fed9a59c640 1 --2- 172.21.15.57:0/799250806 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fed9c06e750 0x7fed9c0bd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:55.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.412+0000 7fed9a59c640 1 -- 172.21.15.57:0/799250806 >> v1:172.21.15.88:6789/0 conn(0x7fed9c0a7160 legacy=0x7fed9c0bcf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:55.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.412+0000 7fed9a59c640 1 -- 172.21.15.57:0/799250806 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed9c14dba0 con 0x7fed9c146e00 2024-04-24T23:39:55.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.416+0000 7fed9a59c640 1 --2- 172.21.15.57:0/799250806 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c146e00 0x7fed9c06e210 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fed8c00a960 tx=0x7fed8c01e2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=498f887ab65574f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:55.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.416+0000 7fed9959a640 1 -- 172.21.15.57:0/799250806 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c0b3070 con 0x7fed9c146e00 2024-04-24T23:39:55.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.416+0000 7fed9959a640 1 -- 172.21.15.57:0/799250806 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed8c0a68b0 con 0x7fed9c146e00 2024-04-24T23:39:55.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.416+0000 7fed9959a640 1 -- 172.21.15.57:0/799250806 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c00b040 con 0x7fed9c146e00 2024-04-24T23:39:55.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.416+0000 7feda0e3e640 1 -- 172.21.15.57:0/799250806 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c146e00 msgr2=0x7fed9c06e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:55.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.416+0000 7feda0e3e640 1 --2- 172.21.15.57:0/799250806 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c146e00 0x7fed9c06e210 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fed8c00a960 tx=0x7fed8c01e2a0 comp rx=0 tx=0).stop 2024-04-24T23:39:55.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.416+0000 7feda0e3e640 1 -- 172.21.15.57:0/799250806 shutdown_connections 2024-04-24T23:39:55.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.416+0000 7feda0e3e640 1 --2- 172.21.15.57:0/799250806 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fed9c06e750 0x7fed9c0bd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:55.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.416+0000 7feda0e3e640 1 --2- 172.21.15.57:0/799250806 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c146e00 0x7fed9c06e210 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:55.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.416+0000 7feda0e3e640 1 -- 172.21.15.57:0/799250806 >> 172.21.15.57:0/799250806 conn(0x7fed9c0be8f0 msgr2=0x7fed9c0bed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:55.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.416+0000 7feda0e3e640 1 -- 172.21.15.57:0/799250806 shutdown_connections 2024-04-24T23:39:55.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.416+0000 7feda0e3e640 1 -- 172.21.15.57:0/799250806 wait complete. 2024-04-24T23:39:55.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.416+0000 7feda0e3e640 1 Processor -- start 2024-04-24T23:39:55.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.416+0000 7feda0e3e640 1 -- start start 2024-04-24T23:39:55.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.416+0000 7feda0e3e640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fed9c06e750 0x7fed9c149b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:55.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.416+0000 7feda0e3e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c0a7160 0x7fed9c14e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:55.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.416+0000 7feda0e3e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed9c146e00 0x7fed9c14edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:55.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.416+0000 7feda0e3e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fed9c1598b0 con 0x7fed9c146e00 2024-04-24T23:39:55.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.416+0000 7feda0e3e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fed9c159730 con 0x7fed9c0a7160 2024-04-24T23:39:55.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.416+0000 7feda0e3e640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fed9c159a30 con 0x7fed9c06e750 2024-04-24T23:39:55.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.420+0000 7fed9ad9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed9c146e00 0x7fed9c14edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:55.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.420+0000 7fed9ad9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed9c146e00 0x7fed9c14edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35818/0 (socket says 172.21.15.57:35818) 2024-04-24T23:39:55.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.420+0000 7fed9ad9d640 1 -- 172.21.15.57:0/437647479 learned_addr learned my addr 172.21.15.57:0/437647479 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:55.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.420+0000 7fed9a59c640 1 --2- 172.21.15.57:0/437647479 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fed9c06e750 0x7fed9c149b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:55.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.420+0000 7fed99d9b640 1 --2- 172.21.15.57:0/437647479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c0a7160 0x7fed9c14e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:55.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.420+0000 7fed9ad9d640 1 -- 172.21.15.57:0/437647479 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fed9c06e750 msgr2=0x7fed9c149b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:55.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.420+0000 7fed9ad9d640 1 --2- 172.21.15.57:0/437647479 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fed9c06e750 0x7fed9c149b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:55.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.420+0000 7fed9ad9d640 1 -- 172.21.15.57:0/437647479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c0a7160 msgr2=0x7fed9c14e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:55.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.420+0000 7fed9ad9d640 1 --2- 172.21.15.57:0/437647479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c0a7160 0x7fed9c14e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:55.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.420+0000 7fed9ad9d640 1 -- 172.21.15.57:0/437647479 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed9c14a0d0 con 0x7fed9c146e00 2024-04-24T23:39:55.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.420+0000 7fed99d9b640 1 --2- 172.21.15.57:0/437647479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c0a7160 0x7fed9c14e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:39:55.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.420+0000 7fed9ad9d640 1 --2- 172.21.15.57:0/437647479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed9c146e00 0x7fed9c14edb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fed9400ef90 tx=0x7fed9400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:55.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.420+0000 7fed8affd640 1 -- 172.21.15.57:0/437647479 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed94018020 con 0x7fed9c146e00 2024-04-24T23:39:55.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.420+0000 7fed8affd640 1 -- 172.21.15.57:0/437647479 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed94014480 con 0x7fed9c146e00 2024-04-24T23:39:55.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.420+0000 7feda0e3e640 1 -- 172.21.15.57:0/437647479 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed9c1e8f80 con 0x7fed9c146e00 2024-04-24T23:39:55.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.420+0000 7fed8affd640 1 -- 172.21.15.57:0/437647479 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed94014870 con 0x7fed9c146e00 2024-04-24T23:39:55.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.420+0000 7feda0e3e640 1 -- 172.21.15.57:0/437647479 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed9c14e350 con 0x7fed9c146e00 2024-04-24T23:39:55.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.420+0000 7feda0e3e640 1 -- 172.21.15.57:0/437647479 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed9c1e94a0 con 0x7fed9c146e00 2024-04-24T23:39:55.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.420+0000 7fed8affd640 1 -- 172.21.15.57:0/437647479 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fed9401b020 con 0x7fed9c146e00 2024-04-24T23:39:55.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.420+0000 7fed8affd640 1 --2- 172.21.15.57:0/437647479 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fed7c0678f0 0x7fed7c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:55.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.420+0000 7fed8affd640 1 -- 172.21.15.57:0/437647479 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fed94086e00 con 0x7fed9c146e00 2024-04-24T23:39:55.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.420+0000 7fed9a59c640 1 --2- 172.21.15.57:0/437647479 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fed7c0678f0 0x7fed7c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:55.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.424+0000 7fed9a59c640 1 --2- 172.21.15.57:0/437647479 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fed7c0678f0 0x7fed7c069db0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fed8c0b0000 tx=0x7fed8c00c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:55.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.424+0000 7fed8affd640 1 -- 172.21.15.57:0/437647479 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fed9c1e94a0 con 0x7fed9c146e00 2024-04-24T23:39:55.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.592+0000 7feda0e3e640 1 -- 172.21.15.57:0/437647479 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fed9c14e140 con 0x7fed9c146e00 2024-04-24T23:39:55.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.592+0000 7fed8affd640 1 -- 172.21.15.57:0/437647479 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fed94022030 con 0x7fed9c146e00 2024-04-24T23:39:55.594 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2024-04-24T23:39:55.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.592+0000 7feda0e3e640 1 -- 172.21.15.57:0/437647479 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fed7c0678f0 msgr2=0x7fed7c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:55.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.592+0000 7feda0e3e640 1 --2- 172.21.15.57:0/437647479 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fed7c0678f0 0x7fed7c069db0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fed8c0b0000 tx=0x7fed8c00c040 comp rx=0 tx=0).stop 2024-04-24T23:39:55.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.592+0000 7feda0e3e640 1 -- 172.21.15.57:0/437647479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed9c146e00 msgr2=0x7fed9c14edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:55.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.592+0000 7feda0e3e640 1 --2- 172.21.15.57:0/437647479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed9c146e00 0x7fed9c14edb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fed9400ef90 tx=0x7fed9400c490 comp rx=0 tx=0).stop 2024-04-24T23:39:55.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.592+0000 7feda0e3e640 1 -- 172.21.15.57:0/437647479 shutdown_connections 2024-04-24T23:39:55.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.592+0000 7feda0e3e640 1 --2- 172.21.15.57:0/437647479 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fed7c0678f0 0x7fed7c069db0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:55.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.592+0000 7feda0e3e640 1 --2- 172.21.15.57:0/437647479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed9c146e00 0x7fed9c14edb0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:55.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.592+0000 7feda0e3e640 1 --2- 172.21.15.57:0/437647479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c0a7160 0x7fed9c14e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:55.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.592+0000 7feda0e3e640 1 --2- 172.21.15.57:0/437647479 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fed9c06e750 0x7fed9c149b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:55.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.596+0000 7feda0e3e640 1 -- 172.21.15.57:0/437647479 >> 172.21.15.57:0/437647479 conn(0x7fed9c0be8f0 msgr2=0x7fed9c0becd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:55.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.596+0000 7feda0e3e640 1 -- 172.21.15.57:0/437647479 shutdown_connections 2024-04-24T23:39:55.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.596+0000 7feda0e3e640 1 -- 172.21.15.57:0/437647479 wait complete. 2024-04-24T23:39:55.611 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-24T23:39:55.612 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:39:55.618 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:39:55.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.736+0000 7fa955e9a640 1 Processor -- start 2024-04-24T23:39:55.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.736+0000 7fa955e9a640 1 -- start start 2024-04-24T23:39:55.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.736+0000 7fa955e9a640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa9500c32d0 0x7fa95014d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:55.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.736+0000 7fa955e9a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa95014dea0 0x7fa950151300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:55.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.736+0000 7fa955e9a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9500bd6c0 con 0x7fa9500c1080 2024-04-24T23:39:55.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.736+0000 7fa955e9a640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fa9500bf4a0 con 0x7fa95014dea0 2024-04-24T23:39:55.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.736+0000 7fa955e9a640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fa9500bd470 con 0x7fa9500c32d0 2024-04-24T23:39:55.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.736+0000 7fa94ffff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa95014dea0 0x7fa950151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:55.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.736+0000 7fa94ffff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa95014dea0 0x7fa950151300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35822/0 (socket says 172.21.15.57:35822) 2024-04-24T23:39:55.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.736+0000 7fa94ffff640 1 -- 172.21.15.57:0/3590014614 learned_addr learned my addr 172.21.15.57:0/3590014614 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:55.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.736+0000 7fa94f7fe640 1 --2- 172.21.15.57:0/3590014614 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa9500c32d0 0x7fa95014d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:55.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.736+0000 7fa94ffff640 1 -- 172.21.15.57:0/3590014614 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa9500c32d0 msgr2=0x7fa95014d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:55.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.736+0000 7fa94ffff640 1 --2- 172.21.15.57:0/3590014614 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa9500c32d0 0x7fa95014d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:55.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.736+0000 7fa94ffff640 1 -- 172.21.15.57:0/3590014614 >> v1:172.21.15.88:6789/0 conn(0x7fa9500c1080 legacy=0x7fa950150bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:55.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.736+0000 7fa94ffff640 1 -- 172.21.15.57:0/3590014614 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9500bd9a0 con 0x7fa95014dea0 2024-04-24T23:39:55.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.740+0000 7fa94ffff640 1 --2- 172.21.15.57:0/3590014614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa95014dea0 0x7fa950151300 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa948009e50 tx=0x7fa94801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd2a03f5ce59fbb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:55.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.740+0000 7fa94e7fc640 1 -- 172.21.15.57:0/3590014614 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9480a55e0 con 0x7fa95014dea0 2024-04-24T23:39:55.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.740+0000 7fa94e7fc640 1 -- 172.21.15.57:0/3590014614 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9480a5780 con 0x7fa95014dea0 2024-04-24T23:39:55.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.740+0000 7fa94e7fc640 1 -- 172.21.15.57:0/3590014614 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9480a5b50 con 0x7fa95014dea0 2024-04-24T23:39:55.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.740+0000 7fa955e9a640 1 -- 172.21.15.57:0/3590014614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa95014dea0 msgr2=0x7fa950151300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:55.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.740+0000 7fa955e9a640 1 --2- 172.21.15.57:0/3590014614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa95014dea0 0x7fa950151300 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa948009e50 tx=0x7fa94801c960 comp rx=0 tx=0).stop 2024-04-24T23:39:55.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.740+0000 7fa955e9a640 1 -- 172.21.15.57:0/3590014614 shutdown_connections 2024-04-24T23:39:55.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.740+0000 7fa955e9a640 1 --2- 172.21.15.57:0/3590014614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa95014dea0 0x7fa950151300 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:55.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.740+0000 7fa955e9a640 1 --2- 172.21.15.57:0/3590014614 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa9500c32d0 0x7fa95014d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:55.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.740+0000 7fa955e9a640 1 -- 172.21.15.57:0/3590014614 >> 172.21.15.57:0/3590014614 conn(0x7fa950067350 msgr2=0x7fa950067760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:55.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.740+0000 7fa955e9a640 1 -- 172.21.15.57:0/3590014614 shutdown_connections 2024-04-24T23:39:55.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.740+0000 7fa955e9a640 1 -- 172.21.15.57:0/3590014614 wait complete. 2024-04-24T23:39:55.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa955e9a640 1 Processor -- start 2024-04-24T23:39:55.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa955e9a640 1 -- start start 2024-04-24T23:39:55.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa955e9a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9500c1080 0x7fa9501ec720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:55.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa955e9a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9500c32d0 0x7fa9501472f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:55.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa955e9a640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa95014dea0 0x7fa95013ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:55.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa955e9a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa9500c1760 con 0x7fa9500c1080 2024-04-24T23:39:55.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa955e9a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa9500c15e0 con 0x7fa9500c32d0 2024-04-24T23:39:55.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa955e9a640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fa95015d940 con 0x7fa95014dea0 2024-04-24T23:39:55.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa94f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9500c1080 0x7fa9501ec720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:55.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa94f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9500c1080 0x7fa9501ec720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35838/0 (socket says 172.21.15.57:35838) 2024-04-24T23:39:55.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa94f7fe640 1 -- 172.21.15.57:0/1386886281 learned_addr learned my addr 172.21.15.57:0/1386886281 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:55.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa94ffff640 1 --2- 172.21.15.57:0/1386886281 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa95014dea0 0x7fa95013ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:55.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa94effd640 1 --2- 172.21.15.57:0/1386886281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9500c32d0 0x7fa9501472f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:55.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa94f7fe640 1 -- 172.21.15.57:0/1386886281 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa95014dea0 msgr2=0x7fa95013ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:55.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa94f7fe640 1 --2- 172.21.15.57:0/1386886281 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa95014dea0 0x7fa95013ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:55.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa94f7fe640 1 -- 172.21.15.57:0/1386886281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9500c32d0 msgr2=0x7fa9501472f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:55.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa94f7fe640 1 --2- 172.21.15.57:0/1386886281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9500c32d0 0x7fa9501472f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:55.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa94f7fe640 1 -- 172.21.15.57:0/1386886281 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9501ecfe0 con 0x7fa9500c1080 2024-04-24T23:39:55.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa94ffff640 1 --2- 172.21.15.57:0/1386886281 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa95014dea0 0x7fa95013ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:39:55.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa94effd640 1 --2- 172.21.15.57:0/1386886281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9500c32d0 0x7fa9501472f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:39:55.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa94f7fe640 1 --2- 172.21.15.57:0/1386886281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9500c1080 0x7fa9501ec720 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa94000d800 tx=0x7fa94000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:55.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa937fff640 1 -- 172.21.15.57:0/1386886281 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94000b6c0 con 0x7fa9500c1080 2024-04-24T23:39:55.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa937fff640 1 -- 172.21.15.57:0/1386886281 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa940019070 con 0x7fa9500c1080 2024-04-24T23:39:55.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa955e9a640 1 -- 172.21.15.57:0/1386886281 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9501ed2c0 con 0x7fa9500c1080 2024-04-24T23:39:55.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa937fff640 1 -- 172.21.15.57:0/1386886281 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94000ba60 con 0x7fa9500c1080 2024-04-24T23:39:55.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa955e9a640 1 -- 172.21.15.57:0/1386886281 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9501ea6a0 con 0x7fa9500c1080 2024-04-24T23:39:55.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa955e9a640 1 -- 172.21.15.57:0/1386886281 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa950068220 con 0x7fa9500c1080 2024-04-24T23:39:55.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa937fff640 1 -- 172.21.15.57:0/1386886281 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa94000bc00 con 0x7fa9500c1080 2024-04-24T23:39:55.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa937fff640 1 --2- 172.21.15.57:0/1386886281 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa93c0678c0 0x7fa93c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:55.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa937fff640 1 -- 172.21.15.57:0/1386886281 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fa940086550 con 0x7fa9500c1080 2024-04-24T23:39:55.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.744+0000 7fa94effd640 1 --2- 172.21.15.57:0/1386886281 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa93c0678c0 0x7fa93c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:55.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.748+0000 7fa94effd640 1 --2- 172.21.15.57:0/1386886281 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa93c0678c0 0x7fa93c069d80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa9500b8680 tx=0x7fa944008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:55.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.748+0000 7fa937fff640 1 -- 172.21.15.57:0/1386886281 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fa940056c90 con 0x7fa9500c1080 2024-04-24T23:39:55.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.908+0000 7fa955e9a640 1 -- 172.21.15.57:0/1386886281 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa95014bb70 con 0x7fa9500c1080 2024-04-24T23:39:55.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.908+0000 7fa937fff640 1 -- 172.21.15.57:0/1386886281 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18853 (secure 0 0 0) 0x7fa940056590 con 0x7fa9500c1080 2024-04-24T23:39:55.911 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:39:55.911 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"fsid":"1ea31698-444a-4667-bcd9-b2608ad103c3","created":"2024-04-24T23:38:16.748774+0000","modified":"2024-04-24T23:39:22.806760+0000","last_up_change":"2024-04-24T23:38:26.956537+0000","last_in_change":"2024-04-24T23:38:18.972175+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:38:27.611782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:38:31.718061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:38:32.469413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:38:36.215724+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"35ce67bc-9b25-416e-ab1e-774c717631f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6825","nonce":671364028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6827","nonce":671364028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6831","nonce":671364028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6829","nonce":671364028}]},"public_addr":"172.21.15.57:6825/671364028","cluster_addr":"172.21.15.57:6827/671364028","heartbeat_back_addr":"172.21.15.57:6831/671364028","heartbeat_front_addr":"172.21.15.57:6829/671364028","state":["exists","up"]},{"osd":1,"uuid":"38f6f4ef-3bc2-4453-9946-7d1d17e735ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6801","nonce":2653552037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6803","nonce":2653552037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6807","nonce":2653552037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6805","nonce":2653552037}]},"public_addr":"172.21.15.57:6801/2653552037","cluster_addr":"172.21.15.57:6803/2653552037","heartbeat_back_addr":"172.21.15.57:6807/2653552037","heartbeat_front_addr":"172.21.15.57:6805/2653552037","state":["exists","up"]},{"osd":2,"uuid":"d77a0a49-b39a-464e-a1c9-49e19280c440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6816","nonce":1565874109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6819","nonce":1565874109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6823","nonce":1565874109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6821","nonce":1565874109}]},"public_addr":"172.21.15.57:6816/1565874109","cluster_addr":"172.21.15.57:6819/1565874109","heartbeat_back_addr":"172.21.15.57:6823/1565874109","heartbeat_front_addr":"172.21.15.57:6821/1565874109","state":["exists","up"]},{"osd":3,"uuid":"f8ea9bfe-d839-44a6-a185-0f0985da314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6809","nonce":3474703186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6811","nonce":3474703186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6817","nonce":3474703186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6813","nonce":3474703186}]},"public_addr":"172.21.15.57:6809/3474703186","cluster_addr":"172.21.15.57:6811/3474703186","heartbeat_back_addr":"172.21.15.57:6817/3474703186","heartbeat_front_addr":"172.21.15.57:6813/3474703186","state":["exists","up"]},{"osd":4,"uuid":"454647d4-6ac2-46b4-8451-320eb951a87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6801","nonce":1271707713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6803","nonce":1271707713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6807","nonce":1271707713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6805","nonce":1271707713}]},"public_addr":"172.21.15.88:6801/1271707713","cluster_addr":"172.21.15.88:6803/1271707713","heartbeat_back_addr":"172.21.15.88:6807/1271707713","heartbeat_front_addr":"172.21.15.88:6805/1271707713","state":["exists","up"]},{"osd":5,"uuid":"f71c03a3-7ad8-46d3-89c9-d61de102586b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6809","nonce":2035054888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6813","nonce":2035054888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6820","nonce":2035054888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6816","nonce":2035054888}]},"public_addr":"172.21.15.88:6809/2035054888","cluster_addr":"172.21.15.88:6813/2035054888","heartbeat_back_addr":"172.21.15.88:6820/2035054888","heartbeat_front_addr":"172.21.15.88:6816/2035054888","state":["exists","up"]},{"osd":6,"uuid":"ec7ae2b7-9cb4-4059-8f98-0022c9763f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6825","nonce":1752291242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6827","nonce":1752291242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6831","nonce":1752291242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6829","nonce":1752291242}]},"public_addr":"172.21.15.88:6825/1752291242","cluster_addr":"172.21.15.88:6827/1752291242","heartbeat_back_addr":"172.21.15.88:6831/1752291242","heartbeat_front_addr":"172.21.15.88:6829/1752291242","state":["exists","up"]},{"osd":7,"uuid":"c0ee7505-60c1-40ba-9902-47313a04dafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6812","nonce":1782800372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6817","nonce":1782800372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6823","nonce":1782800372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6821","nonce":1782800372}]},"public_addr":"172.21.15.88:6812/1782800372","cluster_addr":"172.21.15.88:6817/1782800372","heartbeat_back_addr":"172.21.15.88:6823/1782800372","heartbeat_front_addr":"172.21.15.88:6821/1782800372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.698562+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.682587+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.680197+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.561753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.011095+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.493320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.353451+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.423877+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:39:55.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.912+0000 7fa955e9a640 1 -- 172.21.15.57:0/1386886281 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa93c0678c0 msgr2=0x7fa93c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:55.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.912+0000 7fa955e9a640 1 --2- 172.21.15.57:0/1386886281 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa93c0678c0 0x7fa93c069d80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa9500b8680 tx=0x7fa944008040 comp rx=0 tx=0).stop 2024-04-24T23:39:55.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.912+0000 7fa955e9a640 1 -- 172.21.15.57:0/1386886281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9500c1080 msgr2=0x7fa9501ec720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:55.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.912+0000 7fa955e9a640 1 --2- 172.21.15.57:0/1386886281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9500c1080 0x7fa9501ec720 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa94000d800 tx=0x7fa94000dcc0 comp rx=0 tx=0).stop 2024-04-24T23:39:55.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.912+0000 7fa955e9a640 1 -- 172.21.15.57:0/1386886281 shutdown_connections 2024-04-24T23:39:55.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.912+0000 7fa955e9a640 1 --2- 172.21.15.57:0/1386886281 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fa93c0678c0 0x7fa93c069d80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:55.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.912+0000 7fa955e9a640 1 --2- 172.21.15.57:0/1386886281 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa95014dea0 0x7fa95013ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:55.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.912+0000 7fa955e9a640 1 --2- 172.21.15.57:0/1386886281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9500c32d0 0x7fa9501472f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:55.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.912+0000 7fa955e9a640 1 --2- 172.21.15.57:0/1386886281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9500c1080 0x7fa9501ec720 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:55.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.912+0000 7fa955e9a640 1 -- 172.21.15.57:0/1386886281 >> 172.21.15.57:0/1386886281 conn(0x7fa950067350 msgr2=0x7fa950067730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:55.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.912+0000 7fa955e9a640 1 -- 172.21.15.57:0/1386886281 shutdown_connections 2024-04-24T23:39:55.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:55.912+0000 7fa955e9a640 1 -- 172.21.15.57:0/1386886281 wait complete. 2024-04-24T23:39:55.928 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:38:27.611782+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:38:31.718061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:38:32.469413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-24T23:38:36.215724+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-24T23:39:55.929 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:39:56.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe64df9640 1 Processor -- start 2024-04-24T23:39:56.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe64df9640 1 -- start start 2024-04-24T23:39:56.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe64df9640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbe600675b0 0x7fbe6014f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:56.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe64df9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbe6014bc70 0x7fbe6014c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:56.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe64df9640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe6014f790 con 0x7fbe6006c480 2024-04-24T23:39:56.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe64df9640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fbe60072d70 con 0x7fbe6014bc70 2024-04-24T23:39:56.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe64df9640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fbe600728e0 con 0x7fbe600675b0 2024-04-24T23:39:56.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe5e59c640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbe6006c480 0x7fbe6006fe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:32866/0 (socket says 172.21.15.57:32866) 2024-04-24T23:39:56.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe5e59c640 1 -- 172.21.15.57:0/1161916283 learned_addr learned my addr 172.21.15.57:0/1161916283 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:56.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe5dd9b640 1 --2- 172.21.15.57:0/1161916283 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbe600675b0 0x7fbe6014f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:56.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe5ed9d640 1 --2- 172.21.15.57:0/1161916283 >> v2:172.21.15.88:3300/0 conn(0x7fbe6014bc70 0x7fbe6014c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:56.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe5d59a640 1 -- 172.21.15.57:0/1161916283 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1621149054 0 0) 0x7fbe6014f790 con 0x7fbe6006c480 2024-04-24T23:39:56.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe5d59a640 1 -- 172.21.15.57:0/1161916283 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe48003530 con 0x7fbe6006c480 2024-04-24T23:39:56.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe5d59a640 1 -- 172.21.15.57:0/1161916283 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3276193708 0 0) 0x7fbe48003530 con 0x7fbe6006c480 2024-04-24T23:39:56.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe5d59a640 1 -- 172.21.15.57:0/1161916283 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbe600675b0 msgr2=0x7fbe6014f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:56.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe5d59a640 1 --2- 172.21.15.57:0/1161916283 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbe600675b0 0x7fbe6014f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe5d59a640 1 -- 172.21.15.57:0/1161916283 >> v2:172.21.15.88:3300/0 conn(0x7fbe6014bc70 msgr2=0x7fbe6014c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:56.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe5d59a640 1 --2- 172.21.15.57:0/1161916283 >> v2:172.21.15.88:3300/0 conn(0x7fbe6014bc70 0x7fbe6014c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe5d59a640 1 -- 172.21.15.57:0/1161916283 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe60071b60 con 0x7fbe6006c480 2024-04-24T23:39:56.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe5d59a640 1 -- 172.21.15.57:0/1161916283 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7fbe50001680 con 0x7fbe6006c480 2024-04-24T23:39:56.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe5d59a640 1 -- 172.21.15.57:0/1161916283 >> v1:172.21.15.57:6789/0 conn(0x7fbe6006c480 legacy=0x7fbe6006fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:56.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe5d59a640 1 --2- 172.21.15.57:0/1161916283 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe480039c0 0x7fbe48003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:56.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe5d59a640 1 --2- 172.21.15.57:0/1161916283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe48004810 0x7fbe48004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:56.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe5d59a640 1 --2- 172.21.15.57:0/1161916283 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbe600675b0 0x7fbe480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:56.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe5d59a640 1 -- 172.21.15.57:0/1161916283 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbe60072d70 con 0x7fbe480039c0 2024-04-24T23:39:56.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe5d59a640 1 -- 172.21.15.57:0/1161916283 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbe600728e0 con 0x7fbe48004810 2024-04-24T23:39:56.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe5d59a640 1 -- 172.21.15.57:0/1161916283 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fbe4800b9d0 con 0x7fbe600675b0 2024-04-24T23:39:56.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe5e59c640 1 --2- 172.21.15.57:0/1161916283 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe480039c0 0x7fbe48003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:56.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe5ed9d640 1 --2- 172.21.15.57:0/1161916283 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbe600675b0 0x7fbe480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:56.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe5dd9b640 1 --2- 172.21.15.57:0/1161916283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe48004810 0x7fbe48004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:56.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe5e59c640 1 -- 172.21.15.57:0/1161916283 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbe600675b0 msgr2=0x7fbe480051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:56.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe5e59c640 1 --2- 172.21.15.57:0/1161916283 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbe600675b0 0x7fbe480051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe5e59c640 1 -- 172.21.15.57:0/1161916283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe48004810 msgr2=0x7fbe48004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:56.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe5e59c640 1 --2- 172.21.15.57:0/1161916283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe48004810 0x7fbe48004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe5e59c640 1 -- 172.21.15.57:0/1161916283 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe48003530 con 0x7fbe480039c0 2024-04-24T23:39:56.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.048+0000 7fbe5ed9d640 1 --2- 172.21.15.57:0/1161916283 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbe600675b0 0x7fbe480051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:39:56.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.052+0000 7fbe5e59c640 1 --2- 172.21.15.57:0/1161916283 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe480039c0 0x7fbe48003e00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbe5000c190 tx=0x7fbe5001cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d42ea36b33717f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:56.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.052+0000 7fbe5d59a640 1 -- 172.21.15.57:0/1161916283 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe50007c50 con 0x7fbe480039c0 2024-04-24T23:39:56.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.052+0000 7fbe5d59a640 1 -- 172.21.15.57:0/1161916283 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe500a9020 con 0x7fbe480039c0 2024-04-24T23:39:56.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.052+0000 7fbe5d59a640 1 -- 172.21.15.57:0/1161916283 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe50005ae0 con 0x7fbe480039c0 2024-04-24T23:39:56.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.052+0000 7fbe64df9640 1 -- 172.21.15.57:0/1161916283 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe480039c0 msgr2=0x7fbe48003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:56.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.052+0000 7fbe64df9640 1 --2- 172.21.15.57:0/1161916283 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe480039c0 0x7fbe48003e00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbe5000c190 tx=0x7fbe5001cbc0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.052+0000 7fbe5ed9d640 1 -- 172.21.15.57:0/1161916283 reap_dead start 2024-04-24T23:39:56.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.052+0000 7fbe64df9640 1 -- 172.21.15.57:0/1161916283 shutdown_connections 2024-04-24T23:39:56.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.052+0000 7fbe64df9640 1 -- 172.21.15.57:0/1161916283 >> 172.21.15.57:0/1161916283 conn(0x7fbe600bf370 msgr2=0x7fbe600bf780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:56.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.052+0000 7fbe64df9640 1 -- 172.21.15.57:0/1161916283 shutdown_connections 2024-04-24T23:39:56.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.052+0000 7fbe64df9640 1 -- 172.21.15.57:0/1161916283 wait complete. 2024-04-24T23:39:56.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.052+0000 7fbe64df9640 1 Processor -- start 2024-04-24T23:39:56.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.052+0000 7fbe64df9640 1 -- start start 2024-04-24T23:39:56.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.056+0000 7fbe64df9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe480039c0 0x7fbe601e9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:56.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.056+0000 7fbe64df9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe600a4200 0x7fbe60158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:56.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.056+0000 7fbe64df9640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbe600a77e0 0x7fbe600a33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:56.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.056+0000 7fbe64df9640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbe600bcf90 con 0x7fbe600a4200 2024-04-24T23:39:56.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.056+0000 7fbe64df9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbe600bce10 con 0x7fbe480039c0 2024-04-24T23:39:56.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.056+0000 7fbe64df9640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fbe60071e40 con 0x7fbe600a77e0 2024-04-24T23:39:56.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.056+0000 7fbe5dd9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe600a4200 0x7fbe60158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:56.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.056+0000 7fbe5dd9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe600a4200 0x7fbe60158210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35862/0 (socket says 172.21.15.57:35862) 2024-04-24T23:39:56.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.056+0000 7fbe5dd9b640 1 -- 172.21.15.57:0/98334521 learned_addr learned my addr 172.21.15.57:0/98334521 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:56.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.056+0000 7fbe5e59c640 1 --2- 172.21.15.57:0/98334521 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe480039c0 0x7fbe601e9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:56.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.056+0000 7fbe5ed9d640 1 --2- 172.21.15.57:0/98334521 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbe600a77e0 0x7fbe600a33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:56.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.056+0000 7fbe5dd9b640 1 -- 172.21.15.57:0/98334521 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbe600a77e0 msgr2=0x7fbe600a33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:56.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.056+0000 7fbe5dd9b640 1 --2- 172.21.15.57:0/98334521 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbe600a77e0 0x7fbe600a33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.056+0000 7fbe5dd9b640 1 -- 172.21.15.57:0/98334521 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe480039c0 msgr2=0x7fbe601e9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:56.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.056+0000 7fbe5dd9b640 1 --2- 172.21.15.57:0/98334521 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe480039c0 0x7fbe601e9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.056+0000 7fbe5dd9b640 1 -- 172.21.15.57:0/98334521 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe601e98e0 con 0x7fbe600a4200 2024-04-24T23:39:56.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.056+0000 7fbe5dd9b640 1 --2- 172.21.15.57:0/98334521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe600a4200 0x7fbe60158210 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbe54011560 tx=0x7fbe54011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:56.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.056+0000 7fbe4effd640 1 -- 172.21.15.57:0/98334521 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe54015930 con 0x7fbe600a4200 2024-04-24T23:39:56.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.056+0000 7fbe4effd640 1 -- 172.21.15.57:0/98334521 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe54015ad0 con 0x7fbe600a4200 2024-04-24T23:39:56.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.056+0000 7fbe64df9640 1 -- 172.21.15.57:0/98334521 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe600a5ba0 con 0x7fbe600a4200 2024-04-24T23:39:56.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.056+0000 7fbe4effd640 1 -- 172.21.15.57:0/98334521 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5401d400 con 0x7fbe600a4200 2024-04-24T23:39:56.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.056+0000 7fbe64df9640 1 -- 172.21.15.57:0/98334521 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe601e95e0 con 0x7fbe600a4200 2024-04-24T23:39:56.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.056+0000 7fbe64df9640 1 -- 172.21.15.57:0/98334521 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe60068290 con 0x7fbe600a4200 2024-04-24T23:39:56.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.056+0000 7fbe4effd640 1 -- 172.21.15.57:0/98334521 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbe5401d5a0 con 0x7fbe600a4200 2024-04-24T23:39:56.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.056+0000 7fbe4effd640 1 --2- 172.21.15.57:0/98334521 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fbe400678f0 0x7fbe40069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:56.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.056+0000 7fbe4effd640 1 -- 172.21.15.57:0/98334521 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fbe54086850 con 0x7fbe600a4200 2024-04-24T23:39:56.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.056+0000 7fbe5e59c640 1 --2- 172.21.15.57:0/98334521 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fbe400678f0 0x7fbe40069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:56.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.060+0000 7fbe5e59c640 1 --2- 172.21.15.57:0/98334521 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fbe400678f0 0x7fbe40069db0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbe500aa000 tx=0x7fbe500b1040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:56.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.060+0000 7fbe4effd640 1 -- 172.21.15.57:0/98334521 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fbe54019030 con 0x7fbe600a4200 2024-04-24T23:39:56.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.220+0000 7fbe64df9640 1 -- 172.21.15.57:0/98334521 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbe600bc9e0 con 0x7fbe600a4200 2024-04-24T23:39:56.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.224+0000 7fbe4effd640 1 -- 172.21.15.57:0/98334521 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fbe54056f70 con 0x7fbe600a4200 2024-04-24T23:39:56.224 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-04-24T23:39:56.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.224+0000 7fbe64df9640 1 -- 172.21.15.57:0/98334521 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fbe400678f0 msgr2=0x7fbe40069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:56.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.224+0000 7fbe64df9640 1 --2- 172.21.15.57:0/98334521 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fbe400678f0 0x7fbe40069db0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbe500aa000 tx=0x7fbe500b1040 comp rx=0 tx=0).stop 2024-04-24T23:39:56.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.224+0000 7fbe64df9640 1 -- 172.21.15.57:0/98334521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe600a4200 msgr2=0x7fbe60158210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:56.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.224+0000 7fbe64df9640 1 --2- 172.21.15.57:0/98334521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe600a4200 0x7fbe60158210 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbe54011560 tx=0x7fbe54011a20 comp rx=0 tx=0).stop 2024-04-24T23:39:56.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.224+0000 7fbe64df9640 1 -- 172.21.15.57:0/98334521 shutdown_connections 2024-04-24T23:39:56.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.224+0000 7fbe64df9640 1 --2- 172.21.15.57:0/98334521 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fbe400678f0 0x7fbe40069db0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.224+0000 7fbe64df9640 1 --2- 172.21.15.57:0/98334521 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbe600a77e0 0x7fbe600a33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.224+0000 7fbe64df9640 1 --2- 172.21.15.57:0/98334521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe600a4200 0x7fbe60158210 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.224+0000 7fbe64df9640 1 --2- 172.21.15.57:0/98334521 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe480039c0 0x7fbe601e9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.224+0000 7fbe64df9640 1 -- 172.21.15.57:0/98334521 >> 172.21.15.57:0/98334521 conn(0x7fbe600bf370 msgr2=0x7fbe6006f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:56.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.224+0000 7fbe64df9640 1 -- 172.21.15.57:0/98334521 shutdown_connections 2024-04-24T23:39:56.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.224+0000 7fbe64df9640 1 -- 172.21.15.57:0/98334521 wait complete. 2024-04-24T23:39:56.242 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:39:56.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.364+0000 7f0007137640 1 Processor -- start 2024-04-24T23:39:56.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.364+0000 7f0007137640 1 -- start start 2024-04-24T23:39:56.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.364+0000 7f0007137640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f000014c1f0 0x7f0000151d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:56.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.364+0000 7f0007137640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f00000be110 0x7f0000152240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:56.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.364+0000 7f0007137640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00000bd780 con 0x7f000006b470 2024-04-24T23:39:56.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.364+0000 7f0007137640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f00000bdf60 con 0x7f000014c1f0 2024-04-24T23:39:56.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.364+0000 7f0007137640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f00000be620 con 0x7f00000be110 2024-04-24T23:39:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.364+0000 7f00056d4640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f00000be110 0x7f0000152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.364+0000 7efffffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f000014c1f0 0x7f0000151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.364+0000 7f00056d4640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f00000be110 0x7f0000152240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.57:45708/0 (socket says 172.21.15.57:45708) 2024-04-24T23:39:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.364+0000 7f0004ed3640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f000006b470 0x7f000014bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.57:47210/0 (socket says 172.21.15.57:47210) 2024-04-24T23:39:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.364+0000 7f00056d4640 1 -- 172.21.15.57:0/1686807648 learned_addr learned my addr 172.21.15.57:0/1686807648 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.364+0000 7effff7fe640 1 -- 172.21.15.57:0/1686807648 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1458910375 0 0) 0x7f00000bd780 con 0x7f000006b470 2024-04-24T23:39:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.364+0000 7effff7fe640 1 -- 172.21.15.57:0/1686807648 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effe8003530 con 0x7f000006b470 2024-04-24T23:39:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.364+0000 7f00056d4640 1 -- 172.21.15.57:0/1686807648 >> v2:172.21.15.88:3300/0 conn(0x7f000014c1f0 msgr2=0x7f0000151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.364+0000 7f00056d4640 1 --2- 172.21.15.57:0/1686807648 >> v2:172.21.15.88:3300/0 conn(0x7f000014c1f0 0x7f0000151d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.364+0000 7f00056d4640 1 -- 172.21.15.57:0/1686807648 >> v1:172.21.15.88:6789/0 conn(0x7f000006b470 legacy=0x7f000014bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:56.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.364+0000 7f00056d4640 1 -- 172.21.15.57:0/1686807648 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0000152780 con 0x7f00000be110 2024-04-24T23:39:56.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.364+0000 7efffffff640 1 --2- 172.21.15.57:0/1686807648 >> v2:172.21.15.88:3300/0 conn(0x7f000014c1f0 0x7f0000151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:39:56.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.368+0000 7f00056d4640 1 --2- 172.21.15.57:0/1686807648 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f00000be110 0x7f0000152240 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efff8009e50 tx=0x7efff801c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa0109d34c57e437 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:56.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.368+0000 7effff7fe640 1 -- 172.21.15.57:0/1686807648 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff80a5660 con 0x7f00000be110 2024-04-24T23:39:56.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.368+0000 7effff7fe640 1 -- 172.21.15.57:0/1686807648 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efff80a5800 con 0x7f00000be110 2024-04-24T23:39:56.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.368+0000 7effff7fe640 1 -- 172.21.15.57:0/1686807648 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff80a5bd0 con 0x7f00000be110 2024-04-24T23:39:56.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.368+0000 7f0007137640 1 -- 172.21.15.57:0/1686807648 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f00000be110 msgr2=0x7f0000152240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:56.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.368+0000 7f0007137640 1 --2- 172.21.15.57:0/1686807648 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f00000be110 0x7f0000152240 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efff8009e50 tx=0x7efff801c9a0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.368+0000 7f0007137640 1 -- 172.21.15.57:0/1686807648 shutdown_connections 2024-04-24T23:39:56.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.368+0000 7f0007137640 1 --2- 172.21.15.57:0/1686807648 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f00000be110 0x7f0000152240 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.368+0000 7f0007137640 1 --2- 172.21.15.57:0/1686807648 >> v2:172.21.15.88:3300/0 conn(0x7f000014c1f0 0x7f0000151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.368+0000 7f0007137640 1 -- 172.21.15.57:0/1686807648 >> 172.21.15.57:0/1686807648 conn(0x7f00000c30c0 msgr2=0x7f00000c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:56.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.368+0000 7f0007137640 1 -- 172.21.15.57:0/1686807648 shutdown_connections 2024-04-24T23:39:56.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.368+0000 7f0007137640 1 -- 172.21.15.57:0/1686807648 wait complete. 2024-04-24T23:39:56.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.368+0000 7f0007137640 1 Processor -- start 2024-04-24T23:39:56.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.368+0000 7f0007137640 1 -- start start 2024-04-24T23:39:56.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.372+0000 7f0007137640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f000006b470 0x7f000006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:56.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.372+0000 7f0007137640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f00000be110 0x7f00000c2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:56.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.372+0000 7f0007137640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f000014c1f0 0x7f000014a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.372+0000 7f0007137640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f000006b9d0 con 0x7f000006b470 2024-04-24T23:39:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.372+0000 7f0007137640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f000006b850 con 0x7f000014c1f0 2024-04-24T23:39:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.372+0000 7f0007137640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f00000bf750 con 0x7f00000be110 2024-04-24T23:39:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.372+0000 7f0004ed3640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f000006b470 0x7f000006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.372+0000 7f0004ed3640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f000006b470 0x7f000006e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35878/0 (socket says 172.21.15.57:35878) 2024-04-24T23:39:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.372+0000 7f0004ed3640 1 -- 172.21.15.57:0/2322010136 learned_addr learned my addr 172.21.15.57:0/2322010136 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.372+0000 7efffffff640 1 --2- 172.21.15.57:0/2322010136 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f00000be110 0x7f00000c2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.372+0000 7f00056d4640 1 --2- 172.21.15.57:0/2322010136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f000014c1f0 0x7f000014a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.372+0000 7f0004ed3640 1 -- 172.21.15.57:0/2322010136 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f00000be110 msgr2=0x7f00000c2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.372+0000 7f0004ed3640 1 --2- 172.21.15.57:0/2322010136 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f00000be110 0x7f00000c2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.372+0000 7f0004ed3640 1 -- 172.21.15.57:0/2322010136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f000014c1f0 msgr2=0x7f000014a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.372+0000 7f0004ed3640 1 --2- 172.21.15.57:0/2322010136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f000014c1f0 0x7f000014a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.372+0000 7f0004ed3640 1 -- 172.21.15.57:0/2322010136 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000006ed00 con 0x7f000006b470 2024-04-24T23:39:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.372+0000 7f0004ed3640 1 --2- 172.21.15.57:0/2322010136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f000006b470 0x7f000006e7c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7efff400c430 tx=0x7efff400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.372+0000 7efffd7fa640 1 -- 172.21.15.57:0/2322010136 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff40074e0 con 0x7f000006b470 2024-04-24T23:39:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.372+0000 7efffd7fa640 1 -- 172.21.15.57:0/2322010136 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efff40047f0 con 0x7f000006b470 2024-04-24T23:39:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.372+0000 7f0007137640 1 -- 172.21.15.57:0/2322010136 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00000a5d20 con 0x7f000006b470 2024-04-24T23:39:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.372+0000 7efffd7fa640 1 -- 172.21.15.57:0/2322010136 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff40076a0 con 0x7f000006b470 2024-04-24T23:39:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.372+0000 7f0007137640 1 -- 172.21.15.57:0/2322010136 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0000141bd0 con 0x7f000006b470 2024-04-24T23:39:56.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.372+0000 7f0007137640 1 -- 172.21.15.57:0/2322010136 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0000068930 con 0x7f000006b470 2024-04-24T23:39:56.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.372+0000 7efffd7fa640 1 -- 172.21.15.57:0/2322010136 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efff401a020 con 0x7f000006b470 2024-04-24T23:39:56.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.372+0000 7efffd7fa640 1 --2- 172.21.15.57:0/2322010136 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7effec0678c0 0x7effec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:56.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.372+0000 7efffd7fa640 1 -- 172.21.15.57:0/2322010136 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7efff40858e0 con 0x7f000006b470 2024-04-24T23:39:56.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.372+0000 7efffffff640 1 --2- 172.21.15.57:0/2322010136 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7effec0678c0 0x7effec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:56.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.376+0000 7efffffff640 1 --2- 172.21.15.57:0/2322010136 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7effec0678c0 0x7effec069d80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0000152b10 tx=0x7efff0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:56.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.380+0000 7efffd7fa640 1 -- 172.21.15.57:0/2322010136 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f000006ed00 con 0x7f000006b470 2024-04-24T23:39:56.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.536+0000 7f0007137640 1 -- 172.21.15.57:0/2322010136 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0000151a00 con 0x7f000006b470 2024-04-24T23:39:56.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.536+0000 7efffd7fa640 1 -- 172.21.15.57:0/2322010136 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7efff40560b0 con 0x7f000006b470 2024-04-24T23:39:56.537 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-04-24T23:39:56.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.540+0000 7f0007137640 1 -- 172.21.15.57:0/2322010136 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7effec0678c0 msgr2=0x7effec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:56.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.540+0000 7f0007137640 1 --2- 172.21.15.57:0/2322010136 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7effec0678c0 0x7effec069d80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0000152b10 tx=0x7efff0008040 comp rx=0 tx=0).stop 2024-04-24T23:39:56.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.540+0000 7f0007137640 1 -- 172.21.15.57:0/2322010136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f000006b470 msgr2=0x7f000006e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:56.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.540+0000 7f0007137640 1 --2- 172.21.15.57:0/2322010136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f000006b470 0x7f000006e7c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7efff400c430 tx=0x7efff400c8f0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.540+0000 7f0007137640 1 -- 172.21.15.57:0/2322010136 shutdown_connections 2024-04-24T23:39:56.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.540+0000 7f0007137640 1 --2- 172.21.15.57:0/2322010136 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7effec0678c0 0x7effec069d80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.540+0000 7f0007137640 1 --2- 172.21.15.57:0/2322010136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f000014c1f0 0x7f000014a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.540+0000 7f0007137640 1 --2- 172.21.15.57:0/2322010136 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f00000be110 0x7f00000c2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.540+0000 7f0007137640 1 --2- 172.21.15.57:0/2322010136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f000006b470 0x7f000006e7c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.540+0000 7f0007137640 1 -- 172.21.15.57:0/2322010136 >> 172.21.15.57:0/2322010136 conn(0x7f00000c30c0 msgr2=0x7f00001457a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:56.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.540+0000 7f0007137640 1 -- 172.21.15.57:0/2322010136 shutdown_connections 2024-04-24T23:39:56.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.540+0000 7f0007137640 1 -- 172.21.15.57:0/2322010136 wait complete. 2024-04-24T23:39:56.555 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:39:56.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.672+0000 7fc6b2313640 1 Processor -- start 2024-04-24T23:39:56.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.672+0000 7fc6b2313640 1 -- start start 2024-04-24T23:39:56.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.672+0000 7fc6b2313640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc6ac14deb0 0x7fc6ac0c2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:56.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.672+0000 7fc6b2313640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6ac151270 con 0x7fc6ac0b8660 2024-04-24T23:39:56.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.672+0000 7fc6b2313640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6ac151550 con 0x7fc6ac0c3490 2024-04-24T23:39:56.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.672+0000 7fc6b2313640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fc6ac0c0a90 con 0x7fc6ac14deb0 2024-04-24T23:39:56.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.672+0000 7fc6abfff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc6ac14deb0 0x7fc6ac0c2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:56.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.672+0000 7fc6b08b0640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc6ac0b8660 0x7fc6ac15b060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:32872/0 (socket says 172.21.15.57:32872) 2024-04-24T23:39:56.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.672+0000 7fc6abfff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc6ac14deb0 0x7fc6ac0c2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35886/0 (socket says 172.21.15.57:35886) 2024-04-24T23:39:56.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.672+0000 7fc6b08b0640 1 -- 172.21.15.57:0/2628822778 learned_addr learned my addr 172.21.15.57:0/2628822778 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:56.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.672+0000 7fc6abfff640 1 -- 172.21.15.57:0/2628822778 >> v1:172.21.15.88:6789/0 conn(0x7fc6ac0c3490 legacy=0x7fc6ac0c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:56.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.672+0000 7fc6abfff640 1 -- 172.21.15.57:0/2628822778 >> v1:172.21.15.57:6789/0 conn(0x7fc6ac0b8660 legacy=0x7fc6ac15b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:56.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.672+0000 7fc6abfff640 1 -- 172.21.15.57:0/2628822778 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ac0c06d0 con 0x7fc6ac14deb0 2024-04-24T23:39:56.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.672+0000 7fc6abfff640 1 --2- 172.21.15.57:0/2628822778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6ac14deb0 0x7fc6ac0c2f50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc69c0097c0 tx=0x7fc69c01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=618480fafe50ae2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:56.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.672+0000 7fc6aaffd640 1 -- 172.21.15.57:0/2628822778 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69c0b5070 con 0x7fc6ac14deb0 2024-04-24T23:39:56.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.672+0000 7fc6aaffd640 1 -- 172.21.15.57:0/2628822778 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc69c0a8950 con 0x7fc6ac14deb0 2024-04-24T23:39:56.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.672+0000 7fc6aaffd640 1 -- 172.21.15.57:0/2628822778 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69c0a8d20 con 0x7fc6ac14deb0 2024-04-24T23:39:56.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6b2313640 1 -- 172.21.15.57:0/2628822778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6ac14deb0 msgr2=0x7fc6ac0c2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:56.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6b2313640 1 --2- 172.21.15.57:0/2628822778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6ac14deb0 0x7fc6ac0c2f50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc69c0097c0 tx=0x7fc69c01ec50 comp rx=0 tx=0).stop 2024-04-24T23:39:56.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6b2313640 1 -- 172.21.15.57:0/2628822778 shutdown_connections 2024-04-24T23:39:56.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6b2313640 1 --2- 172.21.15.57:0/2628822778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6ac14deb0 0x7fc6ac0c2f50 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6b2313640 1 -- 172.21.15.57:0/2628822778 >> 172.21.15.57:0/2628822778 conn(0x7fc6ac067120 msgr2=0x7fc6ac067530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:56.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6b2313640 1 -- 172.21.15.57:0/2628822778 shutdown_connections 2024-04-24T23:39:56.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6b2313640 1 -- 172.21.15.57:0/2628822778 wait complete. 2024-04-24T23:39:56.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6b2313640 1 Processor -- start 2024-04-24T23:39:56.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6b2313640 1 -- start start 2024-04-24T23:39:56.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6b2313640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6ac0b8660 0x7fc6ac151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:56.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6b2313640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6ac0c3490 0x7fc6ac13a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:56.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6b2313640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6ac14deb0 0x7fc6ac13ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:56.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6b2313640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ac0c1910 con 0x7fc6ac14deb0 2024-04-24T23:39:56.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6b2313640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ac0c0d70 con 0x7fc6ac0b8660 2024-04-24T23:39:56.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6b2313640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fc6ac0b91f0 con 0x7fc6ac0c3490 2024-04-24T23:39:56.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6b08b0640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6ac14deb0 0x7fc6ac13ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:56.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6b08b0640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6ac14deb0 0x7fc6ac13ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35900/0 (socket says 172.21.15.57:35900) 2024-04-24T23:39:56.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6b08b0640 1 -- 172.21.15.57:0/3978586623 learned_addr learned my addr 172.21.15.57:0/3978586623 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:56.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6ab7fe640 1 --2- 172.21.15.57:0/3978586623 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6ac0c3490 0x7fc6ac13a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:56.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6abfff640 1 --2- 172.21.15.57:0/3978586623 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6ac0b8660 0x7fc6ac151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:56.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6b08b0640 1 -- 172.21.15.57:0/3978586623 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6ac0c3490 msgr2=0x7fc6ac13a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:56.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6b08b0640 1 --2- 172.21.15.57:0/3978586623 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6ac0c3490 0x7fc6ac13a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6b08b0640 1 -- 172.21.15.57:0/3978586623 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6ac0b8660 msgr2=0x7fc6ac151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:56.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6b08b0640 1 --2- 172.21.15.57:0/3978586623 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6ac0b8660 0x7fc6ac151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6b08b0640 1 -- 172.21.15.57:0/3978586623 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ac1524b0 con 0x7fc6ac14deb0 2024-04-24T23:39:56.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6abfff640 1 --2- 172.21.15.57:0/3978586623 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6ac0b8660 0x7fc6ac151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:39:56.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6b08b0640 1 --2- 172.21.15.57:0/3978586623 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6ac14deb0 0x7fc6ac13ac10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc6a400cbc0 tx=0x7fc6a400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:56.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6a8ff9640 1 -- 172.21.15.57:0/3978586623 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4017070 con 0x7fc6ac14deb0 2024-04-24T23:39:56.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6a8ff9640 1 -- 172.21.15.57:0/3978586623 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6a400ad40 con 0x7fc6ac14deb0 2024-04-24T23:39:56.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6a8ff9640 1 -- 172.21.15.57:0/3978586623 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4012600 con 0x7fc6ac14deb0 2024-04-24T23:39:56.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6b2313640 1 -- 172.21.15.57:0/3978586623 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6ac1e7090 con 0x7fc6ac14deb0 2024-04-24T23:39:56.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.676+0000 7fc6b2313640 1 -- 172.21.15.57:0/3978586623 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6ac1e7370 con 0x7fc6ac14deb0 2024-04-24T23:39:56.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.680+0000 7fc6b2313640 1 -- 172.21.15.57:0/3978586623 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6ac068290 con 0x7fc6ac14deb0 2024-04-24T23:39:56.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.680+0000 7fc6a8ff9640 1 -- 172.21.15.57:0/3978586623 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc6a401a070 con 0x7fc6ac14deb0 2024-04-24T23:39:56.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.680+0000 7fc6a8ff9640 1 --2- 172.21.15.57:0/3978586623 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc68c0678c0 0x7fc68c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:56.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.680+0000 7fc6a8ff9640 1 -- 172.21.15.57:0/3978586623 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc6a4085c60 con 0x7fc6ac14deb0 2024-04-24T23:39:56.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.680+0000 7fc6abfff640 1 --2- 172.21.15.57:0/3978586623 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc68c0678c0 0x7fc68c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:56.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.680+0000 7fc6abfff640 1 --2- 172.21.15.57:0/3978586623 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc68c0678c0 0x7fc68c069d80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc69c0b2000 tx=0x7fc69c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:56.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.684+0000 7fc6a8ff9640 1 -- 172.21.15.57:0/3978586623 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fc6ac1524b0 con 0x7fc6ac14deb0 2024-04-24T23:39:56.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.836+0000 7fc6b2313640 1 -- 172.21.15.57:0/3978586623 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc6ac14ee60 con 0x7fc6ac14deb0 2024-04-24T23:39:56.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.836+0000 7fc6a8ff9640 1 -- 172.21.15.57:0/3978586623 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fc6a4085070 con 0x7fc6ac14deb0 2024-04-24T23:39:56.839 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-24T23:39:56.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.840+0000 7fc6b2313640 1 -- 172.21.15.57:0/3978586623 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc68c0678c0 msgr2=0x7fc68c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:56.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.840+0000 7fc6b2313640 1 --2- 172.21.15.57:0/3978586623 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc68c0678c0 0x7fc68c069d80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc69c0b2000 tx=0x7fc69c008040 comp rx=0 tx=0).stop 2024-04-24T23:39:56.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.840+0000 7fc6b2313640 1 -- 172.21.15.57:0/3978586623 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6ac14deb0 msgr2=0x7fc6ac13ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:56.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.840+0000 7fc6b2313640 1 --2- 172.21.15.57:0/3978586623 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6ac14deb0 0x7fc6ac13ac10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc6a400cbc0 tx=0x7fc6a400a430 comp rx=0 tx=0).stop 2024-04-24T23:39:56.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.840+0000 7fc6b2313640 1 -- 172.21.15.57:0/3978586623 shutdown_connections 2024-04-24T23:39:56.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.840+0000 7fc6b2313640 1 --2- 172.21.15.57:0/3978586623 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc68c0678c0 0x7fc68c069d80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.840+0000 7fc6b2313640 1 --2- 172.21.15.57:0/3978586623 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6ac14deb0 0x7fc6ac13ac10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.840+0000 7fc6b2313640 1 --2- 172.21.15.57:0/3978586623 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6ac0c3490 0x7fc6ac13a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.840+0000 7fc6b2313640 1 --2- 172.21.15.57:0/3978586623 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6ac0b8660 0x7fc6ac151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.840+0000 7fc6b2313640 1 -- 172.21.15.57:0/3978586623 >> 172.21.15.57:0/3978586623 conn(0x7fc6ac067120 msgr2=0x7fc6ac067500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:56.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.840+0000 7fc6b2313640 1 -- 172.21.15.57:0/3978586623 shutdown_connections 2024-04-24T23:39:56.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.840+0000 7fc6b2313640 1 -- 172.21.15.57:0/3978586623 wait complete. 2024-04-24T23:39:56.857 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-24T23:39:56.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.984+0000 7f5e3472b640 1 Processor -- start 2024-04-24T23:39:56.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.984+0000 7f5e3472b640 1 -- start start 2024-04-24T23:39:56.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.984+0000 7f5e3472b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5e2c06b470 0x7f5e2c14bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:56.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.984+0000 7f5e3472b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5e2c152410 0x7f5e2c14c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:56.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.984+0000 7f5e3472b640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e2c0bd780 con 0x7f5e2c0be110 2024-04-24T23:39:56.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.984+0000 7f5e3472b640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f5e2c0bdf60 con 0x7f5e2c152410 2024-04-24T23:39:56.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.984+0000 7f5e3472b640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f5e2c0be620 con 0x7f5e2c06b470 2024-04-24T23:39:56.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.984+0000 7f5e31cc6640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5e2c0be110 0x7f5e2c151d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:32886/0 (socket says 172.21.15.57:32886) 2024-04-24T23:39:56.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.984+0000 7f5e31cc6640 1 -- 172.21.15.57:0/2141525051 learned_addr learned my addr 172.21.15.57:0/2141525051 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:39:56.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.984+0000 7f5e32cc8640 1 --2- 172.21.15.57:0/2141525051 >> v2:172.21.15.57:3300/0 conn(0x7f5e2c152410 0x7f5e2c14c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:56.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.984+0000 7f5e324c7640 1 --2- 172.21.15.57:0/2141525051 >> v2:172.21.15.88:3300/0 conn(0x7f5e2c06b470 0x7f5e2c14bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:56.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.984+0000 7f5e32cc8640 1 -- 172.21.15.57:0/2141525051 >> v2:172.21.15.88:3300/0 conn(0x7f5e2c06b470 msgr2=0x7f5e2c14bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:56.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.984+0000 7f5e32cc8640 1 --2- 172.21.15.57:0/2141525051 >> v2:172.21.15.88:3300/0 conn(0x7f5e2c06b470 0x7f5e2c14bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.984+0000 7f5e32cc8640 1 -- 172.21.15.57:0/2141525051 >> v1:172.21.15.57:6789/0 conn(0x7f5e2c0be110 legacy=0x7f5e2c151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:56.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.984+0000 7f5e314c5640 1 -- 172.21.15.57:0/2141525051 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1534652959 0 0) 0x7f5e2c0bd780 con 0x7f5e2c0be110 2024-04-24T23:39:56.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.984+0000 7f5e32cc8640 1 -- 172.21.15.57:0/2141525051 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e2c0a6e20 con 0x7f5e2c152410 2024-04-24T23:39:56.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e32cc8640 1 --2- 172.21.15.57:0/2141525051 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e2c152410 0x7f5e2c14c020 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c068500 tx=0x7f5e2401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed7ec9080788fa0f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:56.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e314c5640 1 -- 172.21.15.57:0/2141525051 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e240b0070 con 0x7f5e2c152410 2024-04-24T23:39:56.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e314c5640 1 -- 172.21.15.57:0/2141525051 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e240ab600 con 0x7f5e2c152410 2024-04-24T23:39:56.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e314c5640 1 -- 172.21.15.57:0/2141525051 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e240ab9d0 con 0x7f5e2c152410 2024-04-24T23:39:56.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e3472b640 1 -- 172.21.15.57:0/2141525051 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e2c152410 msgr2=0x7f5e2c14c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:56.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e3472b640 1 --2- 172.21.15.57:0/2141525051 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e2c152410 0x7f5e2c14c020 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c068500 tx=0x7f5e2401c480 comp rx=0 tx=0).stop 2024-04-24T23:39:56.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e3472b640 1 -- 172.21.15.57:0/2141525051 shutdown_connections 2024-04-24T23:39:56.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e3472b640 1 --2- 172.21.15.57:0/2141525051 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e2c152410 0x7f5e2c14c020 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e3472b640 1 --2- 172.21.15.57:0/2141525051 >> v2:172.21.15.88:3300/0 conn(0x7f5e2c06b470 0x7f5e2c14bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e3472b640 1 -- 172.21.15.57:0/2141525051 >> 172.21.15.57:0/2141525051 conn(0x7f5e2c0c30c0 msgr2=0x7f5e2c0c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:56.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e3472b640 1 -- 172.21.15.57:0/2141525051 shutdown_connections 2024-04-24T23:39:56.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e3472b640 1 -- 172.21.15.57:0/2141525051 wait complete. 2024-04-24T23:39:56.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e3472b640 1 Processor -- start 2024-04-24T23:39:56.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e3472b640 1 -- start start 2024-04-24T23:39:56.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e3472b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e2c06b470 0x7f5e2c14cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:56.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e3472b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e2c0be110 0x7f5e2c1458d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:56.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e3472b640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e2c152410 0x7f5e2c0bc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:56.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e3472b640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2c0bf8d0 con 0x7f5e2c06b470 2024-04-24T23:39:56.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e3472b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2c0bf750 con 0x7f5e2c0be110 2024-04-24T23:39:56.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e3472b640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f5e2c15b850 con 0x7f5e2c152410 2024-04-24T23:39:56.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e324c7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e2c06b470 0x7f5e2c14cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:56.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e324c7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e2c06b470 0x7f5e2c14cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35924/0 (socket says 172.21.15.57:35924) 2024-04-24T23:39:56.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e324c7640 1 -- 172.21.15.57:0/1799444028 learned_addr learned my addr 172.21.15.57:0/1799444028 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:56.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e31cc6640 1 --2- 172.21.15.57:0/1799444028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e2c0be110 0x7f5e2c1458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:56.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e32cc8640 1 --2- 172.21.15.57:0/1799444028 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e2c152410 0x7f5e2c0bc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:56.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e324c7640 1 -- 172.21.15.57:0/1799444028 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e2c152410 msgr2=0x7f5e2c0bc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:56.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e324c7640 1 --2- 172.21.15.57:0/1799444028 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e2c152410 0x7f5e2c0bc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e324c7640 1 -- 172.21.15.57:0/1799444028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e2c0be110 msgr2=0x7f5e2c1458d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:56.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e324c7640 1 --2- 172.21.15.57:0/1799444028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e2c0be110 0x7f5e2c1458d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:56.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e324c7640 1 -- 172.21.15.57:0/1799444028 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e2c0bcc90 con 0x7f5e2c06b470 2024-04-24T23:39:56.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e324c7640 1 --2- 172.21.15.57:0/1799444028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e2c06b470 0x7f5e2c14cb30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5e28007e40 tx=0x7f5e2800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:56.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e22ffd640 1 -- 172.21.15.57:0/1799444028 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e28014620 con 0x7f5e2c06b470 2024-04-24T23:39:56.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e22ffd640 1 -- 172.21.15.57:0/1799444028 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e28019070 con 0x7f5e2c06b470 2024-04-24T23:39:56.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e3472b640 1 -- 172.21.15.57:0/1799444028 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e2c14e140 con 0x7f5e2c06b470 2024-04-24T23:39:56.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e22ffd640 1 -- 172.21.15.57:0/1799444028 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e280149e0 con 0x7f5e2c06b470 2024-04-24T23:39:56.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.988+0000 7f5e3472b640 1 -- 172.21.15.57:0/1799444028 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e2c0c1980 con 0x7f5e2c06b470 2024-04-24T23:39:56.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.992+0000 7f5e3472b640 1 -- 172.21.15.57:0/1799444028 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e2c068930 con 0x7f5e2c06b470 2024-04-24T23:39:56.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.992+0000 7f5e22ffd640 1 -- 172.21.15.57:0/1799444028 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5e28014b80 con 0x7f5e2c06b470 2024-04-24T23:39:56.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.992+0000 7f5e22ffd640 1 --2- 172.21.15.57:0/1799444028 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f5e100678c0 0x7f5e10069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:56.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.992+0000 7f5e22ffd640 1 -- 172.21.15.57:0/1799444028 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f5e280869d0 con 0x7f5e2c06b470 2024-04-24T23:39:56.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.992+0000 7f5e31cc6640 1 --2- 172.21.15.57:0/1799444028 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f5e100678c0 0x7f5e10069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:56.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.992+0000 7f5e31cc6640 1 --2- 172.21.15.57:0/1799444028 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f5e100678c0 0x7f5e10069d80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c0c2950 tx=0x7f5e1c007b80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:56.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:56.996+0000 7f5e22ffd640 1 -- 172.21.15.57:0/1799444028 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f5e2c0bcc90 con 0x7f5e2c06b470 2024-04-24T23:39:57.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.160+0000 7f5e3472b640 1 -- 172.21.15.57:0/1799444028 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f5e2c06dca0 con 0x7f5e2c06b470 2024-04-24T23:39:57.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.164+0000 7f5e22ffd640 1 -- 172.21.15.57:0/1799444028 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f5e28057080 con 0x7f5e2c06b470 2024-04-24T23:39:57.164 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-04-24T23:39:57.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.164+0000 7f5e3472b640 1 -- 172.21.15.57:0/1799444028 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f5e100678c0 msgr2=0x7f5e10069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:57.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.164+0000 7f5e3472b640 1 --2- 172.21.15.57:0/1799444028 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f5e100678c0 0x7f5e10069d80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c0c2950 tx=0x7f5e1c007b80 comp rx=0 tx=0).stop 2024-04-24T23:39:57.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.164+0000 7f5e3472b640 1 -- 172.21.15.57:0/1799444028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e2c06b470 msgr2=0x7f5e2c14cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:57.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.164+0000 7f5e3472b640 1 --2- 172.21.15.57:0/1799444028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e2c06b470 0x7f5e2c14cb30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5e28007e40 tx=0x7f5e2800e4b0 comp rx=0 tx=0).stop 2024-04-24T23:39:57.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.164+0000 7f5e3472b640 1 -- 172.21.15.57:0/1799444028 shutdown_connections 2024-04-24T23:39:57.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.164+0000 7f5e3472b640 1 --2- 172.21.15.57:0/1799444028 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f5e100678c0 0x7f5e10069d80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:57.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.164+0000 7f5e3472b640 1 --2- 172.21.15.57:0/1799444028 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e2c152410 0x7f5e2c0bc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:57.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.164+0000 7f5e3472b640 1 --2- 172.21.15.57:0/1799444028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e2c0be110 0x7f5e2c1458d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:57.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.164+0000 7f5e3472b640 1 --2- 172.21.15.57:0/1799444028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e2c06b470 0x7f5e2c14cb30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:57.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.164+0000 7f5e3472b640 1 -- 172.21.15.57:0/1799444028 >> 172.21.15.57:0/1799444028 conn(0x7f5e2c0c30c0 msgr2=0x7f5e2c0c03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:57.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.164+0000 7f5e3472b640 1 -- 172.21.15.57:0/1799444028 shutdown_connections 2024-04-24T23:39:57.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.164+0000 7f5e3472b640 1 -- 172.21.15.57:0/1799444028 wait complete. 2024-04-24T23:39:57.183 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:39:57.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.304+0000 7fdf3bc9c640 1 Processor -- start 2024-04-24T23:39:57.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.304+0000 7fdf3bc9c640 1 -- start start 2024-04-24T23:39:57.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.304+0000 7fdf3bc9c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdf340ba3d0 0x7fdf3414db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:57.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.304+0000 7fdf3bc9c640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf340b85d0 0x7fdf340b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:57.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.304+0000 7fdf3bc9c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdf3414e050 0x7fdf340b9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:57.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.304+0000 7fdf3bc9c640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fdf34151720 con 0x7fdf3414e050 2024-04-24T23:39:57.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.304+0000 7fdf3bc9c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fdf340c2770 con 0x7fdf340ba3d0 2024-04-24T23:39:57.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.304+0000 7fdf3bc9c640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fdf340c2a10 con 0x7fdf340b85d0 2024-04-24T23:39:57.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.304+0000 7fdf3a239640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdf3414e050 0x7fdf340b9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:57.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.304+0000 7fdf3a239640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdf3414e050 0x7fdf340b9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35932/0 (socket says 172.21.15.57:35932) 2024-04-24T23:39:57.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.304+0000 7fdf3a239640 1 -- 172.21.15.57:0/1929037763 learned_addr learned my addr 172.21.15.57:0/1929037763 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:57.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.308+0000 7fdf39a38640 1 --2- 172.21.15.57:0/1929037763 >> v2:172.21.15.88:3300/0 conn(0x7fdf340ba3d0 0x7fdf3414db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:57.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.308+0000 7fdf39237640 1 --2- 172.21.15.57:0/1929037763 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf340b85d0 0x7fdf340b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:57.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.308+0000 7fdf3a239640 1 -- 172.21.15.57:0/1929037763 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf340b85d0 msgr2=0x7fdf340b8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:57.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.308+0000 7fdf3a239640 1 --2- 172.21.15.57:0/1929037763 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf340b85d0 0x7fdf340b8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:57.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.308+0000 7fdf3a239640 1 -- 172.21.15.57:0/1929037763 >> v2:172.21.15.88:3300/0 conn(0x7fdf340ba3d0 msgr2=0x7fdf3414db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:39:57.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.308+0000 7fdf3a239640 1 --2- 172.21.15.57:0/1929037763 >> v2:172.21.15.88:3300/0 conn(0x7fdf340ba3d0 0x7fdf3414db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:57.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.308+0000 7fdf3a239640 1 -- 172.21.15.57:0/1929037763 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf340c2cf0 con 0x7fdf3414e050 2024-04-24T23:39:57.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.308+0000 7fdf3a239640 1 --2- 172.21.15.57:0/1929037763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf3414e050 0x7fdf340b9170 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdf340c3840 tx=0x7fdf2c01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec71392248faae7e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:57.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.308+0000 7fdf38a36640 1 -- 172.21.15.57:0/1929037763 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c0b4070 con 0x7fdf3414e050 2024-04-24T23:39:57.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.308+0000 7fdf38a36640 1 -- 172.21.15.57:0/1929037763 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf2c0af400 con 0x7fdf3414e050 2024-04-24T23:39:57.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.308+0000 7fdf38a36640 1 -- 172.21.15.57:0/1929037763 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c0af7d0 con 0x7fdf3414e050 2024-04-24T23:39:57.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.308+0000 7fdf3bc9c640 1 -- 172.21.15.57:0/1929037763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf3414e050 msgr2=0x7fdf340b9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:57.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.308+0000 7fdf3bc9c640 1 --2- 172.21.15.57:0/1929037763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf3414e050 0x7fdf340b9170 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdf340c3840 tx=0x7fdf2c01f1e0 comp rx=0 tx=0).stop 2024-04-24T23:39:57.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.308+0000 7fdf3bc9c640 1 -- 172.21.15.57:0/1929037763 shutdown_connections 2024-04-24T23:39:57.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.308+0000 7fdf3bc9c640 1 --2- 172.21.15.57:0/1929037763 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf340b85d0 0x7fdf340b8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:57.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.308+0000 7fdf3bc9c640 1 --2- 172.21.15.57:0/1929037763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf3414e050 0x7fdf340b9170 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:57.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.308+0000 7fdf3bc9c640 1 --2- 172.21.15.57:0/1929037763 >> v2:172.21.15.88:3300/0 conn(0x7fdf340ba3d0 0x7fdf3414db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:57.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.308+0000 7fdf3bc9c640 1 -- 172.21.15.57:0/1929037763 >> 172.21.15.57:0/1929037763 conn(0x7fdf34066f50 msgr2=0x7fdf34067360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:57.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.308+0000 7fdf3bc9c640 1 -- 172.21.15.57:0/1929037763 shutdown_connections 2024-04-24T23:39:57.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.308+0000 7fdf3bc9c640 1 -- 172.21.15.57:0/1929037763 wait complete. 2024-04-24T23:39:57.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.312+0000 7fdf3bc9c640 1 Processor -- start 2024-04-24T23:39:57.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.312+0000 7fdf3bc9c640 1 -- start start 2024-04-24T23:39:57.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.312+0000 7fdf3bc9c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf340b85d0 0x7fdf341519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:57.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.312+0000 7fdf3bc9c640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf340ba3d0 0x7fdf340c5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:57.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.312+0000 7fdf3bc9c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf3414e050 0x7fdf340be310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:57.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.312+0000 7fdf3bc9c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fdf340ba930 con 0x7fdf3414e050 2024-04-24T23:39:57.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.312+0000 7fdf3bc9c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fdf340ba7b0 con 0x7fdf340b85d0 2024-04-24T23:39:57.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.312+0000 7fdf3bc9c640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fdf340b96b0 con 0x7fdf340ba3d0 2024-04-24T23:39:57.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.312+0000 7fdf3a239640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf3414e050 0x7fdf340be310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:57.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.312+0000 7fdf3a239640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf3414e050 0x7fdf340be310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35942/0 (socket says 172.21.15.57:35942) 2024-04-24T23:39:57.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.312+0000 7fdf3a239640 1 -- 172.21.15.57:0/2703594111 learned_addr learned my addr 172.21.15.57:0/2703594111 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:39:57.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.312+0000 7fdf39a38640 1 --2- 172.21.15.57:0/2703594111 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf340b85d0 0x7fdf341519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:57.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.312+0000 7fdf39237640 1 --2- 172.21.15.57:0/2703594111 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf340ba3d0 0x7fdf340c5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:57.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.312+0000 7fdf3a239640 1 -- 172.21.15.57:0/2703594111 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf340ba3d0 msgr2=0x7fdf340c5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:57.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.312+0000 7fdf3a239640 1 --2- 172.21.15.57:0/2703594111 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf340ba3d0 0x7fdf340c5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:57.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.312+0000 7fdf3a239640 1 -- 172.21.15.57:0/2703594111 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf340b85d0 msgr2=0x7fdf341519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:57.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.312+0000 7fdf3a239640 1 --2- 172.21.15.57:0/2703594111 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf340b85d0 0x7fdf341519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:57.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.312+0000 7fdf3a239640 1 -- 172.21.15.57:0/2703594111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf340c5650 con 0x7fdf3414e050 2024-04-24T23:39:57.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.312+0000 7fdf3a239640 1 --2- 172.21.15.57:0/2703594111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf3414e050 0x7fdf340be310 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0b2040 tx=0x7fdf2c01bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:57.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.312+0000 7fdf2a7fc640 1 -- 172.21.15.57:0/2703594111 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c0b4040 con 0x7fdf3414e050 2024-04-24T23:39:57.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.312+0000 7fdf2a7fc640 1 -- 172.21.15.57:0/2703594111 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf2c0c0070 con 0x7fdf3414e050 2024-04-24T23:39:57.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.312+0000 7fdf3bc9c640 1 -- 172.21.15.57:0/2703594111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf341e6ae0 con 0x7fdf3414e050 2024-04-24T23:39:57.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.312+0000 7fdf2a7fc640 1 -- 172.21.15.57:0/2703594111 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c009510 con 0x7fdf3414e050 2024-04-24T23:39:57.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.312+0000 7fdf3bc9c640 1 -- 172.21.15.57:0/2703594111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf340bdb10 con 0x7fdf3414e050 2024-04-24T23:39:57.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.312+0000 7fdf3bc9c640 1 -- 172.21.15.57:0/2703594111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf34068930 con 0x7fdf3414e050 2024-04-24T23:39:57.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.312+0000 7fdf2a7fc640 1 -- 172.21.15.57:0/2703594111 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdf2c0c5460 con 0x7fdf3414e050 2024-04-24T23:39:57.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.312+0000 7fdf2a7fc640 1 --2- 172.21.15.57:0/2703594111 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fdf180678c0 0x7fdf18069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:39:57.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.316+0000 7fdf2a7fc640 1 -- 172.21.15.57:0/2703594111 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fdf2c124340 con 0x7fdf3414e050 2024-04-24T23:39:57.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.316+0000 7fdf39a38640 1 --2- 172.21.15.57:0/2703594111 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fdf180678c0 0x7fdf18069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:39:57.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.316+0000 7fdf39a38640 1 --2- 172.21.15.57:0/2703594111 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fdf180678c0 0x7fdf18069d80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdf3000b950 tx=0x7fdf30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:39:57.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.320+0000 7fdf2a7fc640 1 -- 172.21.15.57:0/2703594111 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fdf340c5650 con 0x7fdf3414e050 2024-04-24T23:39:57.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.496+0000 7fdf3bc9c640 1 -- 172.21.15.57:0/2703594111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdf34074cc0 con 0x7fdf3414e050 2024-04-24T23:39:57.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.496+0000 7fdf2a7fc640 1 -- 172.21.15.57:0/2703594111 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fdf2c018d40 con 0x7fdf3414e050 2024-04-24T23:39:57.497 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2024-04-24T23:39:57.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.500+0000 7fdf3bc9c640 1 -- 172.21.15.57:0/2703594111 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fdf180678c0 msgr2=0x7fdf18069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:57.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.500+0000 7fdf3bc9c640 1 --2- 172.21.15.57:0/2703594111 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fdf180678c0 0x7fdf18069d80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdf3000b950 tx=0x7fdf30008040 comp rx=0 tx=0).stop 2024-04-24T23:39:57.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.500+0000 7fdf3bc9c640 1 -- 172.21.15.57:0/2703594111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf3414e050 msgr2=0x7fdf340be310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:39:57.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.500+0000 7fdf3bc9c640 1 --2- 172.21.15.57:0/2703594111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf3414e050 0x7fdf340be310 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0b2040 tx=0x7fdf2c01bf80 comp rx=0 tx=0).stop 2024-04-24T23:39:57.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.500+0000 7fdf3bc9c640 1 -- 172.21.15.57:0/2703594111 shutdown_connections 2024-04-24T23:39:57.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.500+0000 7fdf3bc9c640 1 --2- 172.21.15.57:0/2703594111 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fdf180678c0 0x7fdf18069d80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:57.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.500+0000 7fdf3bc9c640 1 --2- 172.21.15.57:0/2703594111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf3414e050 0x7fdf340be310 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:57.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.500+0000 7fdf3bc9c640 1 --2- 172.21.15.57:0/2703594111 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf340ba3d0 0x7fdf340c5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:57.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.500+0000 7fdf3bc9c640 1 --2- 172.21.15.57:0/2703594111 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf340b85d0 0x7fdf341519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:39:57.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.500+0000 7fdf3bc9c640 1 -- 172.21.15.57:0/2703594111 >> 172.21.15.57:0/2703594111 conn(0x7fdf34066f50 msgr2=0x7fdf340c08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:39:57.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.500+0000 7fdf3bc9c640 1 -- 172.21.15.57:0/2703594111 shutdown_connections 2024-04-24T23:39:57.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:39:57.500+0000 7fdf3bc9c640 1 -- 172.21.15.57:0/2703594111 wait complete. 2024-04-24T23:39:57.517 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi174.front.sepia.ceph.com... 2024-04-24T23:39:57.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:39:57.517 DEBUG:teuthology.orchestra.run.smithi174:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-04-24T23:39:57.546 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi174.stderr:ceph-fuse[22859]: fuse finished with error 0 and tester_r 0 2024-04-24T23:39:57.548 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:40:03.650 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi174.front.sepia.ceph.com 2024-04-24T23:40:03.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:40:03.651 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-24T23:40:03.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:40:03.658 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2024-04-24T23:40:03.707 INFO:teuthology.orchestra.run.smithi174.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-24T23:40:03.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:40:03.708 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-24T23:40:03.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:40:03.764 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link delete ceph-brx 2024-04-24T23:40:03.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:40:03.928 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2024-04-24T23:40:03.935 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-24T23:40:03.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:40:03.935 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:40:03.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:40:03.993 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link delete ceph-brx 2024-04-24T23:40:04.245 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-24T23:40:04.257 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-24T23:40:04.257 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:40:04.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.388+0000 7f25ddd50640 1 Processor -- start 2024-04-24T23:40:04.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.388+0000 7f25ddd50640 1 -- start start 2024-04-24T23:40:04.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.392+0000 7f25ddd50640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f25d814bc60 0x7f25d806eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:04.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.392+0000 7f25ddd50640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f25d806f090 0x7f25d80b6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:04.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.392+0000 7f25ddd50640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25d814e8e0 con 0x7f25d80bdbe0 2024-04-24T23:40:04.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.392+0000 7f25ddd50640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f25d8152c20 con 0x7f25d806f090 2024-04-24T23:40:04.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.392+0000 7f25ddd50640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f25d814ebc0 con 0x7f25d814bc60 2024-04-24T23:40:04.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.392+0000 7f25d6ffd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f25d806f090 0x7f25d80b6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:04.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.392+0000 7f25d6ffd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f25d806f090 0x7f25d80b6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38998/0 (socket says 172.21.15.57:38998) 2024-04-24T23:40:04.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.392+0000 7f25d6ffd640 1 -- 172.21.15.57:0/4040862851 learned_addr learned my addr 172.21.15.57:0/4040862851 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:04.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.392+0000 7f25d77fe640 1 --2- 172.21.15.57:0/4040862851 >> v2:172.21.15.88:3300/0 conn(0x7f25d814bc60 0x7f25d806eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:04.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.392+0000 7f25d6ffd640 1 -- 172.21.15.57:0/4040862851 >> v2:172.21.15.88:3300/0 conn(0x7f25d814bc60 msgr2=0x7f25d806eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:04.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.392+0000 7f25d6ffd640 1 --2- 172.21.15.57:0/4040862851 >> v2:172.21.15.88:3300/0 conn(0x7f25d814bc60 0x7f25d806eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:04.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.392+0000 7f25d6ffd640 1 -- 172.21.15.57:0/4040862851 >> v1:172.21.15.88:6789/0 conn(0x7f25d80bdbe0 legacy=0x7f25d80bc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:04.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.392+0000 7f25d6ffd640 1 -- 172.21.15.57:0/4040862851 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25d814c040 con 0x7f25d806f090 2024-04-24T23:40:04.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.392+0000 7f25d6ffd640 1 --2- 172.21.15.57:0/4040862851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25d806f090 0x7f25d80b6fd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f25d806f6f0 tx=0x7f25c801c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e4dbbace9a9d6e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:04.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.392+0000 7f25d67fc640 1 -- 172.21.15.57:0/4040862851 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c80a5670 con 0x7f25d806f090 2024-04-24T23:40:04.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.392+0000 7f25d67fc640 1 -- 172.21.15.57:0/4040862851 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25c80a5810 con 0x7f25d806f090 2024-04-24T23:40:04.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.392+0000 7f25d67fc640 1 -- 172.21.15.57:0/4040862851 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c80a5be0 con 0x7f25d806f090 2024-04-24T23:40:04.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25ddd50640 1 -- 172.21.15.57:0/4040862851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25d806f090 msgr2=0x7f25d80b6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:04.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25ddd50640 1 --2- 172.21.15.57:0/4040862851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25d806f090 0x7f25d80b6fd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f25d806f6f0 tx=0x7f25c801c9b0 comp rx=0 tx=0).stop 2024-04-24T23:40:04.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25ddd50640 1 -- 172.21.15.57:0/4040862851 shutdown_connections 2024-04-24T23:40:04.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25ddd50640 1 --2- 172.21.15.57:0/4040862851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25d806f090 0x7f25d80b6fd0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:04.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25ddd50640 1 --2- 172.21.15.57:0/4040862851 >> v2:172.21.15.88:3300/0 conn(0x7f25d814bc60 0x7f25d806eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:04.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25ddd50640 1 -- 172.21.15.57:0/4040862851 >> 172.21.15.57:0/4040862851 conn(0x7f25d80beab0 msgr2=0x7f25d80beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:04.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25ddd50640 1 -- 172.21.15.57:0/4040862851 shutdown_connections 2024-04-24T23:40:04.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25ddd50640 1 -- 172.21.15.57:0/4040862851 wait complete. 2024-04-24T23:40:04.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25ddd50640 1 Processor -- start 2024-04-24T23:40:04.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25ddd50640 1 -- start start 2024-04-24T23:40:04.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25ddd50640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f25d806f090 0x7f25d80bbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:04.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25ddd50640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25d80bdbe0 0x7f25d8145540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:04.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25ddd50640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25d814bc60 0x7f25d81594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:04.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25ddd50640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f25d815c400 con 0x7f25d80bdbe0 2024-04-24T23:40:04.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25ddd50640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f25d815c280 con 0x7f25d814bc60 2024-04-24T23:40:04.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25ddd50640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f25d815c580 con 0x7f25d806f090 2024-04-24T23:40:04.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25d6ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25d80bdbe0 0x7f25d8145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:04.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25d6ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25d80bdbe0 0x7f25d8145540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39008/0 (socket says 172.21.15.57:39008) 2024-04-24T23:40:04.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25d6ffd640 1 -- 172.21.15.57:0/829165752 learned_addr learned my addr 172.21.15.57:0/829165752 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:04.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25d77fe640 1 --2- 172.21.15.57:0/829165752 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f25d806f090 0x7f25d80bbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:04.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25d7fff640 1 --2- 172.21.15.57:0/829165752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25d814bc60 0x7f25d81594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:04.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25d6ffd640 1 -- 172.21.15.57:0/829165752 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f25d806f090 msgr2=0x7f25d80bbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:04.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25d6ffd640 1 --2- 172.21.15.57:0/829165752 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f25d806f090 0x7f25d80bbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:04.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25d6ffd640 1 -- 172.21.15.57:0/829165752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25d814bc60 msgr2=0x7f25d81594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:04.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25d6ffd640 1 --2- 172.21.15.57:0/829165752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25d814bc60 0x7f25d81594f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:04.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25d6ffd640 1 -- 172.21.15.57:0/829165752 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25d8159a30 con 0x7f25d80bdbe0 2024-04-24T23:40:04.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25d6ffd640 1 --2- 172.21.15.57:0/829165752 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25d80bdbe0 0x7f25d8145540 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f25c80af040 tx=0x7f25c8019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:04.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25cffff640 1 -- 172.21.15.57:0/829165752 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c80bc020 con 0x7f25d80bdbe0 2024-04-24T23:40:04.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25cffff640 1 -- 172.21.15.57:0/829165752 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25c80b8670 con 0x7f25d80bdbe0 2024-04-24T23:40:04.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25ddd50640 1 -- 172.21.15.57:0/829165752 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25d8153d40 con 0x7f25d80bdbe0 2024-04-24T23:40:04.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25cffff640 1 -- 172.21.15.57:0/829165752 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c80b8a60 con 0x7f25d80bdbe0 2024-04-24T23:40:04.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.396+0000 7f25ddd50640 1 -- 172.21.15.57:0/829165752 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25d80bb3e0 con 0x7f25d80bdbe0 2024-04-24T23:40:04.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.400+0000 7f25ddd50640 1 -- 172.21.15.57:0/829165752 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25d8068220 con 0x7f25d80bdbe0 2024-04-24T23:40:04.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.400+0000 7f25cffff640 1 -- 172.21.15.57:0/829165752 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f25c80bf020 con 0x7f25d80bdbe0 2024-04-24T23:40:04.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.400+0000 7f25cffff640 1 --2- 172.21.15.57:0/829165752 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f25b80678f0 0x7f25b8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:04.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.400+0000 7f25cffff640 1 -- 172.21.15.57:0/829165752 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f25c81209f0 con 0x7f25d80bdbe0 2024-04-24T23:40:04.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.400+0000 7f25d77fe640 1 --2- 172.21.15.57:0/829165752 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f25b80678f0 0x7f25b8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:04.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.400+0000 7f25d77fe640 1 --2- 172.21.15.57:0/829165752 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f25b80678f0 0x7f25b8069db0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f25c000b930 tx=0x7f25c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:04.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.404+0000 7f25cffff640 1 -- 172.21.15.57:0/829165752 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f25c80c7020 con 0x7f25d80bdbe0 2024-04-24T23:40:04.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.560+0000 7f25ddd50640 1 -- 172.21.15.57:0/829165752 --> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f25d8148f50 con 0x7f25b80678f0 2024-04-24T23:40:04.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.588+0000 7f25cffff640 1 -- 172.21.15.57:0/829165752 <== mgr.4105 v2:172.21.15.88:6832/3931748276 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332695 (secure 0 0 0) 0x7f25c000f860 con 0x7f25b80678f0 2024-04-24T23:40:04.592 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:40:04.595 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-24T23:40:04.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.592+0000 7f25ddd50640 1 -- 172.21.15.57:0/829165752 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f25b80678f0 msgr2=0x7f25b8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:04.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.592+0000 7f25ddd50640 1 --2- 172.21.15.57:0/829165752 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f25b80678f0 0x7f25b8069db0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f25c000b930 tx=0x7f25c0008040 comp rx=0 tx=0).stop 2024-04-24T23:40:04.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.592+0000 7f25ddd50640 1 -- 172.21.15.57:0/829165752 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25d80bdbe0 msgr2=0x7f25d8145540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:04.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.592+0000 7f25ddd50640 1 --2- 172.21.15.57:0/829165752 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25d80bdbe0 0x7f25d8145540 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f25c80af040 tx=0x7f25c8019750 comp rx=0 tx=0).stop 2024-04-24T23:40:04.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.592+0000 7f25ddd50640 1 -- 172.21.15.57:0/829165752 shutdown_connections 2024-04-24T23:40:04.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.592+0000 7f25ddd50640 1 --2- 172.21.15.57:0/829165752 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f25b80678f0 0x7f25b8069db0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:04.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.592+0000 7f25ddd50640 1 --2- 172.21.15.57:0/829165752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25d814bc60 0x7f25d81594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:04.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.592+0000 7f25ddd50640 1 --2- 172.21.15.57:0/829165752 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25d80bdbe0 0x7f25d8145540 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:04.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.592+0000 7f25ddd50640 1 --2- 172.21.15.57:0/829165752 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f25d806f090 0x7f25d80bbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:04.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.592+0000 7f25ddd50640 1 -- 172.21.15.57:0/829165752 >> 172.21.15.57:0/829165752 conn(0x7f25d80beab0 msgr2=0x7f25d814a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:04.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.592+0000 7f25ddd50640 1 -- 172.21.15.57:0/829165752 shutdown_connections 2024-04-24T23:40:04.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.592+0000 7f25ddd50640 1 -- 172.21.15.57:0/829165752 wait complete. 2024-04-24T23:40:04.610 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-04-24T23:40:03.576259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":630584,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":199,"num_read_kb":10469,"num_write":407,"num_write_kb":22968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":364,"ondisk_log_size":364,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":247696,"kb_used_data":2448,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754727024,"statfs":{"total":773094113280,"available":772840472576,"internally_reserved":0,"allocated":2506752,"data_stored":2176120,"data_compressed":67594,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1792,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004429"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.948180+0000","last_change":"2024-04-24T23:38:33.135015+0000","last_active":"2024-04-24T23:39:22.948180+0000","last_peered":"2024-04-24T23:39:22.948180+0000","last_clean":"2024-04-24T23:39:22.948180+0000","last_became_active":"2024-04-24T23:38:33.134584+0000","last_became_peered":"2024-04-24T23:38:33.134584+0000","last_unstale":"2024-04-24T23:39:22.948180+0000","last_undegraded":"2024-04-24T23:39:22.948180+0000","last_fullsized":"2024-04-24T23:39:22.948180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:21.418436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815632+0000","last_change":"2024-04-24T23:38:34.164655+0000","last_active":"2024-04-24T23:39:22.815632+0000","last_peered":"2024-04-24T23:39:22.815632+0000","last_clean":"2024-04-24T23:39:22.815632+0000","last_became_active":"2024-04-24T23:38:34.162093+0000","last_became_peered":"2024-04-24T23:38:34.162093+0000","last_unstale":"2024-04-24T23:39:22.815632+0000","last_undegraded":"2024-04-24T23:39:22.815632+0000","last_fullsized":"2024-04-24T23:39:22.815632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.813716+0000","last_change":"2024-04-24T23:38:38.252169+0000","last_active":"2024-04-24T23:39:22.813716+0000","last_peered":"2024-04-24T23:39:22.813716+0000","last_clean":"2024-04-24T23:39:22.813716+0000","last_became_active":"2024-04-24T23:38:38.251653+0000","last_became_peered":"2024-04-24T23:38:38.251653+0000","last_unstale":"2024-04-24T23:39:22.813716+0000","last_undegraded":"2024-04-24T23:39:22.813716+0000","last_fullsized":"2024-04-24T23:39:22.813716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:57.651551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816215+0000","last_change":"2024-04-24T23:38:33.124025+0000","last_active":"2024-04-24T23:39:22.816215+0000","last_peered":"2024-04-24T23:39:22.816215+0000","last_clean":"2024-04-24T23:39:22.816215+0000","last_became_active":"2024-04-24T23:38:33.123681+0000","last_became_peered":"2024-04-24T23:38:33.123681+0000","last_unstale":"2024-04-24T23:39:22.816215+0000","last_undegraded":"2024-04-24T23:39:22.816215+0000","last_fullsized":"2024-04-24T23:39:22.816215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:27:41.421732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947507+0000","last_change":"2024-04-24T23:38:34.169793+0000","last_active":"2024-04-24T23:39:22.947507+0000","last_peered":"2024-04-24T23:39:22.947507+0000","last_clean":"2024-04-24T23:39:22.947507+0000","last_became_active":"2024-04-24T23:38:34.169115+0000","last_became_peered":"2024-04-24T23:38:34.169115+0000","last_unstale":"2024-04-24T23:39:22.947507+0000","last_undegraded":"2024-04-24T23:39:22.947507+0000","last_fullsized":"2024-04-24T23:39:22.947507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:39.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821314+0000","last_change":"2024-04-24T23:38:38.221580+0000","last_active":"2024-04-24T23:39:22.821314+0000","last_peered":"2024-04-24T23:39:22.821314+0000","last_clean":"2024-04-24T23:39:22.821314+0000","last_became_active":"2024-04-24T23:38:38.220392+0000","last_became_peered":"2024-04-24T23:38:38.220392+0000","last_unstale":"2024-04-24T23:39:22.821314+0000","last_undegraded":"2024-04-24T23:39:22.821314+0000","last_fullsized":"2024-04-24T23:39:22.821314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:16:01.852170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.828191+0000","last_change":"2024-04-24T23:38:33.144231+0000","last_active":"2024-04-24T23:39:22.828191+0000","last_peered":"2024-04-24T23:39:22.828191+0000","last_clean":"2024-04-24T23:39:22.828191+0000","last_became_active":"2024-04-24T23:38:33.143542+0000","last_became_peered":"2024-04-24T23:38:33.143542+0000","last_unstale":"2024-04-24T23:39:22.828191+0000","last_undegraded":"2024-04-24T23:39:22.828191+0000","last_fullsized":"2024-04-24T23:39:22.828191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:09.575181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816530+0000","last_change":"2024-04-24T23:38:34.170796+0000","last_active":"2024-04-24T23:39:22.816530+0000","last_peered":"2024-04-24T23:39:22.816530+0000","last_clean":"2024-04-24T23:39:22.816530+0000","last_became_active":"2024-04-24T23:38:34.169908+0000","last_became_peered":"2024-04-24T23:38:34.169908+0000","last_unstale":"2024-04-24T23:39:22.816530+0000","last_undegraded":"2024-04-24T23:39:22.816530+0000","last_fullsized":"2024-04-24T23:39:22.816530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:17:07.009163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821677+0000","last_change":"2024-04-24T23:38:38.218416+0000","last_active":"2024-04-24T23:39:22.821677+0000","last_peered":"2024-04-24T23:39:22.821677+0000","last_clean":"2024-04-24T23:39:22.821677+0000","last_became_active":"2024-04-24T23:38:38.217390+0000","last_became_peered":"2024-04-24T23:38:38.217390+0000","last_unstale":"2024-04-24T23:39:22.821677+0000","last_undegraded":"2024-04-24T23:39:22.821677+0000","last_fullsized":"2024-04-24T23:39:22.821677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:31.231780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.826953+0000","last_change":"2024-04-24T23:38:33.149114+0000","last_active":"2024-04-24T23:39:22.826953+0000","last_peered":"2024-04-24T23:39:22.826953+0000","last_clean":"2024-04-24T23:39:22.826953+0000","last_became_active":"2024-04-24T23:38:33.148510+0000","last_became_peered":"2024-04-24T23:38:33.148510+0000","last_unstale":"2024-04-24T23:39:22.826953+0000","last_undegraded":"2024-04-24T23:39:22.826953+0000","last_fullsized":"2024-04-24T23:39:22.826953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:39.396571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817264+0000","last_change":"2024-04-24T23:38:34.153747+0000","last_active":"2024-04-24T23:39:22.817264+0000","last_peered":"2024-04-24T23:39:22.817264+0000","last_clean":"2024-04-24T23:39:22.817264+0000","last_became_active":"2024-04-24T23:38:34.152984+0000","last_became_peered":"2024-04-24T23:38:34.152984+0000","last_unstale":"2024-04-24T23:39:22.817264+0000","last_undegraded":"2024-04-24T23:39:22.817264+0000","last_fullsized":"2024-04-24T23:39:22.817264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:54.469544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821502+0000","last_change":"2024-04-24T23:38:38.222542+0000","last_active":"2024-04-24T23:39:22.821502+0000","last_peered":"2024-04-24T23:39:22.821502+0000","last_clean":"2024-04-24T23:39:22.821502+0000","last_became_active":"2024-04-24T23:38:38.220601+0000","last_became_peered":"2024-04-24T23:38:38.220601+0000","last_unstale":"2024-04-24T23:39:22.821502+0000","last_undegraded":"2024-04-24T23:39:22.821502+0000","last_fullsized":"2024-04-24T23:39:22.821502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:32.372869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814379+0000","last_change":"2024-04-24T23:38:34.142429+0000","last_active":"2024-04-24T23:39:22.814379+0000","last_peered":"2024-04-24T23:39:22.814379+0000","last_clean":"2024-04-24T23:39:22.814379+0000","last_became_active":"2024-04-24T23:38:34.141681+0000","last_became_peered":"2024-04-24T23:38:34.141681+0000","last_unstale":"2024-04-24T23:39:22.814379+0000","last_undegraded":"2024-04-24T23:39:22.814379+0000","last_fullsized":"2024-04-24T23:39:22.814379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:57:25.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.827312+0000","last_change":"2024-04-24T23:38:33.140585+0000","last_active":"2024-04-24T23:39:22.827312+0000","last_peered":"2024-04-24T23:39:22.827312+0000","last_clean":"2024-04-24T23:39:22.827312+0000","last_became_active":"2024-04-24T23:38:33.139303+0000","last_became_peered":"2024-04-24T23:38:33.139303+0000","last_unstale":"2024-04-24T23:39:22.827312+0000","last_undegraded":"2024-04-24T23:39:22.827312+0000","last_fullsized":"2024-04-24T23:39:22.827312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:23.343617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822916+0000","last_change":"2024-04-24T23:38:38.216184+0000","last_active":"2024-04-24T23:39:22.822916+0000","last_peered":"2024-04-24T23:39:22.822916+0000","last_clean":"2024-04-24T23:39:22.822916+0000","last_became_active":"2024-04-24T23:38:38.214813+0000","last_became_peered":"2024-04-24T23:38:38.214813+0000","last_unstale":"2024-04-24T23:39:22.822916+0000","last_undegraded":"2024-04-24T23:39:22.822916+0000","last_fullsized":"2024-04-24T23:39:22.822916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:58.553943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814784+0000","last_change":"2024-04-24T23:38:34.174790+0000","last_active":"2024-04-24T23:39:22.814784+0000","last_peered":"2024-04-24T23:39:22.814784+0000","last_clean":"2024-04-24T23:39:22.814784+0000","last_became_active":"2024-04-24T23:38:34.174504+0000","last_became_peered":"2024-04-24T23:38:34.174504+0000","last_unstale":"2024-04-24T23:39:22.814784+0000","last_undegraded":"2024-04-24T23:39:22.814784+0000","last_fullsized":"2024-04-24T23:39:22.814784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:27.147380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822132+0000","last_change":"2024-04-24T23:38:33.125559+0000","last_active":"2024-04-24T23:39:22.822132+0000","last_peered":"2024-04-24T23:39:22.822132+0000","last_clean":"2024-04-24T23:39:22.822132+0000","last_became_active":"2024-04-24T23:38:33.125115+0000","last_became_peered":"2024-04-24T23:38:33.125115+0000","last_unstale":"2024-04-24T23:39:22.822132+0000","last_undegraded":"2024-04-24T23:39:22.822132+0000","last_fullsized":"2024-04-24T23:39:22.822132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:07.598128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821927+0000","last_change":"2024-04-24T23:38:38.221669+0000","last_active":"2024-04-24T23:39:22.821927+0000","last_peered":"2024-04-24T23:39:22.821927+0000","last_clean":"2024-04-24T23:39:22.821927+0000","last_became_active":"2024-04-24T23:38:38.219797+0000","last_became_peered":"2024-04-24T23:38:38.219797+0000","last_unstale":"2024-04-24T23:39:22.821927+0000","last_undegraded":"2024-04-24T23:39:22.821927+0000","last_fullsized":"2024-04-24T23:39:22.821927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:04.091622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814214+0000","last_change":"2024-04-24T23:38:34.163966+0000","last_active":"2024-04-24T23:39:22.814214+0000","last_peered":"2024-04-24T23:39:22.814214+0000","last_clean":"2024-04-24T23:39:22.814214+0000","last_became_active":"2024-04-24T23:38:34.163291+0000","last_became_peered":"2024-04-24T23:38:34.163291+0000","last_unstale":"2024-04-24T23:39:22.814214+0000","last_undegraded":"2024-04-24T23:39:22.814214+0000","last_fullsized":"2024-04-24T23:39:22.814214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:34.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822513+0000","last_change":"2024-04-24T23:38:33.119549+0000","last_active":"2024-04-24T23:39:22.822513+0000","last_peered":"2024-04-24T23:39:22.822513+0000","last_clean":"2024-04-24T23:39:22.822513+0000","last_became_active":"2024-04-24T23:38:33.119052+0000","last_became_peered":"2024-04-24T23:38:33.119052+0000","last_unstale":"2024-04-24T23:39:22.822513+0000","last_undegraded":"2024-04-24T23:39:22.822513+0000","last_fullsized":"2024-04-24T23:39:22.822513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'33","reported_seq":51,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:42.166983+0000","last_change":"2024-04-24T23:38:38.252720+0000","last_active":"2024-04-24T23:39:42.166983+0000","last_peered":"2024-04-24T23:39:42.166983+0000","last_clean":"2024-04-24T23:39:42.166983+0000","last_became_active":"2024-04-24T23:38:38.252138+0000","last_became_peered":"2024-04-24T23:38:38.252138+0000","last_unstale":"2024-04-24T23:39:42.166983+0000","last_undegraded":"2024-04-24T23:39:42.166983+0000","last_fullsized":"2024-04-24T23:39:42.166983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:18.964372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.823517+0000","last_change":"2024-04-24T23:38:34.157008+0000","last_active":"2024-04-24T23:39:22.823517+0000","last_peered":"2024-04-24T23:39:22.823517+0000","last_clean":"2024-04-24T23:39:22.823517+0000","last_became_active":"2024-04-24T23:38:34.152682+0000","last_became_peered":"2024-04-24T23:38:34.152682+0000","last_unstale":"2024-04-24T23:39:22.823517+0000","last_undegraded":"2024-04-24T23:39:22.823517+0000","last_fullsized":"2024-04-24T23:39:22.823517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:48.697457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.824298+0000","last_change":"2024-04-24T23:38:33.139819+0000","last_active":"2024-04-24T23:39:22.824298+0000","last_peered":"2024-04-24T23:39:22.824298+0000","last_clean":"2024-04-24T23:39:22.824298+0000","last_became_active":"2024-04-24T23:38:33.139175+0000","last_became_peered":"2024-04-24T23:38:33.139175+0000","last_unstale":"2024-04-24T23:39:22.824298+0000","last_undegraded":"2024-04-24T23:39:22.824298+0000","last_fullsized":"2024-04-24T23:39:22.824298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:52.007425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.833647+0000","last_change":"2024-04-24T23:39:22.833647+0000","last_active":"2024-04-24T23:39:22.833647+0000","last_peered":"2024-04-24T23:39:22.833647+0000","last_clean":"2024-04-24T23:39:22.833647+0000","last_became_active":"2024-04-24T23:39:22.831081+0000","last_became_peered":"2024-04-24T23:39:22.831081+0000","last_unstale":"2024-04-24T23:39:22.833647+0000","last_undegraded":"2024-04-24T23:39:22.833647+0000","last_fullsized":"2024-04-24T23:39:22.833647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:32:39.380569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947767+0000","last_change":"2024-04-24T23:38:34.154755+0000","last_active":"2024-04-24T23:39:22.947767+0000","last_peered":"2024-04-24T23:39:22.947767+0000","last_clean":"2024-04-24T23:39:22.947767+0000","last_became_active":"2024-04-24T23:38:34.153967+0000","last_became_peered":"2024-04-24T23:38:34.153967+0000","last_unstale":"2024-04-24T23:39:22.947767+0000","last_undegraded":"2024-04-24T23:39:22.947767+0000","last_fullsized":"2024-04-24T23:39:22.947767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.818571+0000","last_change":"2024-04-24T23:38:33.135885+0000","last_active":"2024-04-24T23:39:22.818571+0000","last_peered":"2024-04-24T23:39:22.818571+0000","last_clean":"2024-04-24T23:39:22.818571+0000","last_became_active":"2024-04-24T23:38:33.135225+0000","last_became_peered":"2024-04-24T23:38:33.135225+0000","last_unstale":"2024-04-24T23:39:22.818571+0000","last_undegraded":"2024-04-24T23:39:22.818571+0000","last_fullsized":"2024-04-24T23:39:22.818571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:52.007425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822856+0000","last_change":"2024-04-24T23:38:38.252002+0000","last_active":"2024-04-24T23:39:22.822856+0000","last_peered":"2024-04-24T23:39:22.822856+0000","last_clean":"2024-04-24T23:39:22.822856+0000","last_became_active":"2024-04-24T23:38:38.251057+0000","last_became_peered":"2024-04-24T23:38:38.251057+0000","last_unstale":"2024-04-24T23:39:22.822856+0000","last_undegraded":"2024-04-24T23:39:22.822856+0000","last_fullsized":"2024-04-24T23:39:22.822856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:49.920273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.838498+0000","last_change":"2024-04-24T23:39:22.833969+0000","last_active":"2024-04-24T23:39:22.838498+0000","last_peered":"2024-04-24T23:39:22.838498+0000","last_clean":"2024-04-24T23:39:22.838498+0000","last_became_active":"2024-04-24T23:39:22.833072+0000","last_became_peered":"2024-04-24T23:39:22.833072+0000","last_unstale":"2024-04-24T23:39:22.838498+0000","last_undegraded":"2024-04-24T23:39:22.838498+0000","last_fullsized":"2024-04-24T23:39:22.838498+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:53.567151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:44.174185+0000","last_change":"2024-04-24T23:38:33.115409+0000","last_active":"2024-04-24T23:39:44.174185+0000","last_peered":"2024-04-24T23:39:44.174185+0000","last_clean":"2024-04-24T23:39:44.174185+0000","last_became_active":"2024-04-24T23:38:33.115039+0000","last_became_peered":"2024-04-24T23:38:33.115039+0000","last_unstale":"2024-04-24T23:39:44.174185+0000","last_undegraded":"2024-04-24T23:39:44.174185+0000","last_fullsized":"2024-04-24T23:39:44.174185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:52.007425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.813502+0000","last_change":"2024-04-24T23:38:38.246602+0000","last_active":"2024-04-24T23:39:22.813502+0000","last_peered":"2024-04-24T23:39:22.813502+0000","last_clean":"2024-04-24T23:39:22.813502+0000","last_became_active":"2024-04-24T23:38:38.245775+0000","last_became_peered":"2024-04-24T23:38:38.245775+0000","last_unstale":"2024-04-24T23:39:22.813502+0000","last_undegraded":"2024-04-24T23:39:22.813502+0000","last_fullsized":"2024-04-24T23:39:22.813502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:29.684133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.823555+0000","last_change":"2024-04-24T23:38:34.149008+0000","last_active":"2024-04-24T23:39:22.823555+0000","last_peered":"2024-04-24T23:39:22.823555+0000","last_clean":"2024-04-24T23:39:22.823555+0000","last_became_active":"2024-04-24T23:38:34.148122+0000","last_became_peered":"2024-04-24T23:38:34.148122+0000","last_unstale":"2024-04-24T23:39:22.823555+0000","last_undegraded":"2024-04-24T23:39:22.823555+0000","last_fullsized":"2024-04-24T23:39:22.823555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:39.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.828326+0000","last_change":"2024-04-24T23:38:33.142490+0000","last_active":"2024-04-24T23:39:22.828326+0000","last_peered":"2024-04-24T23:39:22.828326+0000","last_clean":"2024-04-24T23:39:22.828326+0000","last_became_active":"2024-04-24T23:38:33.140003+0000","last_became_peered":"2024-04-24T23:38:33.140003+0000","last_unstale":"2024-04-24T23:39:22.828326+0000","last_undegraded":"2024-04-24T23:39:22.828326+0000","last_fullsized":"2024-04-24T23:39:22.828326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:45:12.216173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.946778+0000","last_change":"2024-04-24T23:38:38.246291+0000","last_active":"2024-04-24T23:39:22.946778+0000","last_peered":"2024-04-24T23:39:22.946778+0000","last_clean":"2024-04-24T23:39:22.946778+0000","last_became_active":"2024-04-24T23:38:38.245611+0000","last_became_peered":"2024-04-24T23:38:38.245611+0000","last_unstale":"2024-04-24T23:39:22.946778+0000","last_undegraded":"2024-04-24T23:39:22.946778+0000","last_fullsized":"2024-04-24T23:39:22.946778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:47.898644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817536+0000","last_change":"2024-04-24T23:38:34.186285+0000","last_active":"2024-04-24T23:39:22.817536+0000","last_peered":"2024-04-24T23:39:22.817536+0000","last_clean":"2024-04-24T23:39:22.817536+0000","last_became_active":"2024-04-24T23:38:34.185023+0000","last_became_peered":"2024-04-24T23:38:34.185023+0000","last_unstale":"2024-04-24T23:39:22.817536+0000","last_undegraded":"2024-04-24T23:39:22.817536+0000","last_fullsized":"2024-04-24T23:39:22.817536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:56.947423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.823814+0000","last_change":"2024-04-24T23:38:33.108447+0000","last_active":"2024-04-24T23:39:22.823814+0000","last_peered":"2024-04-24T23:39:22.823814+0000","last_clean":"2024-04-24T23:39:22.823814+0000","last_became_active":"2024-04-24T23:38:33.108102+0000","last_became_peered":"2024-04-24T23:38:33.108102+0000","last_unstale":"2024-04-24T23:39:22.823814+0000","last_undegraded":"2024-04-24T23:39:22.823814+0000","last_fullsized":"2024-04-24T23:39:22.823814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:47.686974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821488+0000","last_change":"2024-04-24T23:38:38.213425+0000","last_active":"2024-04-24T23:39:22.821488+0000","last_peered":"2024-04-24T23:39:22.821488+0000","last_clean":"2024-04-24T23:39:22.821488+0000","last_became_active":"2024-04-24T23:38:38.212691+0000","last_became_peered":"2024-04-24T23:38:38.212691+0000","last_unstale":"2024-04-24T23:39:22.821488+0000","last_undegraded":"2024-04-24T23:39:22.821488+0000","last_fullsized":"2024-04-24T23:39:22.821488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:01.031822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822383+0000","last_change":"2024-04-24T23:38:34.154178+0000","last_active":"2024-04-24T23:39:22.822383+0000","last_peered":"2024-04-24T23:39:22.822383+0000","last_clean":"2024-04-24T23:39:22.822383+0000","last_became_active":"2024-04-24T23:38:34.153372+0000","last_became_peered":"2024-04-24T23:38:34.153372+0000","last_unstale":"2024-04-24T23:39:22.822383+0000","last_undegraded":"2024-04-24T23:39:22.822383+0000","last_fullsized":"2024-04-24T23:39:22.822383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:10.585665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816188+0000","last_change":"2024-04-24T23:38:33.140060+0000","last_active":"2024-04-24T23:39:22.816188+0000","last_peered":"2024-04-24T23:39:22.816188+0000","last_clean":"2024-04-24T23:39:22.816188+0000","last_became_active":"2024-04-24T23:38:33.139012+0000","last_became_peered":"2024-04-24T23:38:33.139012+0000","last_unstale":"2024-04-24T23:39:22.816188+0000","last_undegraded":"2024-04-24T23:39:22.816188+0000","last_fullsized":"2024-04-24T23:39:22.816188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.830414+0000","last_change":"2024-04-24T23:39:22.828208+0000","last_active":"2024-04-24T23:39:22.830414+0000","last_peered":"2024-04-24T23:39:22.830414+0000","last_clean":"2024-04-24T23:39:22.830414+0000","last_became_active":"2024-04-24T23:39:22.825860+0000","last_became_peered":"2024-04-24T23:39:22.825860+0000","last_unstale":"2024-04-24T23:39:22.830414+0000","last_undegraded":"2024-04-24T23:39:22.830414+0000","last_fullsized":"2024-04-24T23:39:22.830414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:14:39.506678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.820916+0000","last_change":"2024-04-24T23:38:34.152846+0000","last_active":"2024-04-24T23:39:22.820916+0000","last_peered":"2024-04-24T23:39:22.820916+0000","last_clean":"2024-04-24T23:39:22.820916+0000","last_became_active":"2024-04-24T23:38:34.151917+0000","last_became_peered":"2024-04-24T23:38:34.151917+0000","last_unstale":"2024-04-24T23:39:22.820916+0000","last_undegraded":"2024-04-24T23:39:22.820916+0000","last_fullsized":"2024-04-24T23:39:22.820916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:34.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'2","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:44.222348+0000","last_change":"2024-04-24T23:38:33.124295+0000","last_active":"2024-04-24T23:39:44.222348+0000","last_peered":"2024-04-24T23:39:44.222348+0000","last_clean":"2024-04-24T23:39:44.222348+0000","last_became_active":"2024-04-24T23:38:33.123674+0000","last_became_peered":"2024-04-24T23:38:33.123674+0000","last_unstale":"2024-04-24T23:39:44.222348+0000","last_undegraded":"2024-04-24T23:39:44.222348+0000","last_fullsized":"2024-04-24T23:39:44.222348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.824922+0000","last_change":"2024-04-24T23:38:38.214721+0000","last_active":"2024-04-24T23:39:22.824922+0000","last_peered":"2024-04-24T23:39:22.824922+0000","last_clean":"2024-04-24T23:39:22.824922+0000","last_became_active":"2024-04-24T23:38:38.214005+0000","last_became_peered":"2024-04-24T23:38:38.214005+0000","last_unstale":"2024-04-24T23:39:22.824922+0000","last_undegraded":"2024-04-24T23:39:22.824922+0000","last_fullsized":"2024-04-24T23:39:22.824922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:29:56.066046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.946216+0000","last_change":"2024-04-24T23:38:34.139551+0000","last_active":"2024-04-24T23:39:22.946216+0000","last_peered":"2024-04-24T23:39:22.946216+0000","last_clean":"2024-04-24T23:39:22.946216+0000","last_became_active":"2024-04-24T23:38:34.138681+0000","last_became_peered":"2024-04-24T23:38:34.138681+0000","last_unstale":"2024-04-24T23:39:22.946216+0000","last_undegraded":"2024-04-24T23:39:22.946216+0000","last_fullsized":"2024-04-24T23:39:22.946216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:47.556651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.824571+0000","last_change":"2024-04-24T23:38:33.141279+0000","last_active":"2024-04-24T23:39:22.824571+0000","last_peered":"2024-04-24T23:39:22.824571+0000","last_clean":"2024-04-24T23:39:22.824571+0000","last_became_active":"2024-04-24T23:38:33.140618+0000","last_became_peered":"2024-04-24T23:38:33.140618+0000","last_unstale":"2024-04-24T23:39:22.824571+0000","last_undegraded":"2024-04-24T23:39:22.824571+0000","last_fullsized":"2024-04-24T23:39:22.824571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947496+0000","last_change":"2024-04-24T23:38:38.250074+0000","last_active":"2024-04-24T23:39:22.947496+0000","last_peered":"2024-04-24T23:39:22.947496+0000","last_clean":"2024-04-24T23:39:22.947496+0000","last_became_active":"2024-04-24T23:38:38.249402+0000","last_became_peered":"2024-04-24T23:38:38.249402+0000","last_unstale":"2024-04-24T23:39:22.947496+0000","last_undegraded":"2024-04-24T23:39:22.947496+0000","last_fullsized":"2024-04-24T23:39:22.947496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:57.246661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816685+0000","last_change":"2024-04-24T23:38:34.187980+0000","last_active":"2024-04-24T23:39:22.816685+0000","last_peered":"2024-04-24T23:39:22.816685+0000","last_clean":"2024-04-24T23:39:22.816685+0000","last_became_active":"2024-04-24T23:38:34.187655+0000","last_became_peered":"2024-04-24T23:38:34.187655+0000","last_unstale":"2024-04-24T23:39:22.816685+0000","last_undegraded":"2024-04-24T23:39:22.816685+0000","last_fullsized":"2024-04-24T23:39:22.816685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:39.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815604+0000","last_change":"2024-04-24T23:38:33.125255+0000","last_active":"2024-04-24T23:39:22.815604+0000","last_peered":"2024-04-24T23:39:22.815604+0000","last_clean":"2024-04-24T23:39:22.815604+0000","last_became_active":"2024-04-24T23:38:33.115926+0000","last_became_peered":"2024-04-24T23:38:33.115926+0000","last_unstale":"2024-04-24T23:39:22.815604+0000","last_undegraded":"2024-04-24T23:39:22.815604+0000","last_fullsized":"2024-04-24T23:39:22.815604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:42.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.824826+0000","last_change":"2024-04-24T23:38:29.564705+0000","last_active":"2024-04-24T23:39:22.824826+0000","last_peered":"2024-04-24T23:39:22.824826+0000","last_clean":"2024-04-24T23:39:22.824826+0000","last_became_active":"2024-04-24T23:38:29.562027+0000","last_became_peered":"2024-04-24T23:38:29.562027+0000","last_unstale":"2024-04-24T23:39:22.824826+0000","last_undegraded":"2024-04-24T23:39:22.824826+0000","last_fullsized":"2024-04-24T23:39:22.824826+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:27.959678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:27.959678+0000","last_clean_scrub_stamp":"2024-04-24T23:38:27.959678+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:40.724497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'33","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:42.539265+0000","last_change":"2024-04-24T23:38:38.254846+0000","last_active":"2024-04-24T23:39:42.539265+0000","last_peered":"2024-04-24T23:39:42.539265+0000","last_clean":"2024-04-24T23:39:42.539265+0000","last_became_active":"2024-04-24T23:38:38.253792+0000","last_became_peered":"2024-04-24T23:38:38.253792+0000","last_unstale":"2024-04-24T23:39:42.539265+0000","last_undegraded":"2024-04-24T23:39:42.539265+0000","last_fullsized":"2024-04-24T23:39:42.539265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:17:11.093562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":2176,"num_write":33,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.827672+0000","last_change":"2024-04-24T23:38:34.195003+0000","last_active":"2024-04-24T23:39:22.827672+0000","last_peered":"2024-04-24T23:39:22.827672+0000","last_clean":"2024-04-24T23:39:22.827672+0000","last_became_active":"2024-04-24T23:38:34.194530+0000","last_became_peered":"2024-04-24T23:38:34.194530+0000","last_unstale":"2024-04-24T23:39:22.827672+0000","last_undegraded":"2024-04-24T23:39:22.827672+0000","last_fullsized":"2024-04-24T23:39:22.827672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:00.007223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.820712+0000","last_change":"2024-04-24T23:38:33.130165+0000","last_active":"2024-04-24T23:39:22.820712+0000","last_peered":"2024-04-24T23:39:22.820712+0000","last_clean":"2024-04-24T23:39:22.820712+0000","last_became_active":"2024-04-24T23:38:33.129888+0000","last_became_peered":"2024-04-24T23:38:33.129888+0000","last_unstale":"2024-04-24T23:39:22.820712+0000","last_undegraded":"2024-04-24T23:39:22.820712+0000","last_fullsized":"2024-04-24T23:39:22.820712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:27:41.421732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'66","reported_seq":116,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:44.231356+0000","last_change":"2024-04-24T23:38:38.253780+0000","last_active":"2024-04-24T23:39:44.231356+0000","last_peered":"2024-04-24T23:39:44.231356+0000","last_clean":"2024-04-24T23:39:44.231356+0000","last_became_active":"2024-04-24T23:38:38.252899+0000","last_became_peered":"2024-04-24T23:38:38.252899+0000","last_unstale":"2024-04-24T23:39:44.231356+0000","last_undegraded":"2024-04-24T23:39:44.231356+0000","last_fullsized":"2024-04-24T23:39:44.231356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:58.553943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":4096,"num_write":66,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816876+0000","last_change":"2024-04-24T23:38:34.187942+0000","last_active":"2024-04-24T23:39:22.816876+0000","last_peered":"2024-04-24T23:39:22.816876+0000","last_clean":"2024-04-24T23:39:22.816876+0000","last_became_active":"2024-04-24T23:38:34.184929+0000","last_became_peered":"2024-04-24T23:38:34.184929+0000","last_unstale":"2024-04-24T23:39:22.816876+0000","last_undegraded":"2024-04-24T23:39:22.816876+0000","last_fullsized":"2024-04-24T23:39:22.816876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:43.814245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.823408+0000","last_change":"2024-04-24T23:38:33.120289+0000","last_active":"2024-04-24T23:39:22.823408+0000","last_peered":"2024-04-24T23:39:22.823408+0000","last_clean":"2024-04-24T23:39:22.823408+0000","last_became_active":"2024-04-24T23:38:33.119790+0000","last_became_peered":"2024-04-24T23:38:33.119790+0000","last_unstale":"2024-04-24T23:39:22.823408+0000","last_undegraded":"2024-04-24T23:39:22.823408+0000","last_fullsized":"2024-04-24T23:39:22.823408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947098+0000","last_change":"2024-04-24T23:38:38.216064+0000","last_active":"2024-04-24T23:39:22.947098+0000","last_peered":"2024-04-24T23:39:22.947098+0000","last_clean":"2024-04-24T23:39:22.947098+0000","last_became_active":"2024-04-24T23:38:38.215599+0000","last_became_peered":"2024-04-24T23:38:38.215599+0000","last_unstale":"2024-04-24T23:39:22.947098+0000","last_undegraded":"2024-04-24T23:39:22.947098+0000","last_fullsized":"2024-04-24T23:39:22.947098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:01.031822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.828856+0000","last_change":"2024-04-24T23:38:34.194305+0000","last_active":"2024-04-24T23:39:22.828856+0000","last_peered":"2024-04-24T23:39:22.828856+0000","last_clean":"2024-04-24T23:39:22.828856+0000","last_became_active":"2024-04-24T23:38:34.188815+0000","last_became_peered":"2024-04-24T23:38:34.188815+0000","last_unstale":"2024-04-24T23:39:22.828856+0000","last_undegraded":"2024-04-24T23:39:22.828856+0000","last_fullsized":"2024-04-24T23:39:22.828856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:25.599734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821376+0000","last_change":"2024-04-24T23:38:33.125221+0000","last_active":"2024-04-24T23:39:22.821376+0000","last_peered":"2024-04-24T23:39:22.821376+0000","last_clean":"2024-04-24T23:39:22.821376+0000","last_became_active":"2024-04-24T23:38:33.124849+0000","last_became_peered":"2024-04-24T23:38:33.124849+0000","last_unstale":"2024-04-24T23:39:22.821376+0000","last_undegraded":"2024-04-24T23:39:22.821376+0000","last_fullsized":"2024-04-24T23:39:22.821376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:42.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814131+0000","last_change":"2024-04-24T23:38:38.250618+0000","last_active":"2024-04-24T23:39:22.814131+0000","last_peered":"2024-04-24T23:39:22.814131+0000","last_clean":"2024-04-24T23:39:22.814131+0000","last_became_active":"2024-04-24T23:38:38.249521+0000","last_became_peered":"2024-04-24T23:38:38.249521+0000","last_unstale":"2024-04-24T23:39:22.814131+0000","last_undegraded":"2024-04-24T23:39:22.814131+0000","last_fullsized":"2024-04-24T23:39:22.814131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:57.651551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.828052+0000","last_change":"2024-04-24T23:38:34.166018+0000","last_active":"2024-04-24T23:39:22.828052+0000","last_peered":"2024-04-24T23:39:22.828052+0000","last_clean":"2024-04-24T23:39:22.828052+0000","last_became_active":"2024-04-24T23:38:34.165229+0000","last_became_peered":"2024-04-24T23:38:34.165229+0000","last_unstale":"2024-04-24T23:39:22.828052+0000","last_undegraded":"2024-04-24T23:39:22.828052+0000","last_fullsized":"2024-04-24T23:39:22.828052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:56.947423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.823071+0000","last_change":"2024-04-24T23:38:33.109771+0000","last_active":"2024-04-24T23:39:22.823071+0000","last_peered":"2024-04-24T23:39:22.823071+0000","last_clean":"2024-04-24T23:39:22.823071+0000","last_became_active":"2024-04-24T23:38:33.108928+0000","last_became_peered":"2024-04-24T23:38:33.108928+0000","last_unstale":"2024-04-24T23:39:22.823071+0000","last_undegraded":"2024-04-24T23:39:22.823071+0000","last_fullsized":"2024-04-24T23:39:22.823071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:44.838533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.833400+0000","last_change":"2024-04-24T23:39:22.833400+0000","last_active":"2024-04-24T23:39:22.833400+0000","last_peered":"2024-04-24T23:39:22.833400+0000","last_clean":"2024-04-24T23:39:22.833400+0000","last_became_active":"2024-04-24T23:39:22.831340+0000","last_became_peered":"2024-04-24T23:39:22.831340+0000","last_unstale":"2024-04-24T23:39:22.833400+0000","last_undegraded":"2024-04-24T23:39:22.833400+0000","last_fullsized":"2024-04-24T23:39:22.833400+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:05:14.068761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3,6],"acting":[4,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.824993+0000","last_change":"2024-04-24T23:38:34.188981+0000","last_active":"2024-04-24T23:39:22.824993+0000","last_peered":"2024-04-24T23:39:22.824993+0000","last_clean":"2024-04-24T23:39:22.824993+0000","last_became_active":"2024-04-24T23:38:34.188416+0000","last_became_peered":"2024-04-24T23:38:34.188416+0000","last_unstale":"2024-04-24T23:39:22.824993+0000","last_undegraded":"2024-04-24T23:39:22.824993+0000","last_fullsized":"2024-04-24T23:39:22.824993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:17:07.009163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.820272+0000","last_change":"2024-04-24T23:38:33.100912+0000","last_active":"2024-04-24T23:39:22.820272+0000","last_peered":"2024-04-24T23:39:22.820272+0000","last_clean":"2024-04-24T23:39:22.820272+0000","last_became_active":"2024-04-24T23:38:33.100464+0000","last_became_peered":"2024-04-24T23:38:33.100464+0000","last_unstale":"2024-04-24T23:39:22.820272+0000","last_undegraded":"2024-04-24T23:39:22.820272+0000","last_fullsized":"2024-04-24T23:39:22.820272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:47:27.107958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947184+0000","last_change":"2024-04-24T23:38:38.207627+0000","last_active":"2024-04-24T23:39:22.947184+0000","last_peered":"2024-04-24T23:39:22.947184+0000","last_clean":"2024-04-24T23:39:22.947184+0000","last_became_active":"2024-04-24T23:38:38.207049+0000","last_became_peered":"2024-04-24T23:38:38.207049+0000","last_unstale":"2024-04-24T23:39:22.947184+0000","last_undegraded":"2024-04-24T23:39:22.947184+0000","last_fullsized":"2024-04-24T23:39:22.947184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:29:56.066046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814063+0000","last_change":"2024-04-24T23:38:34.161654+0000","last_active":"2024-04-24T23:39:22.814063+0000","last_peered":"2024-04-24T23:39:22.814063+0000","last_clean":"2024-04-24T23:39:22.814063+0000","last_became_active":"2024-04-24T23:38:34.158756+0000","last_became_peered":"2024-04-24T23:38:34.158756+0000","last_unstale":"2024-04-24T23:39:22.814063+0000","last_undegraded":"2024-04-24T23:39:22.814063+0000","last_fullsized":"2024-04-24T23:39:22.814063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:29.660159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.813988+0000","last_change":"2024-04-24T23:38:33.116071+0000","last_active":"2024-04-24T23:39:22.813988+0000","last_peered":"2024-04-24T23:39:22.813988+0000","last_clean":"2024-04-24T23:39:22.813988+0000","last_became_active":"2024-04-24T23:38:33.115472+0000","last_became_peered":"2024-04-24T23:38:33.115472+0000","last_unstale":"2024-04-24T23:39:22.813988+0000","last_undegraded":"2024-04-24T23:39:22.813988+0000","last_fullsized":"2024-04-24T23:39:22.813988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:47.686974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815773+0000","last_change":"2024-04-24T23:38:38.248841+0000","last_active":"2024-04-24T23:39:22.815773+0000","last_peered":"2024-04-24T23:39:22.815773+0000","last_clean":"2024-04-24T23:39:22.815773+0000","last_became_active":"2024-04-24T23:38:38.248311+0000","last_became_peered":"2024-04-24T23:38:38.248311+0000","last_unstale":"2024-04-24T23:39:22.815773+0000","last_undegraded":"2024-04-24T23:39:22.815773+0000","last_fullsized":"2024-04-24T23:39:22.815773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:22.798878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.826809+0000","last_change":"2024-04-24T23:38:34.189772+0000","last_active":"2024-04-24T23:39:22.826809+0000","last_peered":"2024-04-24T23:39:22.826809+0000","last_clean":"2024-04-24T23:39:22.826809+0000","last_became_active":"2024-04-24T23:38:34.179801+0000","last_became_peered":"2024-04-24T23:38:34.179801+0000","last_unstale":"2024-04-24T23:39:22.826809+0000","last_undegraded":"2024-04-24T23:39:22.826809+0000","last_fullsized":"2024-04-24T23:39:22.826809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:54.469544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815922+0000","last_change":"2024-04-24T23:38:33.146611+0000","last_active":"2024-04-24T23:39:22.815922+0000","last_peered":"2024-04-24T23:39:22.815922+0000","last_clean":"2024-04-24T23:39:22.815922+0000","last_became_active":"2024-04-24T23:38:33.145896+0000","last_became_peered":"2024-04-24T23:38:33.145896+0000","last_unstale":"2024-04-24T23:39:22.815922+0000","last_undegraded":"2024-04-24T23:39:22.815922+0000","last_fullsized":"2024-04-24T23:39:22.815922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:47.686974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814661+0000","last_change":"2024-04-24T23:38:38.252023+0000","last_active":"2024-04-24T23:39:22.814661+0000","last_peered":"2024-04-24T23:39:22.814661+0000","last_clean":"2024-04-24T23:39:22.814661+0000","last_became_active":"2024-04-24T23:38:38.251541+0000","last_became_peered":"2024-04-24T23:38:38.251541+0000","last_unstale":"2024-04-24T23:39:22.814661+0000","last_undegraded":"2024-04-24T23:39:22.814661+0000","last_fullsized":"2024-04-24T23:39:22.814661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:25:30.720742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.946803+0000","last_change":"2024-04-24T23:38:34.164658+0000","last_active":"2024-04-24T23:39:22.946803+0000","last_peered":"2024-04-24T23:39:22.946803+0000","last_clean":"2024-04-24T23:39:22.946803+0000","last_became_active":"2024-04-24T23:38:34.164024+0000","last_became_peered":"2024-04-24T23:38:34.164024+0000","last_unstale":"2024-04-24T23:39:22.946803+0000","last_undegraded":"2024-04-24T23:39:22.946803+0000","last_fullsized":"2024-04-24T23:39:22.946803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:47.516208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947439+0000","last_change":"2024-04-24T23:38:33.111314+0000","last_active":"2024-04-24T23:39:22.947439+0000","last_peered":"2024-04-24T23:39:22.947439+0000","last_clean":"2024-04-24T23:39:22.947439+0000","last_became_active":"2024-04-24T23:38:33.109819+0000","last_became_peered":"2024-04-24T23:38:33.109819+0000","last_unstale":"2024-04-24T23:39:22.947439+0000","last_undegraded":"2024-04-24T23:39:22.947439+0000","last_fullsized":"2024-04-24T23:39:22.947439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:21:39.944505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816959+0000","last_change":"2024-04-24T23:38:38.247323+0000","last_active":"2024-04-24T23:39:22.816959+0000","last_peered":"2024-04-24T23:39:22.816959+0000","last_clean":"2024-04-24T23:39:22.816959+0000","last_became_active":"2024-04-24T23:38:38.246172+0000","last_became_peered":"2024-04-24T23:38:38.246172+0000","last_unstale":"2024-04-24T23:39:22.816959+0000","last_undegraded":"2024-04-24T23:39:22.816959+0000","last_fullsized":"2024-04-24T23:39:22.816959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:32.771055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.827448+0000","last_change":"2024-04-24T23:38:34.189746+0000","last_active":"2024-04-24T23:39:22.827448+0000","last_peered":"2024-04-24T23:39:22.827448+0000","last_clean":"2024-04-24T23:39:22.827448+0000","last_became_active":"2024-04-24T23:38:34.179433+0000","last_became_peered":"2024-04-24T23:38:34.179433+0000","last_unstale":"2024-04-24T23:39:22.827448+0000","last_undegraded":"2024-04-24T23:39:22.827448+0000","last_fullsized":"2024-04-24T23:39:22.827448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:56.049789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'35","reported_seq":61,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:57.551905+0000","last_change":"2024-04-24T23:38:33.127637+0000","last_active":"2024-04-24T23:39:57.551905+0000","last_peered":"2024-04-24T23:39:57.551905+0000","last_clean":"2024-04-24T23:39:57.551905+0000","last_became_active":"2024-04-24T23:38:33.127122+0000","last_became_peered":"2024-04-24T23:38:33.127122+0000","last_unstale":"2024-04-24T23:39:57.551905+0000","last_undegraded":"2024-04-24T23:39:57.551905+0000","last_fullsized":"2024-04-24T23:39:57.551905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39309,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821945+0000","last_change":"2024-04-24T23:38:38.216781+0000","last_active":"2024-04-24T23:39:22.821945+0000","last_peered":"2024-04-24T23:39:22.821945+0000","last_clean":"2024-04-24T23:39:22.821945+0000","last_became_active":"2024-04-24T23:38:38.215741+0000","last_became_peered":"2024-04-24T23:38:38.215741+0000","last_unstale":"2024-04-24T23:39:22.821945+0000","last_undegraded":"2024-04-24T23:39:22.821945+0000","last_fullsized":"2024-04-24T23:39:22.821945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:47.898644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822840+0000","last_change":"2024-04-24T23:38:34.167424+0000","last_active":"2024-04-24T23:39:22.822840+0000","last_peered":"2024-04-24T23:39:22.822840+0000","last_clean":"2024-04-24T23:39:22.822840+0000","last_became_active":"2024-04-24T23:38:34.166602+0000","last_became_peered":"2024-04-24T23:38:34.166602+0000","last_unstale":"2024-04-24T23:39:22.822840+0000","last_undegraded":"2024-04-24T23:39:22.822840+0000","last_fullsized":"2024-04-24T23:39:22.822840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:31.033906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:44.220165+0000","last_change":"2024-04-24T23:38:33.146758+0000","last_active":"2024-04-24T23:39:44.220165+0000","last_peered":"2024-04-24T23:39:44.220165+0000","last_clean":"2024-04-24T23:39:44.220165+0000","last_became_active":"2024-04-24T23:38:33.146311+0000","last_became_peered":"2024-04-24T23:38:33.146311+0000","last_unstale":"2024-04-24T23:39:44.220165+0000","last_undegraded":"2024-04-24T23:39:44.220165+0000","last_fullsized":"2024-04-24T23:39:44.220165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:09.575181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822020+0000","last_change":"2024-04-24T23:38:38.221177+0000","last_active":"2024-04-24T23:39:22.822020+0000","last_peered":"2024-04-24T23:39:22.822020+0000","last_clean":"2024-04-24T23:39:22.822020+0000","last_became_active":"2024-04-24T23:38:38.219482+0000","last_became_peered":"2024-04-24T23:38:38.219482+0000","last_unstale":"2024-04-24T23:39:22.822020+0000","last_undegraded":"2024-04-24T23:39:22.822020+0000","last_fullsized":"2024-04-24T23:39:22.822020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:00.134189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947929+0000","last_change":"2024-04-24T23:38:34.170044+0000","last_active":"2024-04-24T23:39:22.947929+0000","last_peered":"2024-04-24T23:39:22.947929+0000","last_clean":"2024-04-24T23:39:22.947929+0000","last_became_active":"2024-04-24T23:38:34.169512+0000","last_became_peered":"2024-04-24T23:38:34.169512+0000","last_unstale":"2024-04-24T23:39:22.947929+0000","last_undegraded":"2024-04-24T23:39:22.947929+0000","last_fullsized":"2024-04-24T23:39:22.947929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817797+0000","last_change":"2024-04-24T23:38:33.131079+0000","last_active":"2024-04-24T23:39:22.817797+0000","last_peered":"2024-04-24T23:39:22.817797+0000","last_clean":"2024-04-24T23:39:22.817797+0000","last_became_active":"2024-04-24T23:38:33.130150+0000","last_became_peered":"2024-04-24T23:38:33.130150+0000","last_unstale":"2024-04-24T23:39:22.817797+0000","last_undegraded":"2024-04-24T23:39:22.817797+0000","last_fullsized":"2024-04-24T23:39:22.817797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:07.598128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'35","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:42.446330+0000","last_change":"2024-04-24T23:38:38.212241+0000","last_active":"2024-04-24T23:39:42.446330+0000","last_peered":"2024-04-24T23:39:42.446330+0000","last_clean":"2024-04-24T23:39:42.446330+0000","last_became_active":"2024-04-24T23:38:38.208130+0000","last_became_peered":"2024-04-24T23:38:38.208130+0000","last_unstale":"2024-04-24T23:39:42.446330+0000","last_undegraded":"2024-04-24T23:39:42.446330+0000","last_fullsized":"2024-04-24T23:39:42.446330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:32.771055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":4096,"num_write":33,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817836+0000","last_change":"2024-04-24T23:38:34.199814+0000","last_active":"2024-04-24T23:39:22.817836+0000","last_peered":"2024-04-24T23:39:22.817836+0000","last_clean":"2024-04-24T23:39:22.817836+0000","last_became_active":"2024-04-24T23:38:34.199311+0000","last_became_peered":"2024-04-24T23:38:34.199311+0000","last_unstale":"2024-04-24T23:39:22.817836+0000","last_undegraded":"2024-04-24T23:39:22.817836+0000","last_fullsized":"2024-04-24T23:39:22.817836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:09:44.182605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.818287+0000","last_change":"2024-04-24T23:38:33.140029+0000","last_active":"2024-04-24T23:39:22.818287+0000","last_peered":"2024-04-24T23:39:22.818287+0000","last_clean":"2024-04-24T23:39:22.818287+0000","last_became_active":"2024-04-24T23:38:33.139325+0000","last_became_peered":"2024-04-24T23:38:33.139325+0000","last_unstale":"2024-04-24T23:39:22.818287+0000","last_undegraded":"2024-04-24T23:39:22.818287+0000","last_fullsized":"2024-04-24T23:39:22.818287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:07.598128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815762+0000","last_change":"2024-04-24T23:38:38.246245+0000","last_active":"2024-04-24T23:39:22.815762+0000","last_peered":"2024-04-24T23:39:22.815762+0000","last_clean":"2024-04-24T23:39:22.815762+0000","last_became_active":"2024-04-24T23:38:38.245657+0000","last_became_peered":"2024-04-24T23:38:38.245657+0000","last_unstale":"2024-04-24T23:39:22.815762+0000","last_undegraded":"2024-04-24T23:39:22.815762+0000","last_fullsized":"2024-04-24T23:39:22.815762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:45.297412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947170+0000","last_change":"2024-04-24T23:38:38.251308+0000","last_active":"2024-04-24T23:39:22.947170+0000","last_peered":"2024-04-24T23:39:22.947170+0000","last_clean":"2024-04-24T23:39:22.947170+0000","last_became_active":"2024-04-24T23:38:38.250718+0000","last_became_peered":"2024-04-24T23:38:38.250718+0000","last_unstale":"2024-04-24T23:39:22.947170+0000","last_undegraded":"2024-04-24T23:39:22.947170+0000","last_fullsized":"2024-04-24T23:39:22.947170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:18.964372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821087+0000","last_change":"2024-04-24T23:38:34.174658+0000","last_active":"2024-04-24T23:39:22.821087+0000","last_peered":"2024-04-24T23:39:22.821087+0000","last_clean":"2024-04-24T23:39:22.821087+0000","last_became_active":"2024-04-24T23:38:34.174289+0000","last_became_peered":"2024-04-24T23:38:34.174289+0000","last_unstale":"2024-04-24T23:39:22.821087+0000","last_undegraded":"2024-04-24T23:39:22.821087+0000","last_fullsized":"2024-04-24T23:39:22.821087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:29.660159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814626+0000","last_change":"2024-04-24T23:38:33.131171+0000","last_active":"2024-04-24T23:39:22.814626+0000","last_peered":"2024-04-24T23:39:22.814626+0000","last_clean":"2024-04-24T23:39:22.814626+0000","last_became_active":"2024-04-24T23:38:33.130621+0000","last_became_peered":"2024-04-24T23:38:33.130621+0000","last_unstale":"2024-04-24T23:39:22.814626+0000","last_undegraded":"2024-04-24T23:39:22.814626+0000","last_fullsized":"2024-04-24T23:39:22.814626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817794+0000","last_change":"2024-04-24T23:38:38.214392+0000","last_active":"2024-04-24T23:39:22.817794+0000","last_peered":"2024-04-24T23:39:22.817794+0000","last_clean":"2024-04-24T23:39:22.817794+0000","last_became_active":"2024-04-24T23:38:38.213249+0000","last_became_peered":"2024-04-24T23:38:38.213249+0000","last_unstale":"2024-04-24T23:39:22.817794+0000","last_undegraded":"2024-04-24T23:39:22.817794+0000","last_fullsized":"2024-04-24T23:39:22.817794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:01.031822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815731+0000","last_change":"2024-04-24T23:38:34.164231+0000","last_active":"2024-04-24T23:39:22.815731+0000","last_peered":"2024-04-24T23:39:22.815731+0000","last_clean":"2024-04-24T23:39:22.815731+0000","last_became_active":"2024-04-24T23:38:34.163685+0000","last_became_peered":"2024-04-24T23:38:34.163685+0000","last_unstale":"2024-04-24T23:39:22.815731+0000","last_undegraded":"2024-04-24T23:39:22.815731+0000","last_fullsized":"2024-04-24T23:39:22.815731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:29.660159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814851+0000","last_change":"2024-04-24T23:38:33.116249+0000","last_active":"2024-04-24T23:39:22.814851+0000","last_peered":"2024-04-24T23:39:22.814851+0000","last_clean":"2024-04-24T23:39:22.814851+0000","last_became_active":"2024-04-24T23:38:33.113333+0000","last_became_peered":"2024-04-24T23:38:33.113333+0000","last_unstale":"2024-04-24T23:39:22.814851+0000","last_undegraded":"2024-04-24T23:39:22.814851+0000","last_fullsized":"2024-04-24T23:39:22.814851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:47:27.107958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814770+0000","last_change":"2024-04-24T23:38:33.111080+0000","last_active":"2024-04-24T23:39:22.814770+0000","last_peered":"2024-04-24T23:39:22.814770+0000","last_clean":"2024-04-24T23:39:22.814770+0000","last_became_active":"2024-04-24T23:38:33.110315+0000","last_became_peered":"2024-04-24T23:38:33.110315+0000","last_unstale":"2024-04-24T23:39:22.814770+0000","last_undegraded":"2024-04-24T23:39:22.814770+0000","last_fullsized":"2024-04-24T23:39:22.814770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947422+0000","last_change":"2024-04-24T23:38:34.148734+0000","last_active":"2024-04-24T23:39:22.947422+0000","last_peered":"2024-04-24T23:39:22.947422+0000","last_clean":"2024-04-24T23:39:22.947422+0000","last_became_active":"2024-04-24T23:38:34.146909+0000","last_became_peered":"2024-04-24T23:38:34.146909+0000","last_unstale":"2024-04-24T23:39:22.947422+0000","last_undegraded":"2024-04-24T23:39:22.947422+0000","last_fullsized":"2024-04-24T23:39:22.947422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:57:25.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.820296+0000","last_change":"2024-04-24T23:38:38.215787+0000","last_active":"2024-04-24T23:39:22.820296+0000","last_peered":"2024-04-24T23:39:22.820296+0000","last_clean":"2024-04-24T23:39:22.820296+0000","last_became_active":"2024-04-24T23:38:38.215395+0000","last_became_peered":"2024-04-24T23:38:38.215395+0000","last_unstale":"2024-04-24T23:39:22.820296+0000","last_undegraded":"2024-04-24T23:39:22.820296+0000","last_fullsized":"2024-04-24T23:39:22.820296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:51.641050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815067+0000","last_change":"2024-04-24T23:38:33.131735+0000","last_active":"2024-04-24T23:39:22.815067+0000","last_peered":"2024-04-24T23:39:22.815067+0000","last_clean":"2024-04-24T23:39:22.815067+0000","last_became_active":"2024-04-24T23:38:33.131314+0000","last_became_peered":"2024-04-24T23:38:33.131314+0000","last_unstale":"2024-04-24T23:39:22.815067+0000","last_undegraded":"2024-04-24T23:39:22.815067+0000","last_fullsized":"2024-04-24T23:39:22.815067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:42.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822079+0000","last_change":"2024-04-24T23:38:34.150894+0000","last_active":"2024-04-24T23:39:22.822079+0000","last_peered":"2024-04-24T23:39:22.822079+0000","last_clean":"2024-04-24T23:39:22.822079+0000","last_became_active":"2024-04-24T23:38:34.149910+0000","last_became_peered":"2024-04-24T23:38:34.149910+0000","last_unstale":"2024-04-24T23:39:22.822079+0000","last_undegraded":"2024-04-24T23:39:22.822079+0000","last_fullsized":"2024-04-24T23:39:22.822079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:08.608611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814775+0000","last_change":"2024-04-24T23:38:38.219498+0000","last_active":"2024-04-24T23:39:22.814775+0000","last_peered":"2024-04-24T23:39:22.814775+0000","last_clean":"2024-04-24T23:39:22.814775+0000","last_became_active":"2024-04-24T23:38:38.219100+0000","last_became_peered":"2024-04-24T23:38:38.219100+0000","last_unstale":"2024-04-24T23:39:22.814775+0000","last_undegraded":"2024-04-24T23:39:22.814775+0000","last_fullsized":"2024-04-24T23:39:22.814775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:17.585261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.813672+0000","last_change":"2024-04-24T23:38:34.162139+0000","last_active":"2024-04-24T23:39:22.813672+0000","last_peered":"2024-04-24T23:39:22.813672+0000","last_clean":"2024-04-24T23:39:22.813672+0000","last_became_active":"2024-04-24T23:38:34.159701+0000","last_became_peered":"2024-04-24T23:38:34.159701+0000","last_unstale":"2024-04-24T23:39:22.813672+0000","last_undegraded":"2024-04-24T23:39:22.813672+0000","last_fullsized":"2024-04-24T23:39:22.813672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:34.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.819582+0000","last_change":"2024-04-24T23:38:34.156925+0000","last_active":"2024-04-24T23:39:22.819582+0000","last_peered":"2024-04-24T23:39:22.819582+0000","last_clean":"2024-04-24T23:39:22.819582+0000","last_became_active":"2024-04-24T23:38:34.155969+0000","last_became_peered":"2024-04-24T23:38:34.155969+0000","last_unstale":"2024-04-24T23:39:22.819582+0000","last_undegraded":"2024-04-24T23:39:22.819582+0000","last_fullsized":"2024-04-24T23:39:22.819582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:31.033906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815530+0000","last_change":"2024-04-24T23:38:34.188234+0000","last_active":"2024-04-24T23:39:22.815530+0000","last_peered":"2024-04-24T23:39:22.815530+0000","last_clean":"2024-04-24T23:39:22.815530+0000","last_became_active":"2024-04-24T23:38:34.186332+0000","last_became_peered":"2024-04-24T23:38:34.186332+0000","last_unstale":"2024-04-24T23:39:22.815530+0000","last_undegraded":"2024-04-24T23:39:22.815530+0000","last_fullsized":"2024-04-24T23:39:22.815530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:56.049789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947106+0000","last_change":"2024-04-24T23:38:34.154728+0000","last_active":"2024-04-24T23:39:22.947106+0000","last_peered":"2024-04-24T23:39:22.947106+0000","last_clean":"2024-04-24T23:39:22.947106+0000","last_became_active":"2024-04-24T23:38:34.147038+0000","last_became_peered":"2024-04-24T23:38:34.147038+0000","last_unstale":"2024-04-24T23:39:22.947106+0000","last_undegraded":"2024-04-24T23:39:22.947106+0000","last_fullsized":"2024-04-24T23:39:22.947106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:34.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816375+0000","last_change":"2024-04-24T23:38:34.164080+0000","last_active":"2024-04-24T23:39:22.816375+0000","last_peered":"2024-04-24T23:39:22.816375+0000","last_clean":"2024-04-24T23:39:22.816375+0000","last_became_active":"2024-04-24T23:38:34.163761+0000","last_became_peered":"2024-04-24T23:38:34.163761+0000","last_unstale":"2024-04-24T23:39:22.816375+0000","last_undegraded":"2024-04-24T23:39:22.816375+0000","last_fullsized":"2024-04-24T23:39:22.816375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:00.007223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.829099+0000","last_change":"2024-04-24T23:39:22.829099+0000","last_active":"2024-04-24T23:39:22.829099+0000","last_peered":"2024-04-24T23:39:22.829099+0000","last_clean":"2024-04-24T23:39:22.829099+0000","last_became_active":"2024-04-24T23:39:22.828227+0000","last_became_peered":"2024-04-24T23:39:22.828227+0000","last_unstale":"2024-04-24T23:39:22.829099+0000","last_undegraded":"2024-04-24T23:39:22.829099+0000","last_fullsized":"2024-04-24T23:39:22.829099+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:38.663063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817535+0000","last_change":"2024-04-24T23:38:34.179301+0000","last_active":"2024-04-24T23:39:22.817535+0000","last_peered":"2024-04-24T23:39:22.817535+0000","last_clean":"2024-04-24T23:39:22.817535+0000","last_became_active":"2024-04-24T23:38:34.178651+0000","last_became_peered":"2024-04-24T23:38:34.178651+0000","last_unstale":"2024-04-24T23:39:22.817535+0000","last_undegraded":"2024-04-24T23:39:22.817535+0000","last_fullsized":"2024-04-24T23:39:22.817535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:57.767771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816067+0000","last_change":"2024-04-24T23:38:34.162572+0000","last_active":"2024-04-24T23:39:22.816067+0000","last_peered":"2024-04-24T23:39:22.816067+0000","last_clean":"2024-04-24T23:39:22.816067+0000","last_became_active":"2024-04-24T23:38:34.162156+0000","last_became_peered":"2024-04-24T23:38:34.162156+0000","last_unstale":"2024-04-24T23:39:22.816067+0000","last_undegraded":"2024-04-24T23:39:22.816067+0000","last_fullsized":"2024-04-24T23:39:22.816067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:57.767771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814482+0000","last_change":"2024-04-24T23:38:34.187429+0000","last_active":"2024-04-24T23:39:22.814482+0000","last_peered":"2024-04-24T23:39:22.814482+0000","last_clean":"2024-04-24T23:39:22.814482+0000","last_became_active":"2024-04-24T23:38:34.184827+0000","last_became_peered":"2024-04-24T23:38:34.184827+0000","last_unstale":"2024-04-24T23:39:22.814482+0000","last_undegraded":"2024-04-24T23:39:22.814482+0000","last_fullsized":"2024-04-24T23:39:22.814482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814372+0000","last_change":"2024-04-24T23:38:34.165830+0000","last_active":"2024-04-24T23:39:22.814372+0000","last_peered":"2024-04-24T23:39:22.814372+0000","last_clean":"2024-04-24T23:39:22.814372+0000","last_became_active":"2024-04-24T23:38:34.165531+0000","last_became_peered":"2024-04-24T23:38:34.165531+0000","last_unstale":"2024-04-24T23:39:22.814372+0000","last_undegraded":"2024-04-24T23:39:22.814372+0000","last_fullsized":"2024-04-24T23:39:22.814372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:57:25.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815294+0000","last_change":"2024-04-24T23:38:34.199810+0000","last_active":"2024-04-24T23:39:22.815294+0000","last_peered":"2024-04-24T23:39:22.815294+0000","last_clean":"2024-04-24T23:39:22.815294+0000","last_became_active":"2024-04-24T23:38:34.199173+0000","last_became_peered":"2024-04-24T23:38:34.199173+0000","last_unstale":"2024-04-24T23:39:22.815294+0000","last_undegraded":"2024-04-24T23:39:22.815294+0000","last_fullsized":"2024-04-24T23:39:22.815294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:27.147380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.946789+0000","last_change":"2024-04-24T23:38:34.165276+0000","last_active":"2024-04-24T23:39:22.946789+0000","last_peered":"2024-04-24T23:39:22.946789+0000","last_clean":"2024-04-24T23:39:22.946789+0000","last_became_active":"2024-04-24T23:38:34.165000+0000","last_became_peered":"2024-04-24T23:38:34.165000+0000","last_unstale":"2024-04-24T23:39:22.946789+0000","last_undegraded":"2024-04-24T23:39:22.946789+0000","last_fullsized":"2024-04-24T23:39:22.946789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:30:58.955608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816108+0000","last_change":"2024-04-24T23:38:34.146904+0000","last_active":"2024-04-24T23:39:22.816108+0000","last_peered":"2024-04-24T23:39:22.816108+0000","last_clean":"2024-04-24T23:39:22.816108+0000","last_became_active":"2024-04-24T23:38:34.146096+0000","last_became_peered":"2024-04-24T23:38:34.146096+0000","last_unstale":"2024-04-24T23:39:22.816108+0000","last_undegraded":"2024-04-24T23:39:22.816108+0000","last_fullsized":"2024-04-24T23:39:22.816108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:39.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.828011+0000","last_change":"2024-04-24T23:38:34.178750+0000","last_active":"2024-04-24T23:39:22.828011+0000","last_peered":"2024-04-24T23:39:22.828011+0000","last_clean":"2024-04-24T23:39:22.828011+0000","last_became_active":"2024-04-24T23:38:34.177451+0000","last_became_peered":"2024-04-24T23:38:34.177451+0000","last_unstale":"2024-04-24T23:39:22.828011+0000","last_undegraded":"2024-04-24T23:39:22.828011+0000","last_fullsized":"2024-04-24T23:39:22.828011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:43.814245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821128+0000","last_change":"2024-04-24T23:38:34.160937+0000","last_active":"2024-04-24T23:39:22.821128+0000","last_peered":"2024-04-24T23:39:22.821128+0000","last_clean":"2024-04-24T23:39:22.821128+0000","last_became_active":"2024-04-24T23:38:34.159252+0000","last_became_peered":"2024-04-24T23:38:34.159252+0000","last_unstale":"2024-04-24T23:39:22.821128+0000","last_undegraded":"2024-04-24T23:39:22.821128+0000","last_fullsized":"2024-04-24T23:39:22.821128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:10.585665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817749+0000","last_change":"2024-04-24T23:38:34.199973+0000","last_active":"2024-04-24T23:39:22.817749+0000","last_peered":"2024-04-24T23:39:22.817749+0000","last_clean":"2024-04-24T23:39:22.817749+0000","last_became_active":"2024-04-24T23:38:34.199464+0000","last_became_peered":"2024-04-24T23:38:34.199464+0000","last_unstale":"2024-04-24T23:39:22.817749+0000","last_undegraded":"2024-04-24T23:39:22.817749+0000","last_fullsized":"2024-04-24T23:39:22.817749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:14.879972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814510+0000","last_change":"2024-04-24T23:38:34.182144+0000","last_active":"2024-04-24T23:39:22.814510+0000","last_peered":"2024-04-24T23:39:22.814510+0000","last_clean":"2024-04-24T23:39:22.814510+0000","last_became_active":"2024-04-24T23:38:34.181459+0000","last_became_peered":"2024-04-24T23:38:34.181459+0000","last_unstale":"2024-04-24T23:39:22.814510+0000","last_undegraded":"2024-04-24T23:39:22.814510+0000","last_fullsized":"2024-04-24T23:39:22.814510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822224+0000","last_change":"2024-04-24T23:38:34.150090+0000","last_active":"2024-04-24T23:39:22.822224+0000","last_peered":"2024-04-24T23:39:22.822224+0000","last_clean":"2024-04-24T23:39:22.822224+0000","last_became_active":"2024-04-24T23:38:34.149272+0000","last_became_peered":"2024-04-24T23:38:34.149272+0000","last_unstale":"2024-04-24T23:39:22.822224+0000","last_undegraded":"2024-04-24T23:39:22.822224+0000","last_fullsized":"2024-04-24T23:39:22.822224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:57:25.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.946633+0000","last_change":"2024-04-24T23:38:34.155641+0000","last_active":"2024-04-24T23:39:22.946633+0000","last_peered":"2024-04-24T23:39:22.946633+0000","last_clean":"2024-04-24T23:39:22.946633+0000","last_became_active":"2024-04-24T23:38:34.153683+0000","last_became_peered":"2024-04-24T23:38:34.153683+0000","last_unstale":"2024-04-24T23:39:22.946633+0000","last_undegraded":"2024-04-24T23:39:22.946633+0000","last_fullsized":"2024-04-24T23:39:22.946633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:24.354101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814424+0000","last_change":"2024-04-24T23:38:34.173601+0000","last_active":"2024-04-24T23:39:22.814424+0000","last_peered":"2024-04-24T23:39:22.814424+0000","last_clean":"2024-04-24T23:39:22.814424+0000","last_became_active":"2024-04-24T23:38:34.165764+0000","last_became_peered":"2024-04-24T23:38:34.165764+0000","last_unstale":"2024-04-24T23:39:22.814424+0000","last_undegraded":"2024-04-24T23:39:22.814424+0000","last_fullsized":"2024-04-24T23:39:22.814424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822583+0000","last_change":"2024-04-24T23:38:34.142409+0000","last_active":"2024-04-24T23:39:22.822583+0000","last_peered":"2024-04-24T23:39:22.822583+0000","last_clean":"2024-04-24T23:39:22.822583+0000","last_became_active":"2024-04-24T23:38:34.141699+0000","last_became_peered":"2024-04-24T23:38:34.141699+0000","last_unstale":"2024-04-24T23:39:22.822583+0000","last_undegraded":"2024-04-24T23:39:22.822583+0000","last_fullsized":"2024-04-24T23:39:22.822583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:53.017909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817092+0000","last_change":"2024-04-24T23:38:34.155964+0000","last_active":"2024-04-24T23:39:22.817092+0000","last_peered":"2024-04-24T23:39:22.817092+0000","last_clean":"2024-04-24T23:39:22.817092+0000","last_became_active":"2024-04-24T23:38:34.155106+0000","last_became_peered":"2024-04-24T23:38:34.155106+0000","last_unstale":"2024-04-24T23:39:22.817092+0000","last_undegraded":"2024-04-24T23:39:22.817092+0000","last_fullsized":"2024-04-24T23:39:22.817092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817444+0000","last_change":"2024-04-24T23:38:34.157245+0000","last_active":"2024-04-24T23:39:22.817444+0000","last_peered":"2024-04-24T23:39:22.817444+0000","last_clean":"2024-04-24T23:39:22.817444+0000","last_became_active":"2024-04-24T23:38:34.156452+0000","last_became_peered":"2024-04-24T23:38:34.156452+0000","last_unstale":"2024-04-24T23:39:22.817444+0000","last_undegraded":"2024-04-24T23:39:22.817444+0000","last_fullsized":"2024-04-24T23:39:22.817444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.831864+0000","last_change":"2024-04-24T23:39:22.831864+0000","last_active":"2024-04-24T23:39:22.831864+0000","last_peered":"2024-04-24T23:39:22.831864+0000","last_clean":"2024-04-24T23:39:22.831864+0000","last_became_active":"2024-04-24T23:39:22.830955+0000","last_became_peered":"2024-04-24T23:39:22.830955+0000","last_unstale":"2024-04-24T23:39:22.831864+0000","last_undegraded":"2024-04-24T23:39:22.831864+0000","last_fullsized":"2024-04-24T23:39:22.831864+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:14:35.422279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.813772+0000","last_change":"2024-04-24T23:38:34.184693+0000","last_active":"2024-04-24T23:39:22.813772+0000","last_peered":"2024-04-24T23:39:22.813772+0000","last_clean":"2024-04-24T23:39:22.813772+0000","last_became_active":"2024-04-24T23:38:34.184367+0000","last_became_peered":"2024-04-24T23:38:34.184367+0000","last_unstale":"2024-04-24T23:39:22.813772+0000","last_undegraded":"2024-04-24T23:39:22.813772+0000","last_fullsized":"2024-04-24T23:39:22.813772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:30:58.955608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.824737+0000","last_change":"2024-04-24T23:38:34.176406+0000","last_active":"2024-04-24T23:39:22.824737+0000","last_peered":"2024-04-24T23:39:22.824737+0000","last_clean":"2024-04-24T23:39:22.824737+0000","last_became_active":"2024-04-24T23:38:34.165882+0000","last_became_peered":"2024-04-24T23:38:34.165882+0000","last_unstale":"2024-04-24T23:39:22.824737+0000","last_undegraded":"2024-04-24T23:39:22.824737+0000","last_fullsized":"2024-04-24T23:39:22.824737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:09:44.182605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815044+0000","last_change":"2024-04-24T23:38:34.184368+0000","last_active":"2024-04-24T23:39:22.815044+0000","last_peered":"2024-04-24T23:39:22.815044+0000","last_clean":"2024-04-24T23:39:22.815044+0000","last_became_active":"2024-04-24T23:38:34.183652+0000","last_became_peered":"2024-04-24T23:38:34.183652+0000","last_unstale":"2024-04-24T23:39:22.815044+0000","last_undegraded":"2024-04-24T23:39:22.815044+0000","last_fullsized":"2024-04-24T23:39:22.815044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:57.767771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.826002+0000","last_change":"2024-04-24T23:38:34.176656+0000","last_active":"2024-04-24T23:39:22.826002+0000","last_peered":"2024-04-24T23:39:22.826002+0000","last_clean":"2024-04-24T23:39:22.826002+0000","last_became_active":"2024-04-24T23:38:34.165931+0000","last_became_peered":"2024-04-24T23:38:34.165931+0000","last_unstale":"2024-04-24T23:39:22.826002+0000","last_undegraded":"2024-04-24T23:39:22.826002+0000","last_fullsized":"2024-04-24T23:39:22.826002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:14.879972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.829857+0000","last_change":"2024-04-24T23:39:22.826478+0000","last_active":"2024-04-24T23:39:22.829857+0000","last_peered":"2024-04-24T23:39:22.829857+0000","last_clean":"2024-04-24T23:39:22.829857+0000","last_became_active":"2024-04-24T23:39:22.825554+0000","last_became_peered":"2024-04-24T23:39:22.825554+0000","last_unstale":"2024-04-24T23:39:22.829857+0000","last_undegraded":"2024-04-24T23:39:22.829857+0000","last_fullsized":"2024-04-24T23:39:22.829857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:25.599734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947075+0000","last_change":"2024-04-24T23:38:34.150280+0000","last_active":"2024-04-24T23:39:22.947075+0000","last_peered":"2024-04-24T23:39:22.947075+0000","last_clean":"2024-04-24T23:39:22.947075+0000","last_became_active":"2024-04-24T23:38:34.148402+0000","last_became_peered":"2024-04-24T23:38:34.148402+0000","last_unstale":"2024-04-24T23:39:22.947075+0000","last_undegraded":"2024-04-24T23:39:22.947075+0000","last_fullsized":"2024-04-24T23:39:22.947075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:29.660159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.823743+0000","last_change":"2024-04-24T23:38:34.151749+0000","last_active":"2024-04-24T23:39:22.823743+0000","last_peered":"2024-04-24T23:39:22.823743+0000","last_clean":"2024-04-24T23:39:22.823743+0000","last_became_active":"2024-04-24T23:38:34.150987+0000","last_became_peered":"2024-04-24T23:38:34.150987+0000","last_unstale":"2024-04-24T23:39:22.823743+0000","last_undegraded":"2024-04-24T23:39:22.823743+0000","last_fullsized":"2024-04-24T23:39:22.823743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.828358+0000","last_change":"2024-04-24T23:38:34.194857+0000","last_active":"2024-04-24T23:39:22.828358+0000","last_peered":"2024-04-24T23:39:22.828358+0000","last_clean":"2024-04-24T23:39:22.828358+0000","last_became_active":"2024-04-24T23:38:34.194195+0000","last_became_peered":"2024-04-24T23:38:34.194195+0000","last_unstale":"2024-04-24T23:39:22.828358+0000","last_undegraded":"2024-04-24T23:39:22.828358+0000","last_fullsized":"2024-04-24T23:39:22.828358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:29:51.981646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":10368,"num_write":165,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40216,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":83,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":80432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67594,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31516,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":348160,"data_stored":705319,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":327680,"data_stored":153678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":114459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":290816,"data_stored":114495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31500,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340340,"statfs":{"total":96636764160,"available":96604508160,"internally_reserved":0,"allocated":331776,"data_stored":153787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":282624,"data_stored":114478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":114529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":356352,"data_stored":705375,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":39418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":39309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:40:04.615 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:40:04.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.776+0000 7fc64e4b0640 1 Processor -- start 2024-04-24T23:40:04.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.776+0000 7fc64e4b0640 1 -- start start 2024-04-24T23:40:04.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.776+0000 7fc64e4b0640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc64814bc60 0x7fc64806eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:04.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.776+0000 7fc64e4b0640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc64806f090 0x7fc6480b6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:04.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.776+0000 7fc64e4b0640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc6480bdbe0 0x7fc6480bc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:04.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.776+0000 7fc64e4b0640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fc648152c20 con 0x7fc6480bdbe0 2024-04-24T23:40:04.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.776+0000 7fc64e4b0640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fc64814e8e0 con 0x7fc64814bc60 2024-04-24T23:40:04.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.776+0000 7fc64e4b0640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fc64814ebc0 con 0x7fc64806f090 2024-04-24T23:40:04.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.776+0000 7fc64ca4d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc6480bdbe0 0x7fc6480bc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:04.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.776+0000 7fc64ca4d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc6480bdbe0 0x7fc6480bc9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39016/0 (socket says 172.21.15.57:39016) 2024-04-24T23:40:04.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.776+0000 7fc64ca4d640 1 -- 172.21.15.57:0/1855461371 learned_addr learned my addr 172.21.15.57:0/1855461371 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:04.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.776+0000 7fc6477fe640 1 --2- 172.21.15.57:0/1855461371 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc64806f090 0x7fc6480b6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:04.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.776+0000 7fc647fff640 1 --2- 172.21.15.57:0/1855461371 >> v2:172.21.15.88:3300/0 conn(0x7fc64814bc60 0x7fc64806eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:04.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.776+0000 7fc64ca4d640 1 -- 172.21.15.57:0/1855461371 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc64806f090 msgr2=0x7fc6480b6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:04.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.776+0000 7fc64ca4d640 1 --2- 172.21.15.57:0/1855461371 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc64806f090 0x7fc6480b6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:04.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.776+0000 7fc64ca4d640 1 -- 172.21.15.57:0/1855461371 >> v2:172.21.15.88:3300/0 conn(0x7fc64814bc60 msgr2=0x7fc64806eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:04.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.776+0000 7fc64ca4d640 1 --2- 172.21.15.57:0/1855461371 >> v2:172.21.15.88:3300/0 conn(0x7fc64814bc60 0x7fc64806eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:04.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.776+0000 7fc64ca4d640 1 -- 172.21.15.57:0/1855461371 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc64814c040 con 0x7fc6480bdbe0 2024-04-24T23:40:04.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.776+0000 7fc647fff640 1 --2- 172.21.15.57:0/1855461371 >> v2:172.21.15.88:3300/0 conn(0x7fc64814bc60 0x7fc64806eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:40:04.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.780+0000 7fc64ca4d640 1 --2- 172.21.15.57:0/1855461371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6480bdbe0 0x7fc6480bc9b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc64806f6f0 tx=0x7fc64001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f66c8b54c6b98e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:04.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.780+0000 7fc646ffd640 1 -- 172.21.15.57:0/1855461371 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6400a5670 con 0x7fc6480bdbe0 2024-04-24T23:40:04.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.780+0000 7fc646ffd640 1 -- 172.21.15.57:0/1855461371 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6400a5810 con 0x7fc6480bdbe0 2024-04-24T23:40:04.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.780+0000 7fc646ffd640 1 -- 172.21.15.57:0/1855461371 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6400a5be0 con 0x7fc6480bdbe0 2024-04-24T23:40:04.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.780+0000 7fc64e4b0640 1 -- 172.21.15.57:0/1855461371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6480bdbe0 msgr2=0x7fc6480bc9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:04.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.780+0000 7fc64e4b0640 1 --2- 172.21.15.57:0/1855461371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6480bdbe0 0x7fc6480bc9b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc64806f6f0 tx=0x7fc64001c9f0 comp rx=0 tx=0).stop 2024-04-24T23:40:04.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.780+0000 7fc64e4b0640 1 -- 172.21.15.57:0/1855461371 shutdown_connections 2024-04-24T23:40:04.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.780+0000 7fc64e4b0640 1 --2- 172.21.15.57:0/1855461371 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc64806f090 0x7fc6480b6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:04.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.780+0000 7fc64e4b0640 1 --2- 172.21.15.57:0/1855461371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6480bdbe0 0x7fc6480bc9b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:04.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.780+0000 7fc64e4b0640 1 --2- 172.21.15.57:0/1855461371 >> v2:172.21.15.88:3300/0 conn(0x7fc64814bc60 0x7fc64806eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:04.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.780+0000 7fc64e4b0640 1 -- 172.21.15.57:0/1855461371 >> 172.21.15.57:0/1855461371 conn(0x7fc6480beab0 msgr2=0x7fc6480beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:04.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.780+0000 7fc64e4b0640 1 -- 172.21.15.57:0/1855461371 shutdown_connections 2024-04-24T23:40:04.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.780+0000 7fc64e4b0640 1 -- 172.21.15.57:0/1855461371 wait complete. 2024-04-24T23:40:04.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.780+0000 7fc64e4b0640 1 Processor -- start 2024-04-24T23:40:04.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.780+0000 7fc64e4b0640 1 -- start start 2024-04-24T23:40:04.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.780+0000 7fc64e4b0640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc64806f090 0x7fc64814c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:04.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.780+0000 7fc64e4b0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6480bdbe0 0x7fc6480ba290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:04.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.780+0000 7fc64e4b0640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc64814bc60 0x7fc6480bb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:04.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.780+0000 7fc64e4b0640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc64815b1e0 con 0x7fc64814bc60 2024-04-24T23:40:04.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.780+0000 7fc64e4b0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc64815b060 con 0x7fc6480bdbe0 2024-04-24T23:40:04.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.780+0000 7fc64e4b0640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fc64815b360 con 0x7fc64806f090 2024-04-24T23:40:04.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.780+0000 7fc64ca4d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc64814bc60 0x7fc6480bb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:04.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.784+0000 7fc64ca4d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc64814bc60 0x7fc6480bb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39028/0 (socket says 172.21.15.57:39028) 2024-04-24T23:40:04.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.784+0000 7fc64ca4d640 1 -- 172.21.15.57:0/3170584738 learned_addr learned my addr 172.21.15.57:0/3170584738 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:04.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.784+0000 7fc6477fe640 1 --2- 172.21.15.57:0/3170584738 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6480bdbe0 0x7fc6480ba290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:04.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.784+0000 7fc647fff640 1 --2- 172.21.15.57:0/3170584738 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc64806f090 0x7fc64814c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:04.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.784+0000 7fc64ca4d640 1 -- 172.21.15.57:0/3170584738 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc64806f090 msgr2=0x7fc64814c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:04.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.784+0000 7fc64ca4d640 1 --2- 172.21.15.57:0/3170584738 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc64806f090 0x7fc64814c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:04.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.784+0000 7fc64ca4d640 1 -- 172.21.15.57:0/3170584738 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6480bdbe0 msgr2=0x7fc6480ba290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:04.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.784+0000 7fc64ca4d640 1 --2- 172.21.15.57:0/3170584738 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6480bdbe0 0x7fc6480ba290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:04.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.784+0000 7fc64ca4d640 1 -- 172.21.15.57:0/3170584738 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6480ba7d0 con 0x7fc64814bc60 2024-04-24T23:40:04.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.784+0000 7fc64ca4d640 1 --2- 172.21.15.57:0/3170584738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc64814bc60 0x7fc6480bb930 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc64001b0a0 tx=0x7fc640019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:04.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.784+0000 7fc644ff9640 1 -- 172.21.15.57:0/3170584738 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc640009510 con 0x7fc64814bc60 2024-04-24T23:40:04.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.784+0000 7fc644ff9640 1 -- 172.21.15.57:0/3170584738 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6400be070 con 0x7fc64814bc60 2024-04-24T23:40:04.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.784+0000 7fc64e4b0640 1 -- 172.21.15.57:0/3170584738 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6481e8060 con 0x7fc64814bc60 2024-04-24T23:40:04.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.784+0000 7fc644ff9640 1 -- 172.21.15.57:0/3170584738 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6400b88d0 con 0x7fc64814bc60 2024-04-24T23:40:04.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.784+0000 7fc64e4b0640 1 -- 172.21.15.57:0/3170584738 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6480bb130 con 0x7fc64814bc60 2024-04-24T23:40:04.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.784+0000 7fc64e4b0640 1 -- 172.21.15.57:0/3170584738 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc648068220 con 0x7fc64814bc60 2024-04-24T23:40:04.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.784+0000 7fc644ff9640 1 -- 172.21.15.57:0/3170584738 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc6400b8a70 con 0x7fc64814bc60 2024-04-24T23:40:04.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.784+0000 7fc644ff9640 1 --2- 172.21.15.57:0/3170584738 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc6340678c0 0x7fc634069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:04.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.784+0000 7fc644ff9640 1 -- 172.21.15.57:0/3170584738 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc640121190 con 0x7fc64814bc60 2024-04-24T23:40:04.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.784+0000 7fc647fff640 1 --2- 172.21.15.57:0/3170584738 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc6340678c0 0x7fc634069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:04.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.788+0000 7fc647fff640 1 --2- 172.21.15.57:0/3170584738 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc6340678c0 0x7fc634069d80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00c900 tx=0x7fc63c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:04.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.788+0000 7fc644ff9640 1 -- 172.21.15.57:0/3170584738 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fc6480ba7d0 con 0x7fc64814bc60 2024-04-24T23:40:04.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.948+0000 7fc64e4b0640 1 -- 172.21.15.57:0/3170584738 --> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc6481e8580 con 0x7fc6340678c0 2024-04-24T23:40:04.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.972+0000 7fc644ff9640 1 -- 172.21.15.57:0/3170584738 <== mgr.4105 v2:172.21.15.88:6832/3931748276 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332695 (secure 0 0 0) 0x7fc63c010870 con 0x7fc6340678c0 2024-04-24T23:40:04.975 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:40:04.979 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-24T23:40:04.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.976+0000 7fc64e4b0640 1 -- 172.21.15.57:0/3170584738 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc6340678c0 msgr2=0x7fc634069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:04.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.976+0000 7fc64e4b0640 1 --2- 172.21.15.57:0/3170584738 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc6340678c0 0x7fc634069d80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00c900 tx=0x7fc63c008040 comp rx=0 tx=0).stop 2024-04-24T23:40:04.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.976+0000 7fc64e4b0640 1 -- 172.21.15.57:0/3170584738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc64814bc60 msgr2=0x7fc6480bb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:04.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.976+0000 7fc64e4b0640 1 --2- 172.21.15.57:0/3170584738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc64814bc60 0x7fc6480bb930 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc64001b0a0 tx=0x7fc640019790 comp rx=0 tx=0).stop 2024-04-24T23:40:04.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.976+0000 7fc64e4b0640 1 -- 172.21.15.57:0/3170584738 shutdown_connections 2024-04-24T23:40:04.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.976+0000 7fc64e4b0640 1 --2- 172.21.15.57:0/3170584738 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc6340678c0 0x7fc634069d80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:04.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.976+0000 7fc64e4b0640 1 --2- 172.21.15.57:0/3170584738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc64814bc60 0x7fc6480bb930 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:04.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.976+0000 7fc64e4b0640 1 --2- 172.21.15.57:0/3170584738 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6480bdbe0 0x7fc6480ba290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:04.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.976+0000 7fc64e4b0640 1 --2- 172.21.15.57:0/3170584738 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc64806f090 0x7fc64814c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:04.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.976+0000 7fc64e4b0640 1 -- 172.21.15.57:0/3170584738 >> 172.21.15.57:0/3170584738 conn(0x7fc6480beab0 msgr2=0x7fc64806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:04.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.976+0000 7fc64e4b0640 1 -- 172.21.15.57:0/3170584738 shutdown_connections 2024-04-24T23:40:04.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:04.976+0000 7fc64e4b0640 1 -- 172.21.15.57:0/3170584738 wait complete. 2024-04-24T23:40:04.998 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-04-24T23:40:03.576259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":630584,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":199,"num_read_kb":10469,"num_write":407,"num_write_kb":22968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":364,"ondisk_log_size":364,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":247696,"kb_used_data":2448,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754727024,"statfs":{"total":773094113280,"available":772840472576,"internally_reserved":0,"allocated":2506752,"data_stored":2176120,"data_compressed":67594,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1792,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004429"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.948180+0000","last_change":"2024-04-24T23:38:33.135015+0000","last_active":"2024-04-24T23:39:22.948180+0000","last_peered":"2024-04-24T23:39:22.948180+0000","last_clean":"2024-04-24T23:39:22.948180+0000","last_became_active":"2024-04-24T23:38:33.134584+0000","last_became_peered":"2024-04-24T23:38:33.134584+0000","last_unstale":"2024-04-24T23:39:22.948180+0000","last_undegraded":"2024-04-24T23:39:22.948180+0000","last_fullsized":"2024-04-24T23:39:22.948180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:21.418436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815632+0000","last_change":"2024-04-24T23:38:34.164655+0000","last_active":"2024-04-24T23:39:22.815632+0000","last_peered":"2024-04-24T23:39:22.815632+0000","last_clean":"2024-04-24T23:39:22.815632+0000","last_became_active":"2024-04-24T23:38:34.162093+0000","last_became_peered":"2024-04-24T23:38:34.162093+0000","last_unstale":"2024-04-24T23:39:22.815632+0000","last_undegraded":"2024-04-24T23:39:22.815632+0000","last_fullsized":"2024-04-24T23:39:22.815632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.813716+0000","last_change":"2024-04-24T23:38:38.252169+0000","last_active":"2024-04-24T23:39:22.813716+0000","last_peered":"2024-04-24T23:39:22.813716+0000","last_clean":"2024-04-24T23:39:22.813716+0000","last_became_active":"2024-04-24T23:38:38.251653+0000","last_became_peered":"2024-04-24T23:38:38.251653+0000","last_unstale":"2024-04-24T23:39:22.813716+0000","last_undegraded":"2024-04-24T23:39:22.813716+0000","last_fullsized":"2024-04-24T23:39:22.813716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:57.651551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816215+0000","last_change":"2024-04-24T23:38:33.124025+0000","last_active":"2024-04-24T23:39:22.816215+0000","last_peered":"2024-04-24T23:39:22.816215+0000","last_clean":"2024-04-24T23:39:22.816215+0000","last_became_active":"2024-04-24T23:38:33.123681+0000","last_became_peered":"2024-04-24T23:38:33.123681+0000","last_unstale":"2024-04-24T23:39:22.816215+0000","last_undegraded":"2024-04-24T23:39:22.816215+0000","last_fullsized":"2024-04-24T23:39:22.816215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:27:41.421732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947507+0000","last_change":"2024-04-24T23:38:34.169793+0000","last_active":"2024-04-24T23:39:22.947507+0000","last_peered":"2024-04-24T23:39:22.947507+0000","last_clean":"2024-04-24T23:39:22.947507+0000","last_became_active":"2024-04-24T23:38:34.169115+0000","last_became_peered":"2024-04-24T23:38:34.169115+0000","last_unstale":"2024-04-24T23:39:22.947507+0000","last_undegraded":"2024-04-24T23:39:22.947507+0000","last_fullsized":"2024-04-24T23:39:22.947507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:39.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821314+0000","last_change":"2024-04-24T23:38:38.221580+0000","last_active":"2024-04-24T23:39:22.821314+0000","last_peered":"2024-04-24T23:39:22.821314+0000","last_clean":"2024-04-24T23:39:22.821314+0000","last_became_active":"2024-04-24T23:38:38.220392+0000","last_became_peered":"2024-04-24T23:38:38.220392+0000","last_unstale":"2024-04-24T23:39:22.821314+0000","last_undegraded":"2024-04-24T23:39:22.821314+0000","last_fullsized":"2024-04-24T23:39:22.821314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:16:01.852170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.828191+0000","last_change":"2024-04-24T23:38:33.144231+0000","last_active":"2024-04-24T23:39:22.828191+0000","last_peered":"2024-04-24T23:39:22.828191+0000","last_clean":"2024-04-24T23:39:22.828191+0000","last_became_active":"2024-04-24T23:38:33.143542+0000","last_became_peered":"2024-04-24T23:38:33.143542+0000","last_unstale":"2024-04-24T23:39:22.828191+0000","last_undegraded":"2024-04-24T23:39:22.828191+0000","last_fullsized":"2024-04-24T23:39:22.828191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:09.575181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816530+0000","last_change":"2024-04-24T23:38:34.170796+0000","last_active":"2024-04-24T23:39:22.816530+0000","last_peered":"2024-04-24T23:39:22.816530+0000","last_clean":"2024-04-24T23:39:22.816530+0000","last_became_active":"2024-04-24T23:38:34.169908+0000","last_became_peered":"2024-04-24T23:38:34.169908+0000","last_unstale":"2024-04-24T23:39:22.816530+0000","last_undegraded":"2024-04-24T23:39:22.816530+0000","last_fullsized":"2024-04-24T23:39:22.816530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:17:07.009163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821677+0000","last_change":"2024-04-24T23:38:38.218416+0000","last_active":"2024-04-24T23:39:22.821677+0000","last_peered":"2024-04-24T23:39:22.821677+0000","last_clean":"2024-04-24T23:39:22.821677+0000","last_became_active":"2024-04-24T23:38:38.217390+0000","last_became_peered":"2024-04-24T23:38:38.217390+0000","last_unstale":"2024-04-24T23:39:22.821677+0000","last_undegraded":"2024-04-24T23:39:22.821677+0000","last_fullsized":"2024-04-24T23:39:22.821677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:31.231780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.826953+0000","last_change":"2024-04-24T23:38:33.149114+0000","last_active":"2024-04-24T23:39:22.826953+0000","last_peered":"2024-04-24T23:39:22.826953+0000","last_clean":"2024-04-24T23:39:22.826953+0000","last_became_active":"2024-04-24T23:38:33.148510+0000","last_became_peered":"2024-04-24T23:38:33.148510+0000","last_unstale":"2024-04-24T23:39:22.826953+0000","last_undegraded":"2024-04-24T23:39:22.826953+0000","last_fullsized":"2024-04-24T23:39:22.826953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:39.396571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817264+0000","last_change":"2024-04-24T23:38:34.153747+0000","last_active":"2024-04-24T23:39:22.817264+0000","last_peered":"2024-04-24T23:39:22.817264+0000","last_clean":"2024-04-24T23:39:22.817264+0000","last_became_active":"2024-04-24T23:38:34.152984+0000","last_became_peered":"2024-04-24T23:38:34.152984+0000","last_unstale":"2024-04-24T23:39:22.817264+0000","last_undegraded":"2024-04-24T23:39:22.817264+0000","last_fullsized":"2024-04-24T23:39:22.817264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:54.469544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821502+0000","last_change":"2024-04-24T23:38:38.222542+0000","last_active":"2024-04-24T23:39:22.821502+0000","last_peered":"2024-04-24T23:39:22.821502+0000","last_clean":"2024-04-24T23:39:22.821502+0000","last_became_active":"2024-04-24T23:38:38.220601+0000","last_became_peered":"2024-04-24T23:38:38.220601+0000","last_unstale":"2024-04-24T23:39:22.821502+0000","last_undegraded":"2024-04-24T23:39:22.821502+0000","last_fullsized":"2024-04-24T23:39:22.821502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:32.372869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814379+0000","last_change":"2024-04-24T23:38:34.142429+0000","last_active":"2024-04-24T23:39:22.814379+0000","last_peered":"2024-04-24T23:39:22.814379+0000","last_clean":"2024-04-24T23:39:22.814379+0000","last_became_active":"2024-04-24T23:38:34.141681+0000","last_became_peered":"2024-04-24T23:38:34.141681+0000","last_unstale":"2024-04-24T23:39:22.814379+0000","last_undegraded":"2024-04-24T23:39:22.814379+0000","last_fullsized":"2024-04-24T23:39:22.814379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:57:25.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.827312+0000","last_change":"2024-04-24T23:38:33.140585+0000","last_active":"2024-04-24T23:39:22.827312+0000","last_peered":"2024-04-24T23:39:22.827312+0000","last_clean":"2024-04-24T23:39:22.827312+0000","last_became_active":"2024-04-24T23:38:33.139303+0000","last_became_peered":"2024-04-24T23:38:33.139303+0000","last_unstale":"2024-04-24T23:39:22.827312+0000","last_undegraded":"2024-04-24T23:39:22.827312+0000","last_fullsized":"2024-04-24T23:39:22.827312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:23.343617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822916+0000","last_change":"2024-04-24T23:38:38.216184+0000","last_active":"2024-04-24T23:39:22.822916+0000","last_peered":"2024-04-24T23:39:22.822916+0000","last_clean":"2024-04-24T23:39:22.822916+0000","last_became_active":"2024-04-24T23:38:38.214813+0000","last_became_peered":"2024-04-24T23:38:38.214813+0000","last_unstale":"2024-04-24T23:39:22.822916+0000","last_undegraded":"2024-04-24T23:39:22.822916+0000","last_fullsized":"2024-04-24T23:39:22.822916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:58.553943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814784+0000","last_change":"2024-04-24T23:38:34.174790+0000","last_active":"2024-04-24T23:39:22.814784+0000","last_peered":"2024-04-24T23:39:22.814784+0000","last_clean":"2024-04-24T23:39:22.814784+0000","last_became_active":"2024-04-24T23:38:34.174504+0000","last_became_peered":"2024-04-24T23:38:34.174504+0000","last_unstale":"2024-04-24T23:39:22.814784+0000","last_undegraded":"2024-04-24T23:39:22.814784+0000","last_fullsized":"2024-04-24T23:39:22.814784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:27.147380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822132+0000","last_change":"2024-04-24T23:38:33.125559+0000","last_active":"2024-04-24T23:39:22.822132+0000","last_peered":"2024-04-24T23:39:22.822132+0000","last_clean":"2024-04-24T23:39:22.822132+0000","last_became_active":"2024-04-24T23:38:33.125115+0000","last_became_peered":"2024-04-24T23:38:33.125115+0000","last_unstale":"2024-04-24T23:39:22.822132+0000","last_undegraded":"2024-04-24T23:39:22.822132+0000","last_fullsized":"2024-04-24T23:39:22.822132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:07.598128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821927+0000","last_change":"2024-04-24T23:38:38.221669+0000","last_active":"2024-04-24T23:39:22.821927+0000","last_peered":"2024-04-24T23:39:22.821927+0000","last_clean":"2024-04-24T23:39:22.821927+0000","last_became_active":"2024-04-24T23:38:38.219797+0000","last_became_peered":"2024-04-24T23:38:38.219797+0000","last_unstale":"2024-04-24T23:39:22.821927+0000","last_undegraded":"2024-04-24T23:39:22.821927+0000","last_fullsized":"2024-04-24T23:39:22.821927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:04.091622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814214+0000","last_change":"2024-04-24T23:38:34.163966+0000","last_active":"2024-04-24T23:39:22.814214+0000","last_peered":"2024-04-24T23:39:22.814214+0000","last_clean":"2024-04-24T23:39:22.814214+0000","last_became_active":"2024-04-24T23:38:34.163291+0000","last_became_peered":"2024-04-24T23:38:34.163291+0000","last_unstale":"2024-04-24T23:39:22.814214+0000","last_undegraded":"2024-04-24T23:39:22.814214+0000","last_fullsized":"2024-04-24T23:39:22.814214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:34.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822513+0000","last_change":"2024-04-24T23:38:33.119549+0000","last_active":"2024-04-24T23:39:22.822513+0000","last_peered":"2024-04-24T23:39:22.822513+0000","last_clean":"2024-04-24T23:39:22.822513+0000","last_became_active":"2024-04-24T23:38:33.119052+0000","last_became_peered":"2024-04-24T23:38:33.119052+0000","last_unstale":"2024-04-24T23:39:22.822513+0000","last_undegraded":"2024-04-24T23:39:22.822513+0000","last_fullsized":"2024-04-24T23:39:22.822513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'33","reported_seq":51,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:42.166983+0000","last_change":"2024-04-24T23:38:38.252720+0000","last_active":"2024-04-24T23:39:42.166983+0000","last_peered":"2024-04-24T23:39:42.166983+0000","last_clean":"2024-04-24T23:39:42.166983+0000","last_became_active":"2024-04-24T23:38:38.252138+0000","last_became_peered":"2024-04-24T23:38:38.252138+0000","last_unstale":"2024-04-24T23:39:42.166983+0000","last_undegraded":"2024-04-24T23:39:42.166983+0000","last_fullsized":"2024-04-24T23:39:42.166983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:18.964372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.823517+0000","last_change":"2024-04-24T23:38:34.157008+0000","last_active":"2024-04-24T23:39:22.823517+0000","last_peered":"2024-04-24T23:39:22.823517+0000","last_clean":"2024-04-24T23:39:22.823517+0000","last_became_active":"2024-04-24T23:38:34.152682+0000","last_became_peered":"2024-04-24T23:38:34.152682+0000","last_unstale":"2024-04-24T23:39:22.823517+0000","last_undegraded":"2024-04-24T23:39:22.823517+0000","last_fullsized":"2024-04-24T23:39:22.823517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:48.697457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.824298+0000","last_change":"2024-04-24T23:38:33.139819+0000","last_active":"2024-04-24T23:39:22.824298+0000","last_peered":"2024-04-24T23:39:22.824298+0000","last_clean":"2024-04-24T23:39:22.824298+0000","last_became_active":"2024-04-24T23:38:33.139175+0000","last_became_peered":"2024-04-24T23:38:33.139175+0000","last_unstale":"2024-04-24T23:39:22.824298+0000","last_undegraded":"2024-04-24T23:39:22.824298+0000","last_fullsized":"2024-04-24T23:39:22.824298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:52.007425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.833647+0000","last_change":"2024-04-24T23:39:22.833647+0000","last_active":"2024-04-24T23:39:22.833647+0000","last_peered":"2024-04-24T23:39:22.833647+0000","last_clean":"2024-04-24T23:39:22.833647+0000","last_became_active":"2024-04-24T23:39:22.831081+0000","last_became_peered":"2024-04-24T23:39:22.831081+0000","last_unstale":"2024-04-24T23:39:22.833647+0000","last_undegraded":"2024-04-24T23:39:22.833647+0000","last_fullsized":"2024-04-24T23:39:22.833647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:32:39.380569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947767+0000","last_change":"2024-04-24T23:38:34.154755+0000","last_active":"2024-04-24T23:39:22.947767+0000","last_peered":"2024-04-24T23:39:22.947767+0000","last_clean":"2024-04-24T23:39:22.947767+0000","last_became_active":"2024-04-24T23:38:34.153967+0000","last_became_peered":"2024-04-24T23:38:34.153967+0000","last_unstale":"2024-04-24T23:39:22.947767+0000","last_undegraded":"2024-04-24T23:39:22.947767+0000","last_fullsized":"2024-04-24T23:39:22.947767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.818571+0000","last_change":"2024-04-24T23:38:33.135885+0000","last_active":"2024-04-24T23:39:22.818571+0000","last_peered":"2024-04-24T23:39:22.818571+0000","last_clean":"2024-04-24T23:39:22.818571+0000","last_became_active":"2024-04-24T23:38:33.135225+0000","last_became_peered":"2024-04-24T23:38:33.135225+0000","last_unstale":"2024-04-24T23:39:22.818571+0000","last_undegraded":"2024-04-24T23:39:22.818571+0000","last_fullsized":"2024-04-24T23:39:22.818571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:52.007425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822856+0000","last_change":"2024-04-24T23:38:38.252002+0000","last_active":"2024-04-24T23:39:22.822856+0000","last_peered":"2024-04-24T23:39:22.822856+0000","last_clean":"2024-04-24T23:39:22.822856+0000","last_became_active":"2024-04-24T23:38:38.251057+0000","last_became_peered":"2024-04-24T23:38:38.251057+0000","last_unstale":"2024-04-24T23:39:22.822856+0000","last_undegraded":"2024-04-24T23:39:22.822856+0000","last_fullsized":"2024-04-24T23:39:22.822856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:49.920273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.838498+0000","last_change":"2024-04-24T23:39:22.833969+0000","last_active":"2024-04-24T23:39:22.838498+0000","last_peered":"2024-04-24T23:39:22.838498+0000","last_clean":"2024-04-24T23:39:22.838498+0000","last_became_active":"2024-04-24T23:39:22.833072+0000","last_became_peered":"2024-04-24T23:39:22.833072+0000","last_unstale":"2024-04-24T23:39:22.838498+0000","last_undegraded":"2024-04-24T23:39:22.838498+0000","last_fullsized":"2024-04-24T23:39:22.838498+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:53.567151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:44.174185+0000","last_change":"2024-04-24T23:38:33.115409+0000","last_active":"2024-04-24T23:39:44.174185+0000","last_peered":"2024-04-24T23:39:44.174185+0000","last_clean":"2024-04-24T23:39:44.174185+0000","last_became_active":"2024-04-24T23:38:33.115039+0000","last_became_peered":"2024-04-24T23:38:33.115039+0000","last_unstale":"2024-04-24T23:39:44.174185+0000","last_undegraded":"2024-04-24T23:39:44.174185+0000","last_fullsized":"2024-04-24T23:39:44.174185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:52.007425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.813502+0000","last_change":"2024-04-24T23:38:38.246602+0000","last_active":"2024-04-24T23:39:22.813502+0000","last_peered":"2024-04-24T23:39:22.813502+0000","last_clean":"2024-04-24T23:39:22.813502+0000","last_became_active":"2024-04-24T23:38:38.245775+0000","last_became_peered":"2024-04-24T23:38:38.245775+0000","last_unstale":"2024-04-24T23:39:22.813502+0000","last_undegraded":"2024-04-24T23:39:22.813502+0000","last_fullsized":"2024-04-24T23:39:22.813502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:29.684133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.823555+0000","last_change":"2024-04-24T23:38:34.149008+0000","last_active":"2024-04-24T23:39:22.823555+0000","last_peered":"2024-04-24T23:39:22.823555+0000","last_clean":"2024-04-24T23:39:22.823555+0000","last_became_active":"2024-04-24T23:38:34.148122+0000","last_became_peered":"2024-04-24T23:38:34.148122+0000","last_unstale":"2024-04-24T23:39:22.823555+0000","last_undegraded":"2024-04-24T23:39:22.823555+0000","last_fullsized":"2024-04-24T23:39:22.823555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:39.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.828326+0000","last_change":"2024-04-24T23:38:33.142490+0000","last_active":"2024-04-24T23:39:22.828326+0000","last_peered":"2024-04-24T23:39:22.828326+0000","last_clean":"2024-04-24T23:39:22.828326+0000","last_became_active":"2024-04-24T23:38:33.140003+0000","last_became_peered":"2024-04-24T23:38:33.140003+0000","last_unstale":"2024-04-24T23:39:22.828326+0000","last_undegraded":"2024-04-24T23:39:22.828326+0000","last_fullsized":"2024-04-24T23:39:22.828326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:45:12.216173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.946778+0000","last_change":"2024-04-24T23:38:38.246291+0000","last_active":"2024-04-24T23:39:22.946778+0000","last_peered":"2024-04-24T23:39:22.946778+0000","last_clean":"2024-04-24T23:39:22.946778+0000","last_became_active":"2024-04-24T23:38:38.245611+0000","last_became_peered":"2024-04-24T23:38:38.245611+0000","last_unstale":"2024-04-24T23:39:22.946778+0000","last_undegraded":"2024-04-24T23:39:22.946778+0000","last_fullsized":"2024-04-24T23:39:22.946778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:47.898644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817536+0000","last_change":"2024-04-24T23:38:34.186285+0000","last_active":"2024-04-24T23:39:22.817536+0000","last_peered":"2024-04-24T23:39:22.817536+0000","last_clean":"2024-04-24T23:39:22.817536+0000","last_became_active":"2024-04-24T23:38:34.185023+0000","last_became_peered":"2024-04-24T23:38:34.185023+0000","last_unstale":"2024-04-24T23:39:22.817536+0000","last_undegraded":"2024-04-24T23:39:22.817536+0000","last_fullsized":"2024-04-24T23:39:22.817536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:56.947423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.823814+0000","last_change":"2024-04-24T23:38:33.108447+0000","last_active":"2024-04-24T23:39:22.823814+0000","last_peered":"2024-04-24T23:39:22.823814+0000","last_clean":"2024-04-24T23:39:22.823814+0000","last_became_active":"2024-04-24T23:38:33.108102+0000","last_became_peered":"2024-04-24T23:38:33.108102+0000","last_unstale":"2024-04-24T23:39:22.823814+0000","last_undegraded":"2024-04-24T23:39:22.823814+0000","last_fullsized":"2024-04-24T23:39:22.823814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:47.686974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821488+0000","last_change":"2024-04-24T23:38:38.213425+0000","last_active":"2024-04-24T23:39:22.821488+0000","last_peered":"2024-04-24T23:39:22.821488+0000","last_clean":"2024-04-24T23:39:22.821488+0000","last_became_active":"2024-04-24T23:38:38.212691+0000","last_became_peered":"2024-04-24T23:38:38.212691+0000","last_unstale":"2024-04-24T23:39:22.821488+0000","last_undegraded":"2024-04-24T23:39:22.821488+0000","last_fullsized":"2024-04-24T23:39:22.821488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:01.031822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822383+0000","last_change":"2024-04-24T23:38:34.154178+0000","last_active":"2024-04-24T23:39:22.822383+0000","last_peered":"2024-04-24T23:39:22.822383+0000","last_clean":"2024-04-24T23:39:22.822383+0000","last_became_active":"2024-04-24T23:38:34.153372+0000","last_became_peered":"2024-04-24T23:38:34.153372+0000","last_unstale":"2024-04-24T23:39:22.822383+0000","last_undegraded":"2024-04-24T23:39:22.822383+0000","last_fullsized":"2024-04-24T23:39:22.822383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:10.585665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816188+0000","last_change":"2024-04-24T23:38:33.140060+0000","last_active":"2024-04-24T23:39:22.816188+0000","last_peered":"2024-04-24T23:39:22.816188+0000","last_clean":"2024-04-24T23:39:22.816188+0000","last_became_active":"2024-04-24T23:38:33.139012+0000","last_became_peered":"2024-04-24T23:38:33.139012+0000","last_unstale":"2024-04-24T23:39:22.816188+0000","last_undegraded":"2024-04-24T23:39:22.816188+0000","last_fullsized":"2024-04-24T23:39:22.816188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.830414+0000","last_change":"2024-04-24T23:39:22.828208+0000","last_active":"2024-04-24T23:39:22.830414+0000","last_peered":"2024-04-24T23:39:22.830414+0000","last_clean":"2024-04-24T23:39:22.830414+0000","last_became_active":"2024-04-24T23:39:22.825860+0000","last_became_peered":"2024-04-24T23:39:22.825860+0000","last_unstale":"2024-04-24T23:39:22.830414+0000","last_undegraded":"2024-04-24T23:39:22.830414+0000","last_fullsized":"2024-04-24T23:39:22.830414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:14:39.506678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.820916+0000","last_change":"2024-04-24T23:38:34.152846+0000","last_active":"2024-04-24T23:39:22.820916+0000","last_peered":"2024-04-24T23:39:22.820916+0000","last_clean":"2024-04-24T23:39:22.820916+0000","last_became_active":"2024-04-24T23:38:34.151917+0000","last_became_peered":"2024-04-24T23:38:34.151917+0000","last_unstale":"2024-04-24T23:39:22.820916+0000","last_undegraded":"2024-04-24T23:39:22.820916+0000","last_fullsized":"2024-04-24T23:39:22.820916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:34.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'2","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:44.222348+0000","last_change":"2024-04-24T23:38:33.124295+0000","last_active":"2024-04-24T23:39:44.222348+0000","last_peered":"2024-04-24T23:39:44.222348+0000","last_clean":"2024-04-24T23:39:44.222348+0000","last_became_active":"2024-04-24T23:38:33.123674+0000","last_became_peered":"2024-04-24T23:38:33.123674+0000","last_unstale":"2024-04-24T23:39:44.222348+0000","last_undegraded":"2024-04-24T23:39:44.222348+0000","last_fullsized":"2024-04-24T23:39:44.222348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.824922+0000","last_change":"2024-04-24T23:38:38.214721+0000","last_active":"2024-04-24T23:39:22.824922+0000","last_peered":"2024-04-24T23:39:22.824922+0000","last_clean":"2024-04-24T23:39:22.824922+0000","last_became_active":"2024-04-24T23:38:38.214005+0000","last_became_peered":"2024-04-24T23:38:38.214005+0000","last_unstale":"2024-04-24T23:39:22.824922+0000","last_undegraded":"2024-04-24T23:39:22.824922+0000","last_fullsized":"2024-04-24T23:39:22.824922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:29:56.066046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.946216+0000","last_change":"2024-04-24T23:38:34.139551+0000","last_active":"2024-04-24T23:39:22.946216+0000","last_peered":"2024-04-24T23:39:22.946216+0000","last_clean":"2024-04-24T23:39:22.946216+0000","last_became_active":"2024-04-24T23:38:34.138681+0000","last_became_peered":"2024-04-24T23:38:34.138681+0000","last_unstale":"2024-04-24T23:39:22.946216+0000","last_undegraded":"2024-04-24T23:39:22.946216+0000","last_fullsized":"2024-04-24T23:39:22.946216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:47.556651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.824571+0000","last_change":"2024-04-24T23:38:33.141279+0000","last_active":"2024-04-24T23:39:22.824571+0000","last_peered":"2024-04-24T23:39:22.824571+0000","last_clean":"2024-04-24T23:39:22.824571+0000","last_became_active":"2024-04-24T23:38:33.140618+0000","last_became_peered":"2024-04-24T23:38:33.140618+0000","last_unstale":"2024-04-24T23:39:22.824571+0000","last_undegraded":"2024-04-24T23:39:22.824571+0000","last_fullsized":"2024-04-24T23:39:22.824571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947496+0000","last_change":"2024-04-24T23:38:38.250074+0000","last_active":"2024-04-24T23:39:22.947496+0000","last_peered":"2024-04-24T23:39:22.947496+0000","last_clean":"2024-04-24T23:39:22.947496+0000","last_became_active":"2024-04-24T23:38:38.249402+0000","last_became_peered":"2024-04-24T23:38:38.249402+0000","last_unstale":"2024-04-24T23:39:22.947496+0000","last_undegraded":"2024-04-24T23:39:22.947496+0000","last_fullsized":"2024-04-24T23:39:22.947496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:57.246661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816685+0000","last_change":"2024-04-24T23:38:34.187980+0000","last_active":"2024-04-24T23:39:22.816685+0000","last_peered":"2024-04-24T23:39:22.816685+0000","last_clean":"2024-04-24T23:39:22.816685+0000","last_became_active":"2024-04-24T23:38:34.187655+0000","last_became_peered":"2024-04-24T23:38:34.187655+0000","last_unstale":"2024-04-24T23:39:22.816685+0000","last_undegraded":"2024-04-24T23:39:22.816685+0000","last_fullsized":"2024-04-24T23:39:22.816685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:39.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815604+0000","last_change":"2024-04-24T23:38:33.125255+0000","last_active":"2024-04-24T23:39:22.815604+0000","last_peered":"2024-04-24T23:39:22.815604+0000","last_clean":"2024-04-24T23:39:22.815604+0000","last_became_active":"2024-04-24T23:38:33.115926+0000","last_became_peered":"2024-04-24T23:38:33.115926+0000","last_unstale":"2024-04-24T23:39:22.815604+0000","last_undegraded":"2024-04-24T23:39:22.815604+0000","last_fullsized":"2024-04-24T23:39:22.815604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:42.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.824826+0000","last_change":"2024-04-24T23:38:29.564705+0000","last_active":"2024-04-24T23:39:22.824826+0000","last_peered":"2024-04-24T23:39:22.824826+0000","last_clean":"2024-04-24T23:39:22.824826+0000","last_became_active":"2024-04-24T23:38:29.562027+0000","last_became_peered":"2024-04-24T23:38:29.562027+0000","last_unstale":"2024-04-24T23:39:22.824826+0000","last_undegraded":"2024-04-24T23:39:22.824826+0000","last_fullsized":"2024-04-24T23:39:22.824826+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:27.959678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:27.959678+0000","last_clean_scrub_stamp":"2024-04-24T23:38:27.959678+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:40.724497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'33","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:42.539265+0000","last_change":"2024-04-24T23:38:38.254846+0000","last_active":"2024-04-24T23:39:42.539265+0000","last_peered":"2024-04-24T23:39:42.539265+0000","last_clean":"2024-04-24T23:39:42.539265+0000","last_became_active":"2024-04-24T23:38:38.253792+0000","last_became_peered":"2024-04-24T23:38:38.253792+0000","last_unstale":"2024-04-24T23:39:42.539265+0000","last_undegraded":"2024-04-24T23:39:42.539265+0000","last_fullsized":"2024-04-24T23:39:42.539265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:17:11.093562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":2176,"num_write":33,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.827672+0000","last_change":"2024-04-24T23:38:34.195003+0000","last_active":"2024-04-24T23:39:22.827672+0000","last_peered":"2024-04-24T23:39:22.827672+0000","last_clean":"2024-04-24T23:39:22.827672+0000","last_became_active":"2024-04-24T23:38:34.194530+0000","last_became_peered":"2024-04-24T23:38:34.194530+0000","last_unstale":"2024-04-24T23:39:22.827672+0000","last_undegraded":"2024-04-24T23:39:22.827672+0000","last_fullsized":"2024-04-24T23:39:22.827672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:00.007223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.820712+0000","last_change":"2024-04-24T23:38:33.130165+0000","last_active":"2024-04-24T23:39:22.820712+0000","last_peered":"2024-04-24T23:39:22.820712+0000","last_clean":"2024-04-24T23:39:22.820712+0000","last_became_active":"2024-04-24T23:38:33.129888+0000","last_became_peered":"2024-04-24T23:38:33.129888+0000","last_unstale":"2024-04-24T23:39:22.820712+0000","last_undegraded":"2024-04-24T23:39:22.820712+0000","last_fullsized":"2024-04-24T23:39:22.820712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:27:41.421732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'66","reported_seq":116,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:44.231356+0000","last_change":"2024-04-24T23:38:38.253780+0000","last_active":"2024-04-24T23:39:44.231356+0000","last_peered":"2024-04-24T23:39:44.231356+0000","last_clean":"2024-04-24T23:39:44.231356+0000","last_became_active":"2024-04-24T23:38:38.252899+0000","last_became_peered":"2024-04-24T23:38:38.252899+0000","last_unstale":"2024-04-24T23:39:44.231356+0000","last_undegraded":"2024-04-24T23:39:44.231356+0000","last_fullsized":"2024-04-24T23:39:44.231356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:58.553943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":4096,"num_write":66,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816876+0000","last_change":"2024-04-24T23:38:34.187942+0000","last_active":"2024-04-24T23:39:22.816876+0000","last_peered":"2024-04-24T23:39:22.816876+0000","last_clean":"2024-04-24T23:39:22.816876+0000","last_became_active":"2024-04-24T23:38:34.184929+0000","last_became_peered":"2024-04-24T23:38:34.184929+0000","last_unstale":"2024-04-24T23:39:22.816876+0000","last_undegraded":"2024-04-24T23:39:22.816876+0000","last_fullsized":"2024-04-24T23:39:22.816876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:43.814245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.823408+0000","last_change":"2024-04-24T23:38:33.120289+0000","last_active":"2024-04-24T23:39:22.823408+0000","last_peered":"2024-04-24T23:39:22.823408+0000","last_clean":"2024-04-24T23:39:22.823408+0000","last_became_active":"2024-04-24T23:38:33.119790+0000","last_became_peered":"2024-04-24T23:38:33.119790+0000","last_unstale":"2024-04-24T23:39:22.823408+0000","last_undegraded":"2024-04-24T23:39:22.823408+0000","last_fullsized":"2024-04-24T23:39:22.823408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947098+0000","last_change":"2024-04-24T23:38:38.216064+0000","last_active":"2024-04-24T23:39:22.947098+0000","last_peered":"2024-04-24T23:39:22.947098+0000","last_clean":"2024-04-24T23:39:22.947098+0000","last_became_active":"2024-04-24T23:38:38.215599+0000","last_became_peered":"2024-04-24T23:38:38.215599+0000","last_unstale":"2024-04-24T23:39:22.947098+0000","last_undegraded":"2024-04-24T23:39:22.947098+0000","last_fullsized":"2024-04-24T23:39:22.947098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:01.031822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.828856+0000","last_change":"2024-04-24T23:38:34.194305+0000","last_active":"2024-04-24T23:39:22.828856+0000","last_peered":"2024-04-24T23:39:22.828856+0000","last_clean":"2024-04-24T23:39:22.828856+0000","last_became_active":"2024-04-24T23:38:34.188815+0000","last_became_peered":"2024-04-24T23:38:34.188815+0000","last_unstale":"2024-04-24T23:39:22.828856+0000","last_undegraded":"2024-04-24T23:39:22.828856+0000","last_fullsized":"2024-04-24T23:39:22.828856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:25.599734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821376+0000","last_change":"2024-04-24T23:38:33.125221+0000","last_active":"2024-04-24T23:39:22.821376+0000","last_peered":"2024-04-24T23:39:22.821376+0000","last_clean":"2024-04-24T23:39:22.821376+0000","last_became_active":"2024-04-24T23:38:33.124849+0000","last_became_peered":"2024-04-24T23:38:33.124849+0000","last_unstale":"2024-04-24T23:39:22.821376+0000","last_undegraded":"2024-04-24T23:39:22.821376+0000","last_fullsized":"2024-04-24T23:39:22.821376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:42.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814131+0000","last_change":"2024-04-24T23:38:38.250618+0000","last_active":"2024-04-24T23:39:22.814131+0000","last_peered":"2024-04-24T23:39:22.814131+0000","last_clean":"2024-04-24T23:39:22.814131+0000","last_became_active":"2024-04-24T23:38:38.249521+0000","last_became_peered":"2024-04-24T23:38:38.249521+0000","last_unstale":"2024-04-24T23:39:22.814131+0000","last_undegraded":"2024-04-24T23:39:22.814131+0000","last_fullsized":"2024-04-24T23:39:22.814131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:57.651551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.828052+0000","last_change":"2024-04-24T23:38:34.166018+0000","last_active":"2024-04-24T23:39:22.828052+0000","last_peered":"2024-04-24T23:39:22.828052+0000","last_clean":"2024-04-24T23:39:22.828052+0000","last_became_active":"2024-04-24T23:38:34.165229+0000","last_became_peered":"2024-04-24T23:38:34.165229+0000","last_unstale":"2024-04-24T23:39:22.828052+0000","last_undegraded":"2024-04-24T23:39:22.828052+0000","last_fullsized":"2024-04-24T23:39:22.828052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:56.947423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.823071+0000","last_change":"2024-04-24T23:38:33.109771+0000","last_active":"2024-04-24T23:39:22.823071+0000","last_peered":"2024-04-24T23:39:22.823071+0000","last_clean":"2024-04-24T23:39:22.823071+0000","last_became_active":"2024-04-24T23:38:33.108928+0000","last_became_peered":"2024-04-24T23:38:33.108928+0000","last_unstale":"2024-04-24T23:39:22.823071+0000","last_undegraded":"2024-04-24T23:39:22.823071+0000","last_fullsized":"2024-04-24T23:39:22.823071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:44.838533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.833400+0000","last_change":"2024-04-24T23:39:22.833400+0000","last_active":"2024-04-24T23:39:22.833400+0000","last_peered":"2024-04-24T23:39:22.833400+0000","last_clean":"2024-04-24T23:39:22.833400+0000","last_became_active":"2024-04-24T23:39:22.831340+0000","last_became_peered":"2024-04-24T23:39:22.831340+0000","last_unstale":"2024-04-24T23:39:22.833400+0000","last_undegraded":"2024-04-24T23:39:22.833400+0000","last_fullsized":"2024-04-24T23:39:22.833400+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:05:14.068761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3,6],"acting":[4,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.824993+0000","last_change":"2024-04-24T23:38:34.188981+0000","last_active":"2024-04-24T23:39:22.824993+0000","last_peered":"2024-04-24T23:39:22.824993+0000","last_clean":"2024-04-24T23:39:22.824993+0000","last_became_active":"2024-04-24T23:38:34.188416+0000","last_became_peered":"2024-04-24T23:38:34.188416+0000","last_unstale":"2024-04-24T23:39:22.824993+0000","last_undegraded":"2024-04-24T23:39:22.824993+0000","last_fullsized":"2024-04-24T23:39:22.824993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:17:07.009163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.820272+0000","last_change":"2024-04-24T23:38:33.100912+0000","last_active":"2024-04-24T23:39:22.820272+0000","last_peered":"2024-04-24T23:39:22.820272+0000","last_clean":"2024-04-24T23:39:22.820272+0000","last_became_active":"2024-04-24T23:38:33.100464+0000","last_became_peered":"2024-04-24T23:38:33.100464+0000","last_unstale":"2024-04-24T23:39:22.820272+0000","last_undegraded":"2024-04-24T23:39:22.820272+0000","last_fullsized":"2024-04-24T23:39:22.820272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:47:27.107958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947184+0000","last_change":"2024-04-24T23:38:38.207627+0000","last_active":"2024-04-24T23:39:22.947184+0000","last_peered":"2024-04-24T23:39:22.947184+0000","last_clean":"2024-04-24T23:39:22.947184+0000","last_became_active":"2024-04-24T23:38:38.207049+0000","last_became_peered":"2024-04-24T23:38:38.207049+0000","last_unstale":"2024-04-24T23:39:22.947184+0000","last_undegraded":"2024-04-24T23:39:22.947184+0000","last_fullsized":"2024-04-24T23:39:22.947184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:29:56.066046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814063+0000","last_change":"2024-04-24T23:38:34.161654+0000","last_active":"2024-04-24T23:39:22.814063+0000","last_peered":"2024-04-24T23:39:22.814063+0000","last_clean":"2024-04-24T23:39:22.814063+0000","last_became_active":"2024-04-24T23:38:34.158756+0000","last_became_peered":"2024-04-24T23:38:34.158756+0000","last_unstale":"2024-04-24T23:39:22.814063+0000","last_undegraded":"2024-04-24T23:39:22.814063+0000","last_fullsized":"2024-04-24T23:39:22.814063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:29.660159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.813988+0000","last_change":"2024-04-24T23:38:33.116071+0000","last_active":"2024-04-24T23:39:22.813988+0000","last_peered":"2024-04-24T23:39:22.813988+0000","last_clean":"2024-04-24T23:39:22.813988+0000","last_became_active":"2024-04-24T23:38:33.115472+0000","last_became_peered":"2024-04-24T23:38:33.115472+0000","last_unstale":"2024-04-24T23:39:22.813988+0000","last_undegraded":"2024-04-24T23:39:22.813988+0000","last_fullsized":"2024-04-24T23:39:22.813988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:47.686974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815773+0000","last_change":"2024-04-24T23:38:38.248841+0000","last_active":"2024-04-24T23:39:22.815773+0000","last_peered":"2024-04-24T23:39:22.815773+0000","last_clean":"2024-04-24T23:39:22.815773+0000","last_became_active":"2024-04-24T23:38:38.248311+0000","last_became_peered":"2024-04-24T23:38:38.248311+0000","last_unstale":"2024-04-24T23:39:22.815773+0000","last_undegraded":"2024-04-24T23:39:22.815773+0000","last_fullsized":"2024-04-24T23:39:22.815773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:22.798878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.826809+0000","last_change":"2024-04-24T23:38:34.189772+0000","last_active":"2024-04-24T23:39:22.826809+0000","last_peered":"2024-04-24T23:39:22.826809+0000","last_clean":"2024-04-24T23:39:22.826809+0000","last_became_active":"2024-04-24T23:38:34.179801+0000","last_became_peered":"2024-04-24T23:38:34.179801+0000","last_unstale":"2024-04-24T23:39:22.826809+0000","last_undegraded":"2024-04-24T23:39:22.826809+0000","last_fullsized":"2024-04-24T23:39:22.826809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:54.469544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815922+0000","last_change":"2024-04-24T23:38:33.146611+0000","last_active":"2024-04-24T23:39:22.815922+0000","last_peered":"2024-04-24T23:39:22.815922+0000","last_clean":"2024-04-24T23:39:22.815922+0000","last_became_active":"2024-04-24T23:38:33.145896+0000","last_became_peered":"2024-04-24T23:38:33.145896+0000","last_unstale":"2024-04-24T23:39:22.815922+0000","last_undegraded":"2024-04-24T23:39:22.815922+0000","last_fullsized":"2024-04-24T23:39:22.815922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:47.686974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814661+0000","last_change":"2024-04-24T23:38:38.252023+0000","last_active":"2024-04-24T23:39:22.814661+0000","last_peered":"2024-04-24T23:39:22.814661+0000","last_clean":"2024-04-24T23:39:22.814661+0000","last_became_active":"2024-04-24T23:38:38.251541+0000","last_became_peered":"2024-04-24T23:38:38.251541+0000","last_unstale":"2024-04-24T23:39:22.814661+0000","last_undegraded":"2024-04-24T23:39:22.814661+0000","last_fullsized":"2024-04-24T23:39:22.814661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:25:30.720742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.946803+0000","last_change":"2024-04-24T23:38:34.164658+0000","last_active":"2024-04-24T23:39:22.946803+0000","last_peered":"2024-04-24T23:39:22.946803+0000","last_clean":"2024-04-24T23:39:22.946803+0000","last_became_active":"2024-04-24T23:38:34.164024+0000","last_became_peered":"2024-04-24T23:38:34.164024+0000","last_unstale":"2024-04-24T23:39:22.946803+0000","last_undegraded":"2024-04-24T23:39:22.946803+0000","last_fullsized":"2024-04-24T23:39:22.946803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:47.516208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947439+0000","last_change":"2024-04-24T23:38:33.111314+0000","last_active":"2024-04-24T23:39:22.947439+0000","last_peered":"2024-04-24T23:39:22.947439+0000","last_clean":"2024-04-24T23:39:22.947439+0000","last_became_active":"2024-04-24T23:38:33.109819+0000","last_became_peered":"2024-04-24T23:38:33.109819+0000","last_unstale":"2024-04-24T23:39:22.947439+0000","last_undegraded":"2024-04-24T23:39:22.947439+0000","last_fullsized":"2024-04-24T23:39:22.947439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:21:39.944505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816959+0000","last_change":"2024-04-24T23:38:38.247323+0000","last_active":"2024-04-24T23:39:22.816959+0000","last_peered":"2024-04-24T23:39:22.816959+0000","last_clean":"2024-04-24T23:39:22.816959+0000","last_became_active":"2024-04-24T23:38:38.246172+0000","last_became_peered":"2024-04-24T23:38:38.246172+0000","last_unstale":"2024-04-24T23:39:22.816959+0000","last_undegraded":"2024-04-24T23:39:22.816959+0000","last_fullsized":"2024-04-24T23:39:22.816959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:32.771055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.827448+0000","last_change":"2024-04-24T23:38:34.189746+0000","last_active":"2024-04-24T23:39:22.827448+0000","last_peered":"2024-04-24T23:39:22.827448+0000","last_clean":"2024-04-24T23:39:22.827448+0000","last_became_active":"2024-04-24T23:38:34.179433+0000","last_became_peered":"2024-04-24T23:38:34.179433+0000","last_unstale":"2024-04-24T23:39:22.827448+0000","last_undegraded":"2024-04-24T23:39:22.827448+0000","last_fullsized":"2024-04-24T23:39:22.827448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:56.049789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'35","reported_seq":61,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:57.551905+0000","last_change":"2024-04-24T23:38:33.127637+0000","last_active":"2024-04-24T23:39:57.551905+0000","last_peered":"2024-04-24T23:39:57.551905+0000","last_clean":"2024-04-24T23:39:57.551905+0000","last_became_active":"2024-04-24T23:38:33.127122+0000","last_became_peered":"2024-04-24T23:38:33.127122+0000","last_unstale":"2024-04-24T23:39:57.551905+0000","last_undegraded":"2024-04-24T23:39:57.551905+0000","last_fullsized":"2024-04-24T23:39:57.551905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39309,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821945+0000","last_change":"2024-04-24T23:38:38.216781+0000","last_active":"2024-04-24T23:39:22.821945+0000","last_peered":"2024-04-24T23:39:22.821945+0000","last_clean":"2024-04-24T23:39:22.821945+0000","last_became_active":"2024-04-24T23:38:38.215741+0000","last_became_peered":"2024-04-24T23:38:38.215741+0000","last_unstale":"2024-04-24T23:39:22.821945+0000","last_undegraded":"2024-04-24T23:39:22.821945+0000","last_fullsized":"2024-04-24T23:39:22.821945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:47.898644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822840+0000","last_change":"2024-04-24T23:38:34.167424+0000","last_active":"2024-04-24T23:39:22.822840+0000","last_peered":"2024-04-24T23:39:22.822840+0000","last_clean":"2024-04-24T23:39:22.822840+0000","last_became_active":"2024-04-24T23:38:34.166602+0000","last_became_peered":"2024-04-24T23:38:34.166602+0000","last_unstale":"2024-04-24T23:39:22.822840+0000","last_undegraded":"2024-04-24T23:39:22.822840+0000","last_fullsized":"2024-04-24T23:39:22.822840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:31.033906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:44.220165+0000","last_change":"2024-04-24T23:38:33.146758+0000","last_active":"2024-04-24T23:39:44.220165+0000","last_peered":"2024-04-24T23:39:44.220165+0000","last_clean":"2024-04-24T23:39:44.220165+0000","last_became_active":"2024-04-24T23:38:33.146311+0000","last_became_peered":"2024-04-24T23:38:33.146311+0000","last_unstale":"2024-04-24T23:39:44.220165+0000","last_undegraded":"2024-04-24T23:39:44.220165+0000","last_fullsized":"2024-04-24T23:39:44.220165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:09.575181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822020+0000","last_change":"2024-04-24T23:38:38.221177+0000","last_active":"2024-04-24T23:39:22.822020+0000","last_peered":"2024-04-24T23:39:22.822020+0000","last_clean":"2024-04-24T23:39:22.822020+0000","last_became_active":"2024-04-24T23:38:38.219482+0000","last_became_peered":"2024-04-24T23:38:38.219482+0000","last_unstale":"2024-04-24T23:39:22.822020+0000","last_undegraded":"2024-04-24T23:39:22.822020+0000","last_fullsized":"2024-04-24T23:39:22.822020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:00.134189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947929+0000","last_change":"2024-04-24T23:38:34.170044+0000","last_active":"2024-04-24T23:39:22.947929+0000","last_peered":"2024-04-24T23:39:22.947929+0000","last_clean":"2024-04-24T23:39:22.947929+0000","last_became_active":"2024-04-24T23:38:34.169512+0000","last_became_peered":"2024-04-24T23:38:34.169512+0000","last_unstale":"2024-04-24T23:39:22.947929+0000","last_undegraded":"2024-04-24T23:39:22.947929+0000","last_fullsized":"2024-04-24T23:39:22.947929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817797+0000","last_change":"2024-04-24T23:38:33.131079+0000","last_active":"2024-04-24T23:39:22.817797+0000","last_peered":"2024-04-24T23:39:22.817797+0000","last_clean":"2024-04-24T23:39:22.817797+0000","last_became_active":"2024-04-24T23:38:33.130150+0000","last_became_peered":"2024-04-24T23:38:33.130150+0000","last_unstale":"2024-04-24T23:39:22.817797+0000","last_undegraded":"2024-04-24T23:39:22.817797+0000","last_fullsized":"2024-04-24T23:39:22.817797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:07.598128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'35","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:42.446330+0000","last_change":"2024-04-24T23:38:38.212241+0000","last_active":"2024-04-24T23:39:42.446330+0000","last_peered":"2024-04-24T23:39:42.446330+0000","last_clean":"2024-04-24T23:39:42.446330+0000","last_became_active":"2024-04-24T23:38:38.208130+0000","last_became_peered":"2024-04-24T23:38:38.208130+0000","last_unstale":"2024-04-24T23:39:42.446330+0000","last_undegraded":"2024-04-24T23:39:42.446330+0000","last_fullsized":"2024-04-24T23:39:42.446330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:32.771055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":4096,"num_write":33,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817836+0000","last_change":"2024-04-24T23:38:34.199814+0000","last_active":"2024-04-24T23:39:22.817836+0000","last_peered":"2024-04-24T23:39:22.817836+0000","last_clean":"2024-04-24T23:39:22.817836+0000","last_became_active":"2024-04-24T23:38:34.199311+0000","last_became_peered":"2024-04-24T23:38:34.199311+0000","last_unstale":"2024-04-24T23:39:22.817836+0000","last_undegraded":"2024-04-24T23:39:22.817836+0000","last_fullsized":"2024-04-24T23:39:22.817836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:09:44.182605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.818287+0000","last_change":"2024-04-24T23:38:33.140029+0000","last_active":"2024-04-24T23:39:22.818287+0000","last_peered":"2024-04-24T23:39:22.818287+0000","last_clean":"2024-04-24T23:39:22.818287+0000","last_became_active":"2024-04-24T23:38:33.139325+0000","last_became_peered":"2024-04-24T23:38:33.139325+0000","last_unstale":"2024-04-24T23:39:22.818287+0000","last_undegraded":"2024-04-24T23:39:22.818287+0000","last_fullsized":"2024-04-24T23:39:22.818287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:07.598128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815762+0000","last_change":"2024-04-24T23:38:38.246245+0000","last_active":"2024-04-24T23:39:22.815762+0000","last_peered":"2024-04-24T23:39:22.815762+0000","last_clean":"2024-04-24T23:39:22.815762+0000","last_became_active":"2024-04-24T23:38:38.245657+0000","last_became_peered":"2024-04-24T23:38:38.245657+0000","last_unstale":"2024-04-24T23:39:22.815762+0000","last_undegraded":"2024-04-24T23:39:22.815762+0000","last_fullsized":"2024-04-24T23:39:22.815762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:45.297412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947170+0000","last_change":"2024-04-24T23:38:38.251308+0000","last_active":"2024-04-24T23:39:22.947170+0000","last_peered":"2024-04-24T23:39:22.947170+0000","last_clean":"2024-04-24T23:39:22.947170+0000","last_became_active":"2024-04-24T23:38:38.250718+0000","last_became_peered":"2024-04-24T23:38:38.250718+0000","last_unstale":"2024-04-24T23:39:22.947170+0000","last_undegraded":"2024-04-24T23:39:22.947170+0000","last_fullsized":"2024-04-24T23:39:22.947170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:18.964372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821087+0000","last_change":"2024-04-24T23:38:34.174658+0000","last_active":"2024-04-24T23:39:22.821087+0000","last_peered":"2024-04-24T23:39:22.821087+0000","last_clean":"2024-04-24T23:39:22.821087+0000","last_became_active":"2024-04-24T23:38:34.174289+0000","last_became_peered":"2024-04-24T23:38:34.174289+0000","last_unstale":"2024-04-24T23:39:22.821087+0000","last_undegraded":"2024-04-24T23:39:22.821087+0000","last_fullsized":"2024-04-24T23:39:22.821087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:29.660159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814626+0000","last_change":"2024-04-24T23:38:33.131171+0000","last_active":"2024-04-24T23:39:22.814626+0000","last_peered":"2024-04-24T23:39:22.814626+0000","last_clean":"2024-04-24T23:39:22.814626+0000","last_became_active":"2024-04-24T23:38:33.130621+0000","last_became_peered":"2024-04-24T23:38:33.130621+0000","last_unstale":"2024-04-24T23:39:22.814626+0000","last_undegraded":"2024-04-24T23:39:22.814626+0000","last_fullsized":"2024-04-24T23:39:22.814626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817794+0000","last_change":"2024-04-24T23:38:38.214392+0000","last_active":"2024-04-24T23:39:22.817794+0000","last_peered":"2024-04-24T23:39:22.817794+0000","last_clean":"2024-04-24T23:39:22.817794+0000","last_became_active":"2024-04-24T23:38:38.213249+0000","last_became_peered":"2024-04-24T23:38:38.213249+0000","last_unstale":"2024-04-24T23:39:22.817794+0000","last_undegraded":"2024-04-24T23:39:22.817794+0000","last_fullsized":"2024-04-24T23:39:22.817794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:01.031822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815731+0000","last_change":"2024-04-24T23:38:34.164231+0000","last_active":"2024-04-24T23:39:22.815731+0000","last_peered":"2024-04-24T23:39:22.815731+0000","last_clean":"2024-04-24T23:39:22.815731+0000","last_became_active":"2024-04-24T23:38:34.163685+0000","last_became_peered":"2024-04-24T23:38:34.163685+0000","last_unstale":"2024-04-24T23:39:22.815731+0000","last_undegraded":"2024-04-24T23:39:22.815731+0000","last_fullsized":"2024-04-24T23:39:22.815731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:29.660159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814851+0000","last_change":"2024-04-24T23:38:33.116249+0000","last_active":"2024-04-24T23:39:22.814851+0000","last_peered":"2024-04-24T23:39:22.814851+0000","last_clean":"2024-04-24T23:39:22.814851+0000","last_became_active":"2024-04-24T23:38:33.113333+0000","last_became_peered":"2024-04-24T23:38:33.113333+0000","last_unstale":"2024-04-24T23:39:22.814851+0000","last_undegraded":"2024-04-24T23:39:22.814851+0000","last_fullsized":"2024-04-24T23:39:22.814851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:47:27.107958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814770+0000","last_change":"2024-04-24T23:38:33.111080+0000","last_active":"2024-04-24T23:39:22.814770+0000","last_peered":"2024-04-24T23:39:22.814770+0000","last_clean":"2024-04-24T23:39:22.814770+0000","last_became_active":"2024-04-24T23:38:33.110315+0000","last_became_peered":"2024-04-24T23:38:33.110315+0000","last_unstale":"2024-04-24T23:39:22.814770+0000","last_undegraded":"2024-04-24T23:39:22.814770+0000","last_fullsized":"2024-04-24T23:39:22.814770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947422+0000","last_change":"2024-04-24T23:38:34.148734+0000","last_active":"2024-04-24T23:39:22.947422+0000","last_peered":"2024-04-24T23:39:22.947422+0000","last_clean":"2024-04-24T23:39:22.947422+0000","last_became_active":"2024-04-24T23:38:34.146909+0000","last_became_peered":"2024-04-24T23:38:34.146909+0000","last_unstale":"2024-04-24T23:39:22.947422+0000","last_undegraded":"2024-04-24T23:39:22.947422+0000","last_fullsized":"2024-04-24T23:39:22.947422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:57:25.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.820296+0000","last_change":"2024-04-24T23:38:38.215787+0000","last_active":"2024-04-24T23:39:22.820296+0000","last_peered":"2024-04-24T23:39:22.820296+0000","last_clean":"2024-04-24T23:39:22.820296+0000","last_became_active":"2024-04-24T23:38:38.215395+0000","last_became_peered":"2024-04-24T23:38:38.215395+0000","last_unstale":"2024-04-24T23:39:22.820296+0000","last_undegraded":"2024-04-24T23:39:22.820296+0000","last_fullsized":"2024-04-24T23:39:22.820296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:51.641050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815067+0000","last_change":"2024-04-24T23:38:33.131735+0000","last_active":"2024-04-24T23:39:22.815067+0000","last_peered":"2024-04-24T23:39:22.815067+0000","last_clean":"2024-04-24T23:39:22.815067+0000","last_became_active":"2024-04-24T23:38:33.131314+0000","last_became_peered":"2024-04-24T23:38:33.131314+0000","last_unstale":"2024-04-24T23:39:22.815067+0000","last_undegraded":"2024-04-24T23:39:22.815067+0000","last_fullsized":"2024-04-24T23:39:22.815067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:42.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822079+0000","last_change":"2024-04-24T23:38:34.150894+0000","last_active":"2024-04-24T23:39:22.822079+0000","last_peered":"2024-04-24T23:39:22.822079+0000","last_clean":"2024-04-24T23:39:22.822079+0000","last_became_active":"2024-04-24T23:38:34.149910+0000","last_became_peered":"2024-04-24T23:38:34.149910+0000","last_unstale":"2024-04-24T23:39:22.822079+0000","last_undegraded":"2024-04-24T23:39:22.822079+0000","last_fullsized":"2024-04-24T23:39:22.822079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:08.608611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814775+0000","last_change":"2024-04-24T23:38:38.219498+0000","last_active":"2024-04-24T23:39:22.814775+0000","last_peered":"2024-04-24T23:39:22.814775+0000","last_clean":"2024-04-24T23:39:22.814775+0000","last_became_active":"2024-04-24T23:38:38.219100+0000","last_became_peered":"2024-04-24T23:38:38.219100+0000","last_unstale":"2024-04-24T23:39:22.814775+0000","last_undegraded":"2024-04-24T23:39:22.814775+0000","last_fullsized":"2024-04-24T23:39:22.814775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:17.585261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.813672+0000","last_change":"2024-04-24T23:38:34.162139+0000","last_active":"2024-04-24T23:39:22.813672+0000","last_peered":"2024-04-24T23:39:22.813672+0000","last_clean":"2024-04-24T23:39:22.813672+0000","last_became_active":"2024-04-24T23:38:34.159701+0000","last_became_peered":"2024-04-24T23:38:34.159701+0000","last_unstale":"2024-04-24T23:39:22.813672+0000","last_undegraded":"2024-04-24T23:39:22.813672+0000","last_fullsized":"2024-04-24T23:39:22.813672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:34.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.819582+0000","last_change":"2024-04-24T23:38:34.156925+0000","last_active":"2024-04-24T23:39:22.819582+0000","last_peered":"2024-04-24T23:39:22.819582+0000","last_clean":"2024-04-24T23:39:22.819582+0000","last_became_active":"2024-04-24T23:38:34.155969+0000","last_became_peered":"2024-04-24T23:38:34.155969+0000","last_unstale":"2024-04-24T23:39:22.819582+0000","last_undegraded":"2024-04-24T23:39:22.819582+0000","last_fullsized":"2024-04-24T23:39:22.819582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:31.033906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815530+0000","last_change":"2024-04-24T23:38:34.188234+0000","last_active":"2024-04-24T23:39:22.815530+0000","last_peered":"2024-04-24T23:39:22.815530+0000","last_clean":"2024-04-24T23:39:22.815530+0000","last_became_active":"2024-04-24T23:38:34.186332+0000","last_became_peered":"2024-04-24T23:38:34.186332+0000","last_unstale":"2024-04-24T23:39:22.815530+0000","last_undegraded":"2024-04-24T23:39:22.815530+0000","last_fullsized":"2024-04-24T23:39:22.815530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:56.049789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947106+0000","last_change":"2024-04-24T23:38:34.154728+0000","last_active":"2024-04-24T23:39:22.947106+0000","last_peered":"2024-04-24T23:39:22.947106+0000","last_clean":"2024-04-24T23:39:22.947106+0000","last_became_active":"2024-04-24T23:38:34.147038+0000","last_became_peered":"2024-04-24T23:38:34.147038+0000","last_unstale":"2024-04-24T23:39:22.947106+0000","last_undegraded":"2024-04-24T23:39:22.947106+0000","last_fullsized":"2024-04-24T23:39:22.947106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:34.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816375+0000","last_change":"2024-04-24T23:38:34.164080+0000","last_active":"2024-04-24T23:39:22.816375+0000","last_peered":"2024-04-24T23:39:22.816375+0000","last_clean":"2024-04-24T23:39:22.816375+0000","last_became_active":"2024-04-24T23:38:34.163761+0000","last_became_peered":"2024-04-24T23:38:34.163761+0000","last_unstale":"2024-04-24T23:39:22.816375+0000","last_undegraded":"2024-04-24T23:39:22.816375+0000","last_fullsized":"2024-04-24T23:39:22.816375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:00.007223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.829099+0000","last_change":"2024-04-24T23:39:22.829099+0000","last_active":"2024-04-24T23:39:22.829099+0000","last_peered":"2024-04-24T23:39:22.829099+0000","last_clean":"2024-04-24T23:39:22.829099+0000","last_became_active":"2024-04-24T23:39:22.828227+0000","last_became_peered":"2024-04-24T23:39:22.828227+0000","last_unstale":"2024-04-24T23:39:22.829099+0000","last_undegraded":"2024-04-24T23:39:22.829099+0000","last_fullsized":"2024-04-24T23:39:22.829099+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:38.663063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817535+0000","last_change":"2024-04-24T23:38:34.179301+0000","last_active":"2024-04-24T23:39:22.817535+0000","last_peered":"2024-04-24T23:39:22.817535+0000","last_clean":"2024-04-24T23:39:22.817535+0000","last_became_active":"2024-04-24T23:38:34.178651+0000","last_became_peered":"2024-04-24T23:38:34.178651+0000","last_unstale":"2024-04-24T23:39:22.817535+0000","last_undegraded":"2024-04-24T23:39:22.817535+0000","last_fullsized":"2024-04-24T23:39:22.817535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:57.767771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816067+0000","last_change":"2024-04-24T23:38:34.162572+0000","last_active":"2024-04-24T23:39:22.816067+0000","last_peered":"2024-04-24T23:39:22.816067+0000","last_clean":"2024-04-24T23:39:22.816067+0000","last_became_active":"2024-04-24T23:38:34.162156+0000","last_became_peered":"2024-04-24T23:38:34.162156+0000","last_unstale":"2024-04-24T23:39:22.816067+0000","last_undegraded":"2024-04-24T23:39:22.816067+0000","last_fullsized":"2024-04-24T23:39:22.816067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:57.767771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814482+0000","last_change":"2024-04-24T23:38:34.187429+0000","last_active":"2024-04-24T23:39:22.814482+0000","last_peered":"2024-04-24T23:39:22.814482+0000","last_clean":"2024-04-24T23:39:22.814482+0000","last_became_active":"2024-04-24T23:38:34.184827+0000","last_became_peered":"2024-04-24T23:38:34.184827+0000","last_unstale":"2024-04-24T23:39:22.814482+0000","last_undegraded":"2024-04-24T23:39:22.814482+0000","last_fullsized":"2024-04-24T23:39:22.814482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814372+0000","last_change":"2024-04-24T23:38:34.165830+0000","last_active":"2024-04-24T23:39:22.814372+0000","last_peered":"2024-04-24T23:39:22.814372+0000","last_clean":"2024-04-24T23:39:22.814372+0000","last_became_active":"2024-04-24T23:38:34.165531+0000","last_became_peered":"2024-04-24T23:38:34.165531+0000","last_unstale":"2024-04-24T23:39:22.814372+0000","last_undegraded":"2024-04-24T23:39:22.814372+0000","last_fullsized":"2024-04-24T23:39:22.814372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:57:25.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815294+0000","last_change":"2024-04-24T23:38:34.199810+0000","last_active":"2024-04-24T23:39:22.815294+0000","last_peered":"2024-04-24T23:39:22.815294+0000","last_clean":"2024-04-24T23:39:22.815294+0000","last_became_active":"2024-04-24T23:38:34.199173+0000","last_became_peered":"2024-04-24T23:38:34.199173+0000","last_unstale":"2024-04-24T23:39:22.815294+0000","last_undegraded":"2024-04-24T23:39:22.815294+0000","last_fullsized":"2024-04-24T23:39:22.815294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:27.147380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.946789+0000","last_change":"2024-04-24T23:38:34.165276+0000","last_active":"2024-04-24T23:39:22.946789+0000","last_peered":"2024-04-24T23:39:22.946789+0000","last_clean":"2024-04-24T23:39:22.946789+0000","last_became_active":"2024-04-24T23:38:34.165000+0000","last_became_peered":"2024-04-24T23:38:34.165000+0000","last_unstale":"2024-04-24T23:39:22.946789+0000","last_undegraded":"2024-04-24T23:39:22.946789+0000","last_fullsized":"2024-04-24T23:39:22.946789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:30:58.955608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816108+0000","last_change":"2024-04-24T23:38:34.146904+0000","last_active":"2024-04-24T23:39:22.816108+0000","last_peered":"2024-04-24T23:39:22.816108+0000","last_clean":"2024-04-24T23:39:22.816108+0000","last_became_active":"2024-04-24T23:38:34.146096+0000","last_became_peered":"2024-04-24T23:38:34.146096+0000","last_unstale":"2024-04-24T23:39:22.816108+0000","last_undegraded":"2024-04-24T23:39:22.816108+0000","last_fullsized":"2024-04-24T23:39:22.816108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:39.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.828011+0000","last_change":"2024-04-24T23:38:34.178750+0000","last_active":"2024-04-24T23:39:22.828011+0000","last_peered":"2024-04-24T23:39:22.828011+0000","last_clean":"2024-04-24T23:39:22.828011+0000","last_became_active":"2024-04-24T23:38:34.177451+0000","last_became_peered":"2024-04-24T23:38:34.177451+0000","last_unstale":"2024-04-24T23:39:22.828011+0000","last_undegraded":"2024-04-24T23:39:22.828011+0000","last_fullsized":"2024-04-24T23:39:22.828011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:43.814245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821128+0000","last_change":"2024-04-24T23:38:34.160937+0000","last_active":"2024-04-24T23:39:22.821128+0000","last_peered":"2024-04-24T23:39:22.821128+0000","last_clean":"2024-04-24T23:39:22.821128+0000","last_became_active":"2024-04-24T23:38:34.159252+0000","last_became_peered":"2024-04-24T23:38:34.159252+0000","last_unstale":"2024-04-24T23:39:22.821128+0000","last_undegraded":"2024-04-24T23:39:22.821128+0000","last_fullsized":"2024-04-24T23:39:22.821128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:10.585665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817749+0000","last_change":"2024-04-24T23:38:34.199973+0000","last_active":"2024-04-24T23:39:22.817749+0000","last_peered":"2024-04-24T23:39:22.817749+0000","last_clean":"2024-04-24T23:39:22.817749+0000","last_became_active":"2024-04-24T23:38:34.199464+0000","last_became_peered":"2024-04-24T23:38:34.199464+0000","last_unstale":"2024-04-24T23:39:22.817749+0000","last_undegraded":"2024-04-24T23:39:22.817749+0000","last_fullsized":"2024-04-24T23:39:22.817749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:14.879972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814510+0000","last_change":"2024-04-24T23:38:34.182144+0000","last_active":"2024-04-24T23:39:22.814510+0000","last_peered":"2024-04-24T23:39:22.814510+0000","last_clean":"2024-04-24T23:39:22.814510+0000","last_became_active":"2024-04-24T23:38:34.181459+0000","last_became_peered":"2024-04-24T23:38:34.181459+0000","last_unstale":"2024-04-24T23:39:22.814510+0000","last_undegraded":"2024-04-24T23:39:22.814510+0000","last_fullsized":"2024-04-24T23:39:22.814510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822224+0000","last_change":"2024-04-24T23:38:34.150090+0000","last_active":"2024-04-24T23:39:22.822224+0000","last_peered":"2024-04-24T23:39:22.822224+0000","last_clean":"2024-04-24T23:39:22.822224+0000","last_became_active":"2024-04-24T23:38:34.149272+0000","last_became_peered":"2024-04-24T23:38:34.149272+0000","last_unstale":"2024-04-24T23:39:22.822224+0000","last_undegraded":"2024-04-24T23:39:22.822224+0000","last_fullsized":"2024-04-24T23:39:22.822224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:57:25.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.946633+0000","last_change":"2024-04-24T23:38:34.155641+0000","last_active":"2024-04-24T23:39:22.946633+0000","last_peered":"2024-04-24T23:39:22.946633+0000","last_clean":"2024-04-24T23:39:22.946633+0000","last_became_active":"2024-04-24T23:38:34.153683+0000","last_became_peered":"2024-04-24T23:38:34.153683+0000","last_unstale":"2024-04-24T23:39:22.946633+0000","last_undegraded":"2024-04-24T23:39:22.946633+0000","last_fullsized":"2024-04-24T23:39:22.946633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:24.354101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814424+0000","last_change":"2024-04-24T23:38:34.173601+0000","last_active":"2024-04-24T23:39:22.814424+0000","last_peered":"2024-04-24T23:39:22.814424+0000","last_clean":"2024-04-24T23:39:22.814424+0000","last_became_active":"2024-04-24T23:38:34.165764+0000","last_became_peered":"2024-04-24T23:38:34.165764+0000","last_unstale":"2024-04-24T23:39:22.814424+0000","last_undegraded":"2024-04-24T23:39:22.814424+0000","last_fullsized":"2024-04-24T23:39:22.814424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822583+0000","last_change":"2024-04-24T23:38:34.142409+0000","last_active":"2024-04-24T23:39:22.822583+0000","last_peered":"2024-04-24T23:39:22.822583+0000","last_clean":"2024-04-24T23:39:22.822583+0000","last_became_active":"2024-04-24T23:38:34.141699+0000","last_became_peered":"2024-04-24T23:38:34.141699+0000","last_unstale":"2024-04-24T23:39:22.822583+0000","last_undegraded":"2024-04-24T23:39:22.822583+0000","last_fullsized":"2024-04-24T23:39:22.822583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:53.017909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817092+0000","last_change":"2024-04-24T23:38:34.155964+0000","last_active":"2024-04-24T23:39:22.817092+0000","last_peered":"2024-04-24T23:39:22.817092+0000","last_clean":"2024-04-24T23:39:22.817092+0000","last_became_active":"2024-04-24T23:38:34.155106+0000","last_became_peered":"2024-04-24T23:38:34.155106+0000","last_unstale":"2024-04-24T23:39:22.817092+0000","last_undegraded":"2024-04-24T23:39:22.817092+0000","last_fullsized":"2024-04-24T23:39:22.817092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817444+0000","last_change":"2024-04-24T23:38:34.157245+0000","last_active":"2024-04-24T23:39:22.817444+0000","last_peered":"2024-04-24T23:39:22.817444+0000","last_clean":"2024-04-24T23:39:22.817444+0000","last_became_active":"2024-04-24T23:38:34.156452+0000","last_became_peered":"2024-04-24T23:38:34.156452+0000","last_unstale":"2024-04-24T23:39:22.817444+0000","last_undegraded":"2024-04-24T23:39:22.817444+0000","last_fullsized":"2024-04-24T23:39:22.817444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.831864+0000","last_change":"2024-04-24T23:39:22.831864+0000","last_active":"2024-04-24T23:39:22.831864+0000","last_peered":"2024-04-24T23:39:22.831864+0000","last_clean":"2024-04-24T23:39:22.831864+0000","last_became_active":"2024-04-24T23:39:22.830955+0000","last_became_peered":"2024-04-24T23:39:22.830955+0000","last_unstale":"2024-04-24T23:39:22.831864+0000","last_undegraded":"2024-04-24T23:39:22.831864+0000","last_fullsized":"2024-04-24T23:39:22.831864+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:14:35.422279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.813772+0000","last_change":"2024-04-24T23:38:34.184693+0000","last_active":"2024-04-24T23:39:22.813772+0000","last_peered":"2024-04-24T23:39:22.813772+0000","last_clean":"2024-04-24T23:39:22.813772+0000","last_became_active":"2024-04-24T23:38:34.184367+0000","last_became_peered":"2024-04-24T23:38:34.184367+0000","last_unstale":"2024-04-24T23:39:22.813772+0000","last_undegraded":"2024-04-24T23:39:22.813772+0000","last_fullsized":"2024-04-24T23:39:22.813772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:30:58.955608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.824737+0000","last_change":"2024-04-24T23:38:34.176406+0000","last_active":"2024-04-24T23:39:22.824737+0000","last_peered":"2024-04-24T23:39:22.824737+0000","last_clean":"2024-04-24T23:39:22.824737+0000","last_became_active":"2024-04-24T23:38:34.165882+0000","last_became_peered":"2024-04-24T23:38:34.165882+0000","last_unstale":"2024-04-24T23:39:22.824737+0000","last_undegraded":"2024-04-24T23:39:22.824737+0000","last_fullsized":"2024-04-24T23:39:22.824737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:09:44.182605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815044+0000","last_change":"2024-04-24T23:38:34.184368+0000","last_active":"2024-04-24T23:39:22.815044+0000","last_peered":"2024-04-24T23:39:22.815044+0000","last_clean":"2024-04-24T23:39:22.815044+0000","last_became_active":"2024-04-24T23:38:34.183652+0000","last_became_peered":"2024-04-24T23:38:34.183652+0000","last_unstale":"2024-04-24T23:39:22.815044+0000","last_undegraded":"2024-04-24T23:39:22.815044+0000","last_fullsized":"2024-04-24T23:39:22.815044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:57.767771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.826002+0000","last_change":"2024-04-24T23:38:34.176656+0000","last_active":"2024-04-24T23:39:22.826002+0000","last_peered":"2024-04-24T23:39:22.826002+0000","last_clean":"2024-04-24T23:39:22.826002+0000","last_became_active":"2024-04-24T23:38:34.165931+0000","last_became_peered":"2024-04-24T23:38:34.165931+0000","last_unstale":"2024-04-24T23:39:22.826002+0000","last_undegraded":"2024-04-24T23:39:22.826002+0000","last_fullsized":"2024-04-24T23:39:22.826002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:14.879972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.829857+0000","last_change":"2024-04-24T23:39:22.826478+0000","last_active":"2024-04-24T23:39:22.829857+0000","last_peered":"2024-04-24T23:39:22.829857+0000","last_clean":"2024-04-24T23:39:22.829857+0000","last_became_active":"2024-04-24T23:39:22.825554+0000","last_became_peered":"2024-04-24T23:39:22.825554+0000","last_unstale":"2024-04-24T23:39:22.829857+0000","last_undegraded":"2024-04-24T23:39:22.829857+0000","last_fullsized":"2024-04-24T23:39:22.829857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:25.599734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947075+0000","last_change":"2024-04-24T23:38:34.150280+0000","last_active":"2024-04-24T23:39:22.947075+0000","last_peered":"2024-04-24T23:39:22.947075+0000","last_clean":"2024-04-24T23:39:22.947075+0000","last_became_active":"2024-04-24T23:38:34.148402+0000","last_became_peered":"2024-04-24T23:38:34.148402+0000","last_unstale":"2024-04-24T23:39:22.947075+0000","last_undegraded":"2024-04-24T23:39:22.947075+0000","last_fullsized":"2024-04-24T23:39:22.947075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:29.660159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.823743+0000","last_change":"2024-04-24T23:38:34.151749+0000","last_active":"2024-04-24T23:39:22.823743+0000","last_peered":"2024-04-24T23:39:22.823743+0000","last_clean":"2024-04-24T23:39:22.823743+0000","last_became_active":"2024-04-24T23:38:34.150987+0000","last_became_peered":"2024-04-24T23:38:34.150987+0000","last_unstale":"2024-04-24T23:39:22.823743+0000","last_undegraded":"2024-04-24T23:39:22.823743+0000","last_fullsized":"2024-04-24T23:39:22.823743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.828358+0000","last_change":"2024-04-24T23:38:34.194857+0000","last_active":"2024-04-24T23:39:22.828358+0000","last_peered":"2024-04-24T23:39:22.828358+0000","last_clean":"2024-04-24T23:39:22.828358+0000","last_became_active":"2024-04-24T23:38:34.194195+0000","last_became_peered":"2024-04-24T23:38:34.194195+0000","last_unstale":"2024-04-24T23:39:22.828358+0000","last_undegraded":"2024-04-24T23:39:22.828358+0000","last_fullsized":"2024-04-24T23:39:22.828358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:29:51.981646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":10368,"num_write":165,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40216,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":83,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":80432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67594,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31516,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":348160,"data_stored":705319,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":327680,"data_stored":153678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":114459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":290816,"data_stored":114495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31500,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340340,"statfs":{"total":96636764160,"available":96604508160,"internally_reserved":0,"allocated":331776,"data_stored":153787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":282624,"data_stored":114478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":114529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":356352,"data_stored":705375,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":39418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":39309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:40:05.003 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-24T23:40:05.004 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:40:05.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.168+0000 7f35f2b57640 1 Processor -- start 2024-04-24T23:40:05.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.168+0000 7f35f2b57640 1 -- start start 2024-04-24T23:40:05.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.168+0000 7f35f2b57640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f35ec14bc60 0x7f35ec06eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:05.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.168+0000 7f35f2b57640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f35ec06f090 0x7f35ec0b6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:05.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.168+0000 7f35f2b57640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35ec14e8e0 con 0x7f35ec0bdbe0 2024-04-24T23:40:05.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.168+0000 7f35f2b57640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f35ec152c20 con 0x7f35ec06f090 2024-04-24T23:40:05.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.168+0000 7f35f2b57640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f35ec14ebc0 con 0x7f35ec14bc60 2024-04-24T23:40:05.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.168+0000 7f35ebfff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f35ec06f090 0x7f35ec0b6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:05.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.168+0000 7f35f10f4640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f35ec0bdbe0 0x7f35ec0bc9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37682/0 (socket says 172.21.15.57:37682) 2024-04-24T23:40:05.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.168+0000 7f35f10f4640 1 -- 172.21.15.57:0/3628157581 learned_addr learned my addr 172.21.15.57:0/3628157581 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:40:05.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.168+0000 7f35f08f3640 1 --2- 172.21.15.57:0/3628157581 >> v2:172.21.15.88:3300/0 conn(0x7f35ec14bc60 0x7f35ec06eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:05.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.168+0000 7f35ebfff640 1 -- 172.21.15.57:0/3628157581 >> v2:172.21.15.88:3300/0 conn(0x7f35ec14bc60 msgr2=0x7f35ec06eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:05.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.168+0000 7f35ebfff640 1 --2- 172.21.15.57:0/3628157581 >> v2:172.21.15.88:3300/0 conn(0x7f35ec14bc60 0x7f35ec06eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:05.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.168+0000 7f35ebfff640 1 -- 172.21.15.57:0/3628157581 >> v1:172.21.15.57:6789/0 conn(0x7f35ec0bdbe0 legacy=0x7f35ec0bc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:05.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.168+0000 7f35ebfff640 1 -- 172.21.15.57:0/3628157581 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35ec14c040 con 0x7f35ec06f090 2024-04-24T23:40:05.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.168+0000 7f35eb7fe640 1 -- 172.21.15.57:0/3628157581 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1093619116 0 0) 0x7f35ec14e8e0 con 0x7f35ec0bdbe0 2024-04-24T23:40:05.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.168+0000 7f35f08f3640 1 --2- 172.21.15.57:0/3628157581 >> v2:172.21.15.88:3300/0 conn(0x7f35ec14bc60 0x7f35ec06eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:40:05.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.168+0000 7f35ebfff640 1 --2- 172.21.15.57:0/3628157581 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35ec06f090 0x7f35ec0b6fd0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f35ec06f6f0 tx=0x7f35e001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e7fef8da8be1a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:05.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35eb7fe640 1 -- 172.21.15.57:0/3628157581 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e00b0070 con 0x7f35ec06f090 2024-04-24T23:40:05.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35eb7fe640 1 -- 172.21.15.57:0/3628157581 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35e00ab600 con 0x7f35ec06f090 2024-04-24T23:40:05.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35eb7fe640 1 -- 172.21.15.57:0/3628157581 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e00ab9d0 con 0x7f35ec06f090 2024-04-24T23:40:05.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35f2b57640 1 -- 172.21.15.57:0/3628157581 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35ec06f090 msgr2=0x7f35ec0b6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:05.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35f2b57640 1 --2- 172.21.15.57:0/3628157581 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35ec06f090 0x7f35ec0b6fd0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f35ec06f6f0 tx=0x7f35e001c480 comp rx=0 tx=0).stop 2024-04-24T23:40:05.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35f2b57640 1 -- 172.21.15.57:0/3628157581 shutdown_connections 2024-04-24T23:40:05.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35f2b57640 1 --2- 172.21.15.57:0/3628157581 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35ec06f090 0x7f35ec0b6fd0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:05.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35f2b57640 1 --2- 172.21.15.57:0/3628157581 >> v2:172.21.15.88:3300/0 conn(0x7f35ec14bc60 0x7f35ec06eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:05.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35f2b57640 1 -- 172.21.15.57:0/3628157581 >> 172.21.15.57:0/3628157581 conn(0x7f35ec0beab0 msgr2=0x7f35ec0beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:05.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35f2b57640 1 -- 172.21.15.57:0/3628157581 shutdown_connections 2024-04-24T23:40:05.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35f2b57640 1 -- 172.21.15.57:0/3628157581 wait complete. 2024-04-24T23:40:05.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35f2b57640 1 Processor -- start 2024-04-24T23:40:05.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35f2b57640 1 -- start start 2024-04-24T23:40:05.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35f2b57640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f35ec06f090 0x7f35ec1531e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:05.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35f2b57640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35ec0bdbe0 0x7f35ec146ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:05.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35f2b57640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35ec14bc60 0x7f35ec0bb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:05.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35f2b57640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec15c400 con 0x7f35ec0bdbe0 2024-04-24T23:40:05.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35f2b57640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec15c280 con 0x7f35ec14bc60 2024-04-24T23:40:05.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35f2b57640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f35ec15c580 con 0x7f35ec06f090 2024-04-24T23:40:05.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35ebfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35ec0bdbe0 0x7f35ec146ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:05.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35ebfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35ec0bdbe0 0x7f35ec146ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39050/0 (socket says 172.21.15.57:39050) 2024-04-24T23:40:05.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35ebfff640 1 -- 172.21.15.57:0/1501179983 learned_addr learned my addr 172.21.15.57:0/1501179983 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:05.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35f10f4640 1 --2- 172.21.15.57:0/1501179983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35ec14bc60 0x7f35ec0bb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:05.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35ebfff640 1 -- 172.21.15.57:0/1501179983 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f35ec06f090 msgr2=0x7f35ec1531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:05.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35ebfff640 1 --2- 172.21.15.57:0/1501179983 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f35ec06f090 0x7f35ec1531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:05.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35ebfff640 1 -- 172.21.15.57:0/1501179983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35ec14bc60 msgr2=0x7f35ec0bb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:05.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35ebfff640 1 --2- 172.21.15.57:0/1501179983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35ec14bc60 0x7f35ec0bb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:05.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35ebfff640 1 -- 172.21.15.57:0/1501179983 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35ec147410 con 0x7f35ec0bdbe0 2024-04-24T23:40:05.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35ebfff640 1 --2- 172.21.15.57:0/1501179983 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35ec0bdbe0 0x7f35ec146ed0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f35e001a0b0 tx=0x7f35e001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:05.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35e97fa640 1 -- 172.21.15.57:0/1501179983 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e00b0050 con 0x7f35ec0bdbe0 2024-04-24T23:40:05.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35e97fa640 1 -- 172.21.15.57:0/1501179983 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35e00b1040 con 0x7f35ec0bdbe0 2024-04-24T23:40:05.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35f2b57640 1 -- 172.21.15.57:0/1501179983 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35ec1e8350 con 0x7f35ec0bdbe0 2024-04-24T23:40:05.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35e97fa640 1 -- 172.21.15.57:0/1501179983 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e0004240 con 0x7f35ec0bdbe0 2024-04-24T23:40:05.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.172+0000 7f35f2b57640 1 -- 172.21.15.57:0/1501179983 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35ec145cd0 con 0x7f35ec0bdbe0 2024-04-24T23:40:05.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.176+0000 7f35f2b57640 1 -- 172.21.15.57:0/1501179983 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35ec068220 con 0x7f35ec0bdbe0 2024-04-24T23:40:05.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.176+0000 7f35e97fa640 1 -- 172.21.15.57:0/1501179983 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f35e00be060 con 0x7f35ec0bdbe0 2024-04-24T23:40:05.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.176+0000 7f35e97fa640 1 --2- 172.21.15.57:0/1501179983 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f35d80678f0 0x7f35d8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:05.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.176+0000 7f35e97fa640 1 -- 172.21.15.57:0/1501179983 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f35e011faf0 con 0x7f35ec0bdbe0 2024-04-24T23:40:05.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.176+0000 7f35f08f3640 1 --2- 172.21.15.57:0/1501179983 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f35d80678f0 0x7f35d8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:05.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.176+0000 7f35f08f3640 1 --2- 172.21.15.57:0/1501179983 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f35d80678f0 0x7f35d8069db0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f35dc006f10 tx=0x7f35dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:05.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.180+0000 7f35e97fa640 1 -- 172.21.15.57:0/1501179983 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f35ec147410 con 0x7f35ec0bdbe0 2024-04-24T23:40:05.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.340+0000 7f35f2b57640 1 -- 172.21.15.57:0/1501179983 --> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f35ec154330 con 0x7f35d80678f0 2024-04-24T23:40:05.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.360+0000 7f35e97fa640 1 -- 172.21.15.57:0/1501179983 <== mgr.4105 v2:172.21.15.88:6832/3931748276 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332695 (secure 0 0 0) 0x7f35ec154330 con 0x7f35d80678f0 2024-04-24T23:40:05.365 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:40:05.369 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-24T23:40:05.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.368+0000 7f35f2b57640 1 -- 172.21.15.57:0/1501179983 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f35d80678f0 msgr2=0x7f35d8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:05.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.368+0000 7f35f2b57640 1 --2- 172.21.15.57:0/1501179983 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f35d80678f0 0x7f35d8069db0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f35dc006f10 tx=0x7f35dc008040 comp rx=0 tx=0).stop 2024-04-24T23:40:05.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.368+0000 7f35f2b57640 1 -- 172.21.15.57:0/1501179983 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35ec0bdbe0 msgr2=0x7f35ec146ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:05.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.368+0000 7f35f2b57640 1 --2- 172.21.15.57:0/1501179983 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35ec0bdbe0 0x7f35ec146ed0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f35e001a0b0 tx=0x7f35e001acc0 comp rx=0 tx=0).stop 2024-04-24T23:40:05.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.368+0000 7f35f2b57640 1 -- 172.21.15.57:0/1501179983 shutdown_connections 2024-04-24T23:40:05.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.368+0000 7f35f2b57640 1 --2- 172.21.15.57:0/1501179983 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f35d80678f0 0x7f35d8069db0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:05.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.368+0000 7f35f2b57640 1 --2- 172.21.15.57:0/1501179983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35ec14bc60 0x7f35ec0bb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:05.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.368+0000 7f35f2b57640 1 --2- 172.21.15.57:0/1501179983 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35ec0bdbe0 0x7f35ec146ed0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:05.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.368+0000 7f35f2b57640 1 --2- 172.21.15.57:0/1501179983 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f35ec06f090 0x7f35ec1531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:05.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.368+0000 7f35f2b57640 1 -- 172.21.15.57:0/1501179983 >> 172.21.15.57:0/1501179983 conn(0x7f35ec0beab0 msgr2=0x7f35ec14ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:05.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.368+0000 7f35f2b57640 1 -- 172.21.15.57:0/1501179983 shutdown_connections 2024-04-24T23:40:05.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.368+0000 7f35f2b57640 1 -- 172.21.15.57:0/1501179983 wait complete. 2024-04-24T23:40:05.388 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-04-24T23:40:03.576259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":630584,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":199,"num_read_kb":10469,"num_write":407,"num_write_kb":22968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":364,"ondisk_log_size":364,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":247696,"kb_used_data":2448,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754727024,"statfs":{"total":773094113280,"available":772840472576,"internally_reserved":0,"allocated":2506752,"data_stored":2176120,"data_compressed":67594,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1792,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004429"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.948180+0000","last_change":"2024-04-24T23:38:33.135015+0000","last_active":"2024-04-24T23:39:22.948180+0000","last_peered":"2024-04-24T23:39:22.948180+0000","last_clean":"2024-04-24T23:39:22.948180+0000","last_became_active":"2024-04-24T23:38:33.134584+0000","last_became_peered":"2024-04-24T23:38:33.134584+0000","last_unstale":"2024-04-24T23:39:22.948180+0000","last_undegraded":"2024-04-24T23:39:22.948180+0000","last_fullsized":"2024-04-24T23:39:22.948180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:21.418436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815632+0000","last_change":"2024-04-24T23:38:34.164655+0000","last_active":"2024-04-24T23:39:22.815632+0000","last_peered":"2024-04-24T23:39:22.815632+0000","last_clean":"2024-04-24T23:39:22.815632+0000","last_became_active":"2024-04-24T23:38:34.162093+0000","last_became_peered":"2024-04-24T23:38:34.162093+0000","last_unstale":"2024-04-24T23:39:22.815632+0000","last_undegraded":"2024-04-24T23:39:22.815632+0000","last_fullsized":"2024-04-24T23:39:22.815632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.813716+0000","last_change":"2024-04-24T23:38:38.252169+0000","last_active":"2024-04-24T23:39:22.813716+0000","last_peered":"2024-04-24T23:39:22.813716+0000","last_clean":"2024-04-24T23:39:22.813716+0000","last_became_active":"2024-04-24T23:38:38.251653+0000","last_became_peered":"2024-04-24T23:38:38.251653+0000","last_unstale":"2024-04-24T23:39:22.813716+0000","last_undegraded":"2024-04-24T23:39:22.813716+0000","last_fullsized":"2024-04-24T23:39:22.813716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:57.651551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816215+0000","last_change":"2024-04-24T23:38:33.124025+0000","last_active":"2024-04-24T23:39:22.816215+0000","last_peered":"2024-04-24T23:39:22.816215+0000","last_clean":"2024-04-24T23:39:22.816215+0000","last_became_active":"2024-04-24T23:38:33.123681+0000","last_became_peered":"2024-04-24T23:38:33.123681+0000","last_unstale":"2024-04-24T23:39:22.816215+0000","last_undegraded":"2024-04-24T23:39:22.816215+0000","last_fullsized":"2024-04-24T23:39:22.816215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:27:41.421732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947507+0000","last_change":"2024-04-24T23:38:34.169793+0000","last_active":"2024-04-24T23:39:22.947507+0000","last_peered":"2024-04-24T23:39:22.947507+0000","last_clean":"2024-04-24T23:39:22.947507+0000","last_became_active":"2024-04-24T23:38:34.169115+0000","last_became_peered":"2024-04-24T23:38:34.169115+0000","last_unstale":"2024-04-24T23:39:22.947507+0000","last_undegraded":"2024-04-24T23:39:22.947507+0000","last_fullsized":"2024-04-24T23:39:22.947507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:39.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821314+0000","last_change":"2024-04-24T23:38:38.221580+0000","last_active":"2024-04-24T23:39:22.821314+0000","last_peered":"2024-04-24T23:39:22.821314+0000","last_clean":"2024-04-24T23:39:22.821314+0000","last_became_active":"2024-04-24T23:38:38.220392+0000","last_became_peered":"2024-04-24T23:38:38.220392+0000","last_unstale":"2024-04-24T23:39:22.821314+0000","last_undegraded":"2024-04-24T23:39:22.821314+0000","last_fullsized":"2024-04-24T23:39:22.821314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:16:01.852170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.828191+0000","last_change":"2024-04-24T23:38:33.144231+0000","last_active":"2024-04-24T23:39:22.828191+0000","last_peered":"2024-04-24T23:39:22.828191+0000","last_clean":"2024-04-24T23:39:22.828191+0000","last_became_active":"2024-04-24T23:38:33.143542+0000","last_became_peered":"2024-04-24T23:38:33.143542+0000","last_unstale":"2024-04-24T23:39:22.828191+0000","last_undegraded":"2024-04-24T23:39:22.828191+0000","last_fullsized":"2024-04-24T23:39:22.828191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:09.575181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816530+0000","last_change":"2024-04-24T23:38:34.170796+0000","last_active":"2024-04-24T23:39:22.816530+0000","last_peered":"2024-04-24T23:39:22.816530+0000","last_clean":"2024-04-24T23:39:22.816530+0000","last_became_active":"2024-04-24T23:38:34.169908+0000","last_became_peered":"2024-04-24T23:38:34.169908+0000","last_unstale":"2024-04-24T23:39:22.816530+0000","last_undegraded":"2024-04-24T23:39:22.816530+0000","last_fullsized":"2024-04-24T23:39:22.816530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:17:07.009163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821677+0000","last_change":"2024-04-24T23:38:38.218416+0000","last_active":"2024-04-24T23:39:22.821677+0000","last_peered":"2024-04-24T23:39:22.821677+0000","last_clean":"2024-04-24T23:39:22.821677+0000","last_became_active":"2024-04-24T23:38:38.217390+0000","last_became_peered":"2024-04-24T23:38:38.217390+0000","last_unstale":"2024-04-24T23:39:22.821677+0000","last_undegraded":"2024-04-24T23:39:22.821677+0000","last_fullsized":"2024-04-24T23:39:22.821677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:31.231780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.826953+0000","last_change":"2024-04-24T23:38:33.149114+0000","last_active":"2024-04-24T23:39:22.826953+0000","last_peered":"2024-04-24T23:39:22.826953+0000","last_clean":"2024-04-24T23:39:22.826953+0000","last_became_active":"2024-04-24T23:38:33.148510+0000","last_became_peered":"2024-04-24T23:38:33.148510+0000","last_unstale":"2024-04-24T23:39:22.826953+0000","last_undegraded":"2024-04-24T23:39:22.826953+0000","last_fullsized":"2024-04-24T23:39:22.826953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:39.396571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817264+0000","last_change":"2024-04-24T23:38:34.153747+0000","last_active":"2024-04-24T23:39:22.817264+0000","last_peered":"2024-04-24T23:39:22.817264+0000","last_clean":"2024-04-24T23:39:22.817264+0000","last_became_active":"2024-04-24T23:38:34.152984+0000","last_became_peered":"2024-04-24T23:38:34.152984+0000","last_unstale":"2024-04-24T23:39:22.817264+0000","last_undegraded":"2024-04-24T23:39:22.817264+0000","last_fullsized":"2024-04-24T23:39:22.817264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:54.469544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821502+0000","last_change":"2024-04-24T23:38:38.222542+0000","last_active":"2024-04-24T23:39:22.821502+0000","last_peered":"2024-04-24T23:39:22.821502+0000","last_clean":"2024-04-24T23:39:22.821502+0000","last_became_active":"2024-04-24T23:38:38.220601+0000","last_became_peered":"2024-04-24T23:38:38.220601+0000","last_unstale":"2024-04-24T23:39:22.821502+0000","last_undegraded":"2024-04-24T23:39:22.821502+0000","last_fullsized":"2024-04-24T23:39:22.821502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:32.372869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814379+0000","last_change":"2024-04-24T23:38:34.142429+0000","last_active":"2024-04-24T23:39:22.814379+0000","last_peered":"2024-04-24T23:39:22.814379+0000","last_clean":"2024-04-24T23:39:22.814379+0000","last_became_active":"2024-04-24T23:38:34.141681+0000","last_became_peered":"2024-04-24T23:38:34.141681+0000","last_unstale":"2024-04-24T23:39:22.814379+0000","last_undegraded":"2024-04-24T23:39:22.814379+0000","last_fullsized":"2024-04-24T23:39:22.814379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:57:25.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.827312+0000","last_change":"2024-04-24T23:38:33.140585+0000","last_active":"2024-04-24T23:39:22.827312+0000","last_peered":"2024-04-24T23:39:22.827312+0000","last_clean":"2024-04-24T23:39:22.827312+0000","last_became_active":"2024-04-24T23:38:33.139303+0000","last_became_peered":"2024-04-24T23:38:33.139303+0000","last_unstale":"2024-04-24T23:39:22.827312+0000","last_undegraded":"2024-04-24T23:39:22.827312+0000","last_fullsized":"2024-04-24T23:39:22.827312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:23.343617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822916+0000","last_change":"2024-04-24T23:38:38.216184+0000","last_active":"2024-04-24T23:39:22.822916+0000","last_peered":"2024-04-24T23:39:22.822916+0000","last_clean":"2024-04-24T23:39:22.822916+0000","last_became_active":"2024-04-24T23:38:38.214813+0000","last_became_peered":"2024-04-24T23:38:38.214813+0000","last_unstale":"2024-04-24T23:39:22.822916+0000","last_undegraded":"2024-04-24T23:39:22.822916+0000","last_fullsized":"2024-04-24T23:39:22.822916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:58.553943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814784+0000","last_change":"2024-04-24T23:38:34.174790+0000","last_active":"2024-04-24T23:39:22.814784+0000","last_peered":"2024-04-24T23:39:22.814784+0000","last_clean":"2024-04-24T23:39:22.814784+0000","last_became_active":"2024-04-24T23:38:34.174504+0000","last_became_peered":"2024-04-24T23:38:34.174504+0000","last_unstale":"2024-04-24T23:39:22.814784+0000","last_undegraded":"2024-04-24T23:39:22.814784+0000","last_fullsized":"2024-04-24T23:39:22.814784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:27.147380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822132+0000","last_change":"2024-04-24T23:38:33.125559+0000","last_active":"2024-04-24T23:39:22.822132+0000","last_peered":"2024-04-24T23:39:22.822132+0000","last_clean":"2024-04-24T23:39:22.822132+0000","last_became_active":"2024-04-24T23:38:33.125115+0000","last_became_peered":"2024-04-24T23:38:33.125115+0000","last_unstale":"2024-04-24T23:39:22.822132+0000","last_undegraded":"2024-04-24T23:39:22.822132+0000","last_fullsized":"2024-04-24T23:39:22.822132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:07.598128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821927+0000","last_change":"2024-04-24T23:38:38.221669+0000","last_active":"2024-04-24T23:39:22.821927+0000","last_peered":"2024-04-24T23:39:22.821927+0000","last_clean":"2024-04-24T23:39:22.821927+0000","last_became_active":"2024-04-24T23:38:38.219797+0000","last_became_peered":"2024-04-24T23:38:38.219797+0000","last_unstale":"2024-04-24T23:39:22.821927+0000","last_undegraded":"2024-04-24T23:39:22.821927+0000","last_fullsized":"2024-04-24T23:39:22.821927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:04.091622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814214+0000","last_change":"2024-04-24T23:38:34.163966+0000","last_active":"2024-04-24T23:39:22.814214+0000","last_peered":"2024-04-24T23:39:22.814214+0000","last_clean":"2024-04-24T23:39:22.814214+0000","last_became_active":"2024-04-24T23:38:34.163291+0000","last_became_peered":"2024-04-24T23:38:34.163291+0000","last_unstale":"2024-04-24T23:39:22.814214+0000","last_undegraded":"2024-04-24T23:39:22.814214+0000","last_fullsized":"2024-04-24T23:39:22.814214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:34.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822513+0000","last_change":"2024-04-24T23:38:33.119549+0000","last_active":"2024-04-24T23:39:22.822513+0000","last_peered":"2024-04-24T23:39:22.822513+0000","last_clean":"2024-04-24T23:39:22.822513+0000","last_became_active":"2024-04-24T23:38:33.119052+0000","last_became_peered":"2024-04-24T23:38:33.119052+0000","last_unstale":"2024-04-24T23:39:22.822513+0000","last_undegraded":"2024-04-24T23:39:22.822513+0000","last_fullsized":"2024-04-24T23:39:22.822513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'33","reported_seq":51,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:42.166983+0000","last_change":"2024-04-24T23:38:38.252720+0000","last_active":"2024-04-24T23:39:42.166983+0000","last_peered":"2024-04-24T23:39:42.166983+0000","last_clean":"2024-04-24T23:39:42.166983+0000","last_became_active":"2024-04-24T23:38:38.252138+0000","last_became_peered":"2024-04-24T23:38:38.252138+0000","last_unstale":"2024-04-24T23:39:42.166983+0000","last_undegraded":"2024-04-24T23:39:42.166983+0000","last_fullsized":"2024-04-24T23:39:42.166983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:18.964372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.823517+0000","last_change":"2024-04-24T23:38:34.157008+0000","last_active":"2024-04-24T23:39:22.823517+0000","last_peered":"2024-04-24T23:39:22.823517+0000","last_clean":"2024-04-24T23:39:22.823517+0000","last_became_active":"2024-04-24T23:38:34.152682+0000","last_became_peered":"2024-04-24T23:38:34.152682+0000","last_unstale":"2024-04-24T23:39:22.823517+0000","last_undegraded":"2024-04-24T23:39:22.823517+0000","last_fullsized":"2024-04-24T23:39:22.823517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:48.697457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.824298+0000","last_change":"2024-04-24T23:38:33.139819+0000","last_active":"2024-04-24T23:39:22.824298+0000","last_peered":"2024-04-24T23:39:22.824298+0000","last_clean":"2024-04-24T23:39:22.824298+0000","last_became_active":"2024-04-24T23:38:33.139175+0000","last_became_peered":"2024-04-24T23:38:33.139175+0000","last_unstale":"2024-04-24T23:39:22.824298+0000","last_undegraded":"2024-04-24T23:39:22.824298+0000","last_fullsized":"2024-04-24T23:39:22.824298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:52.007425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.833647+0000","last_change":"2024-04-24T23:39:22.833647+0000","last_active":"2024-04-24T23:39:22.833647+0000","last_peered":"2024-04-24T23:39:22.833647+0000","last_clean":"2024-04-24T23:39:22.833647+0000","last_became_active":"2024-04-24T23:39:22.831081+0000","last_became_peered":"2024-04-24T23:39:22.831081+0000","last_unstale":"2024-04-24T23:39:22.833647+0000","last_undegraded":"2024-04-24T23:39:22.833647+0000","last_fullsized":"2024-04-24T23:39:22.833647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:32:39.380569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947767+0000","last_change":"2024-04-24T23:38:34.154755+0000","last_active":"2024-04-24T23:39:22.947767+0000","last_peered":"2024-04-24T23:39:22.947767+0000","last_clean":"2024-04-24T23:39:22.947767+0000","last_became_active":"2024-04-24T23:38:34.153967+0000","last_became_peered":"2024-04-24T23:38:34.153967+0000","last_unstale":"2024-04-24T23:39:22.947767+0000","last_undegraded":"2024-04-24T23:39:22.947767+0000","last_fullsized":"2024-04-24T23:39:22.947767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.818571+0000","last_change":"2024-04-24T23:38:33.135885+0000","last_active":"2024-04-24T23:39:22.818571+0000","last_peered":"2024-04-24T23:39:22.818571+0000","last_clean":"2024-04-24T23:39:22.818571+0000","last_became_active":"2024-04-24T23:38:33.135225+0000","last_became_peered":"2024-04-24T23:38:33.135225+0000","last_unstale":"2024-04-24T23:39:22.818571+0000","last_undegraded":"2024-04-24T23:39:22.818571+0000","last_fullsized":"2024-04-24T23:39:22.818571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:52.007425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822856+0000","last_change":"2024-04-24T23:38:38.252002+0000","last_active":"2024-04-24T23:39:22.822856+0000","last_peered":"2024-04-24T23:39:22.822856+0000","last_clean":"2024-04-24T23:39:22.822856+0000","last_became_active":"2024-04-24T23:38:38.251057+0000","last_became_peered":"2024-04-24T23:38:38.251057+0000","last_unstale":"2024-04-24T23:39:22.822856+0000","last_undegraded":"2024-04-24T23:39:22.822856+0000","last_fullsized":"2024-04-24T23:39:22.822856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:49.920273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.838498+0000","last_change":"2024-04-24T23:39:22.833969+0000","last_active":"2024-04-24T23:39:22.838498+0000","last_peered":"2024-04-24T23:39:22.838498+0000","last_clean":"2024-04-24T23:39:22.838498+0000","last_became_active":"2024-04-24T23:39:22.833072+0000","last_became_peered":"2024-04-24T23:39:22.833072+0000","last_unstale":"2024-04-24T23:39:22.838498+0000","last_undegraded":"2024-04-24T23:39:22.838498+0000","last_fullsized":"2024-04-24T23:39:22.838498+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:53.567151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:44.174185+0000","last_change":"2024-04-24T23:38:33.115409+0000","last_active":"2024-04-24T23:39:44.174185+0000","last_peered":"2024-04-24T23:39:44.174185+0000","last_clean":"2024-04-24T23:39:44.174185+0000","last_became_active":"2024-04-24T23:38:33.115039+0000","last_became_peered":"2024-04-24T23:38:33.115039+0000","last_unstale":"2024-04-24T23:39:44.174185+0000","last_undegraded":"2024-04-24T23:39:44.174185+0000","last_fullsized":"2024-04-24T23:39:44.174185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:52.007425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.813502+0000","last_change":"2024-04-24T23:38:38.246602+0000","last_active":"2024-04-24T23:39:22.813502+0000","last_peered":"2024-04-24T23:39:22.813502+0000","last_clean":"2024-04-24T23:39:22.813502+0000","last_became_active":"2024-04-24T23:38:38.245775+0000","last_became_peered":"2024-04-24T23:38:38.245775+0000","last_unstale":"2024-04-24T23:39:22.813502+0000","last_undegraded":"2024-04-24T23:39:22.813502+0000","last_fullsized":"2024-04-24T23:39:22.813502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:29.684133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.823555+0000","last_change":"2024-04-24T23:38:34.149008+0000","last_active":"2024-04-24T23:39:22.823555+0000","last_peered":"2024-04-24T23:39:22.823555+0000","last_clean":"2024-04-24T23:39:22.823555+0000","last_became_active":"2024-04-24T23:38:34.148122+0000","last_became_peered":"2024-04-24T23:38:34.148122+0000","last_unstale":"2024-04-24T23:39:22.823555+0000","last_undegraded":"2024-04-24T23:39:22.823555+0000","last_fullsized":"2024-04-24T23:39:22.823555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:39.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.828326+0000","last_change":"2024-04-24T23:38:33.142490+0000","last_active":"2024-04-24T23:39:22.828326+0000","last_peered":"2024-04-24T23:39:22.828326+0000","last_clean":"2024-04-24T23:39:22.828326+0000","last_became_active":"2024-04-24T23:38:33.140003+0000","last_became_peered":"2024-04-24T23:38:33.140003+0000","last_unstale":"2024-04-24T23:39:22.828326+0000","last_undegraded":"2024-04-24T23:39:22.828326+0000","last_fullsized":"2024-04-24T23:39:22.828326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:45:12.216173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.946778+0000","last_change":"2024-04-24T23:38:38.246291+0000","last_active":"2024-04-24T23:39:22.946778+0000","last_peered":"2024-04-24T23:39:22.946778+0000","last_clean":"2024-04-24T23:39:22.946778+0000","last_became_active":"2024-04-24T23:38:38.245611+0000","last_became_peered":"2024-04-24T23:38:38.245611+0000","last_unstale":"2024-04-24T23:39:22.946778+0000","last_undegraded":"2024-04-24T23:39:22.946778+0000","last_fullsized":"2024-04-24T23:39:22.946778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:47.898644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817536+0000","last_change":"2024-04-24T23:38:34.186285+0000","last_active":"2024-04-24T23:39:22.817536+0000","last_peered":"2024-04-24T23:39:22.817536+0000","last_clean":"2024-04-24T23:39:22.817536+0000","last_became_active":"2024-04-24T23:38:34.185023+0000","last_became_peered":"2024-04-24T23:38:34.185023+0000","last_unstale":"2024-04-24T23:39:22.817536+0000","last_undegraded":"2024-04-24T23:39:22.817536+0000","last_fullsized":"2024-04-24T23:39:22.817536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:56.947423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.823814+0000","last_change":"2024-04-24T23:38:33.108447+0000","last_active":"2024-04-24T23:39:22.823814+0000","last_peered":"2024-04-24T23:39:22.823814+0000","last_clean":"2024-04-24T23:39:22.823814+0000","last_became_active":"2024-04-24T23:38:33.108102+0000","last_became_peered":"2024-04-24T23:38:33.108102+0000","last_unstale":"2024-04-24T23:39:22.823814+0000","last_undegraded":"2024-04-24T23:39:22.823814+0000","last_fullsized":"2024-04-24T23:39:22.823814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:47.686974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821488+0000","last_change":"2024-04-24T23:38:38.213425+0000","last_active":"2024-04-24T23:39:22.821488+0000","last_peered":"2024-04-24T23:39:22.821488+0000","last_clean":"2024-04-24T23:39:22.821488+0000","last_became_active":"2024-04-24T23:38:38.212691+0000","last_became_peered":"2024-04-24T23:38:38.212691+0000","last_unstale":"2024-04-24T23:39:22.821488+0000","last_undegraded":"2024-04-24T23:39:22.821488+0000","last_fullsized":"2024-04-24T23:39:22.821488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:01.031822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822383+0000","last_change":"2024-04-24T23:38:34.154178+0000","last_active":"2024-04-24T23:39:22.822383+0000","last_peered":"2024-04-24T23:39:22.822383+0000","last_clean":"2024-04-24T23:39:22.822383+0000","last_became_active":"2024-04-24T23:38:34.153372+0000","last_became_peered":"2024-04-24T23:38:34.153372+0000","last_unstale":"2024-04-24T23:39:22.822383+0000","last_undegraded":"2024-04-24T23:39:22.822383+0000","last_fullsized":"2024-04-24T23:39:22.822383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:10.585665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816188+0000","last_change":"2024-04-24T23:38:33.140060+0000","last_active":"2024-04-24T23:39:22.816188+0000","last_peered":"2024-04-24T23:39:22.816188+0000","last_clean":"2024-04-24T23:39:22.816188+0000","last_became_active":"2024-04-24T23:38:33.139012+0000","last_became_peered":"2024-04-24T23:38:33.139012+0000","last_unstale":"2024-04-24T23:39:22.816188+0000","last_undegraded":"2024-04-24T23:39:22.816188+0000","last_fullsized":"2024-04-24T23:39:22.816188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.830414+0000","last_change":"2024-04-24T23:39:22.828208+0000","last_active":"2024-04-24T23:39:22.830414+0000","last_peered":"2024-04-24T23:39:22.830414+0000","last_clean":"2024-04-24T23:39:22.830414+0000","last_became_active":"2024-04-24T23:39:22.825860+0000","last_became_peered":"2024-04-24T23:39:22.825860+0000","last_unstale":"2024-04-24T23:39:22.830414+0000","last_undegraded":"2024-04-24T23:39:22.830414+0000","last_fullsized":"2024-04-24T23:39:22.830414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:14:39.506678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.820916+0000","last_change":"2024-04-24T23:38:34.152846+0000","last_active":"2024-04-24T23:39:22.820916+0000","last_peered":"2024-04-24T23:39:22.820916+0000","last_clean":"2024-04-24T23:39:22.820916+0000","last_became_active":"2024-04-24T23:38:34.151917+0000","last_became_peered":"2024-04-24T23:38:34.151917+0000","last_unstale":"2024-04-24T23:39:22.820916+0000","last_undegraded":"2024-04-24T23:39:22.820916+0000","last_fullsized":"2024-04-24T23:39:22.820916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:34.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'2","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:44.222348+0000","last_change":"2024-04-24T23:38:33.124295+0000","last_active":"2024-04-24T23:39:44.222348+0000","last_peered":"2024-04-24T23:39:44.222348+0000","last_clean":"2024-04-24T23:39:44.222348+0000","last_became_active":"2024-04-24T23:38:33.123674+0000","last_became_peered":"2024-04-24T23:38:33.123674+0000","last_unstale":"2024-04-24T23:39:44.222348+0000","last_undegraded":"2024-04-24T23:39:44.222348+0000","last_fullsized":"2024-04-24T23:39:44.222348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.824922+0000","last_change":"2024-04-24T23:38:38.214721+0000","last_active":"2024-04-24T23:39:22.824922+0000","last_peered":"2024-04-24T23:39:22.824922+0000","last_clean":"2024-04-24T23:39:22.824922+0000","last_became_active":"2024-04-24T23:38:38.214005+0000","last_became_peered":"2024-04-24T23:38:38.214005+0000","last_unstale":"2024-04-24T23:39:22.824922+0000","last_undegraded":"2024-04-24T23:39:22.824922+0000","last_fullsized":"2024-04-24T23:39:22.824922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:29:56.066046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.946216+0000","last_change":"2024-04-24T23:38:34.139551+0000","last_active":"2024-04-24T23:39:22.946216+0000","last_peered":"2024-04-24T23:39:22.946216+0000","last_clean":"2024-04-24T23:39:22.946216+0000","last_became_active":"2024-04-24T23:38:34.138681+0000","last_became_peered":"2024-04-24T23:38:34.138681+0000","last_unstale":"2024-04-24T23:39:22.946216+0000","last_undegraded":"2024-04-24T23:39:22.946216+0000","last_fullsized":"2024-04-24T23:39:22.946216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:47.556651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.824571+0000","last_change":"2024-04-24T23:38:33.141279+0000","last_active":"2024-04-24T23:39:22.824571+0000","last_peered":"2024-04-24T23:39:22.824571+0000","last_clean":"2024-04-24T23:39:22.824571+0000","last_became_active":"2024-04-24T23:38:33.140618+0000","last_became_peered":"2024-04-24T23:38:33.140618+0000","last_unstale":"2024-04-24T23:39:22.824571+0000","last_undegraded":"2024-04-24T23:39:22.824571+0000","last_fullsized":"2024-04-24T23:39:22.824571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947496+0000","last_change":"2024-04-24T23:38:38.250074+0000","last_active":"2024-04-24T23:39:22.947496+0000","last_peered":"2024-04-24T23:39:22.947496+0000","last_clean":"2024-04-24T23:39:22.947496+0000","last_became_active":"2024-04-24T23:38:38.249402+0000","last_became_peered":"2024-04-24T23:38:38.249402+0000","last_unstale":"2024-04-24T23:39:22.947496+0000","last_undegraded":"2024-04-24T23:39:22.947496+0000","last_fullsized":"2024-04-24T23:39:22.947496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:57.246661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816685+0000","last_change":"2024-04-24T23:38:34.187980+0000","last_active":"2024-04-24T23:39:22.816685+0000","last_peered":"2024-04-24T23:39:22.816685+0000","last_clean":"2024-04-24T23:39:22.816685+0000","last_became_active":"2024-04-24T23:38:34.187655+0000","last_became_peered":"2024-04-24T23:38:34.187655+0000","last_unstale":"2024-04-24T23:39:22.816685+0000","last_undegraded":"2024-04-24T23:39:22.816685+0000","last_fullsized":"2024-04-24T23:39:22.816685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:39.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815604+0000","last_change":"2024-04-24T23:38:33.125255+0000","last_active":"2024-04-24T23:39:22.815604+0000","last_peered":"2024-04-24T23:39:22.815604+0000","last_clean":"2024-04-24T23:39:22.815604+0000","last_became_active":"2024-04-24T23:38:33.115926+0000","last_became_peered":"2024-04-24T23:38:33.115926+0000","last_unstale":"2024-04-24T23:39:22.815604+0000","last_undegraded":"2024-04-24T23:39:22.815604+0000","last_fullsized":"2024-04-24T23:39:22.815604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:42.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.824826+0000","last_change":"2024-04-24T23:38:29.564705+0000","last_active":"2024-04-24T23:39:22.824826+0000","last_peered":"2024-04-24T23:39:22.824826+0000","last_clean":"2024-04-24T23:39:22.824826+0000","last_became_active":"2024-04-24T23:38:29.562027+0000","last_became_peered":"2024-04-24T23:38:29.562027+0000","last_unstale":"2024-04-24T23:39:22.824826+0000","last_undegraded":"2024-04-24T23:39:22.824826+0000","last_fullsized":"2024-04-24T23:39:22.824826+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:27.959678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:27.959678+0000","last_clean_scrub_stamp":"2024-04-24T23:38:27.959678+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:40.724497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'33","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:42.539265+0000","last_change":"2024-04-24T23:38:38.254846+0000","last_active":"2024-04-24T23:39:42.539265+0000","last_peered":"2024-04-24T23:39:42.539265+0000","last_clean":"2024-04-24T23:39:42.539265+0000","last_became_active":"2024-04-24T23:38:38.253792+0000","last_became_peered":"2024-04-24T23:38:38.253792+0000","last_unstale":"2024-04-24T23:39:42.539265+0000","last_undegraded":"2024-04-24T23:39:42.539265+0000","last_fullsized":"2024-04-24T23:39:42.539265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:17:11.093562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":2176,"num_write":33,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.827672+0000","last_change":"2024-04-24T23:38:34.195003+0000","last_active":"2024-04-24T23:39:22.827672+0000","last_peered":"2024-04-24T23:39:22.827672+0000","last_clean":"2024-04-24T23:39:22.827672+0000","last_became_active":"2024-04-24T23:38:34.194530+0000","last_became_peered":"2024-04-24T23:38:34.194530+0000","last_unstale":"2024-04-24T23:39:22.827672+0000","last_undegraded":"2024-04-24T23:39:22.827672+0000","last_fullsized":"2024-04-24T23:39:22.827672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:00.007223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.820712+0000","last_change":"2024-04-24T23:38:33.130165+0000","last_active":"2024-04-24T23:39:22.820712+0000","last_peered":"2024-04-24T23:39:22.820712+0000","last_clean":"2024-04-24T23:39:22.820712+0000","last_became_active":"2024-04-24T23:38:33.129888+0000","last_became_peered":"2024-04-24T23:38:33.129888+0000","last_unstale":"2024-04-24T23:39:22.820712+0000","last_undegraded":"2024-04-24T23:39:22.820712+0000","last_fullsized":"2024-04-24T23:39:22.820712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:27:41.421732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'66","reported_seq":116,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:44.231356+0000","last_change":"2024-04-24T23:38:38.253780+0000","last_active":"2024-04-24T23:39:44.231356+0000","last_peered":"2024-04-24T23:39:44.231356+0000","last_clean":"2024-04-24T23:39:44.231356+0000","last_became_active":"2024-04-24T23:38:38.252899+0000","last_became_peered":"2024-04-24T23:38:38.252899+0000","last_unstale":"2024-04-24T23:39:44.231356+0000","last_undegraded":"2024-04-24T23:39:44.231356+0000","last_fullsized":"2024-04-24T23:39:44.231356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:58.553943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":4096,"num_write":66,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816876+0000","last_change":"2024-04-24T23:38:34.187942+0000","last_active":"2024-04-24T23:39:22.816876+0000","last_peered":"2024-04-24T23:39:22.816876+0000","last_clean":"2024-04-24T23:39:22.816876+0000","last_became_active":"2024-04-24T23:38:34.184929+0000","last_became_peered":"2024-04-24T23:38:34.184929+0000","last_unstale":"2024-04-24T23:39:22.816876+0000","last_undegraded":"2024-04-24T23:39:22.816876+0000","last_fullsized":"2024-04-24T23:39:22.816876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:43.814245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.823408+0000","last_change":"2024-04-24T23:38:33.120289+0000","last_active":"2024-04-24T23:39:22.823408+0000","last_peered":"2024-04-24T23:39:22.823408+0000","last_clean":"2024-04-24T23:39:22.823408+0000","last_became_active":"2024-04-24T23:38:33.119790+0000","last_became_peered":"2024-04-24T23:38:33.119790+0000","last_unstale":"2024-04-24T23:39:22.823408+0000","last_undegraded":"2024-04-24T23:39:22.823408+0000","last_fullsized":"2024-04-24T23:39:22.823408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947098+0000","last_change":"2024-04-24T23:38:38.216064+0000","last_active":"2024-04-24T23:39:22.947098+0000","last_peered":"2024-04-24T23:39:22.947098+0000","last_clean":"2024-04-24T23:39:22.947098+0000","last_became_active":"2024-04-24T23:38:38.215599+0000","last_became_peered":"2024-04-24T23:38:38.215599+0000","last_unstale":"2024-04-24T23:39:22.947098+0000","last_undegraded":"2024-04-24T23:39:22.947098+0000","last_fullsized":"2024-04-24T23:39:22.947098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:01.031822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.828856+0000","last_change":"2024-04-24T23:38:34.194305+0000","last_active":"2024-04-24T23:39:22.828856+0000","last_peered":"2024-04-24T23:39:22.828856+0000","last_clean":"2024-04-24T23:39:22.828856+0000","last_became_active":"2024-04-24T23:38:34.188815+0000","last_became_peered":"2024-04-24T23:38:34.188815+0000","last_unstale":"2024-04-24T23:39:22.828856+0000","last_undegraded":"2024-04-24T23:39:22.828856+0000","last_fullsized":"2024-04-24T23:39:22.828856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:25.599734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821376+0000","last_change":"2024-04-24T23:38:33.125221+0000","last_active":"2024-04-24T23:39:22.821376+0000","last_peered":"2024-04-24T23:39:22.821376+0000","last_clean":"2024-04-24T23:39:22.821376+0000","last_became_active":"2024-04-24T23:38:33.124849+0000","last_became_peered":"2024-04-24T23:38:33.124849+0000","last_unstale":"2024-04-24T23:39:22.821376+0000","last_undegraded":"2024-04-24T23:39:22.821376+0000","last_fullsized":"2024-04-24T23:39:22.821376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:42.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814131+0000","last_change":"2024-04-24T23:38:38.250618+0000","last_active":"2024-04-24T23:39:22.814131+0000","last_peered":"2024-04-24T23:39:22.814131+0000","last_clean":"2024-04-24T23:39:22.814131+0000","last_became_active":"2024-04-24T23:38:38.249521+0000","last_became_peered":"2024-04-24T23:38:38.249521+0000","last_unstale":"2024-04-24T23:39:22.814131+0000","last_undegraded":"2024-04-24T23:39:22.814131+0000","last_fullsized":"2024-04-24T23:39:22.814131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:57.651551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.828052+0000","last_change":"2024-04-24T23:38:34.166018+0000","last_active":"2024-04-24T23:39:22.828052+0000","last_peered":"2024-04-24T23:39:22.828052+0000","last_clean":"2024-04-24T23:39:22.828052+0000","last_became_active":"2024-04-24T23:38:34.165229+0000","last_became_peered":"2024-04-24T23:38:34.165229+0000","last_unstale":"2024-04-24T23:39:22.828052+0000","last_undegraded":"2024-04-24T23:39:22.828052+0000","last_fullsized":"2024-04-24T23:39:22.828052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:56.947423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.823071+0000","last_change":"2024-04-24T23:38:33.109771+0000","last_active":"2024-04-24T23:39:22.823071+0000","last_peered":"2024-04-24T23:39:22.823071+0000","last_clean":"2024-04-24T23:39:22.823071+0000","last_became_active":"2024-04-24T23:38:33.108928+0000","last_became_peered":"2024-04-24T23:38:33.108928+0000","last_unstale":"2024-04-24T23:39:22.823071+0000","last_undegraded":"2024-04-24T23:39:22.823071+0000","last_fullsized":"2024-04-24T23:39:22.823071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:44.838533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.833400+0000","last_change":"2024-04-24T23:39:22.833400+0000","last_active":"2024-04-24T23:39:22.833400+0000","last_peered":"2024-04-24T23:39:22.833400+0000","last_clean":"2024-04-24T23:39:22.833400+0000","last_became_active":"2024-04-24T23:39:22.831340+0000","last_became_peered":"2024-04-24T23:39:22.831340+0000","last_unstale":"2024-04-24T23:39:22.833400+0000","last_undegraded":"2024-04-24T23:39:22.833400+0000","last_fullsized":"2024-04-24T23:39:22.833400+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:05:14.068761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3,6],"acting":[4,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.824993+0000","last_change":"2024-04-24T23:38:34.188981+0000","last_active":"2024-04-24T23:39:22.824993+0000","last_peered":"2024-04-24T23:39:22.824993+0000","last_clean":"2024-04-24T23:39:22.824993+0000","last_became_active":"2024-04-24T23:38:34.188416+0000","last_became_peered":"2024-04-24T23:38:34.188416+0000","last_unstale":"2024-04-24T23:39:22.824993+0000","last_undegraded":"2024-04-24T23:39:22.824993+0000","last_fullsized":"2024-04-24T23:39:22.824993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:17:07.009163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.820272+0000","last_change":"2024-04-24T23:38:33.100912+0000","last_active":"2024-04-24T23:39:22.820272+0000","last_peered":"2024-04-24T23:39:22.820272+0000","last_clean":"2024-04-24T23:39:22.820272+0000","last_became_active":"2024-04-24T23:38:33.100464+0000","last_became_peered":"2024-04-24T23:38:33.100464+0000","last_unstale":"2024-04-24T23:39:22.820272+0000","last_undegraded":"2024-04-24T23:39:22.820272+0000","last_fullsized":"2024-04-24T23:39:22.820272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:47:27.107958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947184+0000","last_change":"2024-04-24T23:38:38.207627+0000","last_active":"2024-04-24T23:39:22.947184+0000","last_peered":"2024-04-24T23:39:22.947184+0000","last_clean":"2024-04-24T23:39:22.947184+0000","last_became_active":"2024-04-24T23:38:38.207049+0000","last_became_peered":"2024-04-24T23:38:38.207049+0000","last_unstale":"2024-04-24T23:39:22.947184+0000","last_undegraded":"2024-04-24T23:39:22.947184+0000","last_fullsized":"2024-04-24T23:39:22.947184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:29:56.066046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814063+0000","last_change":"2024-04-24T23:38:34.161654+0000","last_active":"2024-04-24T23:39:22.814063+0000","last_peered":"2024-04-24T23:39:22.814063+0000","last_clean":"2024-04-24T23:39:22.814063+0000","last_became_active":"2024-04-24T23:38:34.158756+0000","last_became_peered":"2024-04-24T23:38:34.158756+0000","last_unstale":"2024-04-24T23:39:22.814063+0000","last_undegraded":"2024-04-24T23:39:22.814063+0000","last_fullsized":"2024-04-24T23:39:22.814063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:29.660159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.813988+0000","last_change":"2024-04-24T23:38:33.116071+0000","last_active":"2024-04-24T23:39:22.813988+0000","last_peered":"2024-04-24T23:39:22.813988+0000","last_clean":"2024-04-24T23:39:22.813988+0000","last_became_active":"2024-04-24T23:38:33.115472+0000","last_became_peered":"2024-04-24T23:38:33.115472+0000","last_unstale":"2024-04-24T23:39:22.813988+0000","last_undegraded":"2024-04-24T23:39:22.813988+0000","last_fullsized":"2024-04-24T23:39:22.813988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:47.686974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815773+0000","last_change":"2024-04-24T23:38:38.248841+0000","last_active":"2024-04-24T23:39:22.815773+0000","last_peered":"2024-04-24T23:39:22.815773+0000","last_clean":"2024-04-24T23:39:22.815773+0000","last_became_active":"2024-04-24T23:38:38.248311+0000","last_became_peered":"2024-04-24T23:38:38.248311+0000","last_unstale":"2024-04-24T23:39:22.815773+0000","last_undegraded":"2024-04-24T23:39:22.815773+0000","last_fullsized":"2024-04-24T23:39:22.815773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:22.798878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.826809+0000","last_change":"2024-04-24T23:38:34.189772+0000","last_active":"2024-04-24T23:39:22.826809+0000","last_peered":"2024-04-24T23:39:22.826809+0000","last_clean":"2024-04-24T23:39:22.826809+0000","last_became_active":"2024-04-24T23:38:34.179801+0000","last_became_peered":"2024-04-24T23:38:34.179801+0000","last_unstale":"2024-04-24T23:39:22.826809+0000","last_undegraded":"2024-04-24T23:39:22.826809+0000","last_fullsized":"2024-04-24T23:39:22.826809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:54.469544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815922+0000","last_change":"2024-04-24T23:38:33.146611+0000","last_active":"2024-04-24T23:39:22.815922+0000","last_peered":"2024-04-24T23:39:22.815922+0000","last_clean":"2024-04-24T23:39:22.815922+0000","last_became_active":"2024-04-24T23:38:33.145896+0000","last_became_peered":"2024-04-24T23:38:33.145896+0000","last_unstale":"2024-04-24T23:39:22.815922+0000","last_undegraded":"2024-04-24T23:39:22.815922+0000","last_fullsized":"2024-04-24T23:39:22.815922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:47.686974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814661+0000","last_change":"2024-04-24T23:38:38.252023+0000","last_active":"2024-04-24T23:39:22.814661+0000","last_peered":"2024-04-24T23:39:22.814661+0000","last_clean":"2024-04-24T23:39:22.814661+0000","last_became_active":"2024-04-24T23:38:38.251541+0000","last_became_peered":"2024-04-24T23:38:38.251541+0000","last_unstale":"2024-04-24T23:39:22.814661+0000","last_undegraded":"2024-04-24T23:39:22.814661+0000","last_fullsized":"2024-04-24T23:39:22.814661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:25:30.720742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.946803+0000","last_change":"2024-04-24T23:38:34.164658+0000","last_active":"2024-04-24T23:39:22.946803+0000","last_peered":"2024-04-24T23:39:22.946803+0000","last_clean":"2024-04-24T23:39:22.946803+0000","last_became_active":"2024-04-24T23:38:34.164024+0000","last_became_peered":"2024-04-24T23:38:34.164024+0000","last_unstale":"2024-04-24T23:39:22.946803+0000","last_undegraded":"2024-04-24T23:39:22.946803+0000","last_fullsized":"2024-04-24T23:39:22.946803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:47.516208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947439+0000","last_change":"2024-04-24T23:38:33.111314+0000","last_active":"2024-04-24T23:39:22.947439+0000","last_peered":"2024-04-24T23:39:22.947439+0000","last_clean":"2024-04-24T23:39:22.947439+0000","last_became_active":"2024-04-24T23:38:33.109819+0000","last_became_peered":"2024-04-24T23:38:33.109819+0000","last_unstale":"2024-04-24T23:39:22.947439+0000","last_undegraded":"2024-04-24T23:39:22.947439+0000","last_fullsized":"2024-04-24T23:39:22.947439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:21:39.944505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816959+0000","last_change":"2024-04-24T23:38:38.247323+0000","last_active":"2024-04-24T23:39:22.816959+0000","last_peered":"2024-04-24T23:39:22.816959+0000","last_clean":"2024-04-24T23:39:22.816959+0000","last_became_active":"2024-04-24T23:38:38.246172+0000","last_became_peered":"2024-04-24T23:38:38.246172+0000","last_unstale":"2024-04-24T23:39:22.816959+0000","last_undegraded":"2024-04-24T23:39:22.816959+0000","last_fullsized":"2024-04-24T23:39:22.816959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:32.771055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.827448+0000","last_change":"2024-04-24T23:38:34.189746+0000","last_active":"2024-04-24T23:39:22.827448+0000","last_peered":"2024-04-24T23:39:22.827448+0000","last_clean":"2024-04-24T23:39:22.827448+0000","last_became_active":"2024-04-24T23:38:34.179433+0000","last_became_peered":"2024-04-24T23:38:34.179433+0000","last_unstale":"2024-04-24T23:39:22.827448+0000","last_undegraded":"2024-04-24T23:39:22.827448+0000","last_fullsized":"2024-04-24T23:39:22.827448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:56.049789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'35","reported_seq":61,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:57.551905+0000","last_change":"2024-04-24T23:38:33.127637+0000","last_active":"2024-04-24T23:39:57.551905+0000","last_peered":"2024-04-24T23:39:57.551905+0000","last_clean":"2024-04-24T23:39:57.551905+0000","last_became_active":"2024-04-24T23:38:33.127122+0000","last_became_peered":"2024-04-24T23:38:33.127122+0000","last_unstale":"2024-04-24T23:39:57.551905+0000","last_undegraded":"2024-04-24T23:39:57.551905+0000","last_fullsized":"2024-04-24T23:39:57.551905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39309,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821945+0000","last_change":"2024-04-24T23:38:38.216781+0000","last_active":"2024-04-24T23:39:22.821945+0000","last_peered":"2024-04-24T23:39:22.821945+0000","last_clean":"2024-04-24T23:39:22.821945+0000","last_became_active":"2024-04-24T23:38:38.215741+0000","last_became_peered":"2024-04-24T23:38:38.215741+0000","last_unstale":"2024-04-24T23:39:22.821945+0000","last_undegraded":"2024-04-24T23:39:22.821945+0000","last_fullsized":"2024-04-24T23:39:22.821945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:47.898644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822840+0000","last_change":"2024-04-24T23:38:34.167424+0000","last_active":"2024-04-24T23:39:22.822840+0000","last_peered":"2024-04-24T23:39:22.822840+0000","last_clean":"2024-04-24T23:39:22.822840+0000","last_became_active":"2024-04-24T23:38:34.166602+0000","last_became_peered":"2024-04-24T23:38:34.166602+0000","last_unstale":"2024-04-24T23:39:22.822840+0000","last_undegraded":"2024-04-24T23:39:22.822840+0000","last_fullsized":"2024-04-24T23:39:22.822840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:31.033906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:44.220165+0000","last_change":"2024-04-24T23:38:33.146758+0000","last_active":"2024-04-24T23:39:44.220165+0000","last_peered":"2024-04-24T23:39:44.220165+0000","last_clean":"2024-04-24T23:39:44.220165+0000","last_became_active":"2024-04-24T23:38:33.146311+0000","last_became_peered":"2024-04-24T23:38:33.146311+0000","last_unstale":"2024-04-24T23:39:44.220165+0000","last_undegraded":"2024-04-24T23:39:44.220165+0000","last_fullsized":"2024-04-24T23:39:44.220165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:09.575181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822020+0000","last_change":"2024-04-24T23:38:38.221177+0000","last_active":"2024-04-24T23:39:22.822020+0000","last_peered":"2024-04-24T23:39:22.822020+0000","last_clean":"2024-04-24T23:39:22.822020+0000","last_became_active":"2024-04-24T23:38:38.219482+0000","last_became_peered":"2024-04-24T23:38:38.219482+0000","last_unstale":"2024-04-24T23:39:22.822020+0000","last_undegraded":"2024-04-24T23:39:22.822020+0000","last_fullsized":"2024-04-24T23:39:22.822020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:00.134189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947929+0000","last_change":"2024-04-24T23:38:34.170044+0000","last_active":"2024-04-24T23:39:22.947929+0000","last_peered":"2024-04-24T23:39:22.947929+0000","last_clean":"2024-04-24T23:39:22.947929+0000","last_became_active":"2024-04-24T23:38:34.169512+0000","last_became_peered":"2024-04-24T23:38:34.169512+0000","last_unstale":"2024-04-24T23:39:22.947929+0000","last_undegraded":"2024-04-24T23:39:22.947929+0000","last_fullsized":"2024-04-24T23:39:22.947929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817797+0000","last_change":"2024-04-24T23:38:33.131079+0000","last_active":"2024-04-24T23:39:22.817797+0000","last_peered":"2024-04-24T23:39:22.817797+0000","last_clean":"2024-04-24T23:39:22.817797+0000","last_became_active":"2024-04-24T23:38:33.130150+0000","last_became_peered":"2024-04-24T23:38:33.130150+0000","last_unstale":"2024-04-24T23:39:22.817797+0000","last_undegraded":"2024-04-24T23:39:22.817797+0000","last_fullsized":"2024-04-24T23:39:22.817797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:07.598128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'35","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:42.446330+0000","last_change":"2024-04-24T23:38:38.212241+0000","last_active":"2024-04-24T23:39:42.446330+0000","last_peered":"2024-04-24T23:39:42.446330+0000","last_clean":"2024-04-24T23:39:42.446330+0000","last_became_active":"2024-04-24T23:38:38.208130+0000","last_became_peered":"2024-04-24T23:38:38.208130+0000","last_unstale":"2024-04-24T23:39:42.446330+0000","last_undegraded":"2024-04-24T23:39:42.446330+0000","last_fullsized":"2024-04-24T23:39:42.446330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:32.771055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":4096,"num_write":33,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817836+0000","last_change":"2024-04-24T23:38:34.199814+0000","last_active":"2024-04-24T23:39:22.817836+0000","last_peered":"2024-04-24T23:39:22.817836+0000","last_clean":"2024-04-24T23:39:22.817836+0000","last_became_active":"2024-04-24T23:38:34.199311+0000","last_became_peered":"2024-04-24T23:38:34.199311+0000","last_unstale":"2024-04-24T23:39:22.817836+0000","last_undegraded":"2024-04-24T23:39:22.817836+0000","last_fullsized":"2024-04-24T23:39:22.817836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:09:44.182605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.818287+0000","last_change":"2024-04-24T23:38:33.140029+0000","last_active":"2024-04-24T23:39:22.818287+0000","last_peered":"2024-04-24T23:39:22.818287+0000","last_clean":"2024-04-24T23:39:22.818287+0000","last_became_active":"2024-04-24T23:38:33.139325+0000","last_became_peered":"2024-04-24T23:38:33.139325+0000","last_unstale":"2024-04-24T23:39:22.818287+0000","last_undegraded":"2024-04-24T23:39:22.818287+0000","last_fullsized":"2024-04-24T23:39:22.818287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:07.598128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815762+0000","last_change":"2024-04-24T23:38:38.246245+0000","last_active":"2024-04-24T23:39:22.815762+0000","last_peered":"2024-04-24T23:39:22.815762+0000","last_clean":"2024-04-24T23:39:22.815762+0000","last_became_active":"2024-04-24T23:38:38.245657+0000","last_became_peered":"2024-04-24T23:38:38.245657+0000","last_unstale":"2024-04-24T23:39:22.815762+0000","last_undegraded":"2024-04-24T23:39:22.815762+0000","last_fullsized":"2024-04-24T23:39:22.815762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:45.297412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947170+0000","last_change":"2024-04-24T23:38:38.251308+0000","last_active":"2024-04-24T23:39:22.947170+0000","last_peered":"2024-04-24T23:39:22.947170+0000","last_clean":"2024-04-24T23:39:22.947170+0000","last_became_active":"2024-04-24T23:38:38.250718+0000","last_became_peered":"2024-04-24T23:38:38.250718+0000","last_unstale":"2024-04-24T23:39:22.947170+0000","last_undegraded":"2024-04-24T23:39:22.947170+0000","last_fullsized":"2024-04-24T23:39:22.947170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:18.964372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821087+0000","last_change":"2024-04-24T23:38:34.174658+0000","last_active":"2024-04-24T23:39:22.821087+0000","last_peered":"2024-04-24T23:39:22.821087+0000","last_clean":"2024-04-24T23:39:22.821087+0000","last_became_active":"2024-04-24T23:38:34.174289+0000","last_became_peered":"2024-04-24T23:38:34.174289+0000","last_unstale":"2024-04-24T23:39:22.821087+0000","last_undegraded":"2024-04-24T23:39:22.821087+0000","last_fullsized":"2024-04-24T23:39:22.821087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:29.660159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814626+0000","last_change":"2024-04-24T23:38:33.131171+0000","last_active":"2024-04-24T23:39:22.814626+0000","last_peered":"2024-04-24T23:39:22.814626+0000","last_clean":"2024-04-24T23:39:22.814626+0000","last_became_active":"2024-04-24T23:38:33.130621+0000","last_became_peered":"2024-04-24T23:38:33.130621+0000","last_unstale":"2024-04-24T23:39:22.814626+0000","last_undegraded":"2024-04-24T23:39:22.814626+0000","last_fullsized":"2024-04-24T23:39:22.814626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817794+0000","last_change":"2024-04-24T23:38:38.214392+0000","last_active":"2024-04-24T23:39:22.817794+0000","last_peered":"2024-04-24T23:39:22.817794+0000","last_clean":"2024-04-24T23:39:22.817794+0000","last_became_active":"2024-04-24T23:38:38.213249+0000","last_became_peered":"2024-04-24T23:38:38.213249+0000","last_unstale":"2024-04-24T23:39:22.817794+0000","last_undegraded":"2024-04-24T23:39:22.817794+0000","last_fullsized":"2024-04-24T23:39:22.817794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:01.031822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815731+0000","last_change":"2024-04-24T23:38:34.164231+0000","last_active":"2024-04-24T23:39:22.815731+0000","last_peered":"2024-04-24T23:39:22.815731+0000","last_clean":"2024-04-24T23:39:22.815731+0000","last_became_active":"2024-04-24T23:38:34.163685+0000","last_became_peered":"2024-04-24T23:38:34.163685+0000","last_unstale":"2024-04-24T23:39:22.815731+0000","last_undegraded":"2024-04-24T23:39:22.815731+0000","last_fullsized":"2024-04-24T23:39:22.815731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:29.660159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814851+0000","last_change":"2024-04-24T23:38:33.116249+0000","last_active":"2024-04-24T23:39:22.814851+0000","last_peered":"2024-04-24T23:39:22.814851+0000","last_clean":"2024-04-24T23:39:22.814851+0000","last_became_active":"2024-04-24T23:38:33.113333+0000","last_became_peered":"2024-04-24T23:38:33.113333+0000","last_unstale":"2024-04-24T23:39:22.814851+0000","last_undegraded":"2024-04-24T23:39:22.814851+0000","last_fullsized":"2024-04-24T23:39:22.814851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:47:27.107958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814770+0000","last_change":"2024-04-24T23:38:33.111080+0000","last_active":"2024-04-24T23:39:22.814770+0000","last_peered":"2024-04-24T23:39:22.814770+0000","last_clean":"2024-04-24T23:39:22.814770+0000","last_became_active":"2024-04-24T23:38:33.110315+0000","last_became_peered":"2024-04-24T23:38:33.110315+0000","last_unstale":"2024-04-24T23:39:22.814770+0000","last_undegraded":"2024-04-24T23:39:22.814770+0000","last_fullsized":"2024-04-24T23:39:22.814770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947422+0000","last_change":"2024-04-24T23:38:34.148734+0000","last_active":"2024-04-24T23:39:22.947422+0000","last_peered":"2024-04-24T23:39:22.947422+0000","last_clean":"2024-04-24T23:39:22.947422+0000","last_became_active":"2024-04-24T23:38:34.146909+0000","last_became_peered":"2024-04-24T23:38:34.146909+0000","last_unstale":"2024-04-24T23:39:22.947422+0000","last_undegraded":"2024-04-24T23:39:22.947422+0000","last_fullsized":"2024-04-24T23:39:22.947422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:57:25.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.820296+0000","last_change":"2024-04-24T23:38:38.215787+0000","last_active":"2024-04-24T23:39:22.820296+0000","last_peered":"2024-04-24T23:39:22.820296+0000","last_clean":"2024-04-24T23:39:22.820296+0000","last_became_active":"2024-04-24T23:38:38.215395+0000","last_became_peered":"2024-04-24T23:38:38.215395+0000","last_unstale":"2024-04-24T23:39:22.820296+0000","last_undegraded":"2024-04-24T23:39:22.820296+0000","last_fullsized":"2024-04-24T23:39:22.820296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:51.641050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815067+0000","last_change":"2024-04-24T23:38:33.131735+0000","last_active":"2024-04-24T23:39:22.815067+0000","last_peered":"2024-04-24T23:39:22.815067+0000","last_clean":"2024-04-24T23:39:22.815067+0000","last_became_active":"2024-04-24T23:38:33.131314+0000","last_became_peered":"2024-04-24T23:38:33.131314+0000","last_unstale":"2024-04-24T23:39:22.815067+0000","last_undegraded":"2024-04-24T23:39:22.815067+0000","last_fullsized":"2024-04-24T23:39:22.815067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:42.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822079+0000","last_change":"2024-04-24T23:38:34.150894+0000","last_active":"2024-04-24T23:39:22.822079+0000","last_peered":"2024-04-24T23:39:22.822079+0000","last_clean":"2024-04-24T23:39:22.822079+0000","last_became_active":"2024-04-24T23:38:34.149910+0000","last_became_peered":"2024-04-24T23:38:34.149910+0000","last_unstale":"2024-04-24T23:39:22.822079+0000","last_undegraded":"2024-04-24T23:39:22.822079+0000","last_fullsized":"2024-04-24T23:39:22.822079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:08.608611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814775+0000","last_change":"2024-04-24T23:38:38.219498+0000","last_active":"2024-04-24T23:39:22.814775+0000","last_peered":"2024-04-24T23:39:22.814775+0000","last_clean":"2024-04-24T23:39:22.814775+0000","last_became_active":"2024-04-24T23:38:38.219100+0000","last_became_peered":"2024-04-24T23:38:38.219100+0000","last_unstale":"2024-04-24T23:39:22.814775+0000","last_undegraded":"2024-04-24T23:39:22.814775+0000","last_fullsized":"2024-04-24T23:39:22.814775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:17.585261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.813672+0000","last_change":"2024-04-24T23:38:34.162139+0000","last_active":"2024-04-24T23:39:22.813672+0000","last_peered":"2024-04-24T23:39:22.813672+0000","last_clean":"2024-04-24T23:39:22.813672+0000","last_became_active":"2024-04-24T23:38:34.159701+0000","last_became_peered":"2024-04-24T23:38:34.159701+0000","last_unstale":"2024-04-24T23:39:22.813672+0000","last_undegraded":"2024-04-24T23:39:22.813672+0000","last_fullsized":"2024-04-24T23:39:22.813672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:34.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.819582+0000","last_change":"2024-04-24T23:38:34.156925+0000","last_active":"2024-04-24T23:39:22.819582+0000","last_peered":"2024-04-24T23:39:22.819582+0000","last_clean":"2024-04-24T23:39:22.819582+0000","last_became_active":"2024-04-24T23:38:34.155969+0000","last_became_peered":"2024-04-24T23:38:34.155969+0000","last_unstale":"2024-04-24T23:39:22.819582+0000","last_undegraded":"2024-04-24T23:39:22.819582+0000","last_fullsized":"2024-04-24T23:39:22.819582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:31.033906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815530+0000","last_change":"2024-04-24T23:38:34.188234+0000","last_active":"2024-04-24T23:39:22.815530+0000","last_peered":"2024-04-24T23:39:22.815530+0000","last_clean":"2024-04-24T23:39:22.815530+0000","last_became_active":"2024-04-24T23:38:34.186332+0000","last_became_peered":"2024-04-24T23:38:34.186332+0000","last_unstale":"2024-04-24T23:39:22.815530+0000","last_undegraded":"2024-04-24T23:39:22.815530+0000","last_fullsized":"2024-04-24T23:39:22.815530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:56.049789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947106+0000","last_change":"2024-04-24T23:38:34.154728+0000","last_active":"2024-04-24T23:39:22.947106+0000","last_peered":"2024-04-24T23:39:22.947106+0000","last_clean":"2024-04-24T23:39:22.947106+0000","last_became_active":"2024-04-24T23:38:34.147038+0000","last_became_peered":"2024-04-24T23:38:34.147038+0000","last_unstale":"2024-04-24T23:39:22.947106+0000","last_undegraded":"2024-04-24T23:39:22.947106+0000","last_fullsized":"2024-04-24T23:39:22.947106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:34.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816375+0000","last_change":"2024-04-24T23:38:34.164080+0000","last_active":"2024-04-24T23:39:22.816375+0000","last_peered":"2024-04-24T23:39:22.816375+0000","last_clean":"2024-04-24T23:39:22.816375+0000","last_became_active":"2024-04-24T23:38:34.163761+0000","last_became_peered":"2024-04-24T23:38:34.163761+0000","last_unstale":"2024-04-24T23:39:22.816375+0000","last_undegraded":"2024-04-24T23:39:22.816375+0000","last_fullsized":"2024-04-24T23:39:22.816375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:00.007223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.829099+0000","last_change":"2024-04-24T23:39:22.829099+0000","last_active":"2024-04-24T23:39:22.829099+0000","last_peered":"2024-04-24T23:39:22.829099+0000","last_clean":"2024-04-24T23:39:22.829099+0000","last_became_active":"2024-04-24T23:39:22.828227+0000","last_became_peered":"2024-04-24T23:39:22.828227+0000","last_unstale":"2024-04-24T23:39:22.829099+0000","last_undegraded":"2024-04-24T23:39:22.829099+0000","last_fullsized":"2024-04-24T23:39:22.829099+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:38.663063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817535+0000","last_change":"2024-04-24T23:38:34.179301+0000","last_active":"2024-04-24T23:39:22.817535+0000","last_peered":"2024-04-24T23:39:22.817535+0000","last_clean":"2024-04-24T23:39:22.817535+0000","last_became_active":"2024-04-24T23:38:34.178651+0000","last_became_peered":"2024-04-24T23:38:34.178651+0000","last_unstale":"2024-04-24T23:39:22.817535+0000","last_undegraded":"2024-04-24T23:39:22.817535+0000","last_fullsized":"2024-04-24T23:39:22.817535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:57.767771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816067+0000","last_change":"2024-04-24T23:38:34.162572+0000","last_active":"2024-04-24T23:39:22.816067+0000","last_peered":"2024-04-24T23:39:22.816067+0000","last_clean":"2024-04-24T23:39:22.816067+0000","last_became_active":"2024-04-24T23:38:34.162156+0000","last_became_peered":"2024-04-24T23:38:34.162156+0000","last_unstale":"2024-04-24T23:39:22.816067+0000","last_undegraded":"2024-04-24T23:39:22.816067+0000","last_fullsized":"2024-04-24T23:39:22.816067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:57.767771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814482+0000","last_change":"2024-04-24T23:38:34.187429+0000","last_active":"2024-04-24T23:39:22.814482+0000","last_peered":"2024-04-24T23:39:22.814482+0000","last_clean":"2024-04-24T23:39:22.814482+0000","last_became_active":"2024-04-24T23:38:34.184827+0000","last_became_peered":"2024-04-24T23:38:34.184827+0000","last_unstale":"2024-04-24T23:39:22.814482+0000","last_undegraded":"2024-04-24T23:39:22.814482+0000","last_fullsized":"2024-04-24T23:39:22.814482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814372+0000","last_change":"2024-04-24T23:38:34.165830+0000","last_active":"2024-04-24T23:39:22.814372+0000","last_peered":"2024-04-24T23:39:22.814372+0000","last_clean":"2024-04-24T23:39:22.814372+0000","last_became_active":"2024-04-24T23:38:34.165531+0000","last_became_peered":"2024-04-24T23:38:34.165531+0000","last_unstale":"2024-04-24T23:39:22.814372+0000","last_undegraded":"2024-04-24T23:39:22.814372+0000","last_fullsized":"2024-04-24T23:39:22.814372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:57:25.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815294+0000","last_change":"2024-04-24T23:38:34.199810+0000","last_active":"2024-04-24T23:39:22.815294+0000","last_peered":"2024-04-24T23:39:22.815294+0000","last_clean":"2024-04-24T23:39:22.815294+0000","last_became_active":"2024-04-24T23:38:34.199173+0000","last_became_peered":"2024-04-24T23:38:34.199173+0000","last_unstale":"2024-04-24T23:39:22.815294+0000","last_undegraded":"2024-04-24T23:39:22.815294+0000","last_fullsized":"2024-04-24T23:39:22.815294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:27.147380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.946789+0000","last_change":"2024-04-24T23:38:34.165276+0000","last_active":"2024-04-24T23:39:22.946789+0000","last_peered":"2024-04-24T23:39:22.946789+0000","last_clean":"2024-04-24T23:39:22.946789+0000","last_became_active":"2024-04-24T23:38:34.165000+0000","last_became_peered":"2024-04-24T23:38:34.165000+0000","last_unstale":"2024-04-24T23:39:22.946789+0000","last_undegraded":"2024-04-24T23:39:22.946789+0000","last_fullsized":"2024-04-24T23:39:22.946789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:30:58.955608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816108+0000","last_change":"2024-04-24T23:38:34.146904+0000","last_active":"2024-04-24T23:39:22.816108+0000","last_peered":"2024-04-24T23:39:22.816108+0000","last_clean":"2024-04-24T23:39:22.816108+0000","last_became_active":"2024-04-24T23:38:34.146096+0000","last_became_peered":"2024-04-24T23:38:34.146096+0000","last_unstale":"2024-04-24T23:39:22.816108+0000","last_undegraded":"2024-04-24T23:39:22.816108+0000","last_fullsized":"2024-04-24T23:39:22.816108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:39.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.828011+0000","last_change":"2024-04-24T23:38:34.178750+0000","last_active":"2024-04-24T23:39:22.828011+0000","last_peered":"2024-04-24T23:39:22.828011+0000","last_clean":"2024-04-24T23:39:22.828011+0000","last_became_active":"2024-04-24T23:38:34.177451+0000","last_became_peered":"2024-04-24T23:38:34.177451+0000","last_unstale":"2024-04-24T23:39:22.828011+0000","last_undegraded":"2024-04-24T23:39:22.828011+0000","last_fullsized":"2024-04-24T23:39:22.828011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:43.814245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821128+0000","last_change":"2024-04-24T23:38:34.160937+0000","last_active":"2024-04-24T23:39:22.821128+0000","last_peered":"2024-04-24T23:39:22.821128+0000","last_clean":"2024-04-24T23:39:22.821128+0000","last_became_active":"2024-04-24T23:38:34.159252+0000","last_became_peered":"2024-04-24T23:38:34.159252+0000","last_unstale":"2024-04-24T23:39:22.821128+0000","last_undegraded":"2024-04-24T23:39:22.821128+0000","last_fullsized":"2024-04-24T23:39:22.821128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:10.585665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817749+0000","last_change":"2024-04-24T23:38:34.199973+0000","last_active":"2024-04-24T23:39:22.817749+0000","last_peered":"2024-04-24T23:39:22.817749+0000","last_clean":"2024-04-24T23:39:22.817749+0000","last_became_active":"2024-04-24T23:38:34.199464+0000","last_became_peered":"2024-04-24T23:38:34.199464+0000","last_unstale":"2024-04-24T23:39:22.817749+0000","last_undegraded":"2024-04-24T23:39:22.817749+0000","last_fullsized":"2024-04-24T23:39:22.817749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:14.879972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814510+0000","last_change":"2024-04-24T23:38:34.182144+0000","last_active":"2024-04-24T23:39:22.814510+0000","last_peered":"2024-04-24T23:39:22.814510+0000","last_clean":"2024-04-24T23:39:22.814510+0000","last_became_active":"2024-04-24T23:38:34.181459+0000","last_became_peered":"2024-04-24T23:38:34.181459+0000","last_unstale":"2024-04-24T23:39:22.814510+0000","last_undegraded":"2024-04-24T23:39:22.814510+0000","last_fullsized":"2024-04-24T23:39:22.814510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822224+0000","last_change":"2024-04-24T23:38:34.150090+0000","last_active":"2024-04-24T23:39:22.822224+0000","last_peered":"2024-04-24T23:39:22.822224+0000","last_clean":"2024-04-24T23:39:22.822224+0000","last_became_active":"2024-04-24T23:38:34.149272+0000","last_became_peered":"2024-04-24T23:38:34.149272+0000","last_unstale":"2024-04-24T23:39:22.822224+0000","last_undegraded":"2024-04-24T23:39:22.822224+0000","last_fullsized":"2024-04-24T23:39:22.822224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:57:25.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.946633+0000","last_change":"2024-04-24T23:38:34.155641+0000","last_active":"2024-04-24T23:39:22.946633+0000","last_peered":"2024-04-24T23:39:22.946633+0000","last_clean":"2024-04-24T23:39:22.946633+0000","last_became_active":"2024-04-24T23:38:34.153683+0000","last_became_peered":"2024-04-24T23:38:34.153683+0000","last_unstale":"2024-04-24T23:39:22.946633+0000","last_undegraded":"2024-04-24T23:39:22.946633+0000","last_fullsized":"2024-04-24T23:39:22.946633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:24.354101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814424+0000","last_change":"2024-04-24T23:38:34.173601+0000","last_active":"2024-04-24T23:39:22.814424+0000","last_peered":"2024-04-24T23:39:22.814424+0000","last_clean":"2024-04-24T23:39:22.814424+0000","last_became_active":"2024-04-24T23:38:34.165764+0000","last_became_peered":"2024-04-24T23:38:34.165764+0000","last_unstale":"2024-04-24T23:39:22.814424+0000","last_undegraded":"2024-04-24T23:39:22.814424+0000","last_fullsized":"2024-04-24T23:39:22.814424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822583+0000","last_change":"2024-04-24T23:38:34.142409+0000","last_active":"2024-04-24T23:39:22.822583+0000","last_peered":"2024-04-24T23:39:22.822583+0000","last_clean":"2024-04-24T23:39:22.822583+0000","last_became_active":"2024-04-24T23:38:34.141699+0000","last_became_peered":"2024-04-24T23:38:34.141699+0000","last_unstale":"2024-04-24T23:39:22.822583+0000","last_undegraded":"2024-04-24T23:39:22.822583+0000","last_fullsized":"2024-04-24T23:39:22.822583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:53.017909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817092+0000","last_change":"2024-04-24T23:38:34.155964+0000","last_active":"2024-04-24T23:39:22.817092+0000","last_peered":"2024-04-24T23:39:22.817092+0000","last_clean":"2024-04-24T23:39:22.817092+0000","last_became_active":"2024-04-24T23:38:34.155106+0000","last_became_peered":"2024-04-24T23:38:34.155106+0000","last_unstale":"2024-04-24T23:39:22.817092+0000","last_undegraded":"2024-04-24T23:39:22.817092+0000","last_fullsized":"2024-04-24T23:39:22.817092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817444+0000","last_change":"2024-04-24T23:38:34.157245+0000","last_active":"2024-04-24T23:39:22.817444+0000","last_peered":"2024-04-24T23:39:22.817444+0000","last_clean":"2024-04-24T23:39:22.817444+0000","last_became_active":"2024-04-24T23:38:34.156452+0000","last_became_peered":"2024-04-24T23:38:34.156452+0000","last_unstale":"2024-04-24T23:39:22.817444+0000","last_undegraded":"2024-04-24T23:39:22.817444+0000","last_fullsized":"2024-04-24T23:39:22.817444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.831864+0000","last_change":"2024-04-24T23:39:22.831864+0000","last_active":"2024-04-24T23:39:22.831864+0000","last_peered":"2024-04-24T23:39:22.831864+0000","last_clean":"2024-04-24T23:39:22.831864+0000","last_became_active":"2024-04-24T23:39:22.830955+0000","last_became_peered":"2024-04-24T23:39:22.830955+0000","last_unstale":"2024-04-24T23:39:22.831864+0000","last_undegraded":"2024-04-24T23:39:22.831864+0000","last_fullsized":"2024-04-24T23:39:22.831864+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:14:35.422279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.813772+0000","last_change":"2024-04-24T23:38:34.184693+0000","last_active":"2024-04-24T23:39:22.813772+0000","last_peered":"2024-04-24T23:39:22.813772+0000","last_clean":"2024-04-24T23:39:22.813772+0000","last_became_active":"2024-04-24T23:38:34.184367+0000","last_became_peered":"2024-04-24T23:38:34.184367+0000","last_unstale":"2024-04-24T23:39:22.813772+0000","last_undegraded":"2024-04-24T23:39:22.813772+0000","last_fullsized":"2024-04-24T23:39:22.813772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:30:58.955608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.824737+0000","last_change":"2024-04-24T23:38:34.176406+0000","last_active":"2024-04-24T23:39:22.824737+0000","last_peered":"2024-04-24T23:39:22.824737+0000","last_clean":"2024-04-24T23:39:22.824737+0000","last_became_active":"2024-04-24T23:38:34.165882+0000","last_became_peered":"2024-04-24T23:38:34.165882+0000","last_unstale":"2024-04-24T23:39:22.824737+0000","last_undegraded":"2024-04-24T23:39:22.824737+0000","last_fullsized":"2024-04-24T23:39:22.824737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:09:44.182605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815044+0000","last_change":"2024-04-24T23:38:34.184368+0000","last_active":"2024-04-24T23:39:22.815044+0000","last_peered":"2024-04-24T23:39:22.815044+0000","last_clean":"2024-04-24T23:39:22.815044+0000","last_became_active":"2024-04-24T23:38:34.183652+0000","last_became_peered":"2024-04-24T23:38:34.183652+0000","last_unstale":"2024-04-24T23:39:22.815044+0000","last_undegraded":"2024-04-24T23:39:22.815044+0000","last_fullsized":"2024-04-24T23:39:22.815044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:57.767771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.826002+0000","last_change":"2024-04-24T23:38:34.176656+0000","last_active":"2024-04-24T23:39:22.826002+0000","last_peered":"2024-04-24T23:39:22.826002+0000","last_clean":"2024-04-24T23:39:22.826002+0000","last_became_active":"2024-04-24T23:38:34.165931+0000","last_became_peered":"2024-04-24T23:38:34.165931+0000","last_unstale":"2024-04-24T23:39:22.826002+0000","last_undegraded":"2024-04-24T23:39:22.826002+0000","last_fullsized":"2024-04-24T23:39:22.826002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:14.879972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.829857+0000","last_change":"2024-04-24T23:39:22.826478+0000","last_active":"2024-04-24T23:39:22.829857+0000","last_peered":"2024-04-24T23:39:22.829857+0000","last_clean":"2024-04-24T23:39:22.829857+0000","last_became_active":"2024-04-24T23:39:22.825554+0000","last_became_peered":"2024-04-24T23:39:22.825554+0000","last_unstale":"2024-04-24T23:39:22.829857+0000","last_undegraded":"2024-04-24T23:39:22.829857+0000","last_fullsized":"2024-04-24T23:39:22.829857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:25.599734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947075+0000","last_change":"2024-04-24T23:38:34.150280+0000","last_active":"2024-04-24T23:39:22.947075+0000","last_peered":"2024-04-24T23:39:22.947075+0000","last_clean":"2024-04-24T23:39:22.947075+0000","last_became_active":"2024-04-24T23:38:34.148402+0000","last_became_peered":"2024-04-24T23:38:34.148402+0000","last_unstale":"2024-04-24T23:39:22.947075+0000","last_undegraded":"2024-04-24T23:39:22.947075+0000","last_fullsized":"2024-04-24T23:39:22.947075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:29.660159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.823743+0000","last_change":"2024-04-24T23:38:34.151749+0000","last_active":"2024-04-24T23:39:22.823743+0000","last_peered":"2024-04-24T23:39:22.823743+0000","last_clean":"2024-04-24T23:39:22.823743+0000","last_became_active":"2024-04-24T23:38:34.150987+0000","last_became_peered":"2024-04-24T23:38:34.150987+0000","last_unstale":"2024-04-24T23:39:22.823743+0000","last_undegraded":"2024-04-24T23:39:22.823743+0000","last_fullsized":"2024-04-24T23:39:22.823743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.828358+0000","last_change":"2024-04-24T23:38:34.194857+0000","last_active":"2024-04-24T23:39:22.828358+0000","last_peered":"2024-04-24T23:39:22.828358+0000","last_clean":"2024-04-24T23:39:22.828358+0000","last_became_active":"2024-04-24T23:38:34.194195+0000","last_became_peered":"2024-04-24T23:38:34.194195+0000","last_unstale":"2024-04-24T23:39:22.828358+0000","last_undegraded":"2024-04-24T23:39:22.828358+0000","last_fullsized":"2024-04-24T23:39:22.828358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:29:51.981646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":10368,"num_write":165,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40216,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":83,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":80432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67594,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31516,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":348160,"data_stored":705319,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":327680,"data_stored":153678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":114459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":290816,"data_stored":114495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31500,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340340,"statfs":{"total":96636764160,"available":96604508160,"internally_reserved":0,"allocated":331776,"data_stored":153787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":282624,"data_stored":114478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":114529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":356352,"data_stored":705375,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":39418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":39309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:40:05.393 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:40:05.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.560+0000 7f5354adb640 1 Processor -- start 2024-04-24T23:40:05.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.560+0000 7f5354adb640 1 -- start start 2024-04-24T23:40:05.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.560+0000 7f5354adb640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f53500a6350 0x7f53500a6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:05.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.560+0000 7f5354adb640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f53500c3240 0x7f53500c1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:05.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.560+0000 7f5354adb640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53500a39c0 con 0x7f53500a3230 2024-04-24T23:40:05.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.560+0000 7f5354adb640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f53500c0ca0 con 0x7f53500c3240 2024-04-24T23:40:05.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.560+0000 7f5354adb640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f53501528c0 con 0x7f53500a6350 2024-04-24T23:40:05.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.560+0000 7f534dd9b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f53500c3240 0x7f53500c1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:05.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.560+0000 7f534ed9d640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f53500a3230 0x7f53500bf9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37688/0 (socket says 172.21.15.57:37688) 2024-04-24T23:40:05.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.560+0000 7f534ed9d640 1 -- 172.21.15.57:0/735260831 learned_addr learned my addr 172.21.15.57:0/735260831 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:40:05.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.560+0000 7f534e59c640 1 --2- 172.21.15.57:0/735260831 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f53500a6350 0x7f53500a6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:05.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.560+0000 7f534d59a640 1 -- 172.21.15.57:0/735260831 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1345028067 0 0) 0x7f53500a39c0 con 0x7f53500a3230 2024-04-24T23:40:05.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.560+0000 7f534d59a640 1 -- 172.21.15.57:0/735260831 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f533c003530 con 0x7f53500a3230 2024-04-24T23:40:05.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.560+0000 7f534dd9b640 1 -- 172.21.15.57:0/735260831 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f53500a6350 msgr2=0x7f53500a6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:05.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.560+0000 7f534dd9b640 1 --2- 172.21.15.57:0/735260831 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f53500a6350 0x7f53500a6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:05.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.560+0000 7f534dd9b640 1 -- 172.21.15.57:0/735260831 >> v1:172.21.15.57:6789/0 conn(0x7f53500a3230 legacy=0x7f53500bf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:05.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.560+0000 7f534dd9b640 1 -- 172.21.15.57:0/735260831 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53500c0930 con 0x7f53500c3240 2024-04-24T23:40:05.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.560+0000 7f534e59c640 1 --2- 172.21.15.57:0/735260831 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f53500a6350 0x7f53500a6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:40:05.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.564+0000 7f534dd9b640 1 --2- 172.21.15.57:0/735260831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53500c3240 0x7f53500c1130 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f53380097c0 tx=0x7f533801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67915af0518ecbda server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:05.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.564+0000 7f534d59a640 1 -- 172.21.15.57:0/735260831 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53380b0070 con 0x7f53500c3240 2024-04-24T23:40:05.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.564+0000 7f534d59a640 1 -- 172.21.15.57:0/735260831 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53380ab600 con 0x7f53500c3240 2024-04-24T23:40:05.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.564+0000 7f534d59a640 1 -- 172.21.15.57:0/735260831 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53380ab9b0 con 0x7f53500c3240 2024-04-24T23:40:05.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.564+0000 7f5354adb640 1 -- 172.21.15.57:0/735260831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53500c3240 msgr2=0x7f53500c1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:05.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.564+0000 7f5354adb640 1 --2- 172.21.15.57:0/735260831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53500c3240 0x7f53500c1130 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f53380097c0 tx=0x7f533801c4a0 comp rx=0 tx=0).stop 2024-04-24T23:40:05.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.564+0000 7f5354adb640 1 -- 172.21.15.57:0/735260831 shutdown_connections 2024-04-24T23:40:05.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.564+0000 7f5354adb640 1 --2- 172.21.15.57:0/735260831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53500c3240 0x7f53500c1130 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:05.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.564+0000 7f5354adb640 1 --2- 172.21.15.57:0/735260831 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f53500a6350 0x7f53500a6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:05.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.564+0000 7f5354adb640 1 -- 172.21.15.57:0/735260831 >> 172.21.15.57:0/735260831 conn(0x7f535006b8a0 msgr2=0x7f53500a5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:05.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.564+0000 7f5354adb640 1 -- 172.21.15.57:0/735260831 shutdown_connections 2024-04-24T23:40:05.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.564+0000 7f5354adb640 1 -- 172.21.15.57:0/735260831 wait complete. 2024-04-24T23:40:05.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.564+0000 7f5354adb640 1 Processor -- start 2024-04-24T23:40:05.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.564+0000 7f5354adb640 1 -- start start 2024-04-24T23:40:05.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.564+0000 7f5354adb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53500a3230 0x7f535014f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:05.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.564+0000 7f5354adb640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53500a6350 0x7f53501ed630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:05.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.564+0000 7f5354adb640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f53500c3240 0x7f53501edb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:05.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.564+0000 7f5354adb640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5350071330 con 0x7f53500a6350 2024-04-24T23:40:05.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.564+0000 7f5354adb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f53500711b0 con 0x7f53500a3230 2024-04-24T23:40:05.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.564+0000 7f5354adb640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f53500714b0 con 0x7f53500c3240 2024-04-24T23:40:05.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.564+0000 7f534dd9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53500a6350 0x7f53501ed630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:05.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.564+0000 7f534dd9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53500a6350 0x7f53501ed630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39082/0 (socket says 172.21.15.57:39082) 2024-04-24T23:40:05.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.564+0000 7f534dd9b640 1 -- 172.21.15.57:0/3422943407 learned_addr learned my addr 172.21.15.57:0/3422943407 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:05.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.564+0000 7f534e59c640 1 --2- 172.21.15.57:0/3422943407 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53500a3230 0x7f535014f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:05.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.564+0000 7f534ed9d640 1 --2- 172.21.15.57:0/3422943407 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f53500c3240 0x7f53501edb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:05.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.568+0000 7f534dd9b640 1 -- 172.21.15.57:0/3422943407 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f53500c3240 msgr2=0x7f53501edb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:05.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.568+0000 7f534dd9b640 1 --2- 172.21.15.57:0/3422943407 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f53500c3240 0x7f53501edb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:05.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.568+0000 7f534dd9b640 1 -- 172.21.15.57:0/3422943407 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53500a3230 msgr2=0x7f535014f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:05.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.568+0000 7f534dd9b640 1 --2- 172.21.15.57:0/3422943407 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53500a3230 0x7f535014f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:05.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.568+0000 7f534dd9b640 1 -- 172.21.15.57:0/3422943407 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f535014adf0 con 0x7f53500a6350 2024-04-24T23:40:05.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.568+0000 7f534dd9b640 1 --2- 172.21.15.57:0/3422943407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53500a6350 0x7f53501ed630 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f533801a0d0 tx=0x7f5338019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:05.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.568+0000 7f5346ffd640 1 -- 172.21.15.57:0/3422943407 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53380ba070 con 0x7f53500a6350 2024-04-24T23:40:05.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.568+0000 7f5346ffd640 1 -- 172.21.15.57:0/3422943407 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53380ab9b0 con 0x7f53500a6350 2024-04-24T23:40:05.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.568+0000 7f5346ffd640 1 -- 172.21.15.57:0/3422943407 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53380b0040 con 0x7f53500a6350 2024-04-24T23:40:05.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.568+0000 7f5354adb640 1 -- 172.21.15.57:0/3422943407 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f535014b070 con 0x7f53500a6350 2024-04-24T23:40:05.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.568+0000 7f5354adb640 1 -- 172.21.15.57:0/3422943407 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f535014f620 con 0x7f53500a6350 2024-04-24T23:40:05.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.568+0000 7f5354adb640 1 -- 172.21.15.57:0/3422943407 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f535014ea20 con 0x7f53500a6350 2024-04-24T23:40:05.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.568+0000 7f5346ffd640 1 -- 172.21.15.57:0/3422943407 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f53380bd070 con 0x7f53500a6350 2024-04-24T23:40:05.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.568+0000 7f5346ffd640 1 --2- 172.21.15.57:0/3422943407 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f53300678c0 0x7f5330069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:05.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.568+0000 7f5346ffd640 1 -- 172.21.15.57:0/3422943407 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f533811f0d0 con 0x7f53500a6350 2024-04-24T23:40:05.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.568+0000 7f534e59c640 1 --2- 172.21.15.57:0/3422943407 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f53300678c0 0x7f5330069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:05.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.568+0000 7f534e59c640 1 --2- 172.21.15.57:0/3422943407 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f53300678c0 0x7f5330069d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5340003b90 tx=0x7f5340009890 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:05.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.572+0000 7f5346ffd640 1 -- 172.21.15.57:0/3422943407 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f535014adf0 con 0x7f53500a6350 2024-04-24T23:40:05.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.736+0000 7f5354adb640 1 -- 172.21.15.57:0/3422943407 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f535014e7c0 con 0x7f53500a6350 2024-04-24T23:40:05.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.736+0000 7f5346ffd640 1 -- 172.21.15.57:0/3422943407 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18853 (secure 0 0 0) 0x7f5338016090 con 0x7f53500a6350 2024-04-24T23:40:05.739 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:40:05.739 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"fsid":"1ea31698-444a-4667-bcd9-b2608ad103c3","created":"2024-04-24T23:38:16.748774+0000","modified":"2024-04-24T23:39:22.806760+0000","last_up_change":"2024-04-24T23:38:26.956537+0000","last_in_change":"2024-04-24T23:38:18.972175+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:38:27.611782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:38:31.718061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:38:32.469413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:38:36.215724+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"35ce67bc-9b25-416e-ab1e-774c717631f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6825","nonce":671364028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6827","nonce":671364028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6831","nonce":671364028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6829","nonce":671364028}]},"public_addr":"172.21.15.57:6825/671364028","cluster_addr":"172.21.15.57:6827/671364028","heartbeat_back_addr":"172.21.15.57:6831/671364028","heartbeat_front_addr":"172.21.15.57:6829/671364028","state":["exists","up"]},{"osd":1,"uuid":"38f6f4ef-3bc2-4453-9946-7d1d17e735ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6801","nonce":2653552037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6803","nonce":2653552037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6807","nonce":2653552037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6805","nonce":2653552037}]},"public_addr":"172.21.15.57:6801/2653552037","cluster_addr":"172.21.15.57:6803/2653552037","heartbeat_back_addr":"172.21.15.57:6807/2653552037","heartbeat_front_addr":"172.21.15.57:6805/2653552037","state":["exists","up"]},{"osd":2,"uuid":"d77a0a49-b39a-464e-a1c9-49e19280c440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6816","nonce":1565874109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6819","nonce":1565874109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6823","nonce":1565874109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6821","nonce":1565874109}]},"public_addr":"172.21.15.57:6816/1565874109","cluster_addr":"172.21.15.57:6819/1565874109","heartbeat_back_addr":"172.21.15.57:6823/1565874109","heartbeat_front_addr":"172.21.15.57:6821/1565874109","state":["exists","up"]},{"osd":3,"uuid":"f8ea9bfe-d839-44a6-a185-0f0985da314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6809","nonce":3474703186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6811","nonce":3474703186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6817","nonce":3474703186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6813","nonce":3474703186}]},"public_addr":"172.21.15.57:6809/3474703186","cluster_addr":"172.21.15.57:6811/3474703186","heartbeat_back_addr":"172.21.15.57:6817/3474703186","heartbeat_front_addr":"172.21.15.57:6813/3474703186","state":["exists","up"]},{"osd":4,"uuid":"454647d4-6ac2-46b4-8451-320eb951a87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6801","nonce":1271707713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6803","nonce":1271707713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6807","nonce":1271707713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6805","nonce":1271707713}]},"public_addr":"172.21.15.88:6801/1271707713","cluster_addr":"172.21.15.88:6803/1271707713","heartbeat_back_addr":"172.21.15.88:6807/1271707713","heartbeat_front_addr":"172.21.15.88:6805/1271707713","state":["exists","up"]},{"osd":5,"uuid":"f71c03a3-7ad8-46d3-89c9-d61de102586b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6809","nonce":2035054888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6813","nonce":2035054888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6820","nonce":2035054888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6816","nonce":2035054888}]},"public_addr":"172.21.15.88:6809/2035054888","cluster_addr":"172.21.15.88:6813/2035054888","heartbeat_back_addr":"172.21.15.88:6820/2035054888","heartbeat_front_addr":"172.21.15.88:6816/2035054888","state":["exists","up"]},{"osd":6,"uuid":"ec7ae2b7-9cb4-4059-8f98-0022c9763f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6825","nonce":1752291242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6827","nonce":1752291242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6831","nonce":1752291242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6829","nonce":1752291242}]},"public_addr":"172.21.15.88:6825/1752291242","cluster_addr":"172.21.15.88:6827/1752291242","heartbeat_back_addr":"172.21.15.88:6831/1752291242","heartbeat_front_addr":"172.21.15.88:6829/1752291242","state":["exists","up"]},{"osd":7,"uuid":"c0ee7505-60c1-40ba-9902-47313a04dafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6812","nonce":1782800372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6817","nonce":1782800372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6823","nonce":1782800372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6821","nonce":1782800372}]},"public_addr":"172.21.15.88:6812/1782800372","cluster_addr":"172.21.15.88:6817/1782800372","heartbeat_back_addr":"172.21.15.88:6823/1782800372","heartbeat_front_addr":"172.21.15.88:6821/1782800372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.698562+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.682587+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.680197+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.561753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.011095+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.493320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.353451+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.423877+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:40:05.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.740+0000 7f5354adb640 1 -- 172.21.15.57:0/3422943407 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f53300678c0 msgr2=0x7f5330069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:05.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.740+0000 7f5354adb640 1 --2- 172.21.15.57:0/3422943407 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f53300678c0 0x7f5330069d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5340003b90 tx=0x7f5340009890 comp rx=0 tx=0).stop 2024-04-24T23:40:05.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.740+0000 7f5354adb640 1 -- 172.21.15.57:0/3422943407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53500a6350 msgr2=0x7f53501ed630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:05.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.740+0000 7f5354adb640 1 --2- 172.21.15.57:0/3422943407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53500a6350 0x7f53501ed630 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f533801a0d0 tx=0x7f5338019240 comp rx=0 tx=0).stop 2024-04-24T23:40:05.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.740+0000 7f5354adb640 1 -- 172.21.15.57:0/3422943407 shutdown_connections 2024-04-24T23:40:05.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.740+0000 7f5354adb640 1 --2- 172.21.15.57:0/3422943407 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f53300678c0 0x7f5330069d80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:05.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.740+0000 7f5354adb640 1 --2- 172.21.15.57:0/3422943407 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f53500c3240 0x7f53501edb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:05.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.740+0000 7f5354adb640 1 --2- 172.21.15.57:0/3422943407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53500a6350 0x7f53501ed630 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:05.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.740+0000 7f5354adb640 1 --2- 172.21.15.57:0/3422943407 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53500a3230 0x7f535014f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:05.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.740+0000 7f5354adb640 1 -- 172.21.15.57:0/3422943407 >> 172.21.15.57:0/3422943407 conn(0x7f535006b8a0 msgr2=0x7f5350159470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:05.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.740+0000 7f5354adb640 1 -- 172.21.15.57:0/3422943407 shutdown_connections 2024-04-24T23:40:05.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:05.740+0000 7f5354adb640 1 -- 172.21.15.57:0/3422943407 wait complete. 2024-04-24T23:40:06.759 INFO:tasks.ceph:Scrubbing osd.0 2024-04-24T23:40:06.760 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:40:06.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.896+0000 7f298f8ed640 1 Processor -- start 2024-04-24T23:40:06.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.896+0000 7f298f8ed640 1 -- start start 2024-04-24T23:40:06.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.896+0000 7f298f8ed640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f298814deb0 0x7f29880c2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:06.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.896+0000 7f298f8ed640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29880b8660 0x7f298815b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:06.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.896+0000 7f298f8ed640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2988151270 con 0x7f29880c3490 2024-04-24T23:40:06.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.896+0000 7f298f8ed640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f29880c0a90 con 0x7f298814deb0 2024-04-24T23:40:06.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.896+0000 7f298f8ed640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f29880c0d70 con 0x7f29880b8660 2024-04-24T23:40:06.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.896+0000 7f298d689640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f298814deb0 0x7f29880c2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:06.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.896+0000 7f298ce88640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f29880c3490 0x7f29880c1200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37704/0 (socket says 172.21.15.57:37704) 2024-04-24T23:40:06.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.896+0000 7f298ce88640 1 -- 172.21.15.57:0/2015511303 learned_addr learned my addr 172.21.15.57:0/2015511303 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:40:06.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.900+0000 7f298de8a640 1 --2- 172.21.15.57:0/2015511303 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29880b8660 0x7f298815b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:06.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.900+0000 7f298d689640 1 -- 172.21.15.57:0/2015511303 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29880b8660 msgr2=0x7f298815b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:06.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.900+0000 7f298d689640 1 --2- 172.21.15.57:0/2015511303 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29880b8660 0x7f298815b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:06.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.900+0000 7f298d689640 1 -- 172.21.15.57:0/2015511303 >> v1:172.21.15.57:6789/0 conn(0x7f29880c3490 legacy=0x7f29880c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:06.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.900+0000 7f298d689640 1 -- 172.21.15.57:0/2015511303 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2988151550 con 0x7f298814deb0 2024-04-24T23:40:06.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.900+0000 7f297ffff640 1 -- 172.21.15.57:0/2015511303 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1150182616 0 0) 0x7f2988151270 con 0x7f29880c3490 2024-04-24T23:40:06.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.900+0000 7f298d689640 1 --2- 172.21.15.57:0/2015511303 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f298814deb0 0x7f29880c2f50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f29840097c0 tx=0x7f298401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620f476fa9fa618f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:06.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.900+0000 7f297ffff640 1 -- 172.21.15.57:0/2015511303 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29840b5070 con 0x7f298814deb0 2024-04-24T23:40:06.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.900+0000 7f297ffff640 1 -- 172.21.15.57:0/2015511303 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29840a8990 con 0x7f298814deb0 2024-04-24T23:40:06.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.900+0000 7f297ffff640 1 -- 172.21.15.57:0/2015511303 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29840a8d60 con 0x7f298814deb0 2024-04-24T23:40:06.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.900+0000 7f298f8ed640 1 -- 172.21.15.57:0/2015511303 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f298814deb0 msgr2=0x7f29880c2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:06.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.900+0000 7f298f8ed640 1 --2- 172.21.15.57:0/2015511303 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f298814deb0 0x7f29880c2f50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f29840097c0 tx=0x7f298401ec90 comp rx=0 tx=0).stop 2024-04-24T23:40:06.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.900+0000 7f298f8ed640 1 -- 172.21.15.57:0/2015511303 shutdown_connections 2024-04-24T23:40:06.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.900+0000 7f298f8ed640 1 --2- 172.21.15.57:0/2015511303 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29880b8660 0x7f298815b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:06.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.900+0000 7f298f8ed640 1 --2- 172.21.15.57:0/2015511303 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f298814deb0 0x7f29880c2f50 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:06.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.900+0000 7f298f8ed640 1 -- 172.21.15.57:0/2015511303 >> 172.21.15.57:0/2015511303 conn(0x7f2988067120 msgr2=0x7f2988067530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:06.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.900+0000 7f298f8ed640 1 -- 172.21.15.57:0/2015511303 shutdown_connections 2024-04-24T23:40:06.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.900+0000 7f298f8ed640 1 -- 172.21.15.57:0/2015511303 wait complete. 2024-04-24T23:40:06.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.904+0000 7f298f8ed640 1 Processor -- start 2024-04-24T23:40:06.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.904+0000 7f298f8ed640 1 -- start start 2024-04-24T23:40:06.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.904+0000 7f298f8ed640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29880b8660 0x7f29880bd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:06.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.904+0000 7f298f8ed640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29880c3490 0x7f29880bc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:06.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.904+0000 7f298f8ed640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f298814deb0 0x7f2988153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:06.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.904+0000 7f298f8ed640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f29880c1910 con 0x7f29880b8660 2024-04-24T23:40:06.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.904+0000 7f298f8ed640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f298814e290 con 0x7f298814deb0 2024-04-24T23:40:06.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.904+0000 7f298f8ed640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f29880b91f0 con 0x7f29880c3490 2024-04-24T23:40:06.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.904+0000 7f298d689640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29880b8660 0x7f29880bd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:06.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.904+0000 7f298d689640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29880b8660 0x7f29880bd1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39098/0 (socket says 172.21.15.57:39098) 2024-04-24T23:40:06.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.904+0000 7f298d689640 1 -- 172.21.15.57:0/2484566443 learned_addr learned my addr 172.21.15.57:0/2484566443 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:06.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.904+0000 7f298ce88640 1 --2- 172.21.15.57:0/2484566443 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29880c3490 0x7f29880bc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:06.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.904+0000 7f298d689640 1 -- 172.21.15.57:0/2484566443 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29880c3490 msgr2=0x7f29880bc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:06.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.904+0000 7f298d689640 1 --2- 172.21.15.57:0/2484566443 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29880c3490 0x7f29880bc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:06.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.904+0000 7f298de8a640 1 --2- 172.21.15.57:0/2484566443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f298814deb0 0x7f2988153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:06.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.904+0000 7f298d689640 1 -- 172.21.15.57:0/2484566443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f298814deb0 msgr2=0x7f2988153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:06.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.904+0000 7f298d689640 1 --2- 172.21.15.57:0/2484566443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f298814deb0 0x7f2988153d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:06.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.904+0000 7f298d689640 1 -- 172.21.15.57:0/2484566443 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29880bcaf0 con 0x7f29880b8660 2024-04-24T23:40:06.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.904+0000 7f298d689640 1 --2- 172.21.15.57:0/2484566443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29880b8660 0x7f29880bd1e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f29840097c0 tx=0x7f298401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:06.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.904+0000 7f297dffb640 1 -- 172.21.15.57:0/2484566443 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29840c0070 con 0x7f29880b8660 2024-04-24T23:40:06.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.904+0000 7f297dffb640 1 -- 172.21.15.57:0/2484566443 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2984004230 con 0x7f29880b8660 2024-04-24T23:40:06.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.904+0000 7f297dffb640 1 -- 172.21.15.57:0/2484566443 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29840b5040 con 0x7f29880b8660 2024-04-24T23:40:06.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.904+0000 7f298f8ed640 1 -- 172.21.15.57:0/2484566443 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29881dd7f0 con 0x7f29880b8660 2024-04-24T23:40:06.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.904+0000 7f298f8ed640 1 -- 172.21.15.57:0/2484566443 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2988153510 con 0x7f29880b8660 2024-04-24T23:40:06.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.904+0000 7f298f8ed640 1 -- 172.21.15.57:0/2484566443 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2988068290 con 0x7f29880b8660 2024-04-24T23:40:06.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.908+0000 7f297dffb640 1 -- 172.21.15.57:0/2484566443 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2984003620 con 0x7f29880b8660 2024-04-24T23:40:06.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.908+0000 7f297dffb640 1 --2- 172.21.15.57:0/2484566443 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f296c0678c0 0x7f296c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:06.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.908+0000 7f297dffb640 1 -- 172.21.15.57:0/2484566443 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f2984122ee0 con 0x7f29880b8660 2024-04-24T23:40:06.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.908+0000 7f297dffb640 1 --2- 172.21.15.57:0/2484566443 >> [v2:172.21.15.57:6824/671364028,v1:172.21.15.57:6825/671364028] conn(0x7f296c0712e0 0x7f296c073780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:06.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.908+0000 7f297dffb640 1 -- 172.21.15.57:0/2484566443 --> [v2:172.21.15.57:6824/671364028,v1:172.21.15.57:6825/671364028] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f29840a9e50 con 0x7f296c0712e0 2024-04-24T23:40:06.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.908+0000 7f297dffb640 1 -- 172.21.15.57:0/2484566443 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f29841232d0 con 0x7f29880b8660 2024-04-24T23:40:06.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.908+0000 7f298de8a640 1 --2- 172.21.15.57:0/2484566443 >> [v2:172.21.15.57:6824/671364028,v1:172.21.15.57:6825/671364028] conn(0x7f296c0712e0 0x7f296c073780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:06.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.908+0000 7f298ce88640 1 --2- 172.21.15.57:0/2484566443 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f296c0678c0 0x7f296c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:06.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.908+0000 7f298de8a640 1 --2- 172.21.15.57:0/2484566443 >> [v2:172.21.15.57:6824/671364028,v1:172.21.15.57:6825/671364028] conn(0x7f296c0712e0 0x7f296c073780 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:06.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.908+0000 7f298ce88640 1 --2- 172.21.15.57:0/2484566443 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f296c0678c0 0x7f296c069d80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2988067c10 tx=0x7f2978009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:06.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.908+0000 7f297dffb640 1 -- 172.21.15.57:0/2484566443 <== osd.0 v2:172.21.15.57:6824/671364028 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f29840a9e50 con 0x7f296c0712e0 2024-04-24T23:40:06.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.924+0000 7f298f8ed640 1 -- 172.21.15.57:0/2484566443 --> [v2:172.21.15.57:6824/671364028,v1:172.21.15.57:6825/671364028] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f29881493e0 con 0x7f296c0712e0 2024-04-24T23:40:06.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.924+0000 7f297dffb640 1 -- 172.21.15.57:0/2484566443 <== osd.0 v2:172.21.15.57:6824/671364028 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f29881493e0 con 0x7f296c0712e0 2024-04-24T23:40:06.925 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-24T23:40:06.925 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:40:06.925 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-24T23:40:06.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.924+0000 7f298f8ed640 1 -- 172.21.15.57:0/2484566443 >> [v2:172.21.15.57:6824/671364028,v1:172.21.15.57:6825/671364028] conn(0x7f296c0712e0 msgr2=0x7f296c073780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:06.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.924+0000 7f298f8ed640 1 --2- 172.21.15.57:0/2484566443 >> [v2:172.21.15.57:6824/671364028,v1:172.21.15.57:6825/671364028] conn(0x7f296c0712e0 0x7f296c073780 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:06.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.924+0000 7f298f8ed640 1 -- 172.21.15.57:0/2484566443 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f296c0678c0 msgr2=0x7f296c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:06.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.924+0000 7f298f8ed640 1 --2- 172.21.15.57:0/2484566443 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f296c0678c0 0x7f296c069d80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2988067c10 tx=0x7f2978009040 comp rx=0 tx=0).stop 2024-04-24T23:40:06.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.924+0000 7f298f8ed640 1 -- 172.21.15.57:0/2484566443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29880b8660 msgr2=0x7f29880bd1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:06.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.924+0000 7f298f8ed640 1 --2- 172.21.15.57:0/2484566443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29880b8660 0x7f29880bd1e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f29840097c0 tx=0x7f298401ba30 comp rx=0 tx=0).stop 2024-04-24T23:40:06.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.924+0000 7f298de8a640 1 -- 172.21.15.57:0/2484566443 reap_dead start 2024-04-24T23:40:06.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.924+0000 7f298f8ed640 1 -- 172.21.15.57:0/2484566443 shutdown_connections 2024-04-24T23:40:06.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.924+0000 7f298f8ed640 1 -- 172.21.15.57:0/2484566443 >> 172.21.15.57:0/2484566443 conn(0x7f2988067120 msgr2=0x7f298814b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:06.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.924+0000 7f298f8ed640 1 -- 172.21.15.57:0/2484566443 shutdown_connections 2024-04-24T23:40:06.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:06.924+0000 7f298f8ed640 1 -- 172.21.15.57:0/2484566443 wait complete. 2024-04-24T23:40:06.941 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-24T23:40:07.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.056+0000 7f537003f640 1 Processor -- start 2024-04-24T23:40:07.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.060+0000 7f537003f640 1 -- start start 2024-04-24T23:40:07.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.060+0000 7f537003f640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f536806e390 0x7f536815a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:07.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.060+0000 7f537003f640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53680b7520 con 0x7f53680bc7f0 2024-04-24T23:40:07.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.060+0000 7f537003f640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53680b7ae0 con 0x7f536814bdc0 2024-04-24T23:40:07.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.060+0000 7f537003f640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f536814f470 con 0x7f536806e390 2024-04-24T23:40:07.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.060+0000 7f536e5dc640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f536806e390 0x7f536815a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:07.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.060+0000 7f536d5da640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f53680bc7f0 0x7f536806dc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37712/0 (socket says 172.21.15.57:37712) 2024-04-24T23:40:07.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.060+0000 7f536d5da640 1 -- 172.21.15.57:0/1968921599 learned_addr learned my addr 172.21.15.57:0/1968921599 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:40:07.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.060+0000 7f536e5dc640 1 -- 172.21.15.57:0/1968921599 >> v1:172.21.15.88:6789/0 conn(0x7f536814bdc0 legacy=0x7f53680b6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:07.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.060+0000 7f536e5dc640 1 -- 172.21.15.57:0/1968921599 >> v1:172.21.15.57:6789/0 conn(0x7f53680bc7f0 legacy=0x7f536806dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:07.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.060+0000 7f536e5dc640 1 -- 172.21.15.57:0/1968921599 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f536814c1a0 con 0x7f536806e390 2024-04-24T23:40:07.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.060+0000 7f536e5dc640 1 --2- 172.21.15.57:0/1968921599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f536806e390 0x7f536815a070 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5360009d90 tx=0x7f536001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b0c25bc08e5322 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:07.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f536cdd9640 1 -- 172.21.15.57:0/1968921599 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53600b2070 con 0x7f536806e390 2024-04-24T23:40:07.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f536cdd9640 1 -- 172.21.15.57:0/1968921599 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53600a58b0 con 0x7f536806e390 2024-04-24T23:40:07.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f536cdd9640 1 -- 172.21.15.57:0/1968921599 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53600a5c80 con 0x7f536806e390 2024-04-24T23:40:07.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f537003f640 1 -- 172.21.15.57:0/1968921599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f536806e390 msgr2=0x7f536815a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:07.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f537003f640 1 --2- 172.21.15.57:0/1968921599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f536806e390 0x7f536815a070 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5360009d90 tx=0x7f536001c8e0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f537003f640 1 -- 172.21.15.57:0/1968921599 shutdown_connections 2024-04-24T23:40:07.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f537003f640 1 --2- 172.21.15.57:0/1968921599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f536806e390 0x7f536815a070 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f537003f640 1 -- 172.21.15.57:0/1968921599 >> 172.21.15.57:0/1968921599 conn(0x7f53680be8f0 msgr2=0x7f53680bed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:07.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f537003f640 1 -- 172.21.15.57:0/1968921599 shutdown_connections 2024-04-24T23:40:07.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f537003f640 1 -- 172.21.15.57:0/1968921599 wait complete. 2024-04-24T23:40:07.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f537003f640 1 Processor -- start 2024-04-24T23:40:07.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f537003f640 1 -- start start 2024-04-24T23:40:07.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f537003f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f536806e390 0x7f53680c0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:07.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f537003f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53680bc7f0 0x7f53681e9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:07.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f537003f640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f536814bdc0 0x7f53681e9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:07.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f537003f640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f53680b7dc0 con 0x7f536806e390 2024-04-24T23:40:07.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f537003f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f53680b7890 con 0x7f53680bc7f0 2024-04-24T23:40:07.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f537003f640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f536815cdd0 con 0x7f536814bdc0 2024-04-24T23:40:07.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f536dddb640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f536806e390 0x7f53680c0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:07.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f536dddb640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f536806e390 0x7f53680c0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39108/0 (socket says 172.21.15.57:39108) 2024-04-24T23:40:07.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f536dddb640 1 -- 172.21.15.57:0/3830632846 learned_addr learned my addr 172.21.15.57:0/3830632846 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:07.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f536d5da640 1 --2- 172.21.15.57:0/3830632846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53680bc7f0 0x7f53681e9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:07.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f536e5dc640 1 --2- 172.21.15.57:0/3830632846 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f536814bdc0 0x7f53681e9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:07.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f536dddb640 1 -- 172.21.15.57:0/3830632846 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f536814bdc0 msgr2=0x7f53681e9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:07.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f536dddb640 1 --2- 172.21.15.57:0/3830632846 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f536814bdc0 0x7f53681e9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f536dddb640 1 -- 172.21.15.57:0/3830632846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53680bc7f0 msgr2=0x7f53681e9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:07.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f536dddb640 1 --2- 172.21.15.57:0/3830632846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53680bc7f0 0x7f53681e9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f536dddb640 1 -- 172.21.15.57:0/3830632846 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5368072c50 con 0x7f536806e390 2024-04-24T23:40:07.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f536dddb640 1 --2- 172.21.15.57:0/3830632846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f536806e390 0x7f53680c0e00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f536400c420 tx=0x7f536400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:07.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f535e7fc640 1 -- 172.21.15.57:0/3830632846 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53640052d0 con 0x7f536806e390 2024-04-24T23:40:07.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f535e7fc640 1 -- 172.21.15.57:0/3830632846 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5364005470 con 0x7f536806e390 2024-04-24T23:40:07.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f537003f640 1 -- 172.21.15.57:0/3830632846 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5368072f30 con 0x7f536806e390 2024-04-24T23:40:07.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f535e7fc640 1 -- 172.21.15.57:0/3830632846 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5364007260 con 0x7f536806e390 2024-04-24T23:40:07.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.064+0000 7f537003f640 1 -- 172.21.15.57:0/3830632846 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5368152ab0 con 0x7f536806e390 2024-04-24T23:40:07.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.068+0000 7f537003f640 1 -- 172.21.15.57:0/3830632846 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5368068220 con 0x7f536806e390 2024-04-24T23:40:07.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.068+0000 7f535e7fc640 1 -- 172.21.15.57:0/3830632846 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5364007400 con 0x7f536806e390 2024-04-24T23:40:07.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.068+0000 7f535e7fc640 1 --2- 172.21.15.57:0/3830632846 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f534c0678c0 0x7f534c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:07.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.068+0000 7f535e7fc640 1 -- 172.21.15.57:0/3830632846 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f5364085630 con 0x7f536806e390 2024-04-24T23:40:07.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.068+0000 7f536d5da640 1 --2- 172.21.15.57:0/3830632846 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f534c0678c0 0x7f534c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:07.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.068+0000 7f536d5da640 1 --2- 172.21.15.57:0/3830632846 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f534c0678c0 0x7f534c069d80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f536806bc10 tx=0x7f5358009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:07.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.072+0000 7f535e7fc640 1 -- 172.21.15.57:0/3830632846 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f5364055cd0 con 0x7f536806e390 2024-04-24T23:40:07.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.236+0000 7f537003f640 1 -- 172.21.15.57:0/3830632846 --> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f536806da60 con 0x7f534c0678c0 2024-04-24T23:40:07.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.236+0000 7f535e7fc640 1 -- 172.21.15.57:0/3830632846 <== mgr.4105 v2:172.21.15.88:6832/3931748276 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f536806da60 con 0x7f534c0678c0 2024-04-24T23:40:07.239 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 0 to deep-scrub 2024-04-24T23:40:07.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.240+0000 7f537003f640 1 -- 172.21.15.57:0/3830632846 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f534c0678c0 msgr2=0x7f534c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:07.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.240+0000 7f537003f640 1 --2- 172.21.15.57:0/3830632846 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f534c0678c0 0x7f534c069d80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f536806bc10 tx=0x7f5358009040 comp rx=0 tx=0).stop 2024-04-24T23:40:07.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.240+0000 7f537003f640 1 -- 172.21.15.57:0/3830632846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f536806e390 msgr2=0x7f53680c0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:07.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.240+0000 7f537003f640 1 --2- 172.21.15.57:0/3830632846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f536806e390 0x7f53680c0e00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f536400c420 tx=0x7f536400c8e0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.240+0000 7f537003f640 1 -- 172.21.15.57:0/3830632846 shutdown_connections 2024-04-24T23:40:07.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.240+0000 7f537003f640 1 --2- 172.21.15.57:0/3830632846 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f534c0678c0 0x7f534c069d80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.240+0000 7f537003f640 1 --2- 172.21.15.57:0/3830632846 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f536814bdc0 0x7f53681e9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.240+0000 7f537003f640 1 --2- 172.21.15.57:0/3830632846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53680bc7f0 0x7f53681e9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.240+0000 7f537003f640 1 --2- 172.21.15.57:0/3830632846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f536806e390 0x7f53680c0e00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.240+0000 7f537003f640 1 -- 172.21.15.57:0/3830632846 >> 172.21.15.57:0/3830632846 conn(0x7f53680be8f0 msgr2=0x7f53681464e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:07.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.240+0000 7f537003f640 1 -- 172.21.15.57:0/3830632846 shutdown_connections 2024-04-24T23:40:07.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.240+0000 7f537003f640 1 -- 172.21.15.57:0/3830632846 wait complete. 2024-04-24T23:40:07.258 INFO:tasks.ceph:Scrubbing osd.1 2024-04-24T23:40:07.258 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:40:07.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.376+0000 7f0ccc151640 1 Processor -- start 2024-04-24T23:40:07.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.376+0000 7f0ccc151640 1 -- start start 2024-04-24T23:40:07.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.376+0000 7f0ccc151640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0cc406c480 0x7f0cc406fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:07.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.376+0000 7f0ccc151640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0cc414bc70 0x7f0cc414c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:07.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.376+0000 7f0ccc151640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cc4070390 con 0x7f0cc40675b0 2024-04-24T23:40:07.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.376+0000 7f0ccc151640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f0cc4072d70 con 0x7f0cc414bc70 2024-04-24T23:40:07.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.376+0000 7f0ccc151640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f0cc40728e0 con 0x7f0cc406c480 2024-04-24T23:40:07.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.376+0000 7f0cca6ee640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0cc414bc70 0x7f0cc414c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:07.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.376+0000 7f0cc96ec640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0cc40675b0 0x7f0cc414f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37720/0 (socket says 172.21.15.57:37720) 2024-04-24T23:40:07.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.376+0000 7f0cc96ec640 1 -- 172.21.15.57:0/2632293981 learned_addr learned my addr 172.21.15.57:0/2632293981 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:40:07.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.376+0000 7f0cc9eed640 1 --2- 172.21.15.57:0/2632293981 >> v2:172.21.15.88:3300/0 conn(0x7f0cc406c480 0x7f0cc406fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:07.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.376+0000 7f0cca6ee640 1 -- 172.21.15.57:0/2632293981 >> v2:172.21.15.88:3300/0 conn(0x7f0cc406c480 msgr2=0x7f0cc406fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:07.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.376+0000 7f0cca6ee640 1 --2- 172.21.15.57:0/2632293981 >> v2:172.21.15.88:3300/0 conn(0x7f0cc406c480 0x7f0cc406fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.376+0000 7f0cca6ee640 1 -- 172.21.15.57:0/2632293981 >> v1:172.21.15.57:6789/0 conn(0x7f0cc40675b0 legacy=0x7f0cc414f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:07.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.376+0000 7f0cc8eeb640 1 -- 172.21.15.57:0/2632293981 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4076149349 0 0) 0x7f0cc4070390 con 0x7f0cc40675b0 2024-04-24T23:40:07.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.376+0000 7f0cca6ee640 1 -- 172.21.15.57:0/2632293981 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc4071b60 con 0x7f0cc414bc70 2024-04-24T23:40:07.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.380+0000 7f0cca6ee640 1 --2- 172.21.15.57:0/2632293981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cc414bc70 0x7f0cc414c100 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0cc40a8be0 tx=0x7f0cb401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3effce199c69a570 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:07.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.380+0000 7f0cc8eeb640 1 -- 172.21.15.57:0/2632293981 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb40aa600 con 0x7f0cc414bc70 2024-04-24T23:40:07.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.380+0000 7f0cc8eeb640 1 -- 172.21.15.57:0/2632293981 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb40af070 con 0x7f0cc414bc70 2024-04-24T23:40:07.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.380+0000 7f0cc8eeb640 1 -- 172.21.15.57:0/2632293981 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb40aa9c0 con 0x7f0cc414bc70 2024-04-24T23:40:07.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.380+0000 7f0ccc151640 1 -- 172.21.15.57:0/2632293981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cc414bc70 msgr2=0x7f0cc414c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:07.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.380+0000 7f0ccc151640 1 --2- 172.21.15.57:0/2632293981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cc414bc70 0x7f0cc414c100 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0cc40a8be0 tx=0x7f0cb401c480 comp rx=0 tx=0).stop 2024-04-24T23:40:07.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.380+0000 7f0ccc151640 1 -- 172.21.15.57:0/2632293981 shutdown_connections 2024-04-24T23:40:07.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.380+0000 7f0ccc151640 1 --2- 172.21.15.57:0/2632293981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cc414bc70 0x7f0cc414c100 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.380+0000 7f0ccc151640 1 --2- 172.21.15.57:0/2632293981 >> v2:172.21.15.88:3300/0 conn(0x7f0cc406c480 0x7f0cc406fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.380+0000 7f0ccc151640 1 -- 172.21.15.57:0/2632293981 >> 172.21.15.57:0/2632293981 conn(0x7f0cc40bf370 msgr2=0x7f0cc40bf780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:07.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.380+0000 7f0ccc151640 1 -- 172.21.15.57:0/2632293981 shutdown_connections 2024-04-24T23:40:07.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.380+0000 7f0ccc151640 1 -- 172.21.15.57:0/2632293981 wait complete. 2024-04-24T23:40:07.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.384+0000 7f0ccc151640 1 Processor -- start 2024-04-24T23:40:07.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.384+0000 7f0ccc151640 1 -- start start 2024-04-24T23:40:07.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.384+0000 7f0ccc151640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0cc40675b0 0x7f0cc41e6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:07.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.384+0000 7f0ccc151640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0cc406c480 0x7f0cc4145e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:07.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.384+0000 7f0ccc151640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cc414bc70 0x7f0cc41ea900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:07.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.384+0000 7f0ccc151640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc40bcf90 con 0x7f0cc414bc70 2024-04-24T23:40:07.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.384+0000 7f0ccc151640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc40bce10 con 0x7f0cc406c480 2024-04-24T23:40:07.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.384+0000 7f0ccc151640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f0cc4071e40 con 0x7f0cc40675b0 2024-04-24T23:40:07.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.384+0000 7f0cca6ee640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cc414bc70 0x7f0cc41ea900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:07.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.384+0000 7f0cca6ee640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cc414bc70 0x7f0cc41ea900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39128/0 (socket says 172.21.15.57:39128) 2024-04-24T23:40:07.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.384+0000 7f0cca6ee640 1 -- 172.21.15.57:0/3346397586 learned_addr learned my addr 172.21.15.57:0/3346397586 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:07.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.384+0000 7f0cc9eed640 1 --2- 172.21.15.57:0/3346397586 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0cc40675b0 0x7f0cc41e6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:07.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.384+0000 7f0cc96ec640 1 --2- 172.21.15.57:0/3346397586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0cc406c480 0x7f0cc4145e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:07.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.384+0000 7f0cca6ee640 1 -- 172.21.15.57:0/3346397586 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0cc40675b0 msgr2=0x7f0cc41e6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:07.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.384+0000 7f0cca6ee640 1 --2- 172.21.15.57:0/3346397586 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0cc40675b0 0x7f0cc41e6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.384+0000 7f0cca6ee640 1 -- 172.21.15.57:0/3346397586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0cc406c480 msgr2=0x7f0cc4145e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:07.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.384+0000 7f0cca6ee640 1 --2- 172.21.15.57:0/3346397586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0cc406c480 0x7f0cc4145e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.384+0000 7f0cca6ee640 1 -- 172.21.15.57:0/3346397586 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc414fb60 con 0x7f0cc414bc70 2024-04-24T23:40:07.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.384+0000 7f0cc96ec640 1 --2- 172.21.15.57:0/3346397586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0cc406c480 0x7f0cc4145e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:40:07.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.384+0000 7f0cca6ee640 1 --2- 172.21.15.57:0/3346397586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cc414bc70 0x7f0cc41ea900 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0cb401a0b0 tx=0x7f0cb4019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:07.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.384+0000 7f0cc27fc640 1 -- 172.21.15.57:0/3346397586 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb40be410 con 0x7f0cc414bc70 2024-04-24T23:40:07.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.384+0000 7f0cc27fc640 1 -- 172.21.15.57:0/3346397586 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb40be5d0 con 0x7f0cc414bc70 2024-04-24T23:40:07.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.384+0000 7f0cc27fc640 1 -- 172.21.15.57:0/3346397586 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb40be9c0 con 0x7f0cc414bc70 2024-04-24T23:40:07.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.384+0000 7f0ccc151640 1 -- 172.21.15.57:0/3346397586 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cc414fe40 con 0x7f0cc414bc70 2024-04-24T23:40:07.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.384+0000 7f0ccc151640 1 -- 172.21.15.57:0/3346397586 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cc414b350 con 0x7f0cc414bc70 2024-04-24T23:40:07.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.384+0000 7f0ccc151640 1 -- 172.21.15.57:0/3346397586 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0cc4068290 con 0x7f0cc414bc70 2024-04-24T23:40:07.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.388+0000 7f0cc27fc640 1 -- 172.21.15.57:0/3346397586 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0cb40bc020 con 0x7f0cc414bc70 2024-04-24T23:40:07.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.388+0000 7f0cc27fc640 1 --2- 172.21.15.57:0/3346397586 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f0cb00678c0 0x7f0cb0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:07.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.388+0000 7f0cc27fc640 1 -- 172.21.15.57:0/3346397586 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f0cb4120770 con 0x7f0cc414bc70 2024-04-24T23:40:07.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.388+0000 7f0cc27fc640 1 --2- 172.21.15.57:0/3346397586 >> [v2:172.21.15.57:6800/2653552037,v1:172.21.15.57:6801/2653552037] conn(0x7f0cb00712e0 0x7f0cb0073780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:07.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.388+0000 7f0cc27fc640 1 -- 172.21.15.57:0/3346397586 --> [v2:172.21.15.57:6800/2653552037,v1:172.21.15.57:6801/2653552037] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0cb0073e50 con 0x7f0cb00712e0 2024-04-24T23:40:07.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.388+0000 7f0cc27fc640 1 -- 172.21.15.57:0/3346397586 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0cb4120c00 con 0x7f0cc414bc70 2024-04-24T23:40:07.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.388+0000 7f0cc96ec640 1 --2- 172.21.15.57:0/3346397586 >> [v2:172.21.15.57:6800/2653552037,v1:172.21.15.57:6801/2653552037] conn(0x7f0cb00712e0 0x7f0cb0073780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:07.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.388+0000 7f0cc9eed640 1 --2- 172.21.15.57:0/3346397586 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f0cb00678c0 0x7f0cb0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:07.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.388+0000 7f0cc96ec640 1 --2- 172.21.15.57:0/3346397586 >> [v2:172.21.15.57:6800/2653552037,v1:172.21.15.57:6801/2653552037] conn(0x7f0cb00712e0 0x7f0cb0073780 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:07.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.388+0000 7f0cc9eed640 1 --2- 172.21.15.57:0/3346397586 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f0cb00678c0 0x7f0cb0069d80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc009f30 tx=0x7f0cbc00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:07.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.388+0000 7f0cc27fc640 1 -- 172.21.15.57:0/3346397586 <== osd.1 v2:172.21.15.57:6800/2653552037 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0cb0073e50 con 0x7f0cb00712e0 2024-04-24T23:40:07.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.400+0000 7f0ccc151640 1 -- 172.21.15.57:0/3346397586 --> [v2:172.21.15.57:6800/2653552037,v1:172.21.15.57:6801/2653552037] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0cc40bc9e0 con 0x7f0cb00712e0 2024-04-24T23:40:07.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.400+0000 7f0cc27fc640 1 -- 172.21.15.57:0/3346397586 <== osd.1 v2:172.21.15.57:6800/2653552037 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0cc40bc9e0 con 0x7f0cb00712e0 2024-04-24T23:40:07.403 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-24T23:40:07.403 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:40:07.403 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-24T23:40:07.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.400+0000 7f0ccc151640 1 -- 172.21.15.57:0/3346397586 >> [v2:172.21.15.57:6800/2653552037,v1:172.21.15.57:6801/2653552037] conn(0x7f0cb00712e0 msgr2=0x7f0cb0073780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:07.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.400+0000 7f0ccc151640 1 --2- 172.21.15.57:0/3346397586 >> [v2:172.21.15.57:6800/2653552037,v1:172.21.15.57:6801/2653552037] conn(0x7f0cb00712e0 0x7f0cb0073780 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.400+0000 7f0ccc151640 1 -- 172.21.15.57:0/3346397586 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f0cb00678c0 msgr2=0x7f0cb0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:07.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.400+0000 7f0ccc151640 1 --2- 172.21.15.57:0/3346397586 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f0cb00678c0 0x7f0cb0069d80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc009f30 tx=0x7f0cbc00b040 comp rx=0 tx=0).stop 2024-04-24T23:40:07.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.400+0000 7f0ccc151640 1 -- 172.21.15.57:0/3346397586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cc414bc70 msgr2=0x7f0cc41ea900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:07.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.400+0000 7f0ccc151640 1 --2- 172.21.15.57:0/3346397586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cc414bc70 0x7f0cc41ea900 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0cb401a0b0 tx=0x7f0cb4019220 comp rx=0 tx=0).stop 2024-04-24T23:40:07.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.400+0000 7f0cca6ee640 1 -- 172.21.15.57:0/3346397586 reap_dead start 2024-04-24T23:40:07.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.400+0000 7f0ccc151640 1 -- 172.21.15.57:0/3346397586 shutdown_connections 2024-04-24T23:40:07.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.400+0000 7f0ccc151640 1 -- 172.21.15.57:0/3346397586 >> 172.21.15.57:0/3346397586 conn(0x7f0cc40bf370 msgr2=0x7f0cc406f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:07.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.400+0000 7f0ccc151640 1 -- 172.21.15.57:0/3346397586 shutdown_connections 2024-04-24T23:40:07.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.400+0000 7f0ccc151640 1 -- 172.21.15.57:0/3346397586 wait complete. 2024-04-24T23:40:07.417 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-24T23:40:07.521 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:40:07.523 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:40:07.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.524+0000 7f7d962f7640 1 Processor -- start 2024-04-24T23:40:07.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.524+0000 7f7d962f7640 1 -- start start 2024-04-24T23:40:07.526 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:40:07.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.524+0000 7f7d962f7640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7d900b85d0 0x7f7d900b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:07.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.524+0000 7f7d962f7640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7d90151160 0x7f7d900b9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:07.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.524+0000 7f7d962f7640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d900c2770 con 0x7f7d900ba3d0 2024-04-24T23:40:07.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.524+0000 7f7d962f7640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f7d90151720 con 0x7f7d90151160 2024-04-24T23:40:07.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.524+0000 7f7d962f7640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f7d900c2a10 con 0x7f7d900b85d0 2024-04-24T23:40:07.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.524+0000 7f7d8ffff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7d900ba3d0 0x7f7d9014db10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37726/0 (socket says 172.21.15.57:37726) 2024-04-24T23:40:07.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.524+0000 7f7d8ffff640 1 -- 172.21.15.57:0/4081678012 learned_addr learned my addr 172.21.15.57:0/4081678012 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:40:07.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.524+0000 7f7d94894640 1 --2- 172.21.15.57:0/4081678012 >> v2:172.21.15.57:3300/0 conn(0x7f7d90151160 0x7f7d900b9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:07.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.524+0000 7f7d8f7fe640 1 --2- 172.21.15.57:0/4081678012 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7d900b85d0 0x7f7d900b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:07.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.524+0000 7f7d8effd640 1 -- 172.21.15.57:0/4081678012 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1864929792 0 0) 0x7f7d900c2770 con 0x7f7d900ba3d0 2024-04-24T23:40:07.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.524+0000 7f7d8effd640 1 -- 172.21.15.57:0/4081678012 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d7c003530 con 0x7f7d900ba3d0 2024-04-24T23:40:07.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.524+0000 7f7d94894640 1 -- 172.21.15.57:0/4081678012 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7d900b85d0 msgr2=0x7f7d900b8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:07.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.524+0000 7f7d94894640 1 --2- 172.21.15.57:0/4081678012 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7d900b85d0 0x7f7d900b8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.524+0000 7f7d94894640 1 -- 172.21.15.57:0/4081678012 >> v1:172.21.15.57:6789/0 conn(0x7f7d900ba3d0 legacy=0x7f7d9014db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:07.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.524+0000 7f7d94894640 1 -- 172.21.15.57:0/4081678012 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d900c2cf0 con 0x7f7d90151160 2024-04-24T23:40:07.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.528+0000 7f7d94894640 1 --2- 172.21.15.57:0/4081678012 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d90151160 0x7f7d900b9170 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7d88009d90 tx=0x7f7d8801f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ef13209be67219 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:07.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.528+0000 7f7d8effd640 1 -- 172.21.15.57:0/4081678012 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d880b4070 con 0x7f7d90151160 2024-04-24T23:40:07.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.528+0000 7f7d8effd640 1 -- 172.21.15.57:0/4081678012 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d880af600 con 0x7f7d90151160 2024-04-24T23:40:07.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.528+0000 7f7d8effd640 1 -- 172.21.15.57:0/4081678012 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d880af9d0 con 0x7f7d90151160 2024-04-24T23:40:07.532 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:40:07.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.528+0000 7f7d962f7640 1 -- 172.21.15.57:0/4081678012 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d90151160 msgr2=0x7f7d900b9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:07.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.528+0000 7f7d962f7640 1 --2- 172.21.15.57:0/4081678012 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d90151160 0x7f7d900b9170 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7d88009d90 tx=0x7f7d8801f150 comp rx=0 tx=0).stop 2024-04-24T23:40:07.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.528+0000 7f7d962f7640 1 -- 172.21.15.57:0/4081678012 shutdown_connections 2024-04-24T23:40:07.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.528+0000 7f7d962f7640 1 --2- 172.21.15.57:0/4081678012 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7d900b85d0 0x7f7d900b8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.528+0000 7f7d962f7640 1 --2- 172.21.15.57:0/4081678012 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d90151160 0x7f7d900b9170 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.528+0000 7f7d962f7640 1 -- 172.21.15.57:0/4081678012 >> 172.21.15.57:0/4081678012 conn(0x7f7d90066f50 msgr2=0x7f7d90067360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:07.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.528+0000 7f7d962f7640 1 -- 172.21.15.57:0/4081678012 shutdown_connections 2024-04-24T23:40:07.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.528+0000 7f7d962f7640 1 -- 172.21.15.57:0/4081678012 wait complete. 2024-04-24T23:40:07.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.532+0000 7f7d962f7640 1 Processor -- start 2024-04-24T23:40:07.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.532+0000 7f7d962f7640 1 -- start start 2024-04-24T23:40:07.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.532+0000 7f7d962f7640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7d900b85d0 0x7f7d900beb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:07.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.532+0000 7f7d962f7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d900ba3d0 0x7f7d900bc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:07.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.532+0000 7f7d962f7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d90151160 0x7f7d90154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:07.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.532+0000 7f7d962f7640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9014e3a0 con 0x7f7d900ba3d0 2024-04-24T23:40:07.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.532+0000 7f7d962f7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9014e220 con 0x7f7d90151160 2024-04-24T23:40:07.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.532+0000 7f7d962f7640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f7d900ba7b0 con 0x7f7d900b85d0 2024-04-24T23:40:07.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.532+0000 7f7d8f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d900ba3d0 0x7f7d900bc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:07.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.532+0000 7f7d8f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d900ba3d0 0x7f7d900bc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39140/0 (socket says 172.21.15.57:39140) 2024-04-24T23:40:07.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.532+0000 7f7d8f7fe640 1 -- 172.21.15.57:0/2810626869 learned_addr learned my addr 172.21.15.57:0/2810626869 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:07.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.532+0000 7f7d94894640 1 --2- 172.21.15.57:0/2810626869 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d90151160 0x7f7d90154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:07.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.532+0000 7f7d8ffff640 1 --2- 172.21.15.57:0/2810626869 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7d900b85d0 0x7f7d900beb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:07.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.532+0000 7f7d8f7fe640 1 -- 172.21.15.57:0/2810626869 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7d900b85d0 msgr2=0x7f7d900beb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:07.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.532+0000 7f7d8f7fe640 1 --2- 172.21.15.57:0/2810626869 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7d900b85d0 0x7f7d900beb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.532+0000 7f7d8f7fe640 1 -- 172.21.15.57:0/2810626869 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d90151160 msgr2=0x7f7d90154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:07.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.532+0000 7f7d8f7fe640 1 --2- 172.21.15.57:0/2810626869 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d90151160 0x7f7d90154040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.532+0000 7f7d8f7fe640 1 -- 172.21.15.57:0/2810626869 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d90152950 con 0x7f7d900ba3d0 2024-04-24T23:40:07.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.532+0000 7f7d8f7fe640 1 --2- 172.21.15.57:0/2810626869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d900ba3d0 0x7f7d900bc6d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7d8000e930 tx=0x7f7d8000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:07.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.532+0000 7f7d8cff9640 1 -- 172.21.15.57:0/2810626869 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d80017070 con 0x7f7d900ba3d0 2024-04-24T23:40:07.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.532+0000 7f7d8cff9640 1 -- 172.21.15.57:0/2810626869 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d8000ca00 con 0x7f7d900ba3d0 2024-04-24T23:40:07.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.532+0000 7f7d8cff9640 1 -- 172.21.15.57:0/2810626869 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8000cdb0 con 0x7f7d900ba3d0 2024-04-24T23:40:07.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.532+0000 7f7d962f7640 1 -- 172.21.15.57:0/2810626869 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d900bcc10 con 0x7f7d900ba3d0 2024-04-24T23:40:07.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.532+0000 7f7d962f7640 1 -- 172.21.15.57:0/2810626869 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d901e9580 con 0x7f7d900ba3d0 2024-04-24T23:40:07.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.532+0000 7f7d962f7640 1 -- 172.21.15.57:0/2810626869 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d90068930 con 0x7f7d900ba3d0 2024-04-24T23:40:07.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.532+0000 7f7d8cff9640 1 -- 172.21.15.57:0/2810626869 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7d8001a070 con 0x7f7d900ba3d0 2024-04-24T23:40:07.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.536+0000 7f7d8cff9640 1 --2- 172.21.15.57:0/2810626869 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f7d700678c0 0x7f7d70069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:07.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.536+0000 7f7d8cff9640 1 -- 172.21.15.57:0/2810626869 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f7d80086040 con 0x7f7d900ba3d0 2024-04-24T23:40:07.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.536+0000 7f7d8ffff640 1 --2- 172.21.15.57:0/2810626869 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f7d700678c0 0x7f7d70069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:07.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.536+0000 7f7d8ffff640 1 --2- 172.21.15.57:0/2810626869 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f7d700678c0 0x7f7d70069d80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7d78005890 tx=0x7f7d78009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:07.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.540+0000 7f7d8cff9640 1 -- 172.21.15.57:0/2810626869 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f7d900bcc10 con 0x7f7d900ba3d0 2024-04-24T23:40:07.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.700+0000 7f7d962f7640 1 -- 172.21.15.57:0/2810626869 --> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f7d900bbdc0 con 0x7f7d700678c0 2024-04-24T23:40:07.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.700+0000 7f7d8cff9640 1 -- 172.21.15.57:0/2810626869 <== mgr.4105 v2:172.21.15.88:6832/3931748276 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7d900bbdc0 con 0x7f7d700678c0 2024-04-24T23:40:07.703 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 1 to deep-scrub 2024-04-24T23:40:07.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.704+0000 7f7d962f7640 1 -- 172.21.15.57:0/2810626869 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f7d700678c0 msgr2=0x7f7d70069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:07.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.704+0000 7f7d962f7640 1 --2- 172.21.15.57:0/2810626869 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f7d700678c0 0x7f7d70069d80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7d78005890 tx=0x7f7d78009040 comp rx=0 tx=0).stop 2024-04-24T23:40:07.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.704+0000 7f7d962f7640 1 -- 172.21.15.57:0/2810626869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d900ba3d0 msgr2=0x7f7d900bc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:07.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.704+0000 7f7d962f7640 1 --2- 172.21.15.57:0/2810626869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d900ba3d0 0x7f7d900bc6d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7d8000e930 tx=0x7f7d8000edf0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.704+0000 7f7d962f7640 1 -- 172.21.15.57:0/2810626869 shutdown_connections 2024-04-24T23:40:07.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.704+0000 7f7d962f7640 1 --2- 172.21.15.57:0/2810626869 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f7d700678c0 0x7f7d70069d80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.704+0000 7f7d962f7640 1 --2- 172.21.15.57:0/2810626869 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d90151160 0x7f7d90154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.704+0000 7f7d962f7640 1 --2- 172.21.15.57:0/2810626869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d900ba3d0 0x7f7d900bc6d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.704+0000 7f7d962f7640 1 --2- 172.21.15.57:0/2810626869 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7d900b85d0 0x7f7d900beb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.704+0000 7f7d962f7640 1 -- 172.21.15.57:0/2810626869 >> 172.21.15.57:0/2810626869 conn(0x7f7d90066f50 msgr2=0x7f7d9014dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:07.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.704+0000 7f7d962f7640 1 -- 172.21.15.57:0/2810626869 shutdown_connections 2024-04-24T23:40:07.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.704+0000 7f7d962f7640 1 -- 172.21.15.57:0/2810626869 wait complete. 2024-04-24T23:40:07.722 INFO:tasks.ceph:Scrubbing osd.2 2024-04-24T23:40:07.722 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:40:07.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.848+0000 7fd966584640 1 Processor -- start 2024-04-24T23:40:07.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.848+0000 7fd966584640 1 -- start start 2024-04-24T23:40:07.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.848+0000 7fd966584640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd96014bc60 0x7fd9600c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:07.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.848+0000 7fd966584640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd9600c2d00 0x7fd960151c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:07.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.848+0000 7fd966584640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9600bd200 con 0x7fd9600bd5f0 2024-04-24T23:40:07.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.848+0000 7fd966584640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fd9600bde20 con 0x7fd9600c2d00 2024-04-24T23:40:07.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.848+0000 7fd966584640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fd9600be070 con 0x7fd96014bc60 2024-04-24T23:40:07.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.852+0000 7fd95f7fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd9600c2d00 0x7fd960151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:07.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.852+0000 7fd95f7fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd9600c2d00 0x7fd960151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35148/0 (socket says 172.21.15.57:35148) 2024-04-24T23:40:07.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.852+0000 7fd95f7fe640 1 -- 172.21.15.57:0/1583983143 learned_addr learned my addr 172.21.15.57:0/1583983143 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:07.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.852+0000 7fd95ffff640 1 --2- 172.21.15.57:0/1583983143 >> v2:172.21.15.88:3300/0 conn(0x7fd96014bc60 0x7fd9600c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:07.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.852+0000 7fd95f7fe640 1 -- 172.21.15.57:0/1583983143 >> v2:172.21.15.88:3300/0 conn(0x7fd96014bc60 msgr2=0x7fd9600c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:07.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.852+0000 7fd95f7fe640 1 --2- 172.21.15.57:0/1583983143 >> v2:172.21.15.88:3300/0 conn(0x7fd96014bc60 0x7fd9600c27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.852+0000 7fd95f7fe640 1 -- 172.21.15.57:0/1583983143 >> v1:172.21.15.88:6789/0 conn(0x7fd9600bd5f0 legacy=0x7fd96006d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:07.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.852+0000 7fd95f7fe640 1 -- 172.21.15.57:0/1583983143 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9600be350 con 0x7fd9600c2d00 2024-04-24T23:40:07.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.852+0000 7fd95f7fe640 1 --2- 172.21.15.57:0/1583983143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9600c2d00 0x7fd960151c20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd960073460 tx=0x7fd95401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d640bf8710d6832 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:07.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.852+0000 7fd95effd640 1 -- 172.21.15.57:0/1583983143 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9540b0070 con 0x7fd9600c2d00 2024-04-24T23:40:07.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.852+0000 7fd95effd640 1 -- 172.21.15.57:0/1583983143 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9540ab600 con 0x7fd9600c2d00 2024-04-24T23:40:07.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.852+0000 7fd95effd640 1 -- 172.21.15.57:0/1583983143 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9540ab9d0 con 0x7fd9600c2d00 2024-04-24T23:40:07.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.852+0000 7fd966584640 1 -- 172.21.15.57:0/1583983143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9600c2d00 msgr2=0x7fd960151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:07.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.852+0000 7fd966584640 1 --2- 172.21.15.57:0/1583983143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9600c2d00 0x7fd960151c20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd960073460 tx=0x7fd95401c400 comp rx=0 tx=0).stop 2024-04-24T23:40:07.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.852+0000 7fd966584640 1 -- 172.21.15.57:0/1583983143 shutdown_connections 2024-04-24T23:40:07.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.852+0000 7fd966584640 1 --2- 172.21.15.57:0/1583983143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9600c2d00 0x7fd960151c20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.852+0000 7fd966584640 1 --2- 172.21.15.57:0/1583983143 >> v2:172.21.15.88:3300/0 conn(0x7fd96014bc60 0x7fd9600c27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.852+0000 7fd966584640 1 -- 172.21.15.57:0/1583983143 >> 172.21.15.57:0/1583983143 conn(0x7fd96006b920 msgr2=0x7fd9600c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:07.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.852+0000 7fd966584640 1 -- 172.21.15.57:0/1583983143 shutdown_connections 2024-04-24T23:40:07.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.852+0000 7fd966584640 1 -- 172.21.15.57:0/1583983143 wait complete. 2024-04-24T23:40:07.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.856+0000 7fd966584640 1 Processor -- start 2024-04-24T23:40:07.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.856+0000 7fd966584640 1 -- start start 2024-04-24T23:40:07.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.856+0000 7fd966584640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9600bd5f0 0x7fd960151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:07.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.856+0000 7fd966584640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9600c2d00 0x7fd9601e7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:07.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.856+0000 7fd966584640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd96014bc60 0x7fd9601e8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:07.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.856+0000 7fd966584640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd9600bcfe0 con 0x7fd9600c2d00 2024-04-24T23:40:07.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.856+0000 7fd966584640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd9600bce60 con 0x7fd9600bd5f0 2024-04-24T23:40:07.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.856+0000 7fd966584640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fd96015bfb0 con 0x7fd96014bc60 2024-04-24T23:40:07.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.856+0000 7fd95f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9600c2d00 0x7fd9601e7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:07.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.856+0000 7fd95f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9600c2d00 0x7fd9601e7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35158/0 (socket says 172.21.15.57:35158) 2024-04-24T23:40:07.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.856+0000 7fd95f7fe640 1 -- 172.21.15.57:0/3354290375 learned_addr learned my addr 172.21.15.57:0/3354290375 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:07.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.856+0000 7fd95ffff640 1 --2- 172.21.15.57:0/3354290375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9600bd5f0 0x7fd960151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:07.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.856+0000 7fd964b21640 1 --2- 172.21.15.57:0/3354290375 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd96014bc60 0x7fd9601e8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:07.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.856+0000 7fd95f7fe640 1 -- 172.21.15.57:0/3354290375 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd96014bc60 msgr2=0x7fd9601e8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:07.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.856+0000 7fd95f7fe640 1 --2- 172.21.15.57:0/3354290375 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd96014bc60 0x7fd9601e8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.856+0000 7fd95f7fe640 1 -- 172.21.15.57:0/3354290375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9600bd5f0 msgr2=0x7fd960151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:07.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.856+0000 7fd95f7fe640 1 --2- 172.21.15.57:0/3354290375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9600bd5f0 0x7fd960151090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.856+0000 7fd95f7fe640 1 -- 172.21.15.57:0/3354290375 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9601515d0 con 0x7fd9600c2d00 2024-04-24T23:40:07.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.856+0000 7fd95f7fe640 1 --2- 172.21.15.57:0/3354290375 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9600c2d00 0x7fd9601e7e00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd954019010 tx=0x7fd9540191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:07.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.856+0000 7fd95cff9640 1 -- 172.21.15.57:0/3354290375 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9540b9070 con 0x7fd9600c2d00 2024-04-24T23:40:07.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.856+0000 7fd95cff9640 1 -- 172.21.15.57:0/3354290375 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9540b4400 con 0x7fd9600c2d00 2024-04-24T23:40:07.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.856+0000 7fd95cff9640 1 -- 172.21.15.57:0/3354290375 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9540b0040 con 0x7fd9600c2d00 2024-04-24T23:40:07.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.856+0000 7fd966584640 1 -- 172.21.15.57:0/3354290375 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9600b8200 con 0x7fd9600c2d00 2024-04-24T23:40:07.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.856+0000 7fd966584640 1 -- 172.21.15.57:0/3354290375 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd960146d70 con 0x7fd9600c2d00 2024-04-24T23:40:07.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.856+0000 7fd966584640 1 -- 172.21.15.57:0/3354290375 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd960068290 con 0x7fd9600c2d00 2024-04-24T23:40:07.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.856+0000 7fd95cff9640 1 -- 172.21.15.57:0/3354290375 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd9540b33a0 con 0x7fd9600c2d00 2024-04-24T23:40:07.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.860+0000 7fd95cff9640 1 --2- 172.21.15.57:0/3354290375 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd94c0678f0 0x7fd94c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:07.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.860+0000 7fd95cff9640 1 -- 172.21.15.57:0/3354290375 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fd95411f810 con 0x7fd9600c2d00 2024-04-24T23:40:07.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.860+0000 7fd95cff9640 1 --2- 172.21.15.57:0/3354290375 >> [v2:172.21.15.57:6814/1565874109,v1:172.21.15.57:6816/1565874109] conn(0x7fd94c071300 0x7fd94c0737a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:07.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.860+0000 7fd95cff9640 1 -- 172.21.15.57:0/3354290375 --> [v2:172.21.15.57:6814/1565874109,v1:172.21.15.57:6816/1565874109] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd9540ab600 con 0x7fd94c071300 2024-04-24T23:40:07.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.860+0000 7fd95cff9640 1 -- 172.21.15.57:0/3354290375 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd95411fca0 con 0x7fd9600c2d00 2024-04-24T23:40:07.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.860+0000 7fd95ffff640 1 --2- 172.21.15.57:0/3354290375 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd94c0678f0 0x7fd94c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:07.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.860+0000 7fd964b21640 1 --2- 172.21.15.57:0/3354290375 >> [v2:172.21.15.57:6814/1565874109,v1:172.21.15.57:6816/1565874109] conn(0x7fd94c071300 0x7fd94c0737a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:07.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.860+0000 7fd964b21640 1 --2- 172.21.15.57:0/3354290375 >> [v2:172.21.15.57:6814/1565874109,v1:172.21.15.57:6816/1565874109] conn(0x7fd94c071300 0x7fd94c0737a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:07.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.860+0000 7fd95ffff640 1 --2- 172.21.15.57:0/3354290375 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd94c0678f0 0x7fd94c069db0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd950009e90 tx=0x7fd95000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:07.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.860+0000 7fd95cff9640 1 -- 172.21.15.57:0/3354290375 <== osd.2 v2:172.21.15.57:6814/1565874109 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd9540ab600 con 0x7fd94c071300 2024-04-24T23:40:07.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.872+0000 7fd966584640 1 -- 172.21.15.57:0/3354290375 --> [v2:172.21.15.57:6814/1565874109,v1:172.21.15.57:6816/1565874109] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd9601e7bc0 con 0x7fd94c071300 2024-04-24T23:40:07.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.872+0000 7fd95cff9640 1 -- 172.21.15.57:0/3354290375 <== osd.2 v2:172.21.15.57:6814/1565874109 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd9601e7bc0 con 0x7fd94c071300 2024-04-24T23:40:07.875 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-24T23:40:07.875 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:40:07.875 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-24T23:40:07.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.872+0000 7fd966584640 1 -- 172.21.15.57:0/3354290375 >> [v2:172.21.15.57:6814/1565874109,v1:172.21.15.57:6816/1565874109] conn(0x7fd94c071300 msgr2=0x7fd94c0737a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:07.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.872+0000 7fd966584640 1 --2- 172.21.15.57:0/3354290375 >> [v2:172.21.15.57:6814/1565874109,v1:172.21.15.57:6816/1565874109] conn(0x7fd94c071300 0x7fd94c0737a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.872+0000 7fd966584640 1 -- 172.21.15.57:0/3354290375 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd94c0678f0 msgr2=0x7fd94c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:07.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.872+0000 7fd966584640 1 --2- 172.21.15.57:0/3354290375 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd94c0678f0 0x7fd94c069db0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd950009e90 tx=0x7fd95000b040 comp rx=0 tx=0).stop 2024-04-24T23:40:07.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.872+0000 7fd966584640 1 -- 172.21.15.57:0/3354290375 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9600c2d00 msgr2=0x7fd9601e7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:07.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.872+0000 7fd966584640 1 --2- 172.21.15.57:0/3354290375 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9600c2d00 0x7fd9601e7e00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd954019010 tx=0x7fd9540191a0 comp rx=0 tx=0).stop 2024-04-24T23:40:07.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.872+0000 7fd964b21640 1 -- 172.21.15.57:0/3354290375 reap_dead start 2024-04-24T23:40:07.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.872+0000 7fd966584640 1 -- 172.21.15.57:0/3354290375 shutdown_connections 2024-04-24T23:40:07.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.872+0000 7fd966584640 1 -- 172.21.15.57:0/3354290375 >> 172.21.15.57:0/3354290375 conn(0x7fd96006b920 msgr2=0x7fd96014d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:07.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.872+0000 7fd966584640 1 -- 172.21.15.57:0/3354290375 shutdown_connections 2024-04-24T23:40:07.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:07.872+0000 7fd966584640 1 -- 172.21.15.57:0/3354290375 wait complete. 2024-04-24T23:40:07.889 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-24T23:40:08.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.004+0000 7f9d054ab640 1 Processor -- start 2024-04-24T23:40:08.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.004+0000 7f9d054ab640 1 -- start start 2024-04-24T23:40:08.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.004+0000 7f9d054ab640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9d00072200 0x7f9d0014d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.004+0000 7f9d054ab640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9d000bf3a0 0x7f9d0014a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.004+0000 7f9d054ab640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d000bd870 con 0x7f9d0006e520 2024-04-24T23:40:08.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.004+0000 7f9d054ab640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f9d0014e350 con 0x7f9d00072200 2024-04-24T23:40:08.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.004+0000 7f9d054ab640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f9d000be440 con 0x7f9d000bf3a0 2024-04-24T23:40:08.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.004+0000 7f9cfe7fc640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9d0006e520 0x7f9d000be8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53962/0 (socket says 172.21.15.57:53962) 2024-04-24T23:40:08.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.004+0000 7f9cfe7fc640 1 -- 172.21.15.57:0/1351841304 learned_addr learned my addr 172.21.15.57:0/1351841304 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:40:08.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.004+0000 7f9cff7fe640 1 --2- 172.21.15.57:0/1351841304 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9d000bf3a0 0x7f9d0014a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.004+0000 7f9cfeffd640 1 --2- 172.21.15.57:0/1351841304 >> v2:172.21.15.88:3300/0 conn(0x7f9d00072200 0x7f9d0014d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.004+0000 7f9cfdffb640 1 -- 172.21.15.57:0/1351841304 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2920470417 0 0) 0x7f9d000bd870 con 0x7f9d0006e520 2024-04-24T23:40:08.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.004+0000 7f9cfdffb640 1 -- 172.21.15.57:0/1351841304 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cec003530 con 0x7f9d0006e520 2024-04-24T23:40:08.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.004+0000 7f9cfdffb640 1 -- 172.21.15.57:0/1351841304 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1262041040 0 0) 0x7f9cec003530 con 0x7f9d0006e520 2024-04-24T23:40:08.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.004+0000 7f9cff7fe640 1 -- 172.21.15.57:0/1351841304 >> v2:172.21.15.88:3300/0 conn(0x7f9d00072200 msgr2=0x7f9d0014d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:08.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.004+0000 7f9cff7fe640 1 --2- 172.21.15.57:0/1351841304 >> v2:172.21.15.88:3300/0 conn(0x7f9d00072200 0x7f9d0014d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.004+0000 7f9cff7fe640 1 -- 172.21.15.57:0/1351841304 >> v1:172.21.15.57:6789/0 conn(0x7f9d0006e520 legacy=0x7f9d000be8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:08.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.004+0000 7f9cff7fe640 1 -- 172.21.15.57:0/1351841304 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d000bdb10 con 0x7f9d000bf3a0 2024-04-24T23:40:08.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.008+0000 7f9cff7fe640 1 --2- 172.21.15.57:0/1351841304 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9d000bf3a0 0x7f9d0014a500 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9cf800ba60 tx=0x7f9cf8021280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b7a7a133ddfb263 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:08.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.008+0000 7f9cfdffb640 1 -- 172.21.15.57:0/1351841304 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf80b6070 con 0x7f9d000bf3a0 2024-04-24T23:40:08.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.008+0000 7f9cfdffb640 1 -- 172.21.15.57:0/1351841304 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cf80b1400 con 0x7f9d000bf3a0 2024-04-24T23:40:08.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.008+0000 7f9cfdffb640 1 -- 172.21.15.57:0/1351841304 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0001a20 con 0x7f9d000bf3a0 2024-04-24T23:40:08.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.008+0000 7f9d054ab640 1 -- 172.21.15.57:0/1351841304 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9d000bf3a0 msgr2=0x7f9d0014a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:08.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.008+0000 7f9d054ab640 1 --2- 172.21.15.57:0/1351841304 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9d000bf3a0 0x7f9d0014a500 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9cf800ba60 tx=0x7f9cf8021280 comp rx=0 tx=0).stop 2024-04-24T23:40:08.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.008+0000 7f9d054ab640 1 -- 172.21.15.57:0/1351841304 shutdown_connections 2024-04-24T23:40:08.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.008+0000 7f9d054ab640 1 --2- 172.21.15.57:0/1351841304 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9d000bf3a0 0x7f9d0014a500 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.008+0000 7f9d054ab640 1 --2- 172.21.15.57:0/1351841304 >> v2:172.21.15.88:3300/0 conn(0x7f9d00072200 0x7f9d0014d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.008+0000 7f9d054ab640 1 -- 172.21.15.57:0/1351841304 >> 172.21.15.57:0/1351841304 conn(0x7f9d000c2e70 msgr2=0x7f9d000c3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:08.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.008+0000 7f9d054ab640 1 -- 172.21.15.57:0/1351841304 shutdown_connections 2024-04-24T23:40:08.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.008+0000 7f9d054ab640 1 -- 172.21.15.57:0/1351841304 wait complete. 2024-04-24T23:40:08.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.012+0000 7f9d054ab640 1 Processor -- start 2024-04-24T23:40:08.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.012+0000 7f9d054ab640 1 -- start start 2024-04-24T23:40:08.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.012+0000 7f9d054ab640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d0006e520 0x7f9d0006b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.012+0000 7f9d054ab640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d00072200 0x7f9d0014ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.012+0000 7f9d054ab640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9d000bf3a0 0x7f9d001418c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.012+0000 7f9d054ab640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9d000725e0 con 0x7f9d0006e520 2024-04-24T23:40:08.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.012+0000 7f9d054ab640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9d000be0d0 con 0x7f9d00072200 2024-04-24T23:40:08.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.012+0000 7f9d054ab640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f9d00072760 con 0x7f9d000bf3a0 2024-04-24T23:40:08.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.012+0000 7f9cfeffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d0006e520 0x7f9d0006b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.012+0000 7f9cfe7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d00072200 0x7f9d0014ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.012+0000 7f9cfeffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d0006e520 0x7f9d0006b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35172/0 (socket says 172.21.15.57:35172) 2024-04-24T23:40:08.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.012+0000 7f9cfeffd640 1 -- 172.21.15.57:0/3814439065 learned_addr learned my addr 172.21.15.57:0/3814439065 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:08.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.012+0000 7f9cff7fe640 1 --2- 172.21.15.57:0/3814439065 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9d000bf3a0 0x7f9d001418c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.012+0000 7f9cfeffd640 1 -- 172.21.15.57:0/3814439065 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9d000bf3a0 msgr2=0x7f9d001418c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:08.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.012+0000 7f9cfeffd640 1 --2- 172.21.15.57:0/3814439065 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9d000bf3a0 0x7f9d001418c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.012+0000 7f9cfeffd640 1 -- 172.21.15.57:0/3814439065 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d00072200 msgr2=0x7f9d0014ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:08.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.012+0000 7f9cfeffd640 1 --2- 172.21.15.57:0/3814439065 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d00072200 0x7f9d0014ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.012+0000 7f9cfeffd640 1 -- 172.21.15.57:0/3814439065 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d0006b9b0 con 0x7f9d0006e520 2024-04-24T23:40:08.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.012+0000 7f9cfeffd640 1 --2- 172.21.15.57:0/3814439065 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d0006e520 0x7f9d0006b470 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800e960 tx=0x7f9ce800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:08.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.012+0000 7f9cf77fe640 1 -- 172.21.15.57:0/3814439065 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8017070 con 0x7f9d0006e520 2024-04-24T23:40:08.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.012+0000 7f9cf77fe640 1 -- 172.21.15.57:0/3814439065 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce800ca00 con 0x7f9d0006e520 2024-04-24T23:40:08.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.012+0000 7f9cf77fe640 1 -- 172.21.15.57:0/3814439065 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce800cdb0 con 0x7f9d0006e520 2024-04-24T23:40:08.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.012+0000 7f9d054ab640 1 -- 172.21.15.57:0/3814439065 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d000c20b0 con 0x7f9d0006e520 2024-04-24T23:40:08.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.012+0000 7f9d054ab640 1 -- 172.21.15.57:0/3814439065 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d000c14d0 con 0x7f9d0006e520 2024-04-24T23:40:08.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.012+0000 7f9d054ab640 1 -- 172.21.15.57:0/3814439065 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d00068930 con 0x7f9d0006e520 2024-04-24T23:40:08.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.012+0000 7f9cf77fe640 1 -- 172.21.15.57:0/3814439065 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9ce801a070 con 0x7f9d0006e520 2024-04-24T23:40:08.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.016+0000 7f9cf77fe640 1 --2- 172.21.15.57:0/3814439065 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f9ce00678f0 0x7f9ce0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.016+0000 7f9cf77fe640 1 -- 172.21.15.57:0/3814439065 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f9ce8086310 con 0x7f9d0006e520 2024-04-24T23:40:08.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.016+0000 7f9cfe7fc640 1 --2- 172.21.15.57:0/3814439065 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f9ce00678f0 0x7f9ce0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.016+0000 7f9cfe7fc640 1 --2- 172.21.15.57:0/3814439065 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f9ce00678f0 0x7f9ce0069db0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9d00145710 tx=0x7f9cf0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:08.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.020+0000 7f9cf77fe640 1 -- 172.21.15.57:0/3814439065 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f9d0006b9b0 con 0x7f9d0006e520 2024-04-24T23:40:08.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.180+0000 7f9d054ab640 1 -- 172.21.15.57:0/3814439065 --> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f9d0006da50 con 0x7f9ce00678f0 2024-04-24T23:40:08.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.180+0000 7f9cf77fe640 1 -- 172.21.15.57:0/3814439065 <== mgr.4105 v2:172.21.15.88:6832/3931748276 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9d0006da50 con 0x7f9ce00678f0 2024-04-24T23:40:08.181 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 2 to deep-scrub 2024-04-24T23:40:08.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.180+0000 7f9d054ab640 1 -- 172.21.15.57:0/3814439065 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f9ce00678f0 msgr2=0x7f9ce0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:08.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.180+0000 7f9d054ab640 1 --2- 172.21.15.57:0/3814439065 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f9ce00678f0 0x7f9ce0069db0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9d00145710 tx=0x7f9cf0009040 comp rx=0 tx=0).stop 2024-04-24T23:40:08.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.180+0000 7f9d054ab640 1 -- 172.21.15.57:0/3814439065 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d0006e520 msgr2=0x7f9d0006b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:08.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.180+0000 7f9d054ab640 1 --2- 172.21.15.57:0/3814439065 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d0006e520 0x7f9d0006b470 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800e960 tx=0x7f9ce800ee20 comp rx=0 tx=0).stop 2024-04-24T23:40:08.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.180+0000 7f9d054ab640 1 -- 172.21.15.57:0/3814439065 shutdown_connections 2024-04-24T23:40:08.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.180+0000 7f9d054ab640 1 --2- 172.21.15.57:0/3814439065 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f9ce00678f0 0x7f9ce0069db0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.180+0000 7f9d054ab640 1 --2- 172.21.15.57:0/3814439065 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9d000bf3a0 0x7f9d001418c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.184+0000 7f9d054ab640 1 --2- 172.21.15.57:0/3814439065 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d00072200 0x7f9d0014ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.184+0000 7f9d054ab640 1 --2- 172.21.15.57:0/3814439065 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d0006e520 0x7f9d0006b470 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.184+0000 7f9d054ab640 1 -- 172.21.15.57:0/3814439065 >> 172.21.15.57:0/3814439065 conn(0x7f9d000c2e70 msgr2=0x7f9d0014b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:08.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.184+0000 7f9d054ab640 1 -- 172.21.15.57:0/3814439065 shutdown_connections 2024-04-24T23:40:08.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.184+0000 7f9d054ab640 1 -- 172.21.15.57:0/3814439065 wait complete. 2024-04-24T23:40:08.201 INFO:tasks.ceph:Scrubbing osd.3 2024-04-24T23:40:08.202 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:40:08.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f503acdf640 1 Processor -- start 2024-04-24T23:40:08.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f503acdf640 1 -- start start 2024-04-24T23:40:08.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f503acdf640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f503406ea40 0x7f50341514f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f503acdf640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f503414afb0 0x7f503414dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f503acdf640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5034151a30 con 0x7f50340bc3f0 2024-04-24T23:40:08.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f503acdf640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f503414d640 con 0x7f503406ea40 2024-04-24T23:40:08.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f503acdf640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f50340be040 con 0x7f503414afb0 2024-04-24T23:40:08.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f5033fff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f50340bc3f0 0x7f503414a8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53964/0 (socket says 172.21.15.57:53964) 2024-04-24T23:40:08.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f5033fff640 1 -- 172.21.15.57:0/927707285 learned_addr learned my addr 172.21.15.57:0/927707285 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:40:08.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f50337fe640 1 -- 172.21.15.57:0/927707285 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1023497093 0 0) 0x7f5034151a30 con 0x7f50340bc3f0 2024-04-24T23:40:08.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f5038a7b640 1 --2- 172.21.15.57:0/927707285 >> v2:172.21.15.88:3300/0 conn(0x7f503406ea40 0x7f50341514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f503927c640 1 --2- 172.21.15.57:0/927707285 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f503414afb0 0x7f503414dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f50337fe640 1 -- 172.21.15.57:0/927707285 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5020003530 con 0x7f50340bc3f0 2024-04-24T23:40:08.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f50337fe640 1 -- 172.21.15.57:0/927707285 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3551333973 0 0) 0x7f5020003530 con 0x7f50340bc3f0 2024-04-24T23:40:08.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f50337fe640 1 -- 172.21.15.57:0/927707285 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f503414afb0 msgr2=0x7f503414dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:08.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f50337fe640 1 --2- 172.21.15.57:0/927707285 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f503414afb0 0x7f503414dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f50337fe640 1 -- 172.21.15.57:0/927707285 >> v2:172.21.15.88:3300/0 conn(0x7f503406ea40 msgr2=0x7f50341514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:08.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f50337fe640 1 --2- 172.21.15.57:0/927707285 >> v2:172.21.15.88:3300/0 conn(0x7f503406ea40 0x7f50341514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f50337fe640 1 -- 172.21.15.57:0/927707285 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50340be320 con 0x7f50340bc3f0 2024-04-24T23:40:08.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f50337fe640 1 -- 172.21.15.57:0/927707285 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7f5024001a00 con 0x7f50340bc3f0 2024-04-24T23:40:08.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f5038a7b640 1 --2- 172.21.15.57:0/927707285 >> v2:172.21.15.88:3300/0 conn(0x7f503406ea40 0x7f50341514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:40:08.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f50337fe640 1 -- 172.21.15.57:0/927707285 >> v1:172.21.15.57:6789/0 conn(0x7f50340bc3f0 legacy=0x7f503414a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:08.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f50337fe640 1 --2- 172.21.15.57:0/927707285 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f503414afb0 0x7f50200039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f50337fe640 1 --2- 172.21.15.57:0/927707285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5020003f40 0x7f5020004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f50337fe640 1 --2- 172.21.15.57:0/927707285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5020004d50 0x7f50200051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f50337fe640 1 -- 172.21.15.57:0/927707285 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f503414d640 con 0x7f5020003f40 2024-04-24T23:40:08.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f50337fe640 1 -- 172.21.15.57:0/927707285 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f50340be040 con 0x7f5020004d50 2024-04-24T23:40:08.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f50337fe640 1 -- 172.21.15.57:0/927707285 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f502000ba20 con 0x7f503414afb0 2024-04-24T23:40:08.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f5033fff640 1 --2- 172.21.15.57:0/927707285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5020003f40 0x7f5020004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f5038a7b640 1 --2- 172.21.15.57:0/927707285 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f503414afb0 0x7f50200039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f503927c640 1 --2- 172.21.15.57:0/927707285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5020004d50 0x7f50200051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f5033fff640 1 -- 172.21.15.57:0/927707285 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f503414afb0 msgr2=0x7f50200039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:08.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f5033fff640 1 --2- 172.21.15.57:0/927707285 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f503414afb0 0x7f50200039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f5033fff640 1 -- 172.21.15.57:0/927707285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5020004d50 msgr2=0x7f50200051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:08.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f5033fff640 1 --2- 172.21.15.57:0/927707285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5020004d50 0x7f50200051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.324+0000 7f5033fff640 1 -- 172.21.15.57:0/927707285 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5020003530 con 0x7f5020003f40 2024-04-24T23:40:08.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.328+0000 7f5038a7b640 1 --2- 172.21.15.57:0/927707285 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f503414afb0 0x7f50200039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:40:08.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.328+0000 7f503927c640 1 --2- 172.21.15.57:0/927707285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5020004d50 0x7f50200051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:40:08.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.328+0000 7f5033fff640 1 --2- 172.21.15.57:0/927707285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5020003f40 0x7f5020004810 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f502400a880 tx=0x7f502401fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c60a993aab81f8b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:08.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.328+0000 7f50337fe640 1 -- 172.21.15.57:0/927707285 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502400a4a0 con 0x7f5020003f40 2024-04-24T23:40:08.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.328+0000 7f50337fe640 1 -- 172.21.15.57:0/927707285 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50240ad020 con 0x7f5020003f40 2024-04-24T23:40:08.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.328+0000 7f50337fe640 1 -- 172.21.15.57:0/927707285 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50240a9740 con 0x7f5020003f40 2024-04-24T23:40:08.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.328+0000 7f503acdf640 1 -- 172.21.15.57:0/927707285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5020003f40 msgr2=0x7f5020004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:08.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.328+0000 7f503acdf640 1 --2- 172.21.15.57:0/927707285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5020003f40 0x7f5020004810 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f502400a880 tx=0x7f502401fb00 comp rx=0 tx=0).stop 2024-04-24T23:40:08.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.328+0000 7f503927c640 1 -- 172.21.15.57:0/927707285 reap_dead start 2024-04-24T23:40:08.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.328+0000 7f503acdf640 1 -- 172.21.15.57:0/927707285 shutdown_connections 2024-04-24T23:40:08.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.328+0000 7f503acdf640 1 -- 172.21.15.57:0/927707285 >> 172.21.15.57:0/927707285 conn(0x7f503406b920 msgr2=0x7f50340c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:08.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.328+0000 7f503acdf640 1 -- 172.21.15.57:0/927707285 shutdown_connections 2024-04-24T23:40:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.328+0000 7f503acdf640 1 -- 172.21.15.57:0/927707285 wait complete. 2024-04-24T23:40:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.328+0000 7f503acdf640 1 Processor -- start 2024-04-24T23:40:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f503acdf640 1 -- start start 2024-04-24T23:40:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f503acdf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5020003f40 0x7f50340729d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f503acdf640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5034145190 0x7f50341e8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f503acdf640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50341e9450 0x7f503414b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f503acdf640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f503406ee20 con 0x7f50341e9450 2024-04-24T23:40:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f503acdf640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f50340a6480 con 0x7f5020003f40 2024-04-24T23:40:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f503acdf640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f503406efa0 con 0x7f5034145190 2024-04-24T23:40:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f503927c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50341e9450 0x7f503414b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f503927c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50341e9450 0x7f503414b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35192/0 (socket says 172.21.15.57:35192) 2024-04-24T23:40:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f503927c640 1 -- 172.21.15.57:0/2495881370 learned_addr learned my addr 172.21.15.57:0/2495881370 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f5033fff640 1 --2- 172.21.15.57:0/2495881370 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5034145190 0x7f50341e8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f5038a7b640 1 --2- 172.21.15.57:0/2495881370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5020003f40 0x7f50340729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f503927c640 1 -- 172.21.15.57:0/2495881370 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5034145190 msgr2=0x7f50341e8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:08.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f503927c640 1 --2- 172.21.15.57:0/2495881370 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5034145190 0x7f50341e8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f503927c640 1 -- 172.21.15.57:0/2495881370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5020003f40 msgr2=0x7f50340729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:08.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f503927c640 1 --2- 172.21.15.57:0/2495881370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5020003f40 0x7f50340729d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f503927c640 1 -- 172.21.15.57:0/2495881370 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5034072f10 con 0x7f50341e9450 2024-04-24T23:40:08.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f503927c640 1 --2- 172.21.15.57:0/2495881370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50341e9450 0x7f503414b3b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f50340a5310 tx=0x7f502c010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:08.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f50317fa640 1 -- 172.21.15.57:0/2495881370 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502c00f040 con 0x7f50341e9450 2024-04-24T23:40:08.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f50317fa640 1 -- 172.21.15.57:0/2495881370 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f502c01c070 con 0x7f50341e9450 2024-04-24T23:40:08.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f503acdf640 1 -- 172.21.15.57:0/2495881370 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5034143bb0 con 0x7f50341e9450 2024-04-24T23:40:08.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f50317fa640 1 -- 172.21.15.57:0/2495881370 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502c00ead0 con 0x7f50341e9450 2024-04-24T23:40:08.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f503acdf640 1 -- 172.21.15.57:0/2495881370 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f503414c6c0 con 0x7f50341e9450 2024-04-24T23:40:08.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f503acdf640 1 -- 172.21.15.57:0/2495881370 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5034068290 con 0x7f50341e9450 2024-04-24T23:40:08.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f50317fa640 1 -- 172.21.15.57:0/2495881370 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f502c00ec70 con 0x7f50341e9450 2024-04-24T23:40:08.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f50317fa640 1 --2- 172.21.15.57:0/2495881370 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f50140678c0 0x7f5014069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f50317fa640 1 -- 172.21.15.57:0/2495881370 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f502c085ce0 con 0x7f50341e9450 2024-04-24T23:40:08.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f50317fa640 1 --2- 172.21.15.57:0/2495881370 >> [v2:172.21.15.57:6808/3474703186,v1:172.21.15.57:6809/3474703186] conn(0x7f50140712e0 0x7f5014073780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f50317fa640 1 -- 172.21.15.57:0/2495881370 --> [v2:172.21.15.57:6808/3474703186,v1:172.21.15.57:6809/3474703186] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5014073e50 con 0x7f50140712e0 2024-04-24T23:40:08.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f50317fa640 1 -- 172.21.15.57:0/2495881370 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f502c0883e0 con 0x7f50341e9450 2024-04-24T23:40:08.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.332+0000 7f5038a7b640 1 --2- 172.21.15.57:0/2495881370 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f50140678c0 0x7f5014069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.336+0000 7f5033fff640 1 --2- 172.21.15.57:0/2495881370 >> [v2:172.21.15.57:6808/3474703186,v1:172.21.15.57:6809/3474703186] conn(0x7f50140712e0 0x7f5014073780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.336+0000 7f5033fff640 1 --2- 172.21.15.57:0/2495881370 >> [v2:172.21.15.57:6808/3474703186,v1:172.21.15.57:6809/3474703186] conn(0x7f50140712e0 0x7f5014073780 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:08.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.336+0000 7f5038a7b640 1 --2- 172.21.15.57:0/2495881370 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f50140678c0 0x7f5014069d80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f501c00dae0 tx=0x7f501c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:08.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.336+0000 7f50317fa640 1 -- 172.21.15.57:0/2495881370 <== osd.3 v2:172.21.15.57:6808/3474703186 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5014073e50 con 0x7f50140712e0 2024-04-24T23:40:08.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.348+0000 7f503acdf640 1 -- 172.21.15.57:0/2495881370 --> [v2:172.21.15.57:6808/3474703186,v1:172.21.15.57:6809/3474703186] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f50340bfca0 con 0x7f50140712e0 2024-04-24T23:40:08.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.348+0000 7f50317fa640 1 -- 172.21.15.57:0/2495881370 <== osd.3 v2:172.21.15.57:6808/3474703186 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f50340bfca0 con 0x7f50140712e0 2024-04-24T23:40:08.350 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-24T23:40:08.350 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:40:08.350 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-24T23:40:08.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.348+0000 7f503acdf640 1 -- 172.21.15.57:0/2495881370 >> [v2:172.21.15.57:6808/3474703186,v1:172.21.15.57:6809/3474703186] conn(0x7f50140712e0 msgr2=0x7f5014073780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:08.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.348+0000 7f503acdf640 1 --2- 172.21.15.57:0/2495881370 >> [v2:172.21.15.57:6808/3474703186,v1:172.21.15.57:6809/3474703186] conn(0x7f50140712e0 0x7f5014073780 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.348+0000 7f503acdf640 1 -- 172.21.15.57:0/2495881370 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f50140678c0 msgr2=0x7f5014069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:08.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.348+0000 7f503acdf640 1 --2- 172.21.15.57:0/2495881370 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f50140678c0 0x7f5014069d80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f501c00dae0 tx=0x7f501c008040 comp rx=0 tx=0).stop 2024-04-24T23:40:08.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.348+0000 7f503acdf640 1 -- 172.21.15.57:0/2495881370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50341e9450 msgr2=0x7f503414b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:08.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.348+0000 7f503acdf640 1 --2- 172.21.15.57:0/2495881370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50341e9450 0x7f503414b3b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f50340a5310 tx=0x7f502c010c20 comp rx=0 tx=0).stop 2024-04-24T23:40:08.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.348+0000 7f503927c640 1 -- 172.21.15.57:0/2495881370 reap_dead start 2024-04-24T23:40:08.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.348+0000 7f503acdf640 1 -- 172.21.15.57:0/2495881370 shutdown_connections 2024-04-24T23:40:08.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.348+0000 7f503acdf640 1 -- 172.21.15.57:0/2495881370 >> 172.21.15.57:0/2495881370 conn(0x7f503406b920 msgr2=0x7f50340bb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:08.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.348+0000 7f503acdf640 1 -- 172.21.15.57:0/2495881370 shutdown_connections 2024-04-24T23:40:08.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.348+0000 7f503acdf640 1 -- 172.21.15.57:0/2495881370 wait complete. 2024-04-24T23:40:08.366 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-24T23:40:08.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2af4fe6640 1 Processor -- start 2024-04-24T23:40:08.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2af4fe6640 1 -- start start 2024-04-24T23:40:08.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2af4fe6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2af01541d0 0x7f2af00c5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2af4fe6640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2af00b9810 0x7f2af00ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2af4fe6640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2af00c0f70 con 0x7f2af00abe30 2024-04-24T23:40:08.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2af4fe6640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f2af00c0a90 con 0x7f2af01541d0 2024-04-24T23:40:08.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2af4fe6640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f2af00c44f0 con 0x7f2af00b9810 2024-04-24T23:40:08.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2aeed9d640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2af00abe30 0x7f2af01545b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53974/0 (socket says 172.21.15.57:53974) 2024-04-24T23:40:08.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2aeed9d640 1 -- 172.21.15.57:0/4066655904 learned_addr learned my addr 172.21.15.57:0/4066655904 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:40:08.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2aee59c640 1 --2- 172.21.15.57:0/4066655904 >> v2:172.21.15.88:3300/0 conn(0x7f2af01541d0 0x7f2af00c5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2aedd9b640 1 --2- 172.21.15.57:0/4066655904 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2af00b9810 0x7f2af00ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2aed59a640 1 -- 172.21.15.57:0/4066655904 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1133798495 0 0) 0x7f2af00c0f70 con 0x7f2af00abe30 2024-04-24T23:40:08.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2aed59a640 1 -- 172.21.15.57:0/4066655904 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2adc003530 con 0x7f2af00abe30 2024-04-24T23:40:08.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2aed59a640 1 -- 172.21.15.57:0/4066655904 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 394793340 0 0) 0x7f2adc003530 con 0x7f2af00abe30 2024-04-24T23:40:08.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2aed59a640 1 -- 172.21.15.57:0/4066655904 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2af00b9810 msgr2=0x7f2af00ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:08.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2aed59a640 1 --2- 172.21.15.57:0/4066655904 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2af00b9810 0x7f2af00ab8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2aed59a640 1 -- 172.21.15.57:0/4066655904 >> v2:172.21.15.88:3300/0 conn(0x7f2af01541d0 msgr2=0x7f2af00c5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:08.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2aed59a640 1 --2- 172.21.15.57:0/4066655904 >> v2:172.21.15.88:3300/0 conn(0x7f2af01541d0 0x7f2af00c5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2aed59a640 1 -- 172.21.15.57:0/4066655904 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2af00c47d0 con 0x7f2af00abe30 2024-04-24T23:40:08.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2aed59a640 1 -- 172.21.15.57:0/4066655904 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7f2ae0001680 con 0x7f2af00abe30 2024-04-24T23:40:08.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2aed59a640 1 -- 172.21.15.57:0/4066655904 >> v1:172.21.15.57:6789/0 conn(0x7f2af00abe30 legacy=0x7f2af01545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:08.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2aed59a640 1 --2- 172.21.15.57:0/4066655904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2adc0039c0 0x7f2adc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2aed59a640 1 --2- 172.21.15.57:0/4066655904 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2adc004810 0x7f2adc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2aed59a640 1 --2- 172.21.15.57:0/4066655904 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2af00b9810 0x7f2adc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2aed59a640 1 -- 172.21.15.57:0/4066655904 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f2af00c0a90 con 0x7f2adc0039c0 2024-04-24T23:40:08.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2aed59a640 1 -- 172.21.15.57:0/4066655904 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2af00c44f0 con 0x7f2adc004810 2024-04-24T23:40:08.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2aed59a640 1 -- 172.21.15.57:0/4066655904 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f2adc00b9d0 con 0x7f2af00b9810 2024-04-24T23:40:08.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2aee59c640 1 --2- 172.21.15.57:0/4066655904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2adc0039c0 0x7f2adc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2aeed9d640 1 --2- 172.21.15.57:0/4066655904 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2af00b9810 0x7f2adc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2aee59c640 1 -- 172.21.15.57:0/4066655904 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2af00b9810 msgr2=0x7f2adc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:08.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2aee59c640 1 --2- 172.21.15.57:0/4066655904 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2af00b9810 0x7f2adc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2aee59c640 1 -- 172.21.15.57:0/4066655904 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2adc004810 msgr2=0x7f2adc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:08.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2aee59c640 1 --2- 172.21.15.57:0/4066655904 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2adc004810 0x7f2adc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.484+0000 7f2aee59c640 1 -- 172.21.15.57:0/4066655904 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2adc003530 con 0x7f2adc0039c0 2024-04-24T23:40:08.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.488+0000 7f2aee59c640 1 --2- 172.21.15.57:0/4066655904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2adc0039c0 0x7f2adc003de0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2ae800e170 tx=0x7f2ae801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9225964bfac8b76c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:08.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.488+0000 7f2aed59a640 1 -- 172.21.15.57:0/4066655904 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae80b2070 con 0x7f2adc0039c0 2024-04-24T23:40:08.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.488+0000 7f2aed59a640 1 -- 172.21.15.57:0/4066655904 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae80a59b0 con 0x7f2adc0039c0 2024-04-24T23:40:08.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.488+0000 7f2aed59a640 1 -- 172.21.15.57:0/4066655904 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8009c10 con 0x7f2adc0039c0 2024-04-24T23:40:08.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.488+0000 7f2af4fe6640 1 -- 172.21.15.57:0/4066655904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2adc0039c0 msgr2=0x7f2adc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:08.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.488+0000 7f2af4fe6640 1 --2- 172.21.15.57:0/4066655904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2adc0039c0 0x7f2adc003de0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2ae800e170 tx=0x7f2ae801cca0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.488+0000 7f2aeed9d640 1 -- 172.21.15.57:0/4066655904 reap_dead start 2024-04-24T23:40:08.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.488+0000 7f2af4fe6640 1 -- 172.21.15.57:0/4066655904 shutdown_connections 2024-04-24T23:40:08.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.488+0000 7f2af4fe6640 1 -- 172.21.15.57:0/4066655904 >> 172.21.15.57:0/4066655904 conn(0x7f2af00c6110 msgr2=0x7f2af00c6520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:08.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.488+0000 7f2af4fe6640 1 -- 172.21.15.57:0/4066655904 shutdown_connections 2024-04-24T23:40:08.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.488+0000 7f2af4fe6640 1 -- 172.21.15.57:0/4066655904 wait complete. 2024-04-24T23:40:08.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.488+0000 7f2af4fe6640 1 Processor -- start 2024-04-24T23:40:08.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.488+0000 7f2af4fe6640 1 -- start start 2024-04-24T23:40:08.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.492+0000 7f2af4fe6640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2adc0039c0 0x7f2af014e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.492+0000 7f2af4fe6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2af0151650 0x7f2af00a9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.492+0000 7f2af4fe6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2af014a550 0x7f2af00a9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.492+0000 7f2af4fe6640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f2af015bcc0 con 0x7f2af014a550 2024-04-24T23:40:08.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.492+0000 7f2af4fe6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2af015be40 con 0x7f2af0151650 2024-04-24T23:40:08.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.492+0000 7f2af4fe6640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f2af015bfc0 con 0x7f2adc0039c0 2024-04-24T23:40:08.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.492+0000 7f2aeed9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2af014a550 0x7f2af00a9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.492+0000 7f2aeed9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2af014a550 0x7f2af00a9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35214/0 (socket says 172.21.15.57:35214) 2024-04-24T23:40:08.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.492+0000 7f2aeed9d640 1 -- 172.21.15.57:0/2052332609 learned_addr learned my addr 172.21.15.57:0/2052332609 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:08.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.492+0000 7f2aedd9b640 1 --2- 172.21.15.57:0/2052332609 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2af0151650 0x7f2af00a9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.492+0000 7f2aee59c640 1 --2- 172.21.15.57:0/2052332609 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2adc0039c0 0x7f2af014e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.492+0000 7f2aeed9d640 1 -- 172.21.15.57:0/2052332609 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2adc0039c0 msgr2=0x7f2af014e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:08.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.492+0000 7f2aeed9d640 1 --2- 172.21.15.57:0/2052332609 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2adc0039c0 0x7f2af014e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.492+0000 7f2aeed9d640 1 -- 172.21.15.57:0/2052332609 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2af0151650 msgr2=0x7f2af00a9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:08.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.492+0000 7f2aeed9d640 1 --2- 172.21.15.57:0/2052332609 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2af0151650 0x7f2af00a9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.492+0000 7f2aeed9d640 1 -- 172.21.15.57:0/2052332609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2af01ed370 con 0x7f2af014a550 2024-04-24T23:40:08.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.492+0000 7f2aeed9d640 1 --2- 172.21.15.57:0/2052332609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2af014a550 0x7f2af00a9640 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2af00a5bc0 tx=0x7f2ae000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:08.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.492+0000 7f2ae6ffd640 1 -- 172.21.15.57:0/2052332609 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0019070 con 0x7f2af014a550 2024-04-24T23:40:08.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.492+0000 7f2ae6ffd640 1 -- 172.21.15.57:0/2052332609 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae000c690 con 0x7f2af014a550 2024-04-24T23:40:08.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.492+0000 7f2af4fe6640 1 -- 172.21.15.57:0/2052332609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2af00a6e00 con 0x7f2af014a550 2024-04-24T23:40:08.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.492+0000 7f2ae6ffd640 1 -- 172.21.15.57:0/2052332609 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae000ca80 con 0x7f2af014a550 2024-04-24T23:40:08.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.492+0000 7f2af4fe6640 1 -- 172.21.15.57:0/2052332609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2af01ed610 con 0x7f2af014a550 2024-04-24T23:40:08.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.492+0000 7f2af4fe6640 1 -- 172.21.15.57:0/2052332609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2af01ed810 con 0x7f2af014a550 2024-04-24T23:40:08.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.492+0000 7f2ae6ffd640 1 -- 172.21.15.57:0/2052332609 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2ae001c070 con 0x7f2af014a550 2024-04-24T23:40:08.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.492+0000 7f2ae6ffd640 1 --2- 172.21.15.57:0/2052332609 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f2ad00678c0 0x7f2ad0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.492+0000 7f2ae6ffd640 1 -- 172.21.15.57:0/2052332609 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f2ae00855a0 con 0x7f2af014a550 2024-04-24T23:40:08.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.492+0000 7f2aee59c640 1 --2- 172.21.15.57:0/2052332609 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f2ad00678c0 0x7f2ad0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.496+0000 7f2aee59c640 1 --2- 172.21.15.57:0/2052332609 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f2ad00678c0 0x7f2ad0069d80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2ae80af000 tx=0x7f2ae80a7040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:08.499 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.496+0000 7f2ae6ffd640 1 -- 172.21.15.57:0/2052332609 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f2af01ed810 con 0x7f2af014a550 2024-04-24T23:40:08.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.664+0000 7f2af4fe6640 1 -- 172.21.15.57:0/2052332609 --> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f2af014ed90 con 0x7f2ad00678c0 2024-04-24T23:40:08.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.664+0000 7f2ae6ffd640 1 -- 172.21.15.57:0/2052332609 <== mgr.4105 v2:172.21.15.88:6832/3931748276 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2ae80a5930 con 0x7f2ad00678c0 2024-04-24T23:40:08.666 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 3 to deep-scrub 2024-04-24T23:40:08.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.668+0000 7f2af4fe6640 1 -- 172.21.15.57:0/2052332609 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f2ad00678c0 msgr2=0x7f2ad0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:08.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.668+0000 7f2af4fe6640 1 --2- 172.21.15.57:0/2052332609 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f2ad00678c0 0x7f2ad0069d80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2ae80af000 tx=0x7f2ae80a7040 comp rx=0 tx=0).stop 2024-04-24T23:40:08.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.668+0000 7f2af4fe6640 1 -- 172.21.15.57:0/2052332609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2af014a550 msgr2=0x7f2af00a9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:08.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.668+0000 7f2af4fe6640 1 --2- 172.21.15.57:0/2052332609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2af014a550 0x7f2af00a9640 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2af00a5bc0 tx=0x7f2ae000ec10 comp rx=0 tx=0).stop 2024-04-24T23:40:08.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.668+0000 7f2af4fe6640 1 -- 172.21.15.57:0/2052332609 shutdown_connections 2024-04-24T23:40:08.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.668+0000 7f2af4fe6640 1 --2- 172.21.15.57:0/2052332609 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f2ad00678c0 0x7f2ad0069d80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.668+0000 7f2af4fe6640 1 --2- 172.21.15.57:0/2052332609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2af014a550 0x7f2af00a9640 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.668+0000 7f2af4fe6640 1 --2- 172.21.15.57:0/2052332609 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2af0151650 0x7f2af00a9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.668+0000 7f2af4fe6640 1 --2- 172.21.15.57:0/2052332609 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2adc0039c0 0x7f2af014e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.668+0000 7f2af4fe6640 1 -- 172.21.15.57:0/2052332609 >> 172.21.15.57:0/2052332609 conn(0x7f2af00c6110 msgr2=0x7f2af014dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:08.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.668+0000 7f2af4fe6640 1 -- 172.21.15.57:0/2052332609 shutdown_connections 2024-04-24T23:40:08.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.668+0000 7f2af4fe6640 1 -- 172.21.15.57:0/2052332609 wait complete. 2024-04-24T23:40:08.684 INFO:tasks.ceph:Scrubbing osd.4 2024-04-24T23:40:08.685 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:40:08.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.804+0000 7f6ec4e8e640 1 Processor -- start 2024-04-24T23:40:08.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.804+0000 7f6ec4e8e640 1 -- start start 2024-04-24T23:40:08.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.804+0000 7f6ec4e8e640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6ec00c21a0 0x7f6ec00a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.804+0000 7f6ec4e8e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6ec006ebf0 0x7f6ec006f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.804+0000 7f6ec4e8e640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6ec006c220 0x7f6ec00c0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.804+0000 7f6ec4e8e640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f6ec00c2580 con 0x7f6ec00c21a0 2024-04-24T23:40:08.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.804+0000 7f6ec4e8e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f6ec006e9c0 con 0x7f6ec006ebf0 2024-04-24T23:40:08.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.804+0000 7f6ec4e8e640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f6ec0067230 con 0x7f6ec006c220 2024-04-24T23:40:08.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.804+0000 7f6ebe59c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6ec00c21a0 0x7f6ec00a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.804+0000 7f6ebe59c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6ec00c21a0 0x7f6ec00a1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35226/0 (socket says 172.21.15.57:35226) 2024-04-24T23:40:08.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.804+0000 7f6ebe59c640 1 -- 172.21.15.57:0/1243818558 learned_addr learned my addr 172.21.15.57:0/1243818558 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:08.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.804+0000 7f6ebdd9b640 1 --2- 172.21.15.57:0/1243818558 >> v2:172.21.15.88:3300/0 conn(0x7f6ec006ebf0 0x7f6ec006f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.804+0000 7f6ebed9d640 1 --2- 172.21.15.57:0/1243818558 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6ec006c220 0x7f6ec00c0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.804+0000 7f6ebe59c640 1 -- 172.21.15.57:0/1243818558 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6ec006c220 msgr2=0x7f6ec00c0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:08.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.804+0000 7f6ebe59c640 1 --2- 172.21.15.57:0/1243818558 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6ec006c220 0x7f6ec00c0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.804+0000 7f6ebe59c640 1 -- 172.21.15.57:0/1243818558 >> v2:172.21.15.88:3300/0 conn(0x7f6ec006ebf0 msgr2=0x7f6ec006f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:08.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.804+0000 7f6ebe59c640 1 --2- 172.21.15.57:0/1243818558 >> v2:172.21.15.88:3300/0 conn(0x7f6ec006ebf0 0x7f6ec006f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.804+0000 7f6ebe59c640 1 -- 172.21.15.57:0/1243818558 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec0067510 con 0x7f6ec00c21a0 2024-04-24T23:40:08.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.804+0000 7f6ebed9d640 1 --2- 172.21.15.57:0/1243818558 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6ec006c220 0x7f6ec00c0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:40:08.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.808+0000 7f6ebe59c640 1 --2- 172.21.15.57:0/1243818558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ec00c21a0 0x7f6ec00a1ec0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6ec006da00 tx=0x7f6eb001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9081ddb43a8320 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:08.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.808+0000 7f6ebd59a640 1 -- 172.21.15.57:0/1243818558 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb00b5070 con 0x7f6ec00c21a0 2024-04-24T23:40:08.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.808+0000 7f6ebd59a640 1 -- 172.21.15.57:0/1243818558 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eb00a89d0 con 0x7f6ec00c21a0 2024-04-24T23:40:08.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.808+0000 7f6ebd59a640 1 -- 172.21.15.57:0/1243818558 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb00a8da0 con 0x7f6ec00c21a0 2024-04-24T23:40:08.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.808+0000 7f6ec4e8e640 1 -- 172.21.15.57:0/1243818558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ec00c21a0 msgr2=0x7f6ec00a1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:08.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.808+0000 7f6ec4e8e640 1 --2- 172.21.15.57:0/1243818558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ec00c21a0 0x7f6ec00a1ec0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6ec006da00 tx=0x7f6eb001ed10 comp rx=0 tx=0).stop 2024-04-24T23:40:08.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.808+0000 7f6ec4e8e640 1 -- 172.21.15.57:0/1243818558 shutdown_connections 2024-04-24T23:40:08.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.808+0000 7f6ec4e8e640 1 --2- 172.21.15.57:0/1243818558 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6ec006c220 0x7f6ec00c0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.808+0000 7f6ec4e8e640 1 --2- 172.21.15.57:0/1243818558 >> v2:172.21.15.88:3300/0 conn(0x7f6ec006ebf0 0x7f6ec006f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.808+0000 7f6ec4e8e640 1 --2- 172.21.15.57:0/1243818558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ec00c21a0 0x7f6ec00a1ec0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.808+0000 7f6ec4e8e640 1 -- 172.21.15.57:0/1243818558 >> 172.21.15.57:0/1243818558 conn(0x7f6ec00bf220 msgr2=0x7f6ec00bf630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:08.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.808+0000 7f6ec4e8e640 1 -- 172.21.15.57:0/1243818558 shutdown_connections 2024-04-24T23:40:08.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.808+0000 7f6ec4e8e640 1 -- 172.21.15.57:0/1243818558 wait complete. 2024-04-24T23:40:08.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.808+0000 7f6ec4e8e640 1 Processor -- start 2024-04-24T23:40:08.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.808+0000 7f6ec4e8e640 1 -- start start 2024-04-24T23:40:08.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.808+0000 7f6ec4e8e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ec006c220 0x7f6ec01e7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.808+0000 7f6ec4e8e640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6ec006ebf0 0x7f6ec014ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.808+0000 7f6ec4e8e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ec00c21a0 0x7f6ec00b7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.808+0000 7f6ec4e8e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec00c1560 con 0x7f6ec006c220 2024-04-24T23:40:08.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.808+0000 7f6ec4e8e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec00c13e0 con 0x7f6ec00c21a0 2024-04-24T23:40:08.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.808+0000 7f6ec4e8e640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f6ec006c6b0 con 0x7f6ec006ebf0 2024-04-24T23:40:08.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.812+0000 7f6ebe59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ec006c220 0x7f6ec01e7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.812+0000 7f6ebe59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ec006c220 0x7f6ec01e7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35234/0 (socket says 172.21.15.57:35234) 2024-04-24T23:40:08.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.812+0000 7f6ebe59c640 1 -- 172.21.15.57:0/3631989957 learned_addr learned my addr 172.21.15.57:0/3631989957 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:08.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.812+0000 7f6ebed9d640 1 --2- 172.21.15.57:0/3631989957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ec00c21a0 0x7f6ec00b7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.812+0000 7f6ebdd9b640 1 --2- 172.21.15.57:0/3631989957 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6ec006ebf0 0x7f6ec014ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.812+0000 7f6ebe59c640 1 -- 172.21.15.57:0/3631989957 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6ec006ebf0 msgr2=0x7f6ec014ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:08.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.812+0000 7f6ebe59c640 1 --2- 172.21.15.57:0/3631989957 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6ec006ebf0 0x7f6ec014ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.812+0000 7f6ebe59c640 1 -- 172.21.15.57:0/3631989957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ec00c21a0 msgr2=0x7f6ec00b7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:08.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.812+0000 7f6ebe59c640 1 --2- 172.21.15.57:0/3631989957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ec00c21a0 0x7f6ec00b7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.812+0000 7f6ebe59c640 1 -- 172.21.15.57:0/3631989957 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec014d1f0 con 0x7f6ec006c220 2024-04-24T23:40:08.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.812+0000 7f6ebed9d640 1 --2- 172.21.15.57:0/3631989957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ec00c21a0 0x7f6ec00b7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:40:08.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.812+0000 7f6ebe59c640 1 --2- 172.21.15.57:0/3631989957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ec006c220 0x7f6ec01e7ae0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6eb001d3c0 tx=0x7f6eb001bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:08.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.812+0000 7f6eaeffd640 1 -- 172.21.15.57:0/3631989957 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb00b5070 con 0x7f6ec006c220 2024-04-24T23:40:08.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.812+0000 7f6eaeffd640 1 -- 172.21.15.57:0/3631989957 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eb00b0a30 con 0x7f6ec006c220 2024-04-24T23:40:08.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.812+0000 7f6eaeffd640 1 -- 172.21.15.57:0/3631989957 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb00b0e20 con 0x7f6ec006c220 2024-04-24T23:40:08.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.812+0000 7f6ec4e8e640 1 -- 172.21.15.57:0/3631989957 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ec014bcb0 con 0x7f6ec006c220 2024-04-24T23:40:08.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.812+0000 7f6ec4e8e640 1 -- 172.21.15.57:0/3631989957 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ec0151350 con 0x7f6ec006c220 2024-04-24T23:40:08.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.812+0000 7f6ec4e8e640 1 -- 172.21.15.57:0/3631989957 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6ec0151520 con 0x7f6ec006c220 2024-04-24T23:40:08.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.812+0000 7f6eaeffd640 1 -- 172.21.15.57:0/3631989957 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6eb00c2060 con 0x7f6ec006c220 2024-04-24T23:40:08.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.812+0000 7f6eaeffd640 1 --2- 172.21.15.57:0/3631989957 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6ea00678c0 0x7f6ea0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.812+0000 7f6eaeffd640 1 -- 172.21.15.57:0/3631989957 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f6eb01231b0 con 0x7f6ec006c220 2024-04-24T23:40:08.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.812+0000 7f6eaeffd640 1 --2- 172.21.15.57:0/3631989957 >> [v2:172.21.15.88:6800/1271707713,v1:172.21.15.88:6801/1271707713] conn(0x7f6ea00712d0 0x7f6ea0073770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.812+0000 7f6eaeffd640 1 -- 172.21.15.57:0/3631989957 --> [v2:172.21.15.88:6800/1271707713,v1:172.21.15.88:6801/1271707713] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6eb00aaea0 con 0x7f6ea00712d0 2024-04-24T23:40:08.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.812+0000 7f6eaeffd640 1 -- 172.21.15.57:0/3631989957 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6eb012a050 con 0x7f6ec006c220 2024-04-24T23:40:08.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.812+0000 7f6ebdd9b640 1 --2- 172.21.15.57:0/3631989957 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6ea00678c0 0x7f6ea0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.812+0000 7f6ebed9d640 1 --2- 172.21.15.57:0/3631989957 >> [v2:172.21.15.88:6800/1271707713,v1:172.21.15.88:6801/1271707713] conn(0x7f6ea00712d0 0x7f6ea0073770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.812+0000 7f6ebdd9b640 1 --2- 172.21.15.57:0/3631989957 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6ea00678c0 0x7f6ea0069d80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4009a30 tx=0x7f6eb4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:08.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.812+0000 7f6ebed9d640 1 --2- 172.21.15.57:0/3631989957 >> [v2:172.21.15.88:6800/1271707713,v1:172.21.15.88:6801/1271707713] conn(0x7f6ea00712d0 0x7f6ea0073770 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:08.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.816+0000 7f6eaeffd640 1 -- 172.21.15.57:0/3631989957 <== osd.4 v2:172.21.15.88:6800/1271707713 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6eb00aaea0 con 0x7f6ea00712d0 2024-04-24T23:40:08.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.828+0000 7f6ec4e8e640 1 -- 172.21.15.57:0/3631989957 --> [v2:172.21.15.88:6800/1271707713,v1:172.21.15.88:6801/1271707713] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6ec0068930 con 0x7f6ea00712d0 2024-04-24T23:40:08.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.828+0000 7f6eaeffd640 1 -- 172.21.15.57:0/3631989957 <== osd.4 v2:172.21.15.88:6800/1271707713 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6ec0068930 con 0x7f6ea00712d0 2024-04-24T23:40:08.831 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-24T23:40:08.831 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:40:08.831 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-24T23:40:08.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.828+0000 7f6ec4e8e640 1 -- 172.21.15.57:0/3631989957 >> [v2:172.21.15.88:6800/1271707713,v1:172.21.15.88:6801/1271707713] conn(0x7f6ea00712d0 msgr2=0x7f6ea0073770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:08.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.828+0000 7f6ec4e8e640 1 --2- 172.21.15.57:0/3631989957 >> [v2:172.21.15.88:6800/1271707713,v1:172.21.15.88:6801/1271707713] conn(0x7f6ea00712d0 0x7f6ea0073770 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.828+0000 7f6ec4e8e640 1 -- 172.21.15.57:0/3631989957 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6ea00678c0 msgr2=0x7f6ea0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:08.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.828+0000 7f6ec4e8e640 1 --2- 172.21.15.57:0/3631989957 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6ea00678c0 0x7f6ea0069d80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4009a30 tx=0x7f6eb4008040 comp rx=0 tx=0).stop 2024-04-24T23:40:08.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.828+0000 7f6ec4e8e640 1 -- 172.21.15.57:0/3631989957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ec006c220 msgr2=0x7f6ec01e7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:08.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.828+0000 7f6ec4e8e640 1 --2- 172.21.15.57:0/3631989957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ec006c220 0x7f6ec01e7ae0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6eb001d3c0 tx=0x7f6eb001bab0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.828+0000 7f6ebed9d640 1 -- 172.21.15.57:0/3631989957 reap_dead start 2024-04-24T23:40:08.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.828+0000 7f6ec4e8e640 1 -- 172.21.15.57:0/3631989957 shutdown_connections 2024-04-24T23:40:08.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.828+0000 7f6ec4e8e640 1 -- 172.21.15.57:0/3631989957 >> 172.21.15.57:0/3631989957 conn(0x7f6ec00bf220 msgr2=0x7f6ec00bf600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:08.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.828+0000 7f6ec4e8e640 1 -- 172.21.15.57:0/3631989957 shutdown_connections 2024-04-24T23:40:08.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.828+0000 7f6ec4e8e640 1 -- 172.21.15.57:0/3631989957 wait complete. 2024-04-24T23:40:08.846 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-24T23:40:08.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.960+0000 7f46a6d6e640 1 Processor -- start 2024-04-24T23:40:08.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.960+0000 7f46a6d6e640 1 -- start start 2024-04-24T23:40:08.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.960+0000 7f46a6d6e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f46a00c11d0 0x7f46a00a65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.960+0000 7f46a6d6e640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f46a0152830 0x7f46a00bfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.960+0000 7f46a6d6e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46a0151d50 con 0x7f46a00a6200 2024-04-24T23:40:08.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.960+0000 7f46a6d6e640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f46a01523a0 con 0x7f46a0152830 2024-04-24T23:40:08.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.960+0000 7f46a6d6e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f46a0152030 con 0x7f46a00c11d0 2024-04-24T23:40:08.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.960+0000 7f46a530b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f46a0152830 0x7f46a00bfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.960+0000 7f46a530b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f46a0152830 0x7f46a00bfae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35244/0 (socket says 172.21.15.57:35244) 2024-04-24T23:40:08.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.960+0000 7f46a530b640 1 -- 172.21.15.57:0/2710707117 learned_addr learned my addr 172.21.15.57:0/2710707117 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:08.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.960+0000 7f469ffff640 1 --2- 172.21.15.57:0/2710707117 >> v2:172.21.15.88:3300/0 conn(0x7f46a00c11d0 0x7f46a00a65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.960+0000 7f46a530b640 1 -- 172.21.15.57:0/2710707117 >> v2:172.21.15.88:3300/0 conn(0x7f46a00c11d0 msgr2=0x7f46a00a65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:08.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.960+0000 7f46a530b640 1 --2- 172.21.15.57:0/2710707117 >> v2:172.21.15.88:3300/0 conn(0x7f46a00c11d0 0x7f46a00a65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.960+0000 7f46a530b640 1 -- 172.21.15.57:0/2710707117 >> v1:172.21.15.88:6789/0 conn(0x7f46a00a6200 legacy=0x7f46a0070530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:08.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.960+0000 7f46a530b640 1 -- 172.21.15.57:0/2710707117 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a00c3a80 con 0x7f46a0152830 2024-04-24T23:40:08.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.960+0000 7f469ffff640 1 --2- 172.21.15.57:0/2710707117 >> v2:172.21.15.88:3300/0 conn(0x7f46a00c11d0 0x7f46a00a65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:40:08.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.964+0000 7f46a530b640 1 --2- 172.21.15.57:0/2710707117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46a0152830 0x7f46a00bfae0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f46a006fc80 tx=0x7f469001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a4516547267151e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:08.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.964+0000 7f469f7fe640 1 -- 172.21.15.57:0/2710707117 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46900ab430 con 0x7f46a0152830 2024-04-24T23:40:08.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.964+0000 7f469f7fe640 1 -- 172.21.15.57:0/2710707117 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46900b0070 con 0x7f46a0152830 2024-04-24T23:40:08.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.964+0000 7f469f7fe640 1 -- 172.21.15.57:0/2710707117 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46900ab7f0 con 0x7f46a0152830 2024-04-24T23:40:08.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.964+0000 7f46a6d6e640 1 -- 172.21.15.57:0/2710707117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46a0152830 msgr2=0x7f46a00bfae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:08.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.964+0000 7f46a6d6e640 1 --2- 172.21.15.57:0/2710707117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46a0152830 0x7f46a00bfae0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f46a006fc80 tx=0x7f469001c520 comp rx=0 tx=0).stop 2024-04-24T23:40:08.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.964+0000 7f46a6d6e640 1 -- 172.21.15.57:0/2710707117 shutdown_connections 2024-04-24T23:40:08.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.964+0000 7f46a6d6e640 1 --2- 172.21.15.57:0/2710707117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46a0152830 0x7f46a00bfae0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.964+0000 7f46a6d6e640 1 --2- 172.21.15.57:0/2710707117 >> v2:172.21.15.88:3300/0 conn(0x7f46a00c11d0 0x7f46a00a65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.964+0000 7f46a6d6e640 1 -- 172.21.15.57:0/2710707117 >> 172.21.15.57:0/2710707117 conn(0x7f46a006b810 msgr2=0x7f46a00a5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:08.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.964+0000 7f46a6d6e640 1 -- 172.21.15.57:0/2710707117 shutdown_connections 2024-04-24T23:40:08.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.964+0000 7f46a6d6e640 1 -- 172.21.15.57:0/2710707117 wait complete. 2024-04-24T23:40:08.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.964+0000 7f46a6d6e640 1 Processor -- start 2024-04-24T23:40:08.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.964+0000 7f46a6d6e640 1 -- start start 2024-04-24T23:40:08.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.968+0000 7f46a6d6e640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f46a00a6200 0x7f46a00bd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.968+0000 7f46a6d6e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46a00c11d0 0x7f46a01ed950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.968+0000 7f46a6d6e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46a0152830 0x7f46a00bae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.968+0000 7f46a6d6e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f46a00a36a0 con 0x7f46a0152830 2024-04-24T23:40:08.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.968+0000 7f46a6d6e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f46a00a3520 con 0x7f46a00c11d0 2024-04-24T23:40:08.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.968+0000 7f46a6d6e640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f46a006e330 con 0x7f46a00a6200 2024-04-24T23:40:08.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.968+0000 7f46a530b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46a0152830 0x7f46a00bae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.968+0000 7f46a530b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46a0152830 0x7f46a00bae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35250/0 (socket says 172.21.15.57:35250) 2024-04-24T23:40:08.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.968+0000 7f46a530b640 1 -- 172.21.15.57:0/709778810 learned_addr learned my addr 172.21.15.57:0/709778810 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:08.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.968+0000 7f469ffff640 1 --2- 172.21.15.57:0/709778810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46a00c11d0 0x7f46a01ed950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.968+0000 7f46a530b640 1 -- 172.21.15.57:0/709778810 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f46a00a6200 msgr2=0x7f46a00bd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:08.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.968+0000 7f46a530b640 1 --2- 172.21.15.57:0/709778810 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f46a00a6200 0x7f46a00bd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.968+0000 7f46a530b640 1 -- 172.21.15.57:0/709778810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46a00c11d0 msgr2=0x7f46a01ed950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:08.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.968+0000 7f46a530b640 1 --2- 172.21.15.57:0/709778810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46a00c11d0 0x7f46a01ed950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:08.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.968+0000 7f46a530b640 1 -- 172.21.15.57:0/709778810 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a00bb370 con 0x7f46a0152830 2024-04-24T23:40:08.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.968+0000 7f469ffff640 1 --2- 172.21.15.57:0/709778810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46a00c11d0 0x7f46a01ed950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:40:08.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.968+0000 7f46a530b640 1 --2- 172.21.15.57:0/709778810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46a0152830 0x7f46a00bae30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f46900ad040 tx=0x7f46900192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:08.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.968+0000 7f469d7fa640 1 -- 172.21.15.57:0/709778810 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46900b5810 con 0x7f46a0152830 2024-04-24T23:40:08.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.968+0000 7f469d7fa640 1 -- 172.21.15.57:0/709778810 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46900b59d0 con 0x7f46a0152830 2024-04-24T23:40:08.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.968+0000 7f46a6d6e640 1 -- 172.21.15.57:0/709778810 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46a00ba7a0 con 0x7f46a0152830 2024-04-24T23:40:08.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.968+0000 7f469d7fa640 1 -- 172.21.15.57:0/709778810 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46900b5dc0 con 0x7f46a0152830 2024-04-24T23:40:08.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.968+0000 7f46a6d6e640 1 -- 172.21.15.57:0/709778810 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46a0159b60 con 0x7f46a0152830 2024-04-24T23:40:08.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.968+0000 7f46a6d6e640 1 -- 172.21.15.57:0/709778810 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46a0159da0 con 0x7f46a0152830 2024-04-24T23:40:08.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.968+0000 7f469d7fa640 1 -- 172.21.15.57:0/709778810 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f46900bd020 con 0x7f46a0152830 2024-04-24T23:40:08.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.968+0000 7f469d7fa640 1 --2- 172.21.15.57:0/709778810 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f46800678f0 0x7f4680069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:08.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.968+0000 7f469d7fa640 1 -- 172.21.15.57:0/709778810 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f46900a8030 con 0x7f46a0152830 2024-04-24T23:40:08.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.968+0000 7f46a4b0a640 1 --2- 172.21.15.57:0/709778810 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f46800678f0 0x7f4680069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:08.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.972+0000 7f46a4b0a640 1 --2- 172.21.15.57:0/709778810 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f46800678f0 0x7f4680069db0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4698007fd0 tx=0x7f4698007d60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:08.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:08.972+0000 7f469d7fa640 1 -- 172.21.15.57:0/709778810 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f46a0159da0 con 0x7f46a0152830 2024-04-24T23:40:09.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.136+0000 7f46a6d6e640 1 -- 172.21.15.57:0/709778810 --> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f46a0159670 con 0x7f46800678f0 2024-04-24T23:40:09.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.140+0000 7f469d7fa640 1 -- 172.21.15.57:0/709778810 <== mgr.4105 v2:172.21.15.88:6832/3931748276 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f46a0159670 con 0x7f46800678f0 2024-04-24T23:40:09.140 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 4 to deep-scrub 2024-04-24T23:40:09.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.140+0000 7f46a6d6e640 1 -- 172.21.15.57:0/709778810 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f46800678f0 msgr2=0x7f4680069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:09.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.140+0000 7f46a6d6e640 1 --2- 172.21.15.57:0/709778810 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f46800678f0 0x7f4680069db0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4698007fd0 tx=0x7f4698007d60 comp rx=0 tx=0).stop 2024-04-24T23:40:09.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.140+0000 7f46a6d6e640 1 -- 172.21.15.57:0/709778810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46a0152830 msgr2=0x7f46a00bae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:09.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.140+0000 7f46a6d6e640 1 --2- 172.21.15.57:0/709778810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46a0152830 0x7f46a00bae30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f46900ad040 tx=0x7f46900192c0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.140+0000 7f46a6d6e640 1 -- 172.21.15.57:0/709778810 shutdown_connections 2024-04-24T23:40:09.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.140+0000 7f46a6d6e640 1 --2- 172.21.15.57:0/709778810 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f46800678f0 0x7f4680069db0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.140+0000 7f46a6d6e640 1 --2- 172.21.15.57:0/709778810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46a0152830 0x7f46a00bae30 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.140+0000 7f46a6d6e640 1 --2- 172.21.15.57:0/709778810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46a00c11d0 0x7f46a01ed950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.140+0000 7f46a6d6e640 1 --2- 172.21.15.57:0/709778810 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f46a00a6200 0x7f46a00bd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.140+0000 7f46a6d6e640 1 -- 172.21.15.57:0/709778810 >> 172.21.15.57:0/709778810 conn(0x7f46a006b810 msgr2=0x7f46a015a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:09.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.140+0000 7f46a6d6e640 1 -- 172.21.15.57:0/709778810 shutdown_connections 2024-04-24T23:40:09.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.140+0000 7f46a6d6e640 1 -- 172.21.15.57:0/709778810 wait complete. 2024-04-24T23:40:09.159 INFO:tasks.ceph:Scrubbing osd.5 2024-04-24T23:40:09.159 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:40:09.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.280+0000 7f939ad60640 1 Processor -- start 2024-04-24T23:40:09.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.280+0000 7f939ad60640 1 -- start start 2024-04-24T23:40:09.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.280+0000 7f939ad60640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f939414a320 0x7f9394150d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:09.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.280+0000 7f939ad60640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f939406d6d0 0x7f93940bd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:09.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.280+0000 7f939ad60640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f93940bde50 0x7f939414d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:09.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.280+0000 7f939ad60640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f93940722c0 con 0x7f93940bde50 2024-04-24T23:40:09.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.280+0000 7f939ad60640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f93940725a0 con 0x7f939406d6d0 2024-04-24T23:40:09.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.280+0000 7f939ad60640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f939414cfa0 con 0x7f939414a320 2024-04-24T23:40:09.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.280+0000 7f93992fd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f93940bde50 0x7f939414d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:09.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.280+0000 7f93992fd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f93940bde50 0x7f939414d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35254/0 (socket says 172.21.15.57:35254) 2024-04-24T23:40:09.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.280+0000 7f93992fd640 1 -- 172.21.15.57:0/1507312480 learned_addr learned my addr 172.21.15.57:0/1507312480 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:09.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.284+0000 7f9393fff640 1 --2- 172.21.15.57:0/1507312480 >> v2:172.21.15.88:3300/0 conn(0x7f939406d6d0 0x7f93940bd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:09.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.284+0000 7f9398afc640 1 --2- 172.21.15.57:0/1507312480 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f939414a320 0x7f9394150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:09.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.284+0000 7f93992fd640 1 -- 172.21.15.57:0/1507312480 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f939414a320 msgr2=0x7f9394150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:09.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.284+0000 7f93992fd640 1 --2- 172.21.15.57:0/1507312480 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f939414a320 0x7f9394150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.284+0000 7f93992fd640 1 -- 172.21.15.57:0/1507312480 >> v2:172.21.15.88:3300/0 conn(0x7f939406d6d0 msgr2=0x7f93940bd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:09.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.284+0000 7f93992fd640 1 --2- 172.21.15.57:0/1507312480 >> v2:172.21.15.88:3300/0 conn(0x7f939406d6d0 0x7f93940bd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.284+0000 7f93992fd640 1 -- 172.21.15.57:0/1507312480 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f939414a700 con 0x7f93940bde50 2024-04-24T23:40:09.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.284+0000 7f93992fd640 1 --2- 172.21.15.57:0/1507312480 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93940bde50 0x7f939414d4c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f939406f150 tx=0x7f938c01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46850c6977d0e1ee server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:09.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.284+0000 7f93937fe640 1 -- 172.21.15.57:0/1507312480 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c0b4070 con 0x7f93940bde50 2024-04-24T23:40:09.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.284+0000 7f93937fe640 1 -- 172.21.15.57:0/1507312480 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f938c0af400 con 0x7f93940bde50 2024-04-24T23:40:09.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.284+0000 7f93937fe640 1 -- 172.21.15.57:0/1507312480 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c0af7d0 con 0x7f93940bde50 2024-04-24T23:40:09.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.284+0000 7f939ad60640 1 -- 172.21.15.57:0/1507312480 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93940bde50 msgr2=0x7f939414d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:09.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.284+0000 7f939ad60640 1 --2- 172.21.15.57:0/1507312480 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93940bde50 0x7f939414d4c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f939406f150 tx=0x7f938c01f1e0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.284+0000 7f939ad60640 1 -- 172.21.15.57:0/1507312480 shutdown_connections 2024-04-24T23:40:09.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.284+0000 7f939ad60640 1 --2- 172.21.15.57:0/1507312480 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93940bde50 0x7f939414d4c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.284+0000 7f939ad60640 1 --2- 172.21.15.57:0/1507312480 >> v2:172.21.15.88:3300/0 conn(0x7f939406d6d0 0x7f93940bd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.284+0000 7f939ad60640 1 --2- 172.21.15.57:0/1507312480 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f939414a320 0x7f9394150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.284+0000 7f939ad60640 1 -- 172.21.15.57:0/1507312480 >> 172.21.15.57:0/1507312480 conn(0x7f939406b920 msgr2=0x7f93940c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:09.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.284+0000 7f939ad60640 1 -- 172.21.15.57:0/1507312480 shutdown_connections 2024-04-24T23:40:09.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.284+0000 7f939ad60640 1 -- 172.21.15.57:0/1507312480 wait complete. 2024-04-24T23:40:09.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.288+0000 7f939ad60640 1 Processor -- start 2024-04-24T23:40:09.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.288+0000 7f939ad60640 1 -- start start 2024-04-24T23:40:09.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.288+0000 7f939ad60640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f939406d6d0 0x7f93941578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:09.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.288+0000 7f939ad60640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93940bde50 0x7f93941488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:09.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.288+0000 7f939ad60640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f939414a320 0x7f93940c2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:09.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.288+0000 7f939ad60640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f939414da00 con 0x7f93940bde50 2024-04-24T23:40:09.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.288+0000 7f939ad60640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f93940bc540 con 0x7f939406d6d0 2024-04-24T23:40:09.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.288+0000 7f939ad60640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f939414db80 con 0x7f939414a320 2024-04-24T23:40:09.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.288+0000 7f9393fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93940bde50 0x7f93941488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:09.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.288+0000 7f9393fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93940bde50 0x7f93941488a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35264/0 (socket says 172.21.15.57:35264) 2024-04-24T23:40:09.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.288+0000 7f9393fff640 1 -- 172.21.15.57:0/1165957697 learned_addr learned my addr 172.21.15.57:0/1165957697 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:09.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.288+0000 7f9398afc640 1 --2- 172.21.15.57:0/1165957697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f939406d6d0 0x7f93941578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:09.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.288+0000 7f93992fd640 1 --2- 172.21.15.57:0/1165957697 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f939414a320 0x7f93940c2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:09.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.288+0000 7f9393fff640 1 -- 172.21.15.57:0/1165957697 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f939414a320 msgr2=0x7f93940c2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:09.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.288+0000 7f9393fff640 1 --2- 172.21.15.57:0/1165957697 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f939414a320 0x7f93940c2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.288+0000 7f9393fff640 1 -- 172.21.15.57:0/1165957697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f939406d6d0 msgr2=0x7f93941578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:09.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.288+0000 7f9393fff640 1 --2- 172.21.15.57:0/1165957697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f939406d6d0 0x7f93941578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.288+0000 7f9393fff640 1 -- 172.21.15.57:0/1165957697 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9394157e30 con 0x7f93940bde50 2024-04-24T23:40:09.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.288+0000 7f9398afc640 1 --2- 172.21.15.57:0/1165957697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f939406d6d0 0x7f93941578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:40:09.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.288+0000 7f9393fff640 1 --2- 172.21.15.57:0/1165957697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93940bde50 0x7f93941488a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f938000d7d0 tx=0x7f938000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:09.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.288+0000 7f93917fa640 1 -- 172.21.15.57:0/1165957697 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9380018030 con 0x7f93940bde50 2024-04-24T23:40:09.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.288+0000 7f93917fa640 1 -- 172.21.15.57:0/1165957697 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9380004020 con 0x7f93940bde50 2024-04-24T23:40:09.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.288+0000 7f939ad60640 1 -- 172.21.15.57:0/1165957697 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93941491a0 con 0x7f93940bde50 2024-04-24T23:40:09.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.288+0000 7f93917fa640 1 -- 172.21.15.57:0/1165957697 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9380004210 con 0x7f93940bde50 2024-04-24T23:40:09.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.288+0000 7f939ad60640 1 -- 172.21.15.57:0/1165957697 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93941e5270 con 0x7f93940bde50 2024-04-24T23:40:09.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.288+0000 7f939ad60640 1 -- 172.21.15.57:0/1165957697 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9394068290 con 0x7f93940bde50 2024-04-24T23:40:09.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.288+0000 7f93917fa640 1 -- 172.21.15.57:0/1165957697 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f938001b070 con 0x7f93940bde50 2024-04-24T23:40:09.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.288+0000 7f93917fa640 1 --2- 172.21.15.57:0/1165957697 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f93780678c0 0x7f9378069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:09.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.292+0000 7f93917fa640 1 -- 172.21.15.57:0/1165957697 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f9380086900 con 0x7f93940bde50 2024-04-24T23:40:09.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.292+0000 7f93917fa640 1 --2- 172.21.15.57:0/1165957697 >> [v2:172.21.15.88:6808/2035054888,v1:172.21.15.88:6809/2035054888] conn(0x7f93780712d0 0x7f9378073770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:09.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.292+0000 7f93917fa640 1 -- 172.21.15.57:0/1165957697 --> [v2:172.21.15.88:6808/2035054888,v1:172.21.15.88:6809/2035054888] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9380012ea0 con 0x7f93780712d0 2024-04-24T23:40:09.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.292+0000 7f93917fa640 1 -- 172.21.15.57:0/1165957697 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9380086d90 con 0x7f93940bde50 2024-04-24T23:40:09.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.292+0000 7f9398afc640 1 --2- 172.21.15.57:0/1165957697 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f93780678c0 0x7f9378069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:09.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.292+0000 7f93992fd640 1 --2- 172.21.15.57:0/1165957697 >> [v2:172.21.15.88:6808/2035054888,v1:172.21.15.88:6809/2035054888] conn(0x7f93780712d0 0x7f9378073770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:09.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.292+0000 7f9398afc640 1 --2- 172.21.15.57:0/1165957697 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f93780678c0 0x7f9378069d80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f938800b9f0 tx=0x7f9388008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:09.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.292+0000 7f93992fd640 1 --2- 172.21.15.57:0/1165957697 >> [v2:172.21.15.88:6808/2035054888,v1:172.21.15.88:6809/2035054888] conn(0x7f93780712d0 0x7f9378073770 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:09.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.292+0000 7f93917fa640 1 -- 172.21.15.57:0/1165957697 <== osd.5 v2:172.21.15.88:6808/2035054888 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9380012ea0 con 0x7f93780712d0 2024-04-24T23:40:09.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.304+0000 7f939ad60640 1 -- 172.21.15.57:0/1165957697 --> [v2:172.21.15.88:6808/2035054888,v1:172.21.15.88:6809/2035054888] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f93940be8b0 con 0x7f93780712d0 2024-04-24T23:40:09.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.308+0000 7f93917fa640 1 -- 172.21.15.57:0/1165957697 <== osd.5 v2:172.21.15.88:6808/2035054888 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f93940be8b0 con 0x7f93780712d0 2024-04-24T23:40:09.309 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-24T23:40:09.309 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:40:09.309 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-24T23:40:09.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.308+0000 7f939ad60640 1 -- 172.21.15.57:0/1165957697 >> [v2:172.21.15.88:6808/2035054888,v1:172.21.15.88:6809/2035054888] conn(0x7f93780712d0 msgr2=0x7f9378073770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:09.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.308+0000 7f939ad60640 1 --2- 172.21.15.57:0/1165957697 >> [v2:172.21.15.88:6808/2035054888,v1:172.21.15.88:6809/2035054888] conn(0x7f93780712d0 0x7f9378073770 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.308+0000 7f939ad60640 1 -- 172.21.15.57:0/1165957697 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f93780678c0 msgr2=0x7f9378069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:09.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.308+0000 7f939ad60640 1 --2- 172.21.15.57:0/1165957697 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f93780678c0 0x7f9378069d80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f938800b9f0 tx=0x7f9388008040 comp rx=0 tx=0).stop 2024-04-24T23:40:09.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.308+0000 7f939ad60640 1 -- 172.21.15.57:0/1165957697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93940bde50 msgr2=0x7f93941488a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:09.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.308+0000 7f939ad60640 1 --2- 172.21.15.57:0/1165957697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93940bde50 0x7f93941488a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f938000d7d0 tx=0x7f938000dc90 comp rx=0 tx=0).stop 2024-04-24T23:40:09.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.308+0000 7f93992fd640 1 -- 172.21.15.57:0/1165957697 reap_dead start 2024-04-24T23:40:09.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.308+0000 7f939ad60640 1 -- 172.21.15.57:0/1165957697 shutdown_connections 2024-04-24T23:40:09.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.308+0000 7f939ad60640 1 -- 172.21.15.57:0/1165957697 >> 172.21.15.57:0/1165957697 conn(0x7f939406b920 msgr2=0x7f939406db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:09.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.308+0000 7f939ad60640 1 -- 172.21.15.57:0/1165957697 shutdown_connections 2024-04-24T23:40:09.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.308+0000 7f939ad60640 1 -- 172.21.15.57:0/1165957697 wait complete. 2024-04-24T23:40:09.325 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-24T23:40:09.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.440+0000 7f603e81f640 1 Processor -- start 2024-04-24T23:40:09.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.440+0000 7f603e81f640 1 -- start start 2024-04-24T23:40:09.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.440+0000 7f603e81f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f603806b470 0x7f603814b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:09.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.440+0000 7f603e81f640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f60380b8740 0x7f603814bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:09.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.440+0000 7f603e81f640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6038151ba0 con 0x7f60380b80a0 2024-04-24T23:40:09.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.440+0000 7f603e81f640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f6038152490 con 0x7f60380b8740 2024-04-24T23:40:09.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.440+0000 7f603e81f640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f6038152920 con 0x7f603806b470 2024-04-24T23:40:09.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.440+0000 7f60377fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f60380b8740 0x7f603814bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:09.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.440+0000 7f603cdbc640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f60380b80a0 0x7f603814e410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53980/0 (socket says 172.21.15.57:53980) 2024-04-24T23:40:09.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.440+0000 7f60377fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f60380b8740 0x7f603814bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35274/0 (socket says 172.21.15.57:35274) 2024-04-24T23:40:09.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.440+0000 7f603cdbc640 1 -- 172.21.15.57:0/862715206 learned_addr learned my addr 172.21.15.57:0/862715206 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:40:09.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.440+0000 7f6037fff640 1 --2- 172.21.15.57:0/862715206 >> v2:172.21.15.88:3300/0 conn(0x7f603806b470 0x7f603814b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:09.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.440+0000 7f60377fe640 1 -- 172.21.15.57:0/862715206 >> v2:172.21.15.88:3300/0 conn(0x7f603806b470 msgr2=0x7f603814b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:09.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.440+0000 7f60377fe640 1 --2- 172.21.15.57:0/862715206 >> v2:172.21.15.88:3300/0 conn(0x7f603806b470 0x7f603814b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.440+0000 7f60377fe640 1 -- 172.21.15.57:0/862715206 >> v1:172.21.15.57:6789/0 conn(0x7f60380b80a0 legacy=0x7f603814e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:09.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.440+0000 7f60377fe640 1 -- 172.21.15.57:0/862715206 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6038151e40 con 0x7f60380b8740 2024-04-24T23:40:09.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.440+0000 7f6036ffd640 1 -- 172.21.15.57:0/862715206 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 232241044 0 0) 0x7f6038151ba0 con 0x7f60380b80a0 2024-04-24T23:40:09.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.444+0000 7f60377fe640 1 --2- 172.21.15.57:0/862715206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60380b8740 0x7f603814bc50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6038152610 tx=0x7f602c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826071a50a0a99f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:09.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.444+0000 7f6036ffd640 1 -- 172.21.15.57:0/862715206 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602c0b0070 con 0x7f60380b8740 2024-04-24T23:40:09.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.444+0000 7f6036ffd640 1 -- 172.21.15.57:0/862715206 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f602c0ab600 con 0x7f60380b8740 2024-04-24T23:40:09.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.444+0000 7f6036ffd640 1 -- 172.21.15.57:0/862715206 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602c0ab9d0 con 0x7f60380b8740 2024-04-24T23:40:09.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.444+0000 7f603e81f640 1 -- 172.21.15.57:0/862715206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60380b8740 msgr2=0x7f603814bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:09.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.444+0000 7f603e81f640 1 --2- 172.21.15.57:0/862715206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60380b8740 0x7f603814bc50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6038152610 tx=0x7f602c01c430 comp rx=0 tx=0).stop 2024-04-24T23:40:09.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.444+0000 7f603e81f640 1 -- 172.21.15.57:0/862715206 shutdown_connections 2024-04-24T23:40:09.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.444+0000 7f603e81f640 1 --2- 172.21.15.57:0/862715206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60380b8740 0x7f603814bc50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.444+0000 7f603e81f640 1 --2- 172.21.15.57:0/862715206 >> v2:172.21.15.88:3300/0 conn(0x7f603806b470 0x7f603814b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.444+0000 7f603e81f640 1 -- 172.21.15.57:0/862715206 >> 172.21.15.57:0/862715206 conn(0x7f60380c2e70 msgr2=0x7f60380c3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:09.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.444+0000 7f603e81f640 1 -- 172.21.15.57:0/862715206 shutdown_connections 2024-04-24T23:40:09.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.444+0000 7f603e81f640 1 -- 172.21.15.57:0/862715206 wait complete. 2024-04-24T23:40:09.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.444+0000 7f603e81f640 1 Processor -- start 2024-04-24T23:40:09.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.444+0000 7f603e81f640 1 -- start start 2024-04-24T23:40:09.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.444+0000 7f603e81f640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f603806b470 0x7f60380c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:09.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.444+0000 7f603e81f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60380b80a0 0x7f6038148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:09.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.444+0000 7f603e81f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60380b8740 0x7f6038149960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:09.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.444+0000 7f603e81f640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f603815b730 con 0x7f60380b80a0 2024-04-24T23:40:09.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.444+0000 7f603e81f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f603815b5b0 con 0x7f60380b8740 2024-04-24T23:40:09.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.444+0000 7f603e81f640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f603815b8b0 con 0x7f603806b470 2024-04-24T23:40:09.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.444+0000 7f60377fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60380b80a0 0x7f6038148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:09.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.444+0000 7f60377fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60380b80a0 0x7f6038148d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35290/0 (socket says 172.21.15.57:35290) 2024-04-24T23:40:09.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.444+0000 7f60377fe640 1 -- 172.21.15.57:0/1462380149 learned_addr learned my addr 172.21.15.57:0/1462380149 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:09.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.444+0000 7f603cdbc640 1 --2- 172.21.15.57:0/1462380149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60380b8740 0x7f6038149960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:09.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.448+0000 7f60377fe640 1 -- 172.21.15.57:0/1462380149 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f603806b470 msgr2=0x7f60380c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:09.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.448+0000 7f6037fff640 1 --2- 172.21.15.57:0/1462380149 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f603806b470 0x7f60380c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:09.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.448+0000 7f60377fe640 1 --2- 172.21.15.57:0/1462380149 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f603806b470 0x7f60380c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.448+0000 7f60377fe640 1 -- 172.21.15.57:0/1462380149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60380b8740 msgr2=0x7f6038149960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:09.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.448+0000 7f60377fe640 1 --2- 172.21.15.57:0/1462380149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60380b8740 0x7f6038149960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.448+0000 7f60377fe640 1 -- 172.21.15.57:0/1462380149 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60380c21f0 con 0x7f60380b80a0 2024-04-24T23:40:09.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.448+0000 7f603cdbc640 1 --2- 172.21.15.57:0/1462380149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60380b8740 0x7f6038149960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:40:09.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.448+0000 7f60377fe640 1 --2- 172.21.15.57:0/1462380149 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60380b80a0 0x7f6038148d80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f602c01c910 tx=0x7f602c01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:09.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.448+0000 7f6034ff9640 1 -- 172.21.15.57:0/1462380149 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602c0bc070 con 0x7f60380b80a0 2024-04-24T23:40:09.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.448+0000 7f6034ff9640 1 -- 172.21.15.57:0/1462380149 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f602c0b1040 con 0x7f60380b80a0 2024-04-24T23:40:09.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.448+0000 7f603e81f640 1 -- 172.21.15.57:0/1462380149 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6038147970 con 0x7f60380b80a0 2024-04-24T23:40:09.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.448+0000 7f6034ff9640 1 -- 172.21.15.57:0/1462380149 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602c0b0050 con 0x7f60380b80a0 2024-04-24T23:40:09.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.448+0000 7f603e81f640 1 -- 172.21.15.57:0/1462380149 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6038147c10 con 0x7f60380b80a0 2024-04-24T23:40:09.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.448+0000 7f603e81f640 1 -- 172.21.15.57:0/1462380149 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6038068930 con 0x7f60380b80a0 2024-04-24T23:40:09.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.448+0000 7f6034ff9640 1 -- 172.21.15.57:0/1462380149 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f602c0bf070 con 0x7f60380b80a0 2024-04-24T23:40:09.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.448+0000 7f6034ff9640 1 --2- 172.21.15.57:0/1462380149 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f60240678f0 0x7f6024069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:09.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.448+0000 7f6034ff9640 1 -- 172.21.15.57:0/1462380149 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f602c1202f0 con 0x7f60380b80a0 2024-04-24T23:40:09.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.448+0000 7f6037fff640 1 --2- 172.21.15.57:0/1462380149 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f60240678f0 0x7f6024069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:09.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.452+0000 7f6037fff640 1 --2- 172.21.15.57:0/1462380149 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f60240678f0 0x7f6024069db0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6028009790 tx=0x7f6028008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:09.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.452+0000 7f6034ff9640 1 -- 172.21.15.57:0/1462380149 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f602c0c6070 con 0x7f60380b80a0 2024-04-24T23:40:09.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.616+0000 7f603e81f640 1 -- 172.21.15.57:0/1462380149 --> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f603814d2e0 con 0x7f60240678f0 2024-04-24T23:40:09.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.616+0000 7f6034ff9640 1 -- 172.21.15.57:0/1462380149 <== mgr.4105 v2:172.21.15.88:6832/3931748276 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f603814d2e0 con 0x7f60240678f0 2024-04-24T23:40:09.618 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 5 to deep-scrub 2024-04-24T23:40:09.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.620+0000 7f603e81f640 1 -- 172.21.15.57:0/1462380149 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f60240678f0 msgr2=0x7f6024069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:09.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.620+0000 7f603e81f640 1 --2- 172.21.15.57:0/1462380149 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f60240678f0 0x7f6024069db0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6028009790 tx=0x7f6028008040 comp rx=0 tx=0).stop 2024-04-24T23:40:09.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.620+0000 7f603e81f640 1 -- 172.21.15.57:0/1462380149 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60380b80a0 msgr2=0x7f6038148d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:09.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.620+0000 7f603e81f640 1 --2- 172.21.15.57:0/1462380149 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60380b80a0 0x7f6038148d80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f602c01c910 tx=0x7f602c01ac70 comp rx=0 tx=0).stop 2024-04-24T23:40:09.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.620+0000 7f603e81f640 1 -- 172.21.15.57:0/1462380149 shutdown_connections 2024-04-24T23:40:09.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.620+0000 7f603e81f640 1 --2- 172.21.15.57:0/1462380149 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f60240678f0 0x7f6024069db0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.620+0000 7f603e81f640 1 --2- 172.21.15.57:0/1462380149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60380b8740 0x7f6038149960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.620+0000 7f603e81f640 1 --2- 172.21.15.57:0/1462380149 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60380b80a0 0x7f6038148d80 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.620+0000 7f603e81f640 1 --2- 172.21.15.57:0/1462380149 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f603806b470 0x7f60380c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.620+0000 7f603e81f640 1 -- 172.21.15.57:0/1462380149 >> 172.21.15.57:0/1462380149 conn(0x7f60380c2e70 msgr2=0x7f6038148670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:09.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.620+0000 7f603e81f640 1 -- 172.21.15.57:0/1462380149 shutdown_connections 2024-04-24T23:40:09.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.620+0000 7f603e81f640 1 -- 172.21.15.57:0/1462380149 wait complete. 2024-04-24T23:40:09.638 INFO:tasks.ceph:Scrubbing osd.6 2024-04-24T23:40:09.638 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:40:09.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.760+0000 7f5749ec1640 1 Processor -- start 2024-04-24T23:40:09.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.760+0000 7f5749ec1640 1 -- start start 2024-04-24T23:40:09.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f5749ec1640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f574414c170 0x7f57440a8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:09.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f5749ec1640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f57440731f0 0x7f574406f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:09.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f5749ec1640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f574406e540 con 0x7f574406c480 2024-04-24T23:40:09.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f5749ec1640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f574406ea70 con 0x7f574414c170 2024-04-24T23:40:09.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f5749ec1640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f5744067920 con 0x7f57440731f0 2024-04-24T23:40:09.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f57437fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f574406c480 0x7f574414ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53986/0 (socket says 172.21.15.57:53986) 2024-04-24T23:40:09.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f57437fe640 1 -- 172.21.15.57:0/1844478315 learned_addr learned my addr 172.21.15.57:0/1844478315 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:40:09.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f5743fff640 1 --2- 172.21.15.57:0/1844478315 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f57440731f0 0x7f574406f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:09.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f5742ffd640 1 --2- 172.21.15.57:0/1844478315 >> v2:172.21.15.88:3300/0 conn(0x7f574414c170 0x7f57440a8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:09.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f57427fc640 1 -- 172.21.15.57:0/1844478315 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4045307430 0 0) 0x7f574406e540 con 0x7f574406c480 2024-04-24T23:40:09.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f57427fc640 1 -- 172.21.15.57:0/1844478315 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f572c003530 con 0x7f574406c480 2024-04-24T23:40:09.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f57427fc640 1 -- 172.21.15.57:0/1844478315 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 561220112 0 0) 0x7f572c003530 con 0x7f574406c480 2024-04-24T23:40:09.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f57427fc640 1 -- 172.21.15.57:0/1844478315 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f57440731f0 msgr2=0x7f574406f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:09.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f57427fc640 1 --2- 172.21.15.57:0/1844478315 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f57440731f0 0x7f574406f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f57427fc640 1 -- 172.21.15.57:0/1844478315 >> v2:172.21.15.88:3300/0 conn(0x7f574414c170 msgr2=0x7f57440a8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:09.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f57427fc640 1 --2- 172.21.15.57:0/1844478315 >> v2:172.21.15.88:3300/0 conn(0x7f574414c170 0x7f57440a8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f57427fc640 1 -- 172.21.15.57:0/1844478315 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f574406eca0 con 0x7f574406c480 2024-04-24T23:40:09.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f57427fc640 1 -- 172.21.15.57:0/1844478315 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7f5734001a20 con 0x7f574406c480 2024-04-24T23:40:09.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f57427fc640 1 -- 172.21.15.57:0/1844478315 >> v1:172.21.15.57:6789/0 conn(0x7f574406c480 legacy=0x7f574414ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:09.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f57427fc640 1 --2- 172.21.15.57:0/1844478315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f572c0039c0 0x7f572c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:09.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f57427fc640 1 --2- 172.21.15.57:0/1844478315 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f572c004810 0x7f572c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:09.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f57427fc640 1 --2- 172.21.15.57:0/1844478315 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f57440731f0 0x7f572c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:09.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f57427fc640 1 -- 172.21.15.57:0/1844478315 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5744067920 con 0x7f572c004810 2024-04-24T23:40:09.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f57427fc640 1 -- 172.21.15.57:0/1844478315 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f572c00b9d0 con 0x7f572c0039c0 2024-04-24T23:40:09.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f57427fc640 1 -- 172.21.15.57:0/1844478315 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f572c00bb80 con 0x7f57440731f0 2024-04-24T23:40:09.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f5742ffd640 1 --2- 172.21.15.57:0/1844478315 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f572c004810 0x7f572c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:09.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f5743fff640 1 --2- 172.21.15.57:0/1844478315 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f57440731f0 0x7f572c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:09.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f57437fe640 1 --2- 172.21.15.57:0/1844478315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f572c0039c0 0x7f572c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:09.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f5742ffd640 1 -- 172.21.15.57:0/1844478315 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f57440731f0 msgr2=0x7f572c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:09.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f5742ffd640 1 --2- 172.21.15.57:0/1844478315 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f57440731f0 0x7f572c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f5742ffd640 1 -- 172.21.15.57:0/1844478315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f572c0039c0 msgr2=0x7f572c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:09.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f5742ffd640 1 --2- 172.21.15.57:0/1844478315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f572c0039c0 0x7f572c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f5742ffd640 1 -- 172.21.15.57:0/1844478315 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f572c003530 con 0x7f572c004810 2024-04-24T23:40:09.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f5742ffd640 1 --2- 172.21.15.57:0/1844478315 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f572c004810 0x7f572c004c90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5738009ae0 tx=0x7f573801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d5934a841c5e2b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:09.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f57427fc640 1 -- 172.21.15.57:0/1844478315 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57380b2070 con 0x7f572c004810 2024-04-24T23:40:09.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f57427fc640 1 -- 172.21.15.57:0/1844478315 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57380a55c0 con 0x7f572c004810 2024-04-24T23:40:09.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.764+0000 7f57427fc640 1 -- 172.21.15.57:0/1844478315 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57380096b0 con 0x7f572c004810 2024-04-24T23:40:09.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f5749ec1640 1 -- 172.21.15.57:0/1844478315 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f572c004810 msgr2=0x7f572c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:09.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f5749ec1640 1 --2- 172.21.15.57:0/1844478315 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f572c004810 0x7f572c004c90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5738009ae0 tx=0x7f573801cab0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f5743fff640 1 -- 172.21.15.57:0/1844478315 reap_dead start 2024-04-24T23:40:09.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f5749ec1640 1 -- 172.21.15.57:0/1844478315 shutdown_connections 2024-04-24T23:40:09.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f5749ec1640 1 -- 172.21.15.57:0/1844478315 >> 172.21.15.57:0/1844478315 conn(0x7f57440bf290 msgr2=0x7f57440bf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:09.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f5749ec1640 1 -- 172.21.15.57:0/1844478315 shutdown_connections 2024-04-24T23:40:09.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f5749ec1640 1 -- 172.21.15.57:0/1844478315 wait complete. 2024-04-24T23:40:09.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f5749ec1640 1 Processor -- start 2024-04-24T23:40:09.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f5749ec1640 1 -- start start 2024-04-24T23:40:09.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f5749ec1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f572c004810 0x7f57440bdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:09.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f5749ec1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57440a5f20 0x7f57441e9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:09.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f5749ec1640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f57440a59d0 0x7f57441e96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:09.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f5749ec1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f574406c860 con 0x7f572c004810 2024-04-24T23:40:09.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f5749ec1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5744152760 con 0x7f57440a5f20 2024-04-24T23:40:09.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f5749ec1640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f574406c9e0 con 0x7f57440a59d0 2024-04-24T23:40:09.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f57437fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f572c004810 0x7f57440bdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:09.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f57437fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f572c004810 0x7f57440bdce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35306/0 (socket says 172.21.15.57:35306) 2024-04-24T23:40:09.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f57437fe640 1 -- 172.21.15.57:0/2621027476 learned_addr learned my addr 172.21.15.57:0/2621027476 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:09.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f5742ffd640 1 --2- 172.21.15.57:0/2621027476 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57440a5f20 0x7f57441e9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:09.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f5743fff640 1 --2- 172.21.15.57:0/2621027476 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f57440a59d0 0x7f57441e96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:09.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f57437fe640 1 -- 172.21.15.57:0/2621027476 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f57440a59d0 msgr2=0x7f57441e96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:09.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f57437fe640 1 --2- 172.21.15.57:0/2621027476 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f57440a59d0 0x7f57441e96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f57437fe640 1 -- 172.21.15.57:0/2621027476 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57440a5f20 msgr2=0x7f57441e9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:09.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f57437fe640 1 --2- 172.21.15.57:0/2621027476 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57440a5f20 0x7f57441e9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f57437fe640 1 -- 172.21.15.57:0/2621027476 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57440be220 con 0x7f572c004810 2024-04-24T23:40:09.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f5743fff640 1 --2- 172.21.15.57:0/2621027476 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f57440a59d0 0x7f57441e96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:40:09.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f57437fe640 1 --2- 172.21.15.57:0/2621027476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f572c004810 0x7f57440bdce0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5734007930 tx=0x7f573400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:09.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f572bfff640 1 -- 172.21.15.57:0/2621027476 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573400edf0 con 0x7f572c004810 2024-04-24T23:40:09.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f572bfff640 1 -- 172.21.15.57:0/2621027476 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5734018070 con 0x7f572c004810 2024-04-24T23:40:09.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f572bfff640 1 -- 172.21.15.57:0/2621027476 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5734013660 con 0x7f572c004810 2024-04-24T23:40:09.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f5749ec1640 1 -- 172.21.15.57:0/2621027476 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57440be700 con 0x7f572c004810 2024-04-24T23:40:09.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.768+0000 7f5749ec1640 1 -- 172.21.15.57:0/2621027476 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57440bf040 con 0x7f572c004810 2024-04-24T23:40:09.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.772+0000 7f5749ec1640 1 -- 172.21.15.57:0/2621027476 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5744068930 con 0x7f572c004810 2024-04-24T23:40:09.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.772+0000 7f572bfff640 1 -- 172.21.15.57:0/2621027476 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5734013800 con 0x7f572c004810 2024-04-24T23:40:09.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.772+0000 7f572bfff640 1 --2- 172.21.15.57:0/2621027476 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f57300678f0 0x7f5730069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:09.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.772+0000 7f572bfff640 1 -- 172.21.15.57:0/2621027476 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f5734086660 con 0x7f572c004810 2024-04-24T23:40:09.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.772+0000 7f572bfff640 1 --2- 172.21.15.57:0/2621027476 >> [v2:172.21.15.88:6824/1752291242,v1:172.21.15.88:6825/1752291242] conn(0x7f5730071300 0x7f57300737a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:09.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.772+0000 7f572bfff640 1 -- 172.21.15.57:0/2621027476 --> [v2:172.21.15.88:6824/1752291242,v1:172.21.15.88:6825/1752291242] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5730073e70 con 0x7f5730071300 2024-04-24T23:40:09.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.772+0000 7f572bfff640 1 -- 172.21.15.57:0/2621027476 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f573408d050 con 0x7f572c004810 2024-04-24T23:40:09.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.772+0000 7f5742ffd640 1 --2- 172.21.15.57:0/2621027476 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f57300678f0 0x7f5730069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:09.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.772+0000 7f5743fff640 1 --2- 172.21.15.57:0/2621027476 >> [v2:172.21.15.88:6824/1752291242,v1:172.21.15.88:6825/1752291242] conn(0x7f5730071300 0x7f57300737a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:09.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.772+0000 7f5742ffd640 1 --2- 172.21.15.57:0/2621027476 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f57300678f0 0x7f5730069db0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f57380af000 tx=0x7f5738008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:09.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.772+0000 7f5743fff640 1 --2- 172.21.15.57:0/2621027476 >> [v2:172.21.15.88:6824/1752291242,v1:172.21.15.88:6825/1752291242] conn(0x7f5730071300 0x7f57300737a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:09.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.776+0000 7f572bfff640 1 -- 172.21.15.57:0/2621027476 <== osd.6 v2:172.21.15.88:6824/1752291242 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5730073e70 con 0x7f5730071300 2024-04-24T23:40:09.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.788+0000 7f5749ec1640 1 -- 172.21.15.57:0/2621027476 --> [v2:172.21.15.88:6824/1752291242,v1:172.21.15.88:6825/1752291242] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f57441e9c10 con 0x7f5730071300 2024-04-24T23:40:09.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.788+0000 7f572bfff640 1 -- 172.21.15.57:0/2621027476 <== osd.6 v2:172.21.15.88:6824/1752291242 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f57441e9c10 con 0x7f5730071300 2024-04-24T23:40:09.790 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-24T23:40:09.790 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:40:09.790 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-24T23:40:09.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.788+0000 7f5749ec1640 1 -- 172.21.15.57:0/2621027476 >> [v2:172.21.15.88:6824/1752291242,v1:172.21.15.88:6825/1752291242] conn(0x7f5730071300 msgr2=0x7f57300737a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:09.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.788+0000 7f5749ec1640 1 --2- 172.21.15.57:0/2621027476 >> [v2:172.21.15.88:6824/1752291242,v1:172.21.15.88:6825/1752291242] conn(0x7f5730071300 0x7f57300737a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.788+0000 7f5749ec1640 1 -- 172.21.15.57:0/2621027476 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f57300678f0 msgr2=0x7f5730069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:09.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.788+0000 7f5749ec1640 1 --2- 172.21.15.57:0/2621027476 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f57300678f0 0x7f5730069db0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f57380af000 tx=0x7f5738008040 comp rx=0 tx=0).stop 2024-04-24T23:40:09.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.788+0000 7f5749ec1640 1 -- 172.21.15.57:0/2621027476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f572c004810 msgr2=0x7f57440bdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:09.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.788+0000 7f5749ec1640 1 --2- 172.21.15.57:0/2621027476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f572c004810 0x7f57440bdce0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5734007930 tx=0x7f573400e530 comp rx=0 tx=0).stop 2024-04-24T23:40:09.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.788+0000 7f5743fff640 1 -- 172.21.15.57:0/2621027476 reap_dead start 2024-04-24T23:40:09.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.788+0000 7f5749ec1640 1 -- 172.21.15.57:0/2621027476 shutdown_connections 2024-04-24T23:40:09.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.788+0000 7f5749ec1640 1 -- 172.21.15.57:0/2621027476 >> 172.21.15.57:0/2621027476 conn(0x7f57440bf290 msgr2=0x7f5744148e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:09.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.788+0000 7f5749ec1640 1 -- 172.21.15.57:0/2621027476 shutdown_connections 2024-04-24T23:40:09.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.788+0000 7f5749ec1640 1 -- 172.21.15.57:0/2621027476 wait complete. 2024-04-24T23:40:09.806 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-24T23:40:09.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.920+0000 7f9421ec9640 1 Processor -- start 2024-04-24T23:40:09.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.920+0000 7f9421ec9640 1 -- start start 2024-04-24T23:40:09.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.920+0000 7f9421ec9640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f941c0a6200 0x7f941c0a65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:09.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.920+0000 7f9421ec9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f941c0c11d0 0x7f941c070530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:09.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.920+0000 7f9421ec9640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f941c151d50 con 0x7f941c070a70 2024-04-24T23:40:09.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.920+0000 7f9421ec9640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f941c1523a0 con 0x7f941c0a6200 2024-04-24T23:40:09.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.920+0000 7f9421ec9640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f941c152030 con 0x7f941c0c11d0 2024-04-24T23:40:09.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.920+0000 7f941b7fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f941c0a6200 0x7f941c0a65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:09.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.920+0000 7f941b7fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f941c0a6200 0x7f941c0a65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35318/0 (socket says 172.21.15.57:35318) 2024-04-24T23:40:09.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.920+0000 7f941b7fe640 1 -- 172.21.15.57:0/144929621 learned_addr learned my addr 172.21.15.57:0/144929621 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:09.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.920+0000 7f941affd640 1 --2- 172.21.15.57:0/144929621 >> v2:172.21.15.88:3300/0 conn(0x7f941c0c11d0 0x7f941c070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:09.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.920+0000 7f941b7fe640 1 -- 172.21.15.57:0/144929621 >> v2:172.21.15.88:3300/0 conn(0x7f941c0c11d0 msgr2=0x7f941c070530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:09.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.920+0000 7f941b7fe640 1 --2- 172.21.15.57:0/144929621 >> v2:172.21.15.88:3300/0 conn(0x7f941c0c11d0 0x7f941c070530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.920+0000 7f941b7fe640 1 -- 172.21.15.57:0/144929621 >> v1:172.21.15.88:6789/0 conn(0x7f941c070a70 legacy=0x7f941c0bfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:09.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.920+0000 7f941b7fe640 1 -- 172.21.15.57:0/144929621 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f941c0c3a80 con 0x7f941c0a6200 2024-04-24T23:40:09.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.924+0000 7f941b7fe640 1 --2- 172.21.15.57:0/144929621 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f941c0a6200 0x7f941c0a65e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f941c06fc80 tx=0x7f941401c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d57054aa301815 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:09.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.924+0000 7f941a7fc640 1 -- 172.21.15.57:0/144929621 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94140a5780 con 0x7f941c0a6200 2024-04-24T23:40:09.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.924+0000 7f941a7fc640 1 -- 172.21.15.57:0/144929621 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94140a5920 con 0x7f941c0a6200 2024-04-24T23:40:09.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.924+0000 7f941a7fc640 1 -- 172.21.15.57:0/144929621 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94140a5cf0 con 0x7f941c0a6200 2024-04-24T23:40:09.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.924+0000 7f9421ec9640 1 -- 172.21.15.57:0/144929621 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f941c0a6200 msgr2=0x7f941c0a65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:09.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.924+0000 7f9421ec9640 1 --2- 172.21.15.57:0/144929621 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f941c0a6200 0x7f941c0a65e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f941c06fc80 tx=0x7f941401c9b0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.924+0000 7f9421ec9640 1 -- 172.21.15.57:0/144929621 shutdown_connections 2024-04-24T23:40:09.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.924+0000 7f9421ec9640 1 --2- 172.21.15.57:0/144929621 >> v2:172.21.15.88:3300/0 conn(0x7f941c0c11d0 0x7f941c070530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.924+0000 7f9421ec9640 1 --2- 172.21.15.57:0/144929621 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f941c0a6200 0x7f941c0a65e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.924+0000 7f9421ec9640 1 -- 172.21.15.57:0/144929621 >> 172.21.15.57:0/144929621 conn(0x7f941c06b810 msgr2=0x7f941c0a5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:09.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.924+0000 7f9421ec9640 1 -- 172.21.15.57:0/144929621 shutdown_connections 2024-04-24T23:40:09.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.924+0000 7f9421ec9640 1 -- 172.21.15.57:0/144929621 wait complete. 2024-04-24T23:40:09.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.924+0000 7f9421ec9640 1 Processor -- start 2024-04-24T23:40:09.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.924+0000 7f9421ec9640 1 -- start start 2024-04-24T23:40:09.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.928+0000 7f9421ec9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f941c070a70 0x7f941c1eb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:09.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.928+0000 7f9421ec9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f941c0a6200 0x7f941c14e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:09.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.928+0000 7f9421ec9640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f941c0c11d0 0x7f941c1e7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:09.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.928+0000 7f9421ec9640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f941c0a36a0 con 0x7f941c0a6200 2024-04-24T23:40:09.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.928+0000 7f9421ec9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f941c0a3520 con 0x7f941c070a70 2024-04-24T23:40:09.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.928+0000 7f9421ec9640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f941c15bf60 con 0x7f941c0c11d0 2024-04-24T23:40:09.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.928+0000 7f941affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f941c0a6200 0x7f941c14e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:09.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.928+0000 7f941affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f941c0a6200 0x7f941c14e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35334/0 (socket says 172.21.15.57:35334) 2024-04-24T23:40:09.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.928+0000 7f941affd640 1 -- 172.21.15.57:0/463220239 learned_addr learned my addr 172.21.15.57:0/463220239 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:09.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.928+0000 7f941b7fe640 1 --2- 172.21.15.57:0/463220239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f941c070a70 0x7f941c1eb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:09.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.928+0000 7f941bfff640 1 --2- 172.21.15.57:0/463220239 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f941c0c11d0 0x7f941c1e7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:09.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.928+0000 7f941affd640 1 -- 172.21.15.57:0/463220239 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f941c0c11d0 msgr2=0x7f941c1e7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:09.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.928+0000 7f941affd640 1 --2- 172.21.15.57:0/463220239 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f941c0c11d0 0x7f941c1e7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.928+0000 7f941affd640 1 -- 172.21.15.57:0/463220239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f941c070a70 msgr2=0x7f941c1eb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:09.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.928+0000 7f941affd640 1 --2- 172.21.15.57:0/463220239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f941c070a70 0x7f941c1eb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:09.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.928+0000 7f941affd640 1 -- 172.21.15.57:0/463220239 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f941c14e980 con 0x7f941c0a6200 2024-04-24T23:40:09.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.928+0000 7f941bfff640 1 --2- 172.21.15.57:0/463220239 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f941c0c11d0 0x7f941c1e7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:40:09.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.928+0000 7f941b7fe640 1 --2- 172.21.15.57:0/463220239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f941c070a70 0x7f941c1eb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:40:09.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.928+0000 7f941affd640 1 --2- 172.21.15.57:0/463220239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f941c0a6200 0x7f941c14e440 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f940400d830 tx=0x7f940400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:09.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.928+0000 7f9413fff640 1 -- 172.21.15.57:0/463220239 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f940400b6c0 con 0x7f941c0a6200 2024-04-24T23:40:09.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.928+0000 7f9413fff640 1 -- 172.21.15.57:0/463220239 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9404019070 con 0x7f941c0a6200 2024-04-24T23:40:09.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.928+0000 7f9421ec9640 1 -- 172.21.15.57:0/463220239 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f941c14f490 con 0x7f941c0a6200 2024-04-24T23:40:09.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.928+0000 7f9413fff640 1 -- 172.21.15.57:0/463220239 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f940400ba60 con 0x7f941c0a6200 2024-04-24T23:40:09.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.928+0000 7f9421ec9640 1 -- 172.21.15.57:0/463220239 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f941c14d610 con 0x7f941c0a6200 2024-04-24T23:40:09.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.928+0000 7f9421ec9640 1 -- 172.21.15.57:0/463220239 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f941c1ea630 con 0x7f941c0a6200 2024-04-24T23:40:09.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.928+0000 7f9413fff640 1 -- 172.21.15.57:0/463220239 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f940401e460 con 0x7f941c0a6200 2024-04-24T23:40:09.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.928+0000 7f9413fff640 1 --2- 172.21.15.57:0/463220239 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f93fc0678f0 0x7f93fc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:09.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.932+0000 7f9413fff640 1 -- 172.21.15.57:0/463220239 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f94040866e0 con 0x7f941c0a6200 2024-04-24T23:40:09.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.932+0000 7f941b7fe640 1 --2- 172.21.15.57:0/463220239 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f93fc0678f0 0x7f93fc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:09.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.932+0000 7f941b7fe640 1 --2- 172.21.15.57:0/463220239 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f93fc0678f0 0x7f93fc069db0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f94140ae000 tx=0x7f94140a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:09.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:09.936+0000 7f9413fff640 1 -- 172.21.15.57:0/463220239 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f941c14e980 con 0x7f941c0a6200 2024-04-24T23:40:10.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.096+0000 7f9421ec9640 1 -- 172.21.15.57:0/463220239 --> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f941c068930 con 0x7f93fc0678f0 2024-04-24T23:40:10.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.096+0000 7f9413fff640 1 -- 172.21.15.57:0/463220239 <== mgr.4105 v2:172.21.15.88:6832/3931748276 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f941c068930 con 0x7f93fc0678f0 2024-04-24T23:40:10.099 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 6 to deep-scrub 2024-04-24T23:40:10.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.100+0000 7f9421ec9640 1 -- 172.21.15.57:0/463220239 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f93fc0678f0 msgr2=0x7f93fc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:10.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.100+0000 7f9421ec9640 1 --2- 172.21.15.57:0/463220239 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f93fc0678f0 0x7f93fc069db0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f94140ae000 tx=0x7f94140a7070 comp rx=0 tx=0).stop 2024-04-24T23:40:10.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.100+0000 7f9421ec9640 1 -- 172.21.15.57:0/463220239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f941c0a6200 msgr2=0x7f941c14e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:10.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.100+0000 7f9421ec9640 1 --2- 172.21.15.57:0/463220239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f941c0a6200 0x7f941c14e440 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f940400d830 tx=0x7f940400dcf0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.100+0000 7f9421ec9640 1 -- 172.21.15.57:0/463220239 shutdown_connections 2024-04-24T23:40:10.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.100+0000 7f9421ec9640 1 --2- 172.21.15.57:0/463220239 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f93fc0678f0 0x7f93fc069db0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.100+0000 7f9421ec9640 1 --2- 172.21.15.57:0/463220239 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f941c0c11d0 0x7f941c1e7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.100+0000 7f9421ec9640 1 --2- 172.21.15.57:0/463220239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f941c0a6200 0x7f941c14e440 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.100+0000 7f9421ec9640 1 --2- 172.21.15.57:0/463220239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f941c070a70 0x7f941c1eb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.100+0000 7f9421ec9640 1 -- 172.21.15.57:0/463220239 >> 172.21.15.57:0/463220239 conn(0x7f941c06b810 msgr2=0x7f941c0a5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:10.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.100+0000 7f9421ec9640 1 -- 172.21.15.57:0/463220239 shutdown_connections 2024-04-24T23:40:10.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.100+0000 7f9421ec9640 1 -- 172.21.15.57:0/463220239 wait complete. 2024-04-24T23:40:10.117 INFO:tasks.ceph:Scrubbing osd.7 2024-04-24T23:40:10.118 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:40:10.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.240+0000 7f719be18640 1 Processor -- start 2024-04-24T23:40:10.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.240+0000 7f719be18640 1 -- start start 2024-04-24T23:40:10.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.240+0000 7f719be18640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f719414bc60 0x7f71940c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:10.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.240+0000 7f719be18640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71940c2d00 0x7f7194151c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:10.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.240+0000 7f719be18640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f71940bd5f0 0x7f7194152160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:10.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.240+0000 7f719be18640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f71941526a0 con 0x7f719414bc60 2024-04-24T23:40:10.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.240+0000 7f719be18640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f71940bde20 con 0x7f71940bd5f0 2024-04-24T23:40:10.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.240+0000 7f719be18640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f71940bd200 con 0x7f71940c2d00 2024-04-24T23:40:10.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.240+0000 7f7199bb4640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f719414bc60 0x7f71940c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:10.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.240+0000 7f7199bb4640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f719414bc60 0x7f71940c27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35344/0 (socket says 172.21.15.57:35344) 2024-04-24T23:40:10.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.240+0000 7f7199bb4640 1 -- 172.21.15.57:0/3422220473 learned_addr learned my addr 172.21.15.57:0/3422220473 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:10.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.240+0000 7f71993b3640 1 --2- 172.21.15.57:0/3422220473 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71940c2d00 0x7f7194151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:10.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.240+0000 7f719a3b5640 1 --2- 172.21.15.57:0/3422220473 >> v2:172.21.15.88:3300/0 conn(0x7f71940bd5f0 0x7f7194152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:10.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.240+0000 7f7199bb4640 1 -- 172.21.15.57:0/3422220473 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71940c2d00 msgr2=0x7f7194151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:10.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.240+0000 7f7199bb4640 1 --2- 172.21.15.57:0/3422220473 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71940c2d00 0x7f7194151c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.240+0000 7f7199bb4640 1 -- 172.21.15.57:0/3422220473 >> v2:172.21.15.88:3300/0 conn(0x7f71940bd5f0 msgr2=0x7f7194152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:10.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.240+0000 7f7199bb4640 1 --2- 172.21.15.57:0/3422220473 >> v2:172.21.15.88:3300/0 conn(0x7f71940bd5f0 0x7f7194152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.240+0000 7f7199bb4640 1 -- 172.21.15.57:0/3422220473 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71940be070 con 0x7f719414bc60 2024-04-24T23:40:10.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.240+0000 7f71993b3640 1 --2- 172.21.15.57:0/3422220473 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71940c2d00 0x7f7194151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:40:10.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.244+0000 7f7199bb4640 1 --2- 172.21.15.57:0/3422220473 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f719414bc60 0x7f71940c27c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f71940bcb40 tx=0x7f718c01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddbd335669f98e71 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:10.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.244+0000 7f7198bb2640 1 -- 172.21.15.57:0/3422220473 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718c0a55d0 con 0x7f719414bc60 2024-04-24T23:40:10.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.244+0000 7f7198bb2640 1 -- 172.21.15.57:0/3422220473 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f718c0a5770 con 0x7f719414bc60 2024-04-24T23:40:10.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.244+0000 7f7198bb2640 1 -- 172.21.15.57:0/3422220473 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718c0a5b40 con 0x7f719414bc60 2024-04-24T23:40:10.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.244+0000 7f719be18640 1 -- 172.21.15.57:0/3422220473 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f719414bc60 msgr2=0x7f71940c27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:10.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.244+0000 7f719be18640 1 --2- 172.21.15.57:0/3422220473 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f719414bc60 0x7f71940c27c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f71940bcb40 tx=0x7f718c01c8d0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.244+0000 7f719be18640 1 -- 172.21.15.57:0/3422220473 shutdown_connections 2024-04-24T23:40:10.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.244+0000 7f719be18640 1 --2- 172.21.15.57:0/3422220473 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71940c2d00 0x7f7194151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.244+0000 7f719be18640 1 --2- 172.21.15.57:0/3422220473 >> v2:172.21.15.88:3300/0 conn(0x7f71940bd5f0 0x7f7194152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.244+0000 7f719be18640 1 --2- 172.21.15.57:0/3422220473 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f719414bc60 0x7f71940c27c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.244+0000 7f719be18640 1 -- 172.21.15.57:0/3422220473 >> 172.21.15.57:0/3422220473 conn(0x7f719406b920 msgr2=0x7f71940c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:10.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.244+0000 7f719be18640 1 -- 172.21.15.57:0/3422220473 shutdown_connections 2024-04-24T23:40:10.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.244+0000 7f719be18640 1 -- 172.21.15.57:0/3422220473 wait complete. 2024-04-24T23:40:10.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.248+0000 7f719be18640 1 Processor -- start 2024-04-24T23:40:10.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.248+0000 7f719be18640 1 -- start start 2024-04-24T23:40:10.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.248+0000 7f719be18640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71940bd5f0 0x7f7194156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:10.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.248+0000 7f719be18640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71940c2d00 0x7f71940bb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:10.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.248+0000 7f719be18640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f719414bc60 0x7f71941eca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:10.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.248+0000 7f719be18640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f71940bcfe0 con 0x7f71940bd5f0 2024-04-24T23:40:10.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.248+0000 7f719be18640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f71940bce60 con 0x7f719414bc60 2024-04-24T23:40:10.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.248+0000 7f719be18640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f719406dee0 con 0x7f71940c2d00 2024-04-24T23:40:10.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.248+0000 7f7199bb4640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71940bd5f0 0x7f7194156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:10.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.248+0000 7f7199bb4640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71940bd5f0 0x7f7194156f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35348/0 (socket says 172.21.15.57:35348) 2024-04-24T23:40:10.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.248+0000 7f7199bb4640 1 -- 172.21.15.57:0/2316622536 learned_addr learned my addr 172.21.15.57:0/2316622536 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:10.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.248+0000 7f71993b3640 1 --2- 172.21.15.57:0/2316622536 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71940c2d00 0x7f71940bb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:10.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.248+0000 7f719a3b5640 1 --2- 172.21.15.57:0/2316622536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f719414bc60 0x7f71941eca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:10.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.248+0000 7f7199bb4640 1 -- 172.21.15.57:0/2316622536 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71940c2d00 msgr2=0x7f71940bb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:10.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.248+0000 7f7199bb4640 1 --2- 172.21.15.57:0/2316622536 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71940c2d00 0x7f71940bb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.248+0000 7f7199bb4640 1 -- 172.21.15.57:0/2316622536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f719414bc60 msgr2=0x7f71941eca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:10.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.248+0000 7f7199bb4640 1 --2- 172.21.15.57:0/2316622536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f719414bc60 0x7f71941eca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.248+0000 7f7199bb4640 1 -- 172.21.15.57:0/2316622536 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71941477c0 con 0x7f71940bd5f0 2024-04-24T23:40:10.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.248+0000 7f719a3b5640 1 --2- 172.21.15.57:0/2316622536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f719414bc60 0x7f71941eca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:40:10.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.248+0000 7f7199bb4640 1 --2- 172.21.15.57:0/2316622536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71940bd5f0 0x7f7194156f40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f718c01af80 tx=0x7f718c019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:10.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.248+0000 7f71927fc640 1 -- 172.21.15.57:0/2316622536 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718c0bc020 con 0x7f71940bd5f0 2024-04-24T23:40:10.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.248+0000 7f71927fc640 1 -- 172.21.15.57:0/2316622536 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f718c0b8670 con 0x7f71940bd5f0 2024-04-24T23:40:10.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.248+0000 7f719be18640 1 -- 172.21.15.57:0/2316622536 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7194072cc0 con 0x7f71940bd5f0 2024-04-24T23:40:10.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.248+0000 7f71927fc640 1 -- 172.21.15.57:0/2316622536 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718c009510 con 0x7f71940bd5f0 2024-04-24T23:40:10.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.248+0000 7f719be18640 1 -- 172.21.15.57:0/2316622536 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71941583e0 con 0x7f71940bd5f0 2024-04-24T23:40:10.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.248+0000 7f719be18640 1 -- 172.21.15.57:0/2316622536 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f71940730a0 con 0x7f71940bd5f0 2024-04-24T23:40:10.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.248+0000 7f71927fc640 1 -- 172.21.15.57:0/2316622536 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f718c0bf020 con 0x7f71940bd5f0 2024-04-24T23:40:10.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.248+0000 7f71927fc640 1 --2- 172.21.15.57:0/2316622536 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f71800678c0 0x7f7180069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:10.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.248+0000 7f71927fc640 1 -- 172.21.15.57:0/2316622536 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f718c121470 con 0x7f71940bd5f0 2024-04-24T23:40:10.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.252+0000 7f71927fc640 1 --2- 172.21.15.57:0/2316622536 >> [v2:172.21.15.88:6810/1782800372,v1:172.21.15.88:6812/1782800372] conn(0x7f71800712d0 0x7f7180073770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:10.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.252+0000 7f71927fc640 1 -- 172.21.15.57:0/2316622536 --> [v2:172.21.15.88:6810/1782800372,v1:172.21.15.88:6812/1782800372] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7180073e40 con 0x7f71800712d0 2024-04-24T23:40:10.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.252+0000 7f71927fc640 1 -- 172.21.15.57:0/2316622536 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f718c121900 con 0x7f71940bd5f0 2024-04-24T23:40:10.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.252+0000 7f71993b3640 1 --2- 172.21.15.57:0/2316622536 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f71800678c0 0x7f7180069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:10.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.252+0000 7f719a3b5640 1 --2- 172.21.15.57:0/2316622536 >> [v2:172.21.15.88:6810/1782800372,v1:172.21.15.88:6812/1782800372] conn(0x7f71800712d0 0x7f7180073770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:10.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.252+0000 7f71993b3640 1 --2- 172.21.15.57:0/2316622536 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f71800678c0 0x7f7180069d80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f719414f160 tx=0x7f7188008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:10.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.252+0000 7f719a3b5640 1 --2- 172.21.15.57:0/2316622536 >> [v2:172.21.15.88:6810/1782800372,v1:172.21.15.88:6812/1782800372] conn(0x7f71800712d0 0x7f7180073770 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:10.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.252+0000 7f71927fc640 1 -- 172.21.15.57:0/2316622536 <== osd.7 v2:172.21.15.88:6810/1782800372 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7180073e40 con 0x7f71800712d0 2024-04-24T23:40:10.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.264+0000 7f719be18640 1 -- 172.21.15.57:0/2316622536 --> [v2:172.21.15.88:6810/1782800372,v1:172.21.15.88:6812/1782800372] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7194147990 con 0x7f71800712d0 2024-04-24T23:40:10.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.268+0000 7f71927fc640 1 -- 172.21.15.57:0/2316622536 <== osd.7 v2:172.21.15.88:6810/1782800372 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7194147990 con 0x7f71800712d0 2024-04-24T23:40:10.268 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-24T23:40:10.268 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:40:10.269 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-24T23:40:10.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.268+0000 7f719be18640 1 -- 172.21.15.57:0/2316622536 >> [v2:172.21.15.88:6810/1782800372,v1:172.21.15.88:6812/1782800372] conn(0x7f71800712d0 msgr2=0x7f7180073770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:10.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.268+0000 7f719be18640 1 --2- 172.21.15.57:0/2316622536 >> [v2:172.21.15.88:6810/1782800372,v1:172.21.15.88:6812/1782800372] conn(0x7f71800712d0 0x7f7180073770 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.268+0000 7f719be18640 1 -- 172.21.15.57:0/2316622536 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f71800678c0 msgr2=0x7f7180069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:10.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.268+0000 7f719be18640 1 --2- 172.21.15.57:0/2316622536 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f71800678c0 0x7f7180069d80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f719414f160 tx=0x7f7188008040 comp rx=0 tx=0).stop 2024-04-24T23:40:10.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.268+0000 7f719be18640 1 -- 172.21.15.57:0/2316622536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71940bd5f0 msgr2=0x7f7194156f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:10.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.268+0000 7f719be18640 1 --2- 172.21.15.57:0/2316622536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71940bd5f0 0x7f7194156f40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f718c01af80 tx=0x7f718c019670 comp rx=0 tx=0).stop 2024-04-24T23:40:10.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.268+0000 7f719a3b5640 1 -- 172.21.15.57:0/2316622536 reap_dead start 2024-04-24T23:40:10.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.268+0000 7f719be18640 1 -- 172.21.15.57:0/2316622536 shutdown_connections 2024-04-24T23:40:10.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.268+0000 7f719be18640 1 -- 172.21.15.57:0/2316622536 >> 172.21.15.57:0/2316622536 conn(0x7f719406b920 msgr2=0x7f71940bfca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:10.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.268+0000 7f719be18640 1 -- 172.21.15.57:0/2316622536 shutdown_connections 2024-04-24T23:40:10.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.268+0000 7f719be18640 1 -- 172.21.15.57:0/2316622536 wait complete. 2024-04-24T23:40:10.284 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-24T23:40:10.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc319cf2640 1 Processor -- start 2024-04-24T23:40:10.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc319cf2640 1 -- start start 2024-04-24T23:40:10.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc319cf2640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc3140bb480 0x7fc314154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:10.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc319cf2640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3140bd920 con 0x7fc314071fd0 2024-04-24T23:40:10.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc319cf2640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc314150910 con 0x7fc3140a6f30 2024-04-24T23:40:10.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc319cf2640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fc3140723b0 con 0x7fc3140bb480 2024-04-24T23:40:10.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc313fff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc314071fd0 0x7fc31406e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53992/0 (socket says 172.21.15.57:53992) 2024-04-24T23:40:10.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc313fff640 1 -- 172.21.15.57:0/3829698034 learned_addr learned my addr 172.21.15.57:0/3829698034 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:40:10.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc3137fe640 1 --2- 172.21.15.57:0/3829698034 >> v2:172.21.15.88:3300/0 conn(0x7fc3140bb480 0x7fc314154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:10.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc3127fc640 1 -- 172.21.15.57:0/3829698034 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 738746793 0 0) 0x7fc3140bd920 con 0x7fc314071fd0 2024-04-24T23:40:10.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc3127fc640 1 -- 172.21.15.57:0/3829698034 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2fc003530 con 0x7fc314071fd0 2024-04-24T23:40:10.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc3127fc640 1 -- 172.21.15.57:0/3829698034 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 938472140 0 0) 0x7fc2fc003530 con 0x7fc314071fd0 2024-04-24T23:40:10.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc3127fc640 1 -- 172.21.15.57:0/3829698034 >> v2:172.21.15.88:3300/0 conn(0x7fc3140bb480 msgr2=0x7fc314154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:10.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc3127fc640 1 --2- 172.21.15.57:0/3829698034 >> v2:172.21.15.88:3300/0 conn(0x7fc3140bb480 0x7fc314154aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc3127fc640 1 -- 172.21.15.57:0/3829698034 >> v1:172.21.15.88:6789/0 conn(0x7fc3140a6f30 legacy=0x7fc3141510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:10.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc3127fc640 1 -- 172.21.15.57:0/3829698034 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc314151800 con 0x7fc314071fd0 2024-04-24T23:40:10.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc3127fc640 1 -- 172.21.15.57:0/3829698034 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7fc30c001680 con 0x7fc314071fd0 2024-04-24T23:40:10.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc3127fc640 1 -- 172.21.15.57:0/3829698034 >> v1:172.21.15.57:6789/0 conn(0x7fc314071fd0 legacy=0x7fc31406e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:10.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc3127fc640 1 --2- 172.21.15.57:0/3829698034 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc2fc0039c0 0x7fc2fc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:10.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc3127fc640 1 --2- 172.21.15.57:0/3829698034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2fc004810 0x7fc2fc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:10.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc3127fc640 1 --2- 172.21.15.57:0/3829698034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2fc0051d0 0x7fc2fc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:10.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc3127fc640 1 -- 172.21.15.57:0/3829698034 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc3140723b0 con 0x7fc2fc0051d0 2024-04-24T23:40:10.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc3127fc640 1 -- 172.21.15.57:0/3829698034 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc00c070 con 0x7fc2fc004810 2024-04-24T23:40:10.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc3127fc640 1 -- 172.21.15.57:0/3829698034 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fc2fc00c270 con 0x7fc2fc0039c0 2024-04-24T23:40:10.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc313fff640 1 --2- 172.21.15.57:0/3829698034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2fc0051d0 0x7fc2fc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:10.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc3137fe640 1 --2- 172.21.15.57:0/3829698034 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc2fc0039c0 0x7fc2fc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:10.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc312ffd640 1 --2- 172.21.15.57:0/3829698034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2fc004810 0x7fc2fc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:10.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc313fff640 1 -- 172.21.15.57:0/3829698034 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc2fc0039c0 msgr2=0x7fc2fc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:10.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc313fff640 1 --2- 172.21.15.57:0/3829698034 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc2fc0039c0 0x7fc2fc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc313fff640 1 -- 172.21.15.57:0/3829698034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2fc004810 msgr2=0x7fc2fc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:10.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc313fff640 1 --2- 172.21.15.57:0/3829698034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2fc004810 0x7fc2fc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc313fff640 1 -- 172.21.15.57:0/3829698034 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2fc003530 con 0x7fc2fc0051d0 2024-04-24T23:40:10.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc3137fe640 1 --2- 172.21.15.57:0/3829698034 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc2fc0039c0 0x7fc2fc003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:40:10.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.400+0000 7fc312ffd640 1 --2- 172.21.15.57:0/3829698034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2fc004810 0x7fc2fc004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:40:10.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.404+0000 7fc313fff640 1 -- 172.21.15.57:0/3829698034 reap_dead start 2024-04-24T23:40:10.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.404+0000 7fc313fff640 1 --2- 172.21.15.57:0/3829698034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2fc0051d0 0x7fc2fc00b9d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00c1c0 tx=0x7fc30c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c087aff9189ea4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:10.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.404+0000 7fc3127fc640 1 -- 172.21.15.57:0/3829698034 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc30c007d00 con 0x7fc2fc0051d0 2024-04-24T23:40:10.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.404+0000 7fc3127fc640 1 -- 172.21.15.57:0/3829698034 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc30c0a9070 con 0x7fc2fc0051d0 2024-04-24T23:40:10.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.404+0000 7fc3127fc640 1 -- 172.21.15.57:0/3829698034 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc30c0a5dc0 con 0x7fc2fc0051d0 2024-04-24T23:40:10.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.404+0000 7fc319cf2640 1 -- 172.21.15.57:0/3829698034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2fc0051d0 msgr2=0x7fc2fc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:10.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.404+0000 7fc319cf2640 1 --2- 172.21.15.57:0/3829698034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2fc0051d0 0x7fc2fc00b9d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00c1c0 tx=0x7fc30c01cc60 comp rx=0 tx=0).stop 2024-04-24T23:40:10.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.404+0000 7fc319cf2640 1 -- 172.21.15.57:0/3829698034 shutdown_connections 2024-04-24T23:40:10.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.404+0000 7fc319cf2640 1 --2- 172.21.15.57:0/3829698034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2fc0051d0 0x7fc2fc00b9d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.404+0000 7fc319cf2640 1 -- 172.21.15.57:0/3829698034 >> 172.21.15.57:0/3829698034 conn(0x7fc3140be8f0 msgr2=0x7fc3140bed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:10.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.404+0000 7fc319cf2640 1 -- 172.21.15.57:0/3829698034 shutdown_connections 2024-04-24T23:40:10.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.404+0000 7fc319cf2640 1 -- 172.21.15.57:0/3829698034 wait complete. 2024-04-24T23:40:10.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.408+0000 7fc319cf2640 1 Processor -- start 2024-04-24T23:40:10.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.408+0000 7fc319cf2640 1 -- start start 2024-04-24T23:40:10.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.408+0000 7fc319cf2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2fc0051d0 0x7fc314150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:10.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.408+0000 7fc319cf2640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc3141467c0 0x7fc314145b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:10.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.408+0000 7fc319cf2640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3141460d0 0x7fc3141e9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:10.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.408+0000 7fc319cf2640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc314150bd0 con 0x7fc3141460d0 2024-04-24T23:40:10.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.408+0000 7fc319cf2640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc3140bdea0 con 0x7fc2fc0051d0 2024-04-24T23:40:10.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.408+0000 7fc319cf2640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fc3140bb860 con 0x7fc3141467c0 2024-04-24T23:40:10.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.408+0000 7fc313fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3141460d0 0x7fc3141e9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:10.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.408+0000 7fc313fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3141460d0 0x7fc3141e9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35370/0 (socket says 172.21.15.57:35370) 2024-04-24T23:40:10.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.408+0000 7fc313fff640 1 -- 172.21.15.57:0/3962993690 learned_addr learned my addr 172.21.15.57:0/3962993690 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:10.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.408+0000 7fc312ffd640 1 --2- 172.21.15.57:0/3962993690 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc3141467c0 0x7fc314145b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:10.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.408+0000 7fc3137fe640 1 --2- 172.21.15.57:0/3962993690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2fc0051d0 0x7fc314150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:10.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.408+0000 7fc313fff640 1 -- 172.21.15.57:0/3962993690 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc3141467c0 msgr2=0x7fc314145b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:10.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.408+0000 7fc313fff640 1 --2- 172.21.15.57:0/3962993690 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc3141467c0 0x7fc314145b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.408+0000 7fc313fff640 1 -- 172.21.15.57:0/3962993690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2fc0051d0 msgr2=0x7fc314150010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:10.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.408+0000 7fc313fff640 1 --2- 172.21.15.57:0/3962993690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2fc0051d0 0x7fc314150010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.408+0000 7fc313fff640 1 -- 172.21.15.57:0/3962993690 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc314150550 con 0x7fc3141460d0 2024-04-24T23:40:10.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.408+0000 7fc3137fe640 1 --2- 172.21.15.57:0/3962993690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2fc0051d0 0x7fc314150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:40:10.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.408+0000 7fc313fff640 1 --2- 172.21.15.57:0/3962993690 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3141460d0 0x7fc3141e9250 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc30c01ca90 tx=0x7fc2fc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:10.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.408+0000 7fc2fbfff640 1 -- 172.21.15.57:0/3962993690 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc30c007d00 con 0x7fc3141460d0 2024-04-24T23:40:10.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.408+0000 7fc2fbfff640 1 -- 172.21.15.57:0/3962993690 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc30c0b3070 con 0x7fc3141460d0 2024-04-24T23:40:10.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.408+0000 7fc2fbfff640 1 -- 172.21.15.57:0/3962993690 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc30c001c40 con 0x7fc3141460d0 2024-04-24T23:40:10.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.408+0000 7fc319cf2640 1 -- 172.21.15.57:0/3962993690 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc314151da0 con 0x7fc3141460d0 2024-04-24T23:40:10.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.408+0000 7fc319cf2640 1 -- 172.21.15.57:0/3962993690 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3140a6350 con 0x7fc3141460d0 2024-04-24T23:40:10.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.408+0000 7fc319cf2640 1 -- 172.21.15.57:0/3962993690 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc314068220 con 0x7fc3141460d0 2024-04-24T23:40:10.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.408+0000 7fc2fbfff640 1 -- 172.21.15.57:0/3962993690 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc30c004bf0 con 0x7fc3141460d0 2024-04-24T23:40:10.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.408+0000 7fc2fbfff640 1 --2- 172.21.15.57:0/3962993690 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc3000678f0 0x7fc300069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:10.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.412+0000 7fc2fbfff640 1 -- 172.21.15.57:0/3962993690 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc30c11f430 con 0x7fc3141460d0 2024-04-24T23:40:10.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.412+0000 7fc3137fe640 1 --2- 172.21.15.57:0/3962993690 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc3000678f0 0x7fc300069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:10.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.412+0000 7fc3137fe640 1 --2- 172.21.15.57:0/3962993690 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc3000678f0 0x7fc300069db0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc304003ab0 tx=0x7fc30400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:10.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.416+0000 7fc2fbfff640 1 -- 172.21.15.57:0/3962993690 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fc314150550 con 0x7fc3141460d0 2024-04-24T23:40:10.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.580+0000 7fc319cf2640 1 -- 172.21.15.57:0/3962993690 --> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fc31414f2f0 con 0x7fc3000678f0 2024-04-24T23:40:10.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.580+0000 7fc2fbfff640 1 -- 172.21.15.57:0/3962993690 <== mgr.4105 v2:172.21.15.88:6832/3931748276 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc31414f2f0 con 0x7fc3000678f0 2024-04-24T23:40:10.581 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 7 to deep-scrub 2024-04-24T23:40:10.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.580+0000 7fc319cf2640 1 -- 172.21.15.57:0/3962993690 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc3000678f0 msgr2=0x7fc300069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:10.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.580+0000 7fc319cf2640 1 --2- 172.21.15.57:0/3962993690 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc3000678f0 0x7fc300069db0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc304003ab0 tx=0x7fc30400b040 comp rx=0 tx=0).stop 2024-04-24T23:40:10.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.580+0000 7fc319cf2640 1 -- 172.21.15.57:0/3962993690 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3141460d0 msgr2=0x7fc3141e9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:10.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.580+0000 7fc319cf2640 1 --2- 172.21.15.57:0/3962993690 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3141460d0 0x7fc3141e9250 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc30c01ca90 tx=0x7fc2fc005840 comp rx=0 tx=0).stop 2024-04-24T23:40:10.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.580+0000 7fc319cf2640 1 -- 172.21.15.57:0/3962993690 shutdown_connections 2024-04-24T23:40:10.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.580+0000 7fc319cf2640 1 --2- 172.21.15.57:0/3962993690 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc3000678f0 0x7fc300069db0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.580+0000 7fc319cf2640 1 --2- 172.21.15.57:0/3962993690 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3141460d0 0x7fc3141e9250 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.580+0000 7fc319cf2640 1 --2- 172.21.15.57:0/3962993690 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc3141467c0 0x7fc314145b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.580+0000 7fc319cf2640 1 --2- 172.21.15.57:0/3962993690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2fc0051d0 0x7fc314150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.580+0000 7fc319cf2640 1 -- 172.21.15.57:0/3962993690 >> 172.21.15.57:0/3962993690 conn(0x7fc3140be8f0 msgr2=0x7fc31406ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:10.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.580+0000 7fc319cf2640 1 -- 172.21.15.57:0/3962993690 shutdown_connections 2024-04-24T23:40:10.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.580+0000 7fc319cf2640 1 -- 172.21.15.57:0/3962993690 wait complete. 2024-04-24T23:40:10.600 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:40:10.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.712+0000 7f06cf2ab640 1 Processor -- start 2024-04-24T23:40:10.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.712+0000 7f06cf2ab640 1 -- start start 2024-04-24T23:40:10.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06cf2ab640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f06c814bc60 0x7f06c806eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:10.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06cf2ab640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06c814e8e0 con 0x7f06c806f090 2024-04-24T23:40:10.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06cf2ab640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06c814ebc0 con 0x7f06c80bdbe0 2024-04-24T23:40:10.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06cf2ab640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f06c8152c20 con 0x7f06c814bc60 2024-04-24T23:40:10.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06cc846640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f06c806f090 0x7f06c80b6fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54004/0 (socket says 172.21.15.57:54004) 2024-04-24T23:40:10.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06cc846640 1 -- 172.21.15.57:0/1140201281 learned_addr learned my addr 172.21.15.57:0/1140201281 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:40:10.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06bbfff640 1 -- 172.21.15.57:0/1140201281 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3043808492 0 0) 0x7f06c814e8e0 con 0x7f06c806f090 2024-04-24T23:40:10.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06cd047640 1 --2- 172.21.15.57:0/1140201281 >> v2:172.21.15.88:3300/0 conn(0x7f06c814bc60 0x7f06c806eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:10.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06bbfff640 1 -- 172.21.15.57:0/1140201281 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06b4003530 con 0x7f06c806f090 2024-04-24T23:40:10.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06bbfff640 1 -- 172.21.15.57:0/1140201281 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3573494298 0 0) 0x7f06b4003530 con 0x7f06c806f090 2024-04-24T23:40:10.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06bbfff640 1 -- 172.21.15.57:0/1140201281 >> v2:172.21.15.88:3300/0 conn(0x7f06c814bc60 msgr2=0x7f06c806eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:10.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06bbfff640 1 --2- 172.21.15.57:0/1140201281 >> v2:172.21.15.88:3300/0 conn(0x7f06c814bc60 0x7f06c806eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06bbfff640 1 -- 172.21.15.57:0/1140201281 >> v1:172.21.15.88:6789/0 conn(0x7f06c80bdbe0 legacy=0x7f06c8159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:10.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06bbfff640 1 -- 172.21.15.57:0/1140201281 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c80b76e0 con 0x7f06c806f090 2024-04-24T23:40:10.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06bbfff640 1 -- 172.21.15.57:0/1140201281 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7f06bc001680 con 0x7f06c806f090 2024-04-24T23:40:10.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06bbfff640 1 -- 172.21.15.57:0/1140201281 >> v1:172.21.15.57:6789/0 conn(0x7f06c806f090 legacy=0x7f06c80b6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:10.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06bbfff640 1 --2- 172.21.15.57:0/1140201281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06b40039c0 0x7f06b4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:10.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06bbfff640 1 --2- 172.21.15.57:0/1140201281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06b4004810 0x7f06b4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:10.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06bbfff640 1 --2- 172.21.15.57:0/1140201281 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f06b40051d0 0x7f06b400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:10.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06bbfff640 1 -- 172.21.15.57:0/1140201281 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f06c8152c20 con 0x7f06b4004810 2024-04-24T23:40:10.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06bbfff640 1 -- 172.21.15.57:0/1140201281 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f06b400c070 con 0x7f06b40039c0 2024-04-24T23:40:10.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06bbfff640 1 -- 172.21.15.57:0/1140201281 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f06b400c270 con 0x7f06b40051d0 2024-04-24T23:40:10.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06cc846640 1 --2- 172.21.15.57:0/1140201281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06b4004810 0x7f06b4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:10.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06cc846640 1 -- 172.21.15.57:0/1140201281 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f06b40051d0 msgr2=0x7f06b400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:10.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06cd848640 1 --2- 172.21.15.57:0/1140201281 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f06b40051d0 0x7f06b400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:10.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06cd047640 1 --2- 172.21.15.57:0/1140201281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06b40039c0 0x7f06b4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:10.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06cc846640 1 --2- 172.21.15.57:0/1140201281 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f06b40051d0 0x7f06b400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06cc846640 1 -- 172.21.15.57:0/1140201281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06b40039c0 msgr2=0x7f06b4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:10.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06cc846640 1 --2- 172.21.15.57:0/1140201281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06b40039c0 0x7f06b4003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06cc846640 1 -- 172.21.15.57:0/1140201281 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b4003530 con 0x7f06b4004810 2024-04-24T23:40:10.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06cd848640 1 --2- 172.21.15.57:0/1140201281 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f06b40051d0 0x7f06b400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:40:10.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.716+0000 7f06cd848640 1 -- 172.21.15.57:0/1140201281 reap_dead start 2024-04-24T23:40:10.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06cc846640 1 --2- 172.21.15.57:0/1140201281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06b4004810 0x7f06b4004c90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f06c806f4a0 tx=0x7f06bc01f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79fb0c3839d43733 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:10.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06bbfff640 1 -- 172.21.15.57:0/1140201281 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06bc007d40 con 0x7f06b4004810 2024-04-24T23:40:10.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06bbfff640 1 -- 172.21.15.57:0/1140201281 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06bc005b00 con 0x7f06b4004810 2024-04-24T23:40:10.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06bbfff640 1 -- 172.21.15.57:0/1140201281 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06bc007070 con 0x7f06b4004810 2024-04-24T23:40:10.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06cf2ab640 1 -- 172.21.15.57:0/1140201281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06b4004810 msgr2=0x7f06b4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:10.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06cf2ab640 1 --2- 172.21.15.57:0/1140201281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06b4004810 0x7f06b4004c90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f06c806f4a0 tx=0x7f06bc01f3d0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06cf2ab640 1 -- 172.21.15.57:0/1140201281 shutdown_connections 2024-04-24T23:40:10.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06cf2ab640 1 --2- 172.21.15.57:0/1140201281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06b4004810 0x7f06b4004c90 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06cf2ab640 1 -- 172.21.15.57:0/1140201281 >> 172.21.15.57:0/1140201281 conn(0x7f06c80beab0 msgr2=0x7f06c80beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:10.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06cf2ab640 1 -- 172.21.15.57:0/1140201281 shutdown_connections 2024-04-24T23:40:10.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06cf2ab640 1 -- 172.21.15.57:0/1140201281 wait complete. 2024-04-24T23:40:10.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06cf2ab640 1 Processor -- start 2024-04-24T23:40:10.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06cf2ab640 1 -- start start 2024-04-24T23:40:10.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06cf2ab640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f06b4004810 0x7f06c8071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:10.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06cf2ab640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06c8143a50 0x7f06c80ba5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:10.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06cf2ab640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06c81e9700 0x7f06c814d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:10.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06cf2ab640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f06c80bc730 con 0x7f06c81e9700 2024-04-24T23:40:10.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06cf2ab640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f06c80bc5b0 con 0x7f06c8143a50 2024-04-24T23:40:10.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06cf2ab640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f06c8151cc0 con 0x7f06b4004810 2024-04-24T23:40:10.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06cd848640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06c81e9700 0x7f06c814d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:10.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06cd848640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06c81e9700 0x7f06c814d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35388/0 (socket says 172.21.15.57:35388) 2024-04-24T23:40:10.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06cd848640 1 -- 172.21.15.57:0/1114904817 learned_addr learned my addr 172.21.15.57:0/1114904817 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:10.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06cc846640 1 --2- 172.21.15.57:0/1114904817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06c8143a50 0x7f06c80ba5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:10.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06cd047640 1 --2- 172.21.15.57:0/1114904817 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f06b4004810 0x7f06c8071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:10.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06cd848640 1 -- 172.21.15.57:0/1114904817 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f06b4004810 msgr2=0x7f06c8071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:10.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06cd848640 1 --2- 172.21.15.57:0/1114904817 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f06b4004810 0x7f06c8071ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06cd848640 1 -- 172.21.15.57:0/1114904817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06c8143a50 msgr2=0x7f06c80ba5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:10.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06cd848640 1 --2- 172.21.15.57:0/1114904817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06c8143a50 0x7f06c80ba5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06cd848640 1 -- 172.21.15.57:0/1114904817 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c80ba030 con 0x7f06c81e9700 2024-04-24T23:40:10.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06cd848640 1 --2- 172.21.15.57:0/1114904817 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06c81e9700 0x7f06c814d800 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f06c000d540 tx=0x7f06c000da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:10.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06b9ffb640 1 -- 172.21.15.57:0/1114904817 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c0018070 con 0x7f06c81e9700 2024-04-24T23:40:10.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06b9ffb640 1 -- 172.21.15.57:0/1114904817 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06c0003db0 con 0x7f06c81e9700 2024-04-24T23:40:10.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06b9ffb640 1 -- 172.21.15.57:0/1114904817 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c00052b0 con 0x7f06c81e9700 2024-04-24T23:40:10.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.720+0000 7f06cf2ab640 1 -- 172.21.15.57:0/1114904817 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06c80ba2e0 con 0x7f06c81e9700 2024-04-24T23:40:10.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.724+0000 7f06cf2ab640 1 -- 172.21.15.57:0/1114904817 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06c80bb100 con 0x7f06c81e9700 2024-04-24T23:40:10.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.724+0000 7f06cf2ab640 1 -- 172.21.15.57:0/1114904817 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06c8068220 con 0x7f06c81e9700 2024-04-24T23:40:10.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.724+0000 7f06b9ffb640 1 -- 172.21.15.57:0/1114904817 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f06c0005450 con 0x7f06c81e9700 2024-04-24T23:40:10.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.724+0000 7f06b9ffb640 1 --2- 172.21.15.57:0/1114904817 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f06ac0678f0 0x7f06ac069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:10.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.724+0000 7f06b9ffb640 1 -- 172.21.15.57:0/1114904817 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f06c0085550 con 0x7f06c81e9700 2024-04-24T23:40:10.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.724+0000 7f06cd047640 1 --2- 172.21.15.57:0/1114904817 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f06ac0678f0 0x7f06ac069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:10.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.724+0000 7f06cd047640 1 --2- 172.21.15.57:0/1114904817 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f06ac0678f0 0x7f06ac069db0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f06c4009ab0 tx=0x7f06c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:10.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.728+0000 7f06b9ffb640 1 -- 172.21.15.57:0/1114904817 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f06c0055d20 con 0x7f06c81e9700 2024-04-24T23:40:10.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.884+0000 7f06cf2ab640 1 -- 172.21.15.57:0/1114904817 --> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f06c80bd9c0 con 0x7f06ac0678f0 2024-04-24T23:40:10.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.908+0000 7f06b9ffb640 1 -- 172.21.15.57:0/1114904817 <== mgr.4105 v2:172.21.15.88:6832/3931748276 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+331510 (secure 0 0 0) 0x7f06c80bd9c0 con 0x7f06ac0678f0 2024-04-24T23:40:10.912 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:40:10.914 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-24T23:40:10.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.912+0000 7f06cf2ab640 1 -- 172.21.15.57:0/1114904817 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f06ac0678f0 msgr2=0x7f06ac069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:10.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.912+0000 7f06cf2ab640 1 --2- 172.21.15.57:0/1114904817 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f06ac0678f0 0x7f06ac069db0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f06c4009ab0 tx=0x7f06c4008040 comp rx=0 tx=0).stop 2024-04-24T23:40:10.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.912+0000 7f06cf2ab640 1 -- 172.21.15.57:0/1114904817 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06c81e9700 msgr2=0x7f06c814d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:10.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.912+0000 7f06cf2ab640 1 --2- 172.21.15.57:0/1114904817 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06c81e9700 0x7f06c814d800 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f06c000d540 tx=0x7f06c000da00 comp rx=0 tx=0).stop 2024-04-24T23:40:10.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.912+0000 7f06cf2ab640 1 -- 172.21.15.57:0/1114904817 shutdown_connections 2024-04-24T23:40:10.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.912+0000 7f06cf2ab640 1 --2- 172.21.15.57:0/1114904817 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f06ac0678f0 0x7f06ac069db0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.912+0000 7f06cf2ab640 1 --2- 172.21.15.57:0/1114904817 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06c81e9700 0x7f06c814d800 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.912+0000 7f06cf2ab640 1 --2- 172.21.15.57:0/1114904817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06c8143a50 0x7f06c80ba5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.912+0000 7f06cf2ab640 1 --2- 172.21.15.57:0/1114904817 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f06b4004810 0x7f06c8071ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:10.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.912+0000 7f06cf2ab640 1 -- 172.21.15.57:0/1114904817 >> 172.21.15.57:0/1114904817 conn(0x7f06c80beab0 msgr2=0x7f06c81520a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:10.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.912+0000 7f06cf2ab640 1 -- 172.21.15.57:0/1114904817 shutdown_connections 2024-04-24T23:40:10.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:10.912+0000 7f06cf2ab640 1 -- 172.21.15.57:0/1114904817 wait complete. 2024-04-24T23:40:10.930 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-04-24T23:40:09.578383+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":630584,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":199,"num_read_kb":10469,"num_write":407,"num_write_kb":22968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":364,"ondisk_log_size":364,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":247696,"kb_used_data":2448,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754727024,"statfs":{"total":773094113280,"available":772840472576,"internally_reserved":0,"allocated":2506752,"data_stored":2176120,"data_compressed":67594,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004393"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.948313+0000","last_change":"2024-04-24T23:38:33.135015+0000","last_active":"2024-04-24T23:39:22.948313+0000","last_peered":"2024-04-24T23:39:22.948313+0000","last_clean":"2024-04-24T23:39:22.948313+0000","last_became_active":"2024-04-24T23:38:33.134584+0000","last_became_peered":"2024-04-24T23:38:33.134584+0000","last_unstale":"2024-04-24T23:39:22.948313+0000","last_undegraded":"2024-04-24T23:39:22.948313+0000","last_fullsized":"2024-04-24T23:39:22.948313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815632+0000","last_change":"2024-04-24T23:38:34.164655+0000","last_active":"2024-04-24T23:39:22.815632+0000","last_peered":"2024-04-24T23:39:22.815632+0000","last_clean":"2024-04-24T23:39:22.815632+0000","last_became_active":"2024-04-24T23:38:34.162093+0000","last_became_peered":"2024-04-24T23:38:34.162093+0000","last_unstale":"2024-04-24T23:39:22.815632+0000","last_undegraded":"2024-04-24T23:39:22.815632+0000","last_fullsized":"2024-04-24T23:39:22.815632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.813716+0000","last_change":"2024-04-24T23:38:38.252169+0000","last_active":"2024-04-24T23:39:22.813716+0000","last_peered":"2024-04-24T23:39:22.813716+0000","last_clean":"2024-04-24T23:39:22.813716+0000","last_became_active":"2024-04-24T23:38:38.251653+0000","last_became_peered":"2024-04-24T23:38:38.251653+0000","last_unstale":"2024-04-24T23:39:22.813716+0000","last_undegraded":"2024-04-24T23:39:22.813716+0000","last_fullsized":"2024-04-24T23:39:22.813716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:57.651551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816215+0000","last_change":"2024-04-24T23:38:33.124025+0000","last_active":"2024-04-24T23:39:22.816215+0000","last_peered":"2024-04-24T23:39:22.816215+0000","last_clean":"2024-04-24T23:39:22.816215+0000","last_became_active":"2024-04-24T23:38:33.123681+0000","last_became_peered":"2024-04-24T23:38:33.123681+0000","last_unstale":"2024-04-24T23:39:22.816215+0000","last_undegraded":"2024-04-24T23:39:22.816215+0000","last_fullsized":"2024-04-24T23:39:22.816215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:27:41.421732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947639+0000","last_change":"2024-04-24T23:38:34.169793+0000","last_active":"2024-04-24T23:39:22.947639+0000","last_peered":"2024-04-24T23:39:22.947639+0000","last_clean":"2024-04-24T23:39:22.947639+0000","last_became_active":"2024-04-24T23:38:34.169115+0000","last_became_peered":"2024-04-24T23:38:34.169115+0000","last_unstale":"2024-04-24T23:39:22.947639+0000","last_undegraded":"2024-04-24T23:39:22.947639+0000","last_fullsized":"2024-04-24T23:39:22.947639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821314+0000","last_change":"2024-04-24T23:38:38.221580+0000","last_active":"2024-04-24T23:39:22.821314+0000","last_peered":"2024-04-24T23:39:22.821314+0000","last_clean":"2024-04-24T23:39:22.821314+0000","last_became_active":"2024-04-24T23:38:38.220392+0000","last_became_peered":"2024-04-24T23:38:38.220392+0000","last_unstale":"2024-04-24T23:39:22.821314+0000","last_undegraded":"2024-04-24T23:39:22.821314+0000","last_fullsized":"2024-04-24T23:39:22.821314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:16:01.852170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.828191+0000","last_change":"2024-04-24T23:38:33.144231+0000","last_active":"2024-04-24T23:39:22.828191+0000","last_peered":"2024-04-24T23:39:22.828191+0000","last_clean":"2024-04-24T23:39:22.828191+0000","last_became_active":"2024-04-24T23:38:33.143542+0000","last_became_peered":"2024-04-24T23:38:33.143542+0000","last_unstale":"2024-04-24T23:39:22.828191+0000","last_undegraded":"2024-04-24T23:39:22.828191+0000","last_fullsized":"2024-04-24T23:39:22.828191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:09.575181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816530+0000","last_change":"2024-04-24T23:38:34.170796+0000","last_active":"2024-04-24T23:39:22.816530+0000","last_peered":"2024-04-24T23:39:22.816530+0000","last_clean":"2024-04-24T23:39:22.816530+0000","last_became_active":"2024-04-24T23:38:34.169908+0000","last_became_peered":"2024-04-24T23:38:34.169908+0000","last_unstale":"2024-04-24T23:39:22.816530+0000","last_undegraded":"2024-04-24T23:39:22.816530+0000","last_fullsized":"2024-04-24T23:39:22.816530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:17:07.009163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821677+0000","last_change":"2024-04-24T23:38:38.218416+0000","last_active":"2024-04-24T23:39:22.821677+0000","last_peered":"2024-04-24T23:39:22.821677+0000","last_clean":"2024-04-24T23:39:22.821677+0000","last_became_active":"2024-04-24T23:38:38.217390+0000","last_became_peered":"2024-04-24T23:38:38.217390+0000","last_unstale":"2024-04-24T23:39:22.821677+0000","last_undegraded":"2024-04-24T23:39:22.821677+0000","last_fullsized":"2024-04-24T23:39:22.821677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:31.231780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.826953+0000","last_change":"2024-04-24T23:38:33.149114+0000","last_active":"2024-04-24T23:39:22.826953+0000","last_peered":"2024-04-24T23:39:22.826953+0000","last_clean":"2024-04-24T23:39:22.826953+0000","last_became_active":"2024-04-24T23:38:33.148510+0000","last_became_peered":"2024-04-24T23:38:33.148510+0000","last_unstale":"2024-04-24T23:39:22.826953+0000","last_undegraded":"2024-04-24T23:39:22.826953+0000","last_fullsized":"2024-04-24T23:39:22.826953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:39.396571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817264+0000","last_change":"2024-04-24T23:38:34.153747+0000","last_active":"2024-04-24T23:39:22.817264+0000","last_peered":"2024-04-24T23:39:22.817264+0000","last_clean":"2024-04-24T23:39:22.817264+0000","last_became_active":"2024-04-24T23:38:34.152984+0000","last_became_peered":"2024-04-24T23:38:34.152984+0000","last_unstale":"2024-04-24T23:39:22.817264+0000","last_undegraded":"2024-04-24T23:39:22.817264+0000","last_fullsized":"2024-04-24T23:39:22.817264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:54.469544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821502+0000","last_change":"2024-04-24T23:38:38.222542+0000","last_active":"2024-04-24T23:39:22.821502+0000","last_peered":"2024-04-24T23:39:22.821502+0000","last_clean":"2024-04-24T23:39:22.821502+0000","last_became_active":"2024-04-24T23:38:38.220601+0000","last_became_peered":"2024-04-24T23:38:38.220601+0000","last_unstale":"2024-04-24T23:39:22.821502+0000","last_undegraded":"2024-04-24T23:39:22.821502+0000","last_fullsized":"2024-04-24T23:39:22.821502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:32.372869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814379+0000","last_change":"2024-04-24T23:38:34.142429+0000","last_active":"2024-04-24T23:39:22.814379+0000","last_peered":"2024-04-24T23:39:22.814379+0000","last_clean":"2024-04-24T23:39:22.814379+0000","last_became_active":"2024-04-24T23:38:34.141681+0000","last_became_peered":"2024-04-24T23:38:34.141681+0000","last_unstale":"2024-04-24T23:39:22.814379+0000","last_undegraded":"2024-04-24T23:39:22.814379+0000","last_fullsized":"2024-04-24T23:39:22.814379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:57:25.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.827312+0000","last_change":"2024-04-24T23:38:33.140585+0000","last_active":"2024-04-24T23:39:22.827312+0000","last_peered":"2024-04-24T23:39:22.827312+0000","last_clean":"2024-04-24T23:39:22.827312+0000","last_became_active":"2024-04-24T23:38:33.139303+0000","last_became_peered":"2024-04-24T23:38:33.139303+0000","last_unstale":"2024-04-24T23:39:22.827312+0000","last_undegraded":"2024-04-24T23:39:22.827312+0000","last_fullsized":"2024-04-24T23:39:22.827312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:23.343617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822916+0000","last_change":"2024-04-24T23:38:38.216184+0000","last_active":"2024-04-24T23:39:22.822916+0000","last_peered":"2024-04-24T23:39:22.822916+0000","last_clean":"2024-04-24T23:39:22.822916+0000","last_became_active":"2024-04-24T23:38:38.214813+0000","last_became_peered":"2024-04-24T23:38:38.214813+0000","last_unstale":"2024-04-24T23:39:22.822916+0000","last_undegraded":"2024-04-24T23:39:22.822916+0000","last_fullsized":"2024-04-24T23:39:22.822916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:58.553943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814784+0000","last_change":"2024-04-24T23:38:34.174790+0000","last_active":"2024-04-24T23:39:22.814784+0000","last_peered":"2024-04-24T23:39:22.814784+0000","last_clean":"2024-04-24T23:39:22.814784+0000","last_became_active":"2024-04-24T23:38:34.174504+0000","last_became_peered":"2024-04-24T23:38:34.174504+0000","last_unstale":"2024-04-24T23:39:22.814784+0000","last_undegraded":"2024-04-24T23:39:22.814784+0000","last_fullsized":"2024-04-24T23:39:22.814784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:27.147380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822266+0000","last_change":"2024-04-24T23:38:33.125559+0000","last_active":"2024-04-24T23:39:22.822266+0000","last_peered":"2024-04-24T23:39:22.822266+0000","last_clean":"2024-04-24T23:39:22.822266+0000","last_became_active":"2024-04-24T23:38:33.125115+0000","last_became_peered":"2024-04-24T23:38:33.125115+0000","last_unstale":"2024-04-24T23:39:22.822266+0000","last_undegraded":"2024-04-24T23:39:22.822266+0000","last_fullsized":"2024-04-24T23:39:22.822266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821927+0000","last_change":"2024-04-24T23:38:38.221669+0000","last_active":"2024-04-24T23:39:22.821927+0000","last_peered":"2024-04-24T23:39:22.821927+0000","last_clean":"2024-04-24T23:39:22.821927+0000","last_became_active":"2024-04-24T23:38:38.219797+0000","last_became_peered":"2024-04-24T23:38:38.219797+0000","last_unstale":"2024-04-24T23:39:22.821927+0000","last_undegraded":"2024-04-24T23:39:22.821927+0000","last_fullsized":"2024-04-24T23:39:22.821927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:04.091622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814214+0000","last_change":"2024-04-24T23:38:34.163966+0000","last_active":"2024-04-24T23:39:22.814214+0000","last_peered":"2024-04-24T23:39:22.814214+0000","last_clean":"2024-04-24T23:39:22.814214+0000","last_became_active":"2024-04-24T23:38:34.163291+0000","last_became_peered":"2024-04-24T23:38:34.163291+0000","last_unstale":"2024-04-24T23:39:22.814214+0000","last_undegraded":"2024-04-24T23:39:22.814214+0000","last_fullsized":"2024-04-24T23:39:22.814214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:34.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822639+0000","last_change":"2024-04-24T23:38:33.119549+0000","last_active":"2024-04-24T23:39:22.822639+0000","last_peered":"2024-04-24T23:39:22.822639+0000","last_clean":"2024-04-24T23:39:22.822639+0000","last_became_active":"2024-04-24T23:38:33.119052+0000","last_became_peered":"2024-04-24T23:38:33.119052+0000","last_unstale":"2024-04-24T23:39:22.822639+0000","last_undegraded":"2024-04-24T23:39:22.822639+0000","last_fullsized":"2024-04-24T23:39:22.822639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'33","reported_seq":52,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:44.230491+0000","last_change":"2024-04-24T23:38:38.252720+0000","last_active":"2024-04-24T23:39:44.230491+0000","last_peered":"2024-04-24T23:39:44.230491+0000","last_clean":"2024-04-24T23:39:44.230491+0000","last_became_active":"2024-04-24T23:38:38.252138+0000","last_became_peered":"2024-04-24T23:38:38.252138+0000","last_unstale":"2024-04-24T23:39:44.230491+0000","last_undegraded":"2024-04-24T23:39:44.230491+0000","last_fullsized":"2024-04-24T23:39:44.230491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.823517+0000","last_change":"2024-04-24T23:38:34.157008+0000","last_active":"2024-04-24T23:39:22.823517+0000","last_peered":"2024-04-24T23:39:22.823517+0000","last_clean":"2024-04-24T23:39:22.823517+0000","last_became_active":"2024-04-24T23:38:34.152682+0000","last_became_peered":"2024-04-24T23:38:34.152682+0000","last_unstale":"2024-04-24T23:39:22.823517+0000","last_undegraded":"2024-04-24T23:39:22.823517+0000","last_fullsized":"2024-04-24T23:39:22.823517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:48.697457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.824298+0000","last_change":"2024-04-24T23:38:33.139819+0000","last_active":"2024-04-24T23:39:22.824298+0000","last_peered":"2024-04-24T23:39:22.824298+0000","last_clean":"2024-04-24T23:39:22.824298+0000","last_became_active":"2024-04-24T23:38:33.139175+0000","last_became_peered":"2024-04-24T23:38:33.139175+0000","last_unstale":"2024-04-24T23:39:22.824298+0000","last_undegraded":"2024-04-24T23:39:22.824298+0000","last_fullsized":"2024-04-24T23:39:22.824298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:52.007425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.833647+0000","last_change":"2024-04-24T23:39:22.833647+0000","last_active":"2024-04-24T23:39:22.833647+0000","last_peered":"2024-04-24T23:39:22.833647+0000","last_clean":"2024-04-24T23:39:22.833647+0000","last_became_active":"2024-04-24T23:39:22.831081+0000","last_became_peered":"2024-04-24T23:39:22.831081+0000","last_unstale":"2024-04-24T23:39:22.833647+0000","last_undegraded":"2024-04-24T23:39:22.833647+0000","last_fullsized":"2024-04-24T23:39:22.833647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:32:39.380569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947844+0000","last_change":"2024-04-24T23:38:34.154755+0000","last_active":"2024-04-24T23:39:22.947844+0000","last_peered":"2024-04-24T23:39:22.947844+0000","last_clean":"2024-04-24T23:39:22.947844+0000","last_became_active":"2024-04-24T23:38:34.153967+0000","last_became_peered":"2024-04-24T23:38:34.153967+0000","last_unstale":"2024-04-24T23:39:22.947844+0000","last_undegraded":"2024-04-24T23:39:22.947844+0000","last_fullsized":"2024-04-24T23:39:22.947844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.818571+0000","last_change":"2024-04-24T23:38:33.135885+0000","last_active":"2024-04-24T23:39:22.818571+0000","last_peered":"2024-04-24T23:39:22.818571+0000","last_clean":"2024-04-24T23:39:22.818571+0000","last_became_active":"2024-04-24T23:38:33.135225+0000","last_became_peered":"2024-04-24T23:38:33.135225+0000","last_unstale":"2024-04-24T23:39:22.818571+0000","last_undegraded":"2024-04-24T23:39:22.818571+0000","last_fullsized":"2024-04-24T23:39:22.818571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:52.007425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822856+0000","last_change":"2024-04-24T23:38:38.252002+0000","last_active":"2024-04-24T23:39:22.822856+0000","last_peered":"2024-04-24T23:39:22.822856+0000","last_clean":"2024-04-24T23:39:22.822856+0000","last_became_active":"2024-04-24T23:38:38.251057+0000","last_became_peered":"2024-04-24T23:38:38.251057+0000","last_unstale":"2024-04-24T23:39:22.822856+0000","last_undegraded":"2024-04-24T23:39:22.822856+0000","last_fullsized":"2024-04-24T23:39:22.822856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:49.920273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.838498+0000","last_change":"2024-04-24T23:39:22.833969+0000","last_active":"2024-04-24T23:39:22.838498+0000","last_peered":"2024-04-24T23:39:22.838498+0000","last_clean":"2024-04-24T23:39:22.838498+0000","last_became_active":"2024-04-24T23:39:22.833072+0000","last_became_peered":"2024-04-24T23:39:22.833072+0000","last_unstale":"2024-04-24T23:39:22.838498+0000","last_undegraded":"2024-04-24T23:39:22.838498+0000","last_fullsized":"2024-04-24T23:39:22.838498+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:53.567151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"26'5","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:44.219591+0000","last_change":"2024-04-24T23:38:33.115409+0000","last_active":"2024-04-24T23:39:44.219591+0000","last_peered":"2024-04-24T23:39:44.219591+0000","last_clean":"2024-04-24T23:39:44.219591+0000","last_became_active":"2024-04-24T23:38:33.115039+0000","last_became_peered":"2024-04-24T23:38:33.115039+0000","last_unstale":"2024-04-24T23:39:44.219591+0000","last_undegraded":"2024-04-24T23:39:44.219591+0000","last_fullsized":"2024-04-24T23:39:44.219591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.813502+0000","last_change":"2024-04-24T23:38:38.246602+0000","last_active":"2024-04-24T23:39:22.813502+0000","last_peered":"2024-04-24T23:39:22.813502+0000","last_clean":"2024-04-24T23:39:22.813502+0000","last_became_active":"2024-04-24T23:38:38.245775+0000","last_became_peered":"2024-04-24T23:38:38.245775+0000","last_unstale":"2024-04-24T23:39:22.813502+0000","last_undegraded":"2024-04-24T23:39:22.813502+0000","last_fullsized":"2024-04-24T23:39:22.813502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:29.684133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.823679+0000","last_change":"2024-04-24T23:38:34.149008+0000","last_active":"2024-04-24T23:39:22.823679+0000","last_peered":"2024-04-24T23:39:22.823679+0000","last_clean":"2024-04-24T23:39:22.823679+0000","last_became_active":"2024-04-24T23:38:34.148122+0000","last_became_peered":"2024-04-24T23:38:34.148122+0000","last_unstale":"2024-04-24T23:39:22.823679+0000","last_undegraded":"2024-04-24T23:39:22.823679+0000","last_fullsized":"2024-04-24T23:39:22.823679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.828326+0000","last_change":"2024-04-24T23:38:33.142490+0000","last_active":"2024-04-24T23:39:22.828326+0000","last_peered":"2024-04-24T23:39:22.828326+0000","last_clean":"2024-04-24T23:39:22.828326+0000","last_became_active":"2024-04-24T23:38:33.140003+0000","last_became_peered":"2024-04-24T23:38:33.140003+0000","last_unstale":"2024-04-24T23:39:22.828326+0000","last_undegraded":"2024-04-24T23:39:22.828326+0000","last_fullsized":"2024-04-24T23:39:22.828326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:45:12.216173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.946930+0000","last_change":"2024-04-24T23:38:38.246291+0000","last_active":"2024-04-24T23:39:22.946930+0000","last_peered":"2024-04-24T23:39:22.946930+0000","last_clean":"2024-04-24T23:39:22.946930+0000","last_became_active":"2024-04-24T23:38:38.245611+0000","last_became_peered":"2024-04-24T23:38:38.245611+0000","last_unstale":"2024-04-24T23:39:22.946930+0000","last_undegraded":"2024-04-24T23:39:22.946930+0000","last_fullsized":"2024-04-24T23:39:22.946930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817536+0000","last_change":"2024-04-24T23:38:34.186285+0000","last_active":"2024-04-24T23:39:22.817536+0000","last_peered":"2024-04-24T23:39:22.817536+0000","last_clean":"2024-04-24T23:39:22.817536+0000","last_became_active":"2024-04-24T23:38:34.185023+0000","last_became_peered":"2024-04-24T23:38:34.185023+0000","last_unstale":"2024-04-24T23:39:22.817536+0000","last_undegraded":"2024-04-24T23:39:22.817536+0000","last_fullsized":"2024-04-24T23:39:22.817536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:56.947423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.823945+0000","last_change":"2024-04-24T23:38:33.108447+0000","last_active":"2024-04-24T23:39:22.823945+0000","last_peered":"2024-04-24T23:39:22.823945+0000","last_clean":"2024-04-24T23:39:22.823945+0000","last_became_active":"2024-04-24T23:38:33.108102+0000","last_became_peered":"2024-04-24T23:38:33.108102+0000","last_unstale":"2024-04-24T23:39:22.823945+0000","last_undegraded":"2024-04-24T23:39:22.823945+0000","last_fullsized":"2024-04-24T23:39:22.823945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821620+0000","last_change":"2024-04-24T23:38:38.213425+0000","last_active":"2024-04-24T23:39:22.821620+0000","last_peered":"2024-04-24T23:39:22.821620+0000","last_clean":"2024-04-24T23:39:22.821620+0000","last_became_active":"2024-04-24T23:38:38.212691+0000","last_became_peered":"2024-04-24T23:38:38.212691+0000","last_unstale":"2024-04-24T23:39:22.821620+0000","last_undegraded":"2024-04-24T23:39:22.821620+0000","last_fullsized":"2024-04-24T23:39:22.821620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822383+0000","last_change":"2024-04-24T23:38:34.154178+0000","last_active":"2024-04-24T23:39:22.822383+0000","last_peered":"2024-04-24T23:39:22.822383+0000","last_clean":"2024-04-24T23:39:22.822383+0000","last_became_active":"2024-04-24T23:38:34.153372+0000","last_became_peered":"2024-04-24T23:38:34.153372+0000","last_unstale":"2024-04-24T23:39:22.822383+0000","last_undegraded":"2024-04-24T23:39:22.822383+0000","last_fullsized":"2024-04-24T23:39:22.822383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:10.585665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816188+0000","last_change":"2024-04-24T23:38:33.140060+0000","last_active":"2024-04-24T23:39:22.816188+0000","last_peered":"2024-04-24T23:39:22.816188+0000","last_clean":"2024-04-24T23:39:22.816188+0000","last_became_active":"2024-04-24T23:38:33.139012+0000","last_became_peered":"2024-04-24T23:38:33.139012+0000","last_unstale":"2024-04-24T23:39:22.816188+0000","last_undegraded":"2024-04-24T23:39:22.816188+0000","last_fullsized":"2024-04-24T23:39:22.816188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.830414+0000","last_change":"2024-04-24T23:39:22.828208+0000","last_active":"2024-04-24T23:39:22.830414+0000","last_peered":"2024-04-24T23:39:22.830414+0000","last_clean":"2024-04-24T23:39:22.830414+0000","last_became_active":"2024-04-24T23:39:22.825860+0000","last_became_peered":"2024-04-24T23:39:22.825860+0000","last_unstale":"2024-04-24T23:39:22.830414+0000","last_undegraded":"2024-04-24T23:39:22.830414+0000","last_fullsized":"2024-04-24T23:39:22.830414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:14:39.506678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821043+0000","last_change":"2024-04-24T23:38:34.152846+0000","last_active":"2024-04-24T23:39:22.821043+0000","last_peered":"2024-04-24T23:39:22.821043+0000","last_clean":"2024-04-24T23:39:22.821043+0000","last_became_active":"2024-04-24T23:38:34.151917+0000","last_became_peered":"2024-04-24T23:38:34.151917+0000","last_unstale":"2024-04-24T23:39:22.821043+0000","last_undegraded":"2024-04-24T23:39:22.821043+0000","last_fullsized":"2024-04-24T23:39:22.821043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'2","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:44.222348+0000","last_change":"2024-04-24T23:38:33.124295+0000","last_active":"2024-04-24T23:39:44.222348+0000","last_peered":"2024-04-24T23:39:44.222348+0000","last_clean":"2024-04-24T23:39:44.222348+0000","last_became_active":"2024-04-24T23:38:33.123674+0000","last_became_peered":"2024-04-24T23:38:33.123674+0000","last_unstale":"2024-04-24T23:39:44.222348+0000","last_undegraded":"2024-04-24T23:39:44.222348+0000","last_fullsized":"2024-04-24T23:39:44.222348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.825048+0000","last_change":"2024-04-24T23:38:38.214721+0000","last_active":"2024-04-24T23:39:22.825048+0000","last_peered":"2024-04-24T23:39:22.825048+0000","last_clean":"2024-04-24T23:39:22.825048+0000","last_became_active":"2024-04-24T23:38:38.214005+0000","last_became_peered":"2024-04-24T23:38:38.214005+0000","last_unstale":"2024-04-24T23:39:22.825048+0000","last_undegraded":"2024-04-24T23:39:22.825048+0000","last_fullsized":"2024-04-24T23:39:22.825048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.946299+0000","last_change":"2024-04-24T23:38:34.139551+0000","last_active":"2024-04-24T23:39:22.946299+0000","last_peered":"2024-04-24T23:39:22.946299+0000","last_clean":"2024-04-24T23:39:22.946299+0000","last_became_active":"2024-04-24T23:38:34.138681+0000","last_became_peered":"2024-04-24T23:38:34.138681+0000","last_unstale":"2024-04-24T23:39:22.946299+0000","last_undegraded":"2024-04-24T23:39:22.946299+0000","last_fullsized":"2024-04-24T23:39:22.946299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.824571+0000","last_change":"2024-04-24T23:38:33.141279+0000","last_active":"2024-04-24T23:39:22.824571+0000","last_peered":"2024-04-24T23:39:22.824571+0000","last_clean":"2024-04-24T23:39:22.824571+0000","last_became_active":"2024-04-24T23:38:33.140618+0000","last_became_peered":"2024-04-24T23:38:33.140618+0000","last_unstale":"2024-04-24T23:39:22.824571+0000","last_undegraded":"2024-04-24T23:39:22.824571+0000","last_fullsized":"2024-04-24T23:39:22.824571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947628+0000","last_change":"2024-04-24T23:38:38.250074+0000","last_active":"2024-04-24T23:39:22.947628+0000","last_peered":"2024-04-24T23:39:22.947628+0000","last_clean":"2024-04-24T23:39:22.947628+0000","last_became_active":"2024-04-24T23:38:38.249402+0000","last_became_peered":"2024-04-24T23:38:38.249402+0000","last_unstale":"2024-04-24T23:39:22.947628+0000","last_undegraded":"2024-04-24T23:39:22.947628+0000","last_fullsized":"2024-04-24T23:39:22.947628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816685+0000","last_change":"2024-04-24T23:38:34.187980+0000","last_active":"2024-04-24T23:39:22.816685+0000","last_peered":"2024-04-24T23:39:22.816685+0000","last_clean":"2024-04-24T23:39:22.816685+0000","last_became_active":"2024-04-24T23:38:34.187655+0000","last_became_peered":"2024-04-24T23:38:34.187655+0000","last_unstale":"2024-04-24T23:39:22.816685+0000","last_undegraded":"2024-04-24T23:39:22.816685+0000","last_fullsized":"2024-04-24T23:39:22.816685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:39.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815604+0000","last_change":"2024-04-24T23:38:33.125255+0000","last_active":"2024-04-24T23:39:22.815604+0000","last_peered":"2024-04-24T23:39:22.815604+0000","last_clean":"2024-04-24T23:39:22.815604+0000","last_became_active":"2024-04-24T23:38:33.115926+0000","last_became_peered":"2024-04-24T23:38:33.115926+0000","last_unstale":"2024-04-24T23:39:22.815604+0000","last_undegraded":"2024-04-24T23:39:22.815604+0000","last_fullsized":"2024-04-24T23:39:22.815604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:42.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.824826+0000","last_change":"2024-04-24T23:38:29.564705+0000","last_active":"2024-04-24T23:39:22.824826+0000","last_peered":"2024-04-24T23:39:22.824826+0000","last_clean":"2024-04-24T23:39:22.824826+0000","last_became_active":"2024-04-24T23:38:29.562027+0000","last_became_peered":"2024-04-24T23:38:29.562027+0000","last_unstale":"2024-04-24T23:39:22.824826+0000","last_undegraded":"2024-04-24T23:39:22.824826+0000","last_fullsized":"2024-04-24T23:39:22.824826+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:27.959678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:27.959678+0000","last_clean_scrub_stamp":"2024-04-24T23:38:27.959678+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:40.724497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'33","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:42.539265+0000","last_change":"2024-04-24T23:38:38.254846+0000","last_active":"2024-04-24T23:39:42.539265+0000","last_peered":"2024-04-24T23:39:42.539265+0000","last_clean":"2024-04-24T23:39:42.539265+0000","last_became_active":"2024-04-24T23:38:38.253792+0000","last_became_peered":"2024-04-24T23:38:38.253792+0000","last_unstale":"2024-04-24T23:39:42.539265+0000","last_undegraded":"2024-04-24T23:39:42.539265+0000","last_fullsized":"2024-04-24T23:39:42.539265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:17:11.093562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":2176,"num_write":33,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.827672+0000","last_change":"2024-04-24T23:38:34.195003+0000","last_active":"2024-04-24T23:39:22.827672+0000","last_peered":"2024-04-24T23:39:22.827672+0000","last_clean":"2024-04-24T23:39:22.827672+0000","last_became_active":"2024-04-24T23:38:34.194530+0000","last_became_peered":"2024-04-24T23:38:34.194530+0000","last_unstale":"2024-04-24T23:39:22.827672+0000","last_undegraded":"2024-04-24T23:39:22.827672+0000","last_fullsized":"2024-04-24T23:39:22.827672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:00.007223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.820712+0000","last_change":"2024-04-24T23:38:33.130165+0000","last_active":"2024-04-24T23:39:22.820712+0000","last_peered":"2024-04-24T23:39:22.820712+0000","last_clean":"2024-04-24T23:39:22.820712+0000","last_became_active":"2024-04-24T23:38:33.129888+0000","last_became_peered":"2024-04-24T23:38:33.129888+0000","last_unstale":"2024-04-24T23:39:22.820712+0000","last_undegraded":"2024-04-24T23:39:22.820712+0000","last_fullsized":"2024-04-24T23:39:22.820712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:27:41.421732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'66","reported_seq":116,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:44.231356+0000","last_change":"2024-04-24T23:38:38.253780+0000","last_active":"2024-04-24T23:39:44.231356+0000","last_peered":"2024-04-24T23:39:44.231356+0000","last_clean":"2024-04-24T23:39:44.231356+0000","last_became_active":"2024-04-24T23:38:38.252899+0000","last_became_peered":"2024-04-24T23:38:38.252899+0000","last_unstale":"2024-04-24T23:39:44.231356+0000","last_undegraded":"2024-04-24T23:39:44.231356+0000","last_fullsized":"2024-04-24T23:39:44.231356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:58.553943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":4096,"num_write":66,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816876+0000","last_change":"2024-04-24T23:38:34.187942+0000","last_active":"2024-04-24T23:39:22.816876+0000","last_peered":"2024-04-24T23:39:22.816876+0000","last_clean":"2024-04-24T23:39:22.816876+0000","last_became_active":"2024-04-24T23:38:34.184929+0000","last_became_peered":"2024-04-24T23:38:34.184929+0000","last_unstale":"2024-04-24T23:39:22.816876+0000","last_undegraded":"2024-04-24T23:39:22.816876+0000","last_fullsized":"2024-04-24T23:39:22.816876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:43.814245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.823564+0000","last_change":"2024-04-24T23:38:33.120289+0000","last_active":"2024-04-24T23:39:22.823564+0000","last_peered":"2024-04-24T23:39:22.823564+0000","last_clean":"2024-04-24T23:39:22.823564+0000","last_became_active":"2024-04-24T23:38:33.119790+0000","last_became_peered":"2024-04-24T23:38:33.119790+0000","last_unstale":"2024-04-24T23:39:22.823564+0000","last_undegraded":"2024-04-24T23:39:22.823564+0000","last_fullsized":"2024-04-24T23:39:22.823564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947244+0000","last_change":"2024-04-24T23:38:38.216064+0000","last_active":"2024-04-24T23:39:22.947244+0000","last_peered":"2024-04-24T23:39:22.947244+0000","last_clean":"2024-04-24T23:39:22.947244+0000","last_became_active":"2024-04-24T23:38:38.215599+0000","last_became_peered":"2024-04-24T23:38:38.215599+0000","last_unstale":"2024-04-24T23:39:22.947244+0000","last_undegraded":"2024-04-24T23:39:22.947244+0000","last_fullsized":"2024-04-24T23:39:22.947244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.828856+0000","last_change":"2024-04-24T23:38:34.194305+0000","last_active":"2024-04-24T23:39:22.828856+0000","last_peered":"2024-04-24T23:39:22.828856+0000","last_clean":"2024-04-24T23:39:22.828856+0000","last_became_active":"2024-04-24T23:38:34.188815+0000","last_became_peered":"2024-04-24T23:38:34.188815+0000","last_unstale":"2024-04-24T23:39:22.828856+0000","last_undegraded":"2024-04-24T23:39:22.828856+0000","last_fullsized":"2024-04-24T23:39:22.828856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:25.599734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821376+0000","last_change":"2024-04-24T23:38:33.125221+0000","last_active":"2024-04-24T23:39:22.821376+0000","last_peered":"2024-04-24T23:39:22.821376+0000","last_clean":"2024-04-24T23:39:22.821376+0000","last_became_active":"2024-04-24T23:38:33.124849+0000","last_became_peered":"2024-04-24T23:38:33.124849+0000","last_unstale":"2024-04-24T23:39:22.821376+0000","last_undegraded":"2024-04-24T23:39:22.821376+0000","last_fullsized":"2024-04-24T23:39:22.821376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:42.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814131+0000","last_change":"2024-04-24T23:38:38.250618+0000","last_active":"2024-04-24T23:39:22.814131+0000","last_peered":"2024-04-24T23:39:22.814131+0000","last_clean":"2024-04-24T23:39:22.814131+0000","last_became_active":"2024-04-24T23:38:38.249521+0000","last_became_peered":"2024-04-24T23:38:38.249521+0000","last_unstale":"2024-04-24T23:39:22.814131+0000","last_undegraded":"2024-04-24T23:39:22.814131+0000","last_fullsized":"2024-04-24T23:39:22.814131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:57.651551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.828052+0000","last_change":"2024-04-24T23:38:34.166018+0000","last_active":"2024-04-24T23:39:22.828052+0000","last_peered":"2024-04-24T23:39:22.828052+0000","last_clean":"2024-04-24T23:39:22.828052+0000","last_became_active":"2024-04-24T23:38:34.165229+0000","last_became_peered":"2024-04-24T23:38:34.165229+0000","last_unstale":"2024-04-24T23:39:22.828052+0000","last_undegraded":"2024-04-24T23:39:22.828052+0000","last_fullsized":"2024-04-24T23:39:22.828052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:56.947423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.823071+0000","last_change":"2024-04-24T23:38:33.109771+0000","last_active":"2024-04-24T23:39:22.823071+0000","last_peered":"2024-04-24T23:39:22.823071+0000","last_clean":"2024-04-24T23:39:22.823071+0000","last_became_active":"2024-04-24T23:38:33.108928+0000","last_became_peered":"2024-04-24T23:38:33.108928+0000","last_unstale":"2024-04-24T23:39:22.823071+0000","last_undegraded":"2024-04-24T23:39:22.823071+0000","last_fullsized":"2024-04-24T23:39:22.823071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:44.838533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.833400+0000","last_change":"2024-04-24T23:39:22.833400+0000","last_active":"2024-04-24T23:39:22.833400+0000","last_peered":"2024-04-24T23:39:22.833400+0000","last_clean":"2024-04-24T23:39:22.833400+0000","last_became_active":"2024-04-24T23:39:22.831340+0000","last_became_peered":"2024-04-24T23:39:22.831340+0000","last_unstale":"2024-04-24T23:39:22.833400+0000","last_undegraded":"2024-04-24T23:39:22.833400+0000","last_fullsized":"2024-04-24T23:39:22.833400+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:05:14.068761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3,6],"acting":[4,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.824993+0000","last_change":"2024-04-24T23:38:34.188981+0000","last_active":"2024-04-24T23:39:22.824993+0000","last_peered":"2024-04-24T23:39:22.824993+0000","last_clean":"2024-04-24T23:39:22.824993+0000","last_became_active":"2024-04-24T23:38:34.188416+0000","last_became_peered":"2024-04-24T23:38:34.188416+0000","last_unstale":"2024-04-24T23:39:22.824993+0000","last_undegraded":"2024-04-24T23:39:22.824993+0000","last_fullsized":"2024-04-24T23:39:22.824993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:17:07.009163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.820272+0000","last_change":"2024-04-24T23:38:33.100912+0000","last_active":"2024-04-24T23:39:22.820272+0000","last_peered":"2024-04-24T23:39:22.820272+0000","last_clean":"2024-04-24T23:39:22.820272+0000","last_became_active":"2024-04-24T23:38:33.100464+0000","last_became_peered":"2024-04-24T23:38:33.100464+0000","last_unstale":"2024-04-24T23:39:22.820272+0000","last_undegraded":"2024-04-24T23:39:22.820272+0000","last_fullsized":"2024-04-24T23:39:22.820272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:47:27.107958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947314+0000","last_change":"2024-04-24T23:38:38.207627+0000","last_active":"2024-04-24T23:39:22.947314+0000","last_peered":"2024-04-24T23:39:22.947314+0000","last_clean":"2024-04-24T23:39:22.947314+0000","last_became_active":"2024-04-24T23:38:38.207049+0000","last_became_peered":"2024-04-24T23:38:38.207049+0000","last_unstale":"2024-04-24T23:39:22.947314+0000","last_undegraded":"2024-04-24T23:39:22.947314+0000","last_fullsized":"2024-04-24T23:39:22.947314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814063+0000","last_change":"2024-04-24T23:38:34.161654+0000","last_active":"2024-04-24T23:39:22.814063+0000","last_peered":"2024-04-24T23:39:22.814063+0000","last_clean":"2024-04-24T23:39:22.814063+0000","last_became_active":"2024-04-24T23:38:34.158756+0000","last_became_peered":"2024-04-24T23:38:34.158756+0000","last_unstale":"2024-04-24T23:39:22.814063+0000","last_undegraded":"2024-04-24T23:39:22.814063+0000","last_fullsized":"2024-04-24T23:39:22.814063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:29.660159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.813988+0000","last_change":"2024-04-24T23:38:33.116071+0000","last_active":"2024-04-24T23:39:22.813988+0000","last_peered":"2024-04-24T23:39:22.813988+0000","last_clean":"2024-04-24T23:39:22.813988+0000","last_became_active":"2024-04-24T23:38:33.115472+0000","last_became_peered":"2024-04-24T23:38:33.115472+0000","last_unstale":"2024-04-24T23:39:22.813988+0000","last_undegraded":"2024-04-24T23:39:22.813988+0000","last_fullsized":"2024-04-24T23:39:22.813988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:47.686974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815773+0000","last_change":"2024-04-24T23:38:38.248841+0000","last_active":"2024-04-24T23:39:22.815773+0000","last_peered":"2024-04-24T23:39:22.815773+0000","last_clean":"2024-04-24T23:39:22.815773+0000","last_became_active":"2024-04-24T23:38:38.248311+0000","last_became_peered":"2024-04-24T23:38:38.248311+0000","last_unstale":"2024-04-24T23:39:22.815773+0000","last_undegraded":"2024-04-24T23:39:22.815773+0000","last_fullsized":"2024-04-24T23:39:22.815773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:22.798878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.826809+0000","last_change":"2024-04-24T23:38:34.189772+0000","last_active":"2024-04-24T23:39:22.826809+0000","last_peered":"2024-04-24T23:39:22.826809+0000","last_clean":"2024-04-24T23:39:22.826809+0000","last_became_active":"2024-04-24T23:38:34.179801+0000","last_became_peered":"2024-04-24T23:38:34.179801+0000","last_unstale":"2024-04-24T23:39:22.826809+0000","last_undegraded":"2024-04-24T23:39:22.826809+0000","last_fullsized":"2024-04-24T23:39:22.826809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:54.469544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815922+0000","last_change":"2024-04-24T23:38:33.146611+0000","last_active":"2024-04-24T23:39:22.815922+0000","last_peered":"2024-04-24T23:39:22.815922+0000","last_clean":"2024-04-24T23:39:22.815922+0000","last_became_active":"2024-04-24T23:38:33.145896+0000","last_became_peered":"2024-04-24T23:38:33.145896+0000","last_unstale":"2024-04-24T23:39:22.815922+0000","last_undegraded":"2024-04-24T23:39:22.815922+0000","last_fullsized":"2024-04-24T23:39:22.815922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:47.686974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814661+0000","last_change":"2024-04-24T23:38:38.252023+0000","last_active":"2024-04-24T23:39:22.814661+0000","last_peered":"2024-04-24T23:39:22.814661+0000","last_clean":"2024-04-24T23:39:22.814661+0000","last_became_active":"2024-04-24T23:38:38.251541+0000","last_became_peered":"2024-04-24T23:38:38.251541+0000","last_unstale":"2024-04-24T23:39:22.814661+0000","last_undegraded":"2024-04-24T23:39:22.814661+0000","last_fullsized":"2024-04-24T23:39:22.814661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:25:30.720742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:07.639085+0000","last_change":"2024-04-24T23:40:07.639213+0000","last_active":"2024-04-24T23:40:07.639085+0000","last_peered":"2024-04-24T23:40:07.639085+0000","last_clean":"2024-04-24T23:40:07.639085+0000","last_became_active":"2024-04-24T23:38:34.164024+0000","last_became_peered":"2024-04-24T23:38:34.164024+0000","last_unstale":"2024-04-24T23:40:07.639085+0000","last_undegraded":"2024-04-24T23:40:07.639085+0000","last_fullsized":"2024-04-24T23:40:07.639085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:07.638833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:07.638833+0000","last_clean_scrub_stamp":"2024-04-24T23:40:07.638833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:13.497785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947585+0000","last_change":"2024-04-24T23:38:33.111314+0000","last_active":"2024-04-24T23:39:22.947585+0000","last_peered":"2024-04-24T23:39:22.947585+0000","last_clean":"2024-04-24T23:39:22.947585+0000","last_became_active":"2024-04-24T23:38:33.109819+0000","last_became_peered":"2024-04-24T23:38:33.109819+0000","last_unstale":"2024-04-24T23:39:22.947585+0000","last_undegraded":"2024-04-24T23:39:22.947585+0000","last_fullsized":"2024-04-24T23:39:22.947585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816959+0000","last_change":"2024-04-24T23:38:38.247323+0000","last_active":"2024-04-24T23:39:22.816959+0000","last_peered":"2024-04-24T23:39:22.816959+0000","last_clean":"2024-04-24T23:39:22.816959+0000","last_became_active":"2024-04-24T23:38:38.246172+0000","last_became_peered":"2024-04-24T23:38:38.246172+0000","last_unstale":"2024-04-24T23:39:22.816959+0000","last_undegraded":"2024-04-24T23:39:22.816959+0000","last_fullsized":"2024-04-24T23:39:22.816959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:32.771055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.827448+0000","last_change":"2024-04-24T23:38:34.189746+0000","last_active":"2024-04-24T23:39:22.827448+0000","last_peered":"2024-04-24T23:39:22.827448+0000","last_clean":"2024-04-24T23:39:22.827448+0000","last_became_active":"2024-04-24T23:38:34.179433+0000","last_became_peered":"2024-04-24T23:38:34.179433+0000","last_unstale":"2024-04-24T23:39:22.827448+0000","last_undegraded":"2024-04-24T23:39:22.827448+0000","last_fullsized":"2024-04-24T23:39:22.827448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:56.049789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'35","reported_seq":61,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:57.551905+0000","last_change":"2024-04-24T23:38:33.127637+0000","last_active":"2024-04-24T23:39:57.551905+0000","last_peered":"2024-04-24T23:39:57.551905+0000","last_clean":"2024-04-24T23:39:57.551905+0000","last_became_active":"2024-04-24T23:38:33.127122+0000","last_became_peered":"2024-04-24T23:38:33.127122+0000","last_unstale":"2024-04-24T23:39:57.551905+0000","last_undegraded":"2024-04-24T23:39:57.551905+0000","last_fullsized":"2024-04-24T23:39:57.551905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:30.023422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39309,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822081+0000","last_change":"2024-04-24T23:38:38.216781+0000","last_active":"2024-04-24T23:39:22.822081+0000","last_peered":"2024-04-24T23:39:22.822081+0000","last_clean":"2024-04-24T23:39:22.822081+0000","last_became_active":"2024-04-24T23:38:38.215741+0000","last_became_peered":"2024-04-24T23:38:38.215741+0000","last_unstale":"2024-04-24T23:39:22.822081+0000","last_undegraded":"2024-04-24T23:39:22.822081+0000","last_fullsized":"2024-04-24T23:39:22.822081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822840+0000","last_change":"2024-04-24T23:38:34.167424+0000","last_active":"2024-04-24T23:39:22.822840+0000","last_peered":"2024-04-24T23:39:22.822840+0000","last_clean":"2024-04-24T23:39:22.822840+0000","last_became_active":"2024-04-24T23:38:34.166602+0000","last_became_peered":"2024-04-24T23:38:34.166602+0000","last_unstale":"2024-04-24T23:39:22.822840+0000","last_undegraded":"2024-04-24T23:39:22.822840+0000","last_fullsized":"2024-04-24T23:39:22.822840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:31.033906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'5","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:44.238786+0000","last_change":"2024-04-24T23:38:33.146758+0000","last_active":"2024-04-24T23:39:44.238786+0000","last_peered":"2024-04-24T23:39:44.238786+0000","last_clean":"2024-04-24T23:39:44.238786+0000","last_became_active":"2024-04-24T23:38:33.146311+0000","last_became_peered":"2024-04-24T23:38:33.146311+0000","last_unstale":"2024-04-24T23:39:44.238786+0000","last_undegraded":"2024-04-24T23:39:44.238786+0000","last_fullsized":"2024-04-24T23:39:44.238786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822020+0000","last_change":"2024-04-24T23:38:38.221177+0000","last_active":"2024-04-24T23:39:22.822020+0000","last_peered":"2024-04-24T23:39:22.822020+0000","last_clean":"2024-04-24T23:39:22.822020+0000","last_became_active":"2024-04-24T23:38:38.219482+0000","last_became_peered":"2024-04-24T23:38:38.219482+0000","last_unstale":"2024-04-24T23:39:22.822020+0000","last_undegraded":"2024-04-24T23:39:22.822020+0000","last_fullsized":"2024-04-24T23:39:22.822020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:00.134189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.948039+0000","last_change":"2024-04-24T23:38:34.170044+0000","last_active":"2024-04-24T23:39:22.948039+0000","last_peered":"2024-04-24T23:39:22.948039+0000","last_clean":"2024-04-24T23:39:22.948039+0000","last_became_active":"2024-04-24T23:38:34.169512+0000","last_became_peered":"2024-04-24T23:38:34.169512+0000","last_unstale":"2024-04-24T23:39:22.948039+0000","last_undegraded":"2024-04-24T23:39:22.948039+0000","last_fullsized":"2024-04-24T23:39:22.948039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817797+0000","last_change":"2024-04-24T23:38:33.131079+0000","last_active":"2024-04-24T23:39:22.817797+0000","last_peered":"2024-04-24T23:39:22.817797+0000","last_clean":"2024-04-24T23:39:22.817797+0000","last_became_active":"2024-04-24T23:38:33.130150+0000","last_became_peered":"2024-04-24T23:38:33.130150+0000","last_unstale":"2024-04-24T23:39:22.817797+0000","last_undegraded":"2024-04-24T23:39:22.817797+0000","last_fullsized":"2024-04-24T23:39:22.817797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:07.598128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'35","reported_seq":86,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:42.446330+0000","last_change":"2024-04-24T23:38:38.212241+0000","last_active":"2024-04-24T23:39:42.446330+0000","last_peered":"2024-04-24T23:39:42.446330+0000","last_clean":"2024-04-24T23:39:42.446330+0000","last_became_active":"2024-04-24T23:38:38.208130+0000","last_became_peered":"2024-04-24T23:38:38.208130+0000","last_unstale":"2024-04-24T23:39:42.446330+0000","last_undegraded":"2024-04-24T23:39:42.446330+0000","last_fullsized":"2024-04-24T23:39:42.446330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:32.771055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":4096,"num_write":33,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817836+0000","last_change":"2024-04-24T23:38:34.199814+0000","last_active":"2024-04-24T23:39:22.817836+0000","last_peered":"2024-04-24T23:39:22.817836+0000","last_clean":"2024-04-24T23:39:22.817836+0000","last_became_active":"2024-04-24T23:38:34.199311+0000","last_became_peered":"2024-04-24T23:38:34.199311+0000","last_unstale":"2024-04-24T23:39:22.817836+0000","last_undegraded":"2024-04-24T23:39:22.817836+0000","last_fullsized":"2024-04-24T23:39:22.817836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:09:44.182605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.818287+0000","last_change":"2024-04-24T23:38:33.140029+0000","last_active":"2024-04-24T23:39:22.818287+0000","last_peered":"2024-04-24T23:39:22.818287+0000","last_clean":"2024-04-24T23:39:22.818287+0000","last_became_active":"2024-04-24T23:38:33.139325+0000","last_became_peered":"2024-04-24T23:38:33.139325+0000","last_unstale":"2024-04-24T23:39:22.818287+0000","last_undegraded":"2024-04-24T23:39:22.818287+0000","last_fullsized":"2024-04-24T23:39:22.818287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:07.598128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815762+0000","last_change":"2024-04-24T23:38:38.246245+0000","last_active":"2024-04-24T23:39:22.815762+0000","last_peered":"2024-04-24T23:39:22.815762+0000","last_clean":"2024-04-24T23:39:22.815762+0000","last_became_active":"2024-04-24T23:38:38.245657+0000","last_became_peered":"2024-04-24T23:38:38.245657+0000","last_unstale":"2024-04-24T23:39:22.815762+0000","last_undegraded":"2024-04-24T23:39:22.815762+0000","last_fullsized":"2024-04-24T23:39:22.815762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:45.297412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947325+0000","last_change":"2024-04-24T23:38:38.251308+0000","last_active":"2024-04-24T23:39:22.947325+0000","last_peered":"2024-04-24T23:39:22.947325+0000","last_clean":"2024-04-24T23:39:22.947325+0000","last_became_active":"2024-04-24T23:38:38.250718+0000","last_became_peered":"2024-04-24T23:38:38.250718+0000","last_unstale":"2024-04-24T23:39:22.947325+0000","last_undegraded":"2024-04-24T23:39:22.947325+0000","last_fullsized":"2024-04-24T23:39:22.947325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821224+0000","last_change":"2024-04-24T23:38:34.174658+0000","last_active":"2024-04-24T23:39:22.821224+0000","last_peered":"2024-04-24T23:39:22.821224+0000","last_clean":"2024-04-24T23:39:22.821224+0000","last_became_active":"2024-04-24T23:38:34.174289+0000","last_became_peered":"2024-04-24T23:38:34.174289+0000","last_unstale":"2024-04-24T23:39:22.821224+0000","last_undegraded":"2024-04-24T23:39:22.821224+0000","last_fullsized":"2024-04-24T23:39:22.821224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814626+0000","last_change":"2024-04-24T23:38:33.131171+0000","last_active":"2024-04-24T23:39:22.814626+0000","last_peered":"2024-04-24T23:39:22.814626+0000","last_clean":"2024-04-24T23:39:22.814626+0000","last_became_active":"2024-04-24T23:38:33.130621+0000","last_became_peered":"2024-04-24T23:38:33.130621+0000","last_unstale":"2024-04-24T23:39:22.814626+0000","last_undegraded":"2024-04-24T23:39:22.814626+0000","last_fullsized":"2024-04-24T23:39:22.814626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817794+0000","last_change":"2024-04-24T23:38:38.214392+0000","last_active":"2024-04-24T23:39:22.817794+0000","last_peered":"2024-04-24T23:39:22.817794+0000","last_clean":"2024-04-24T23:39:22.817794+0000","last_became_active":"2024-04-24T23:38:38.213249+0000","last_became_peered":"2024-04-24T23:38:38.213249+0000","last_unstale":"2024-04-24T23:39:22.817794+0000","last_undegraded":"2024-04-24T23:39:22.817794+0000","last_fullsized":"2024-04-24T23:39:22.817794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:21:01.031822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815731+0000","last_change":"2024-04-24T23:38:34.164231+0000","last_active":"2024-04-24T23:39:22.815731+0000","last_peered":"2024-04-24T23:39:22.815731+0000","last_clean":"2024-04-24T23:39:22.815731+0000","last_became_active":"2024-04-24T23:38:34.163685+0000","last_became_peered":"2024-04-24T23:38:34.163685+0000","last_unstale":"2024-04-24T23:39:22.815731+0000","last_undegraded":"2024-04-24T23:39:22.815731+0000","last_fullsized":"2024-04-24T23:39:22.815731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:29.660159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814851+0000","last_change":"2024-04-24T23:38:33.116249+0000","last_active":"2024-04-24T23:39:22.814851+0000","last_peered":"2024-04-24T23:39:22.814851+0000","last_clean":"2024-04-24T23:39:22.814851+0000","last_became_active":"2024-04-24T23:38:33.113333+0000","last_became_peered":"2024-04-24T23:38:33.113333+0000","last_unstale":"2024-04-24T23:39:22.814851+0000","last_undegraded":"2024-04-24T23:39:22.814851+0000","last_fullsized":"2024-04-24T23:39:22.814851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:47:27.107958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814770+0000","last_change":"2024-04-24T23:38:33.111080+0000","last_active":"2024-04-24T23:39:22.814770+0000","last_peered":"2024-04-24T23:39:22.814770+0000","last_clean":"2024-04-24T23:39:22.814770+0000","last_became_active":"2024-04-24T23:38:33.110315+0000","last_became_peered":"2024-04-24T23:38:33.110315+0000","last_unstale":"2024-04-24T23:39:22.814770+0000","last_undegraded":"2024-04-24T23:39:22.814770+0000","last_fullsized":"2024-04-24T23:39:22.814770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:33.659240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947552+0000","last_change":"2024-04-24T23:38:34.148734+0000","last_active":"2024-04-24T23:39:22.947552+0000","last_peered":"2024-04-24T23:39:22.947552+0000","last_clean":"2024-04-24T23:39:22.947552+0000","last_became_active":"2024-04-24T23:38:34.146909+0000","last_became_peered":"2024-04-24T23:38:34.146909+0000","last_unstale":"2024-04-24T23:39:22.947552+0000","last_undegraded":"2024-04-24T23:39:22.947552+0000","last_fullsized":"2024-04-24T23:39:22.947552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.820296+0000","last_change":"2024-04-24T23:38:38.215787+0000","last_active":"2024-04-24T23:39:22.820296+0000","last_peered":"2024-04-24T23:39:22.820296+0000","last_clean":"2024-04-24T23:39:22.820296+0000","last_became_active":"2024-04-24T23:38:38.215395+0000","last_became_peered":"2024-04-24T23:38:38.215395+0000","last_unstale":"2024-04-24T23:39:22.820296+0000","last_undegraded":"2024-04-24T23:39:22.820296+0000","last_fullsized":"2024-04-24T23:39:22.820296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:51.641050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815067+0000","last_change":"2024-04-24T23:38:33.131735+0000","last_active":"2024-04-24T23:39:22.815067+0000","last_peered":"2024-04-24T23:39:22.815067+0000","last_clean":"2024-04-24T23:39:22.815067+0000","last_became_active":"2024-04-24T23:38:33.131314+0000","last_became_peered":"2024-04-24T23:38:33.131314+0000","last_unstale":"2024-04-24T23:39:22.815067+0000","last_undegraded":"2024-04-24T23:39:22.815067+0000","last_fullsized":"2024-04-24T23:39:22.815067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:32.073715+0000","last_clean_scrub_stamp":"2024-04-24T23:38:32.073715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:42.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822079+0000","last_change":"2024-04-24T23:38:34.150894+0000","last_active":"2024-04-24T23:39:22.822079+0000","last_peered":"2024-04-24T23:39:22.822079+0000","last_clean":"2024-04-24T23:39:22.822079+0000","last_became_active":"2024-04-24T23:38:34.149910+0000","last_became_peered":"2024-04-24T23:38:34.149910+0000","last_unstale":"2024-04-24T23:39:22.822079+0000","last_undegraded":"2024-04-24T23:39:22.822079+0000","last_fullsized":"2024-04-24T23:39:22.822079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:08.608611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814775+0000","last_change":"2024-04-24T23:38:38.219498+0000","last_active":"2024-04-24T23:39:22.814775+0000","last_peered":"2024-04-24T23:39:22.814775+0000","last_clean":"2024-04-24T23:39:22.814775+0000","last_became_active":"2024-04-24T23:38:38.219100+0000","last_became_peered":"2024-04-24T23:38:38.219100+0000","last_unstale":"2024-04-24T23:39:22.814775+0000","last_undegraded":"2024-04-24T23:39:22.814775+0000","last_fullsized":"2024-04-24T23:39:22.814775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:17.585261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.813672+0000","last_change":"2024-04-24T23:38:34.162139+0000","last_active":"2024-04-24T23:39:22.813672+0000","last_peered":"2024-04-24T23:39:22.813672+0000","last_clean":"2024-04-24T23:39:22.813672+0000","last_became_active":"2024-04-24T23:38:34.159701+0000","last_became_peered":"2024-04-24T23:38:34.159701+0000","last_unstale":"2024-04-24T23:39:22.813672+0000","last_undegraded":"2024-04-24T23:39:22.813672+0000","last_fullsized":"2024-04-24T23:39:22.813672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:34.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.819582+0000","last_change":"2024-04-24T23:38:34.156925+0000","last_active":"2024-04-24T23:39:22.819582+0000","last_peered":"2024-04-24T23:39:22.819582+0000","last_clean":"2024-04-24T23:39:22.819582+0000","last_became_active":"2024-04-24T23:38:34.155969+0000","last_became_peered":"2024-04-24T23:38:34.155969+0000","last_unstale":"2024-04-24T23:39:22.819582+0000","last_undegraded":"2024-04-24T23:39:22.819582+0000","last_fullsized":"2024-04-24T23:39:22.819582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:31.033906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815530+0000","last_change":"2024-04-24T23:38:34.188234+0000","last_active":"2024-04-24T23:39:22.815530+0000","last_peered":"2024-04-24T23:39:22.815530+0000","last_clean":"2024-04-24T23:39:22.815530+0000","last_became_active":"2024-04-24T23:38:34.186332+0000","last_became_peered":"2024-04-24T23:38:34.186332+0000","last_unstale":"2024-04-24T23:39:22.815530+0000","last_undegraded":"2024-04-24T23:39:22.815530+0000","last_fullsized":"2024-04-24T23:39:22.815530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:56.049789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947231+0000","last_change":"2024-04-24T23:38:34.154728+0000","last_active":"2024-04-24T23:39:22.947231+0000","last_peered":"2024-04-24T23:39:22.947231+0000","last_clean":"2024-04-24T23:39:22.947231+0000","last_became_active":"2024-04-24T23:38:34.147038+0000","last_became_peered":"2024-04-24T23:38:34.147038+0000","last_unstale":"2024-04-24T23:39:22.947231+0000","last_undegraded":"2024-04-24T23:39:22.947231+0000","last_fullsized":"2024-04-24T23:39:22.947231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816375+0000","last_change":"2024-04-24T23:38:34.164080+0000","last_active":"2024-04-24T23:39:22.816375+0000","last_peered":"2024-04-24T23:39:22.816375+0000","last_clean":"2024-04-24T23:39:22.816375+0000","last_became_active":"2024-04-24T23:38:34.163761+0000","last_became_peered":"2024-04-24T23:38:34.163761+0000","last_unstale":"2024-04-24T23:39:22.816375+0000","last_undegraded":"2024-04-24T23:39:22.816375+0000","last_fullsized":"2024-04-24T23:39:22.816375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:00.007223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.831704+0000","last_change":"2024-04-24T23:39:22.829099+0000","last_active":"2024-04-24T23:39:22.831704+0000","last_peered":"2024-04-24T23:39:22.831704+0000","last_clean":"2024-04-24T23:39:22.831704+0000","last_became_active":"2024-04-24T23:39:22.828227+0000","last_became_peered":"2024-04-24T23:39:22.828227+0000","last_unstale":"2024-04-24T23:39:22.831704+0000","last_undegraded":"2024-04-24T23:39:22.831704+0000","last_fullsized":"2024-04-24T23:39:22.831704+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817535+0000","last_change":"2024-04-24T23:38:34.179301+0000","last_active":"2024-04-24T23:39:22.817535+0000","last_peered":"2024-04-24T23:39:22.817535+0000","last_clean":"2024-04-24T23:39:22.817535+0000","last_became_active":"2024-04-24T23:38:34.178651+0000","last_became_peered":"2024-04-24T23:38:34.178651+0000","last_unstale":"2024-04-24T23:39:22.817535+0000","last_undegraded":"2024-04-24T23:39:22.817535+0000","last_fullsized":"2024-04-24T23:39:22.817535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:57.767771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816067+0000","last_change":"2024-04-24T23:38:34.162572+0000","last_active":"2024-04-24T23:39:22.816067+0000","last_peered":"2024-04-24T23:39:22.816067+0000","last_clean":"2024-04-24T23:39:22.816067+0000","last_became_active":"2024-04-24T23:38:34.162156+0000","last_became_peered":"2024-04-24T23:38:34.162156+0000","last_unstale":"2024-04-24T23:39:22.816067+0000","last_undegraded":"2024-04-24T23:39:22.816067+0000","last_fullsized":"2024-04-24T23:39:22.816067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:57.767771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814482+0000","last_change":"2024-04-24T23:38:34.187429+0000","last_active":"2024-04-24T23:39:22.814482+0000","last_peered":"2024-04-24T23:39:22.814482+0000","last_clean":"2024-04-24T23:39:22.814482+0000","last_became_active":"2024-04-24T23:38:34.184827+0000","last_became_peered":"2024-04-24T23:38:34.184827+0000","last_unstale":"2024-04-24T23:39:22.814482+0000","last_undegraded":"2024-04-24T23:39:22.814482+0000","last_fullsized":"2024-04-24T23:39:22.814482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814372+0000","last_change":"2024-04-24T23:38:34.165830+0000","last_active":"2024-04-24T23:39:22.814372+0000","last_peered":"2024-04-24T23:39:22.814372+0000","last_clean":"2024-04-24T23:39:22.814372+0000","last_became_active":"2024-04-24T23:38:34.165531+0000","last_became_peered":"2024-04-24T23:38:34.165531+0000","last_unstale":"2024-04-24T23:39:22.814372+0000","last_undegraded":"2024-04-24T23:39:22.814372+0000","last_fullsized":"2024-04-24T23:39:22.814372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:57:25.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815294+0000","last_change":"2024-04-24T23:38:34.199810+0000","last_active":"2024-04-24T23:39:22.815294+0000","last_peered":"2024-04-24T23:39:22.815294+0000","last_clean":"2024-04-24T23:39:22.815294+0000","last_became_active":"2024-04-24T23:38:34.199173+0000","last_became_peered":"2024-04-24T23:38:34.199173+0000","last_unstale":"2024-04-24T23:39:22.815294+0000","last_undegraded":"2024-04-24T23:39:22.815294+0000","last_fullsized":"2024-04-24T23:39:22.815294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:27.147380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.946932+0000","last_change":"2024-04-24T23:38:34.165276+0000","last_active":"2024-04-24T23:39:22.946932+0000","last_peered":"2024-04-24T23:39:22.946932+0000","last_clean":"2024-04-24T23:39:22.946932+0000","last_became_active":"2024-04-24T23:38:34.165000+0000","last_became_peered":"2024-04-24T23:38:34.165000+0000","last_unstale":"2024-04-24T23:39:22.946932+0000","last_undegraded":"2024-04-24T23:39:22.946932+0000","last_fullsized":"2024-04-24T23:39:22.946932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.816108+0000","last_change":"2024-04-24T23:38:34.146904+0000","last_active":"2024-04-24T23:39:22.816108+0000","last_peered":"2024-04-24T23:39:22.816108+0000","last_clean":"2024-04-24T23:39:22.816108+0000","last_became_active":"2024-04-24T23:38:34.146096+0000","last_became_peered":"2024-04-24T23:38:34.146096+0000","last_unstale":"2024-04-24T23:39:22.816108+0000","last_undegraded":"2024-04-24T23:39:22.816108+0000","last_fullsized":"2024-04-24T23:39:22.816108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:39.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.828011+0000","last_change":"2024-04-24T23:38:34.178750+0000","last_active":"2024-04-24T23:39:22.828011+0000","last_peered":"2024-04-24T23:39:22.828011+0000","last_clean":"2024-04-24T23:39:22.828011+0000","last_became_active":"2024-04-24T23:38:34.177451+0000","last_became_peered":"2024-04-24T23:38:34.177451+0000","last_unstale":"2024-04-24T23:39:22.828011+0000","last_undegraded":"2024-04-24T23:39:22.828011+0000","last_fullsized":"2024-04-24T23:39:22.828011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:43.814245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.821128+0000","last_change":"2024-04-24T23:38:34.160937+0000","last_active":"2024-04-24T23:39:22.821128+0000","last_peered":"2024-04-24T23:39:22.821128+0000","last_clean":"2024-04-24T23:39:22.821128+0000","last_became_active":"2024-04-24T23:38:34.159252+0000","last_became_peered":"2024-04-24T23:38:34.159252+0000","last_unstale":"2024-04-24T23:39:22.821128+0000","last_undegraded":"2024-04-24T23:39:22.821128+0000","last_fullsized":"2024-04-24T23:39:22.821128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:10.585665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817749+0000","last_change":"2024-04-24T23:38:34.199973+0000","last_active":"2024-04-24T23:39:22.817749+0000","last_peered":"2024-04-24T23:39:22.817749+0000","last_clean":"2024-04-24T23:39:22.817749+0000","last_became_active":"2024-04-24T23:38:34.199464+0000","last_became_peered":"2024-04-24T23:38:34.199464+0000","last_unstale":"2024-04-24T23:39:22.817749+0000","last_undegraded":"2024-04-24T23:39:22.817749+0000","last_fullsized":"2024-04-24T23:39:22.817749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:14.879972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814510+0000","last_change":"2024-04-24T23:38:34.182144+0000","last_active":"2024-04-24T23:39:22.814510+0000","last_peered":"2024-04-24T23:39:22.814510+0000","last_clean":"2024-04-24T23:39:22.814510+0000","last_became_active":"2024-04-24T23:38:34.181459+0000","last_became_peered":"2024-04-24T23:38:34.181459+0000","last_unstale":"2024-04-24T23:39:22.814510+0000","last_undegraded":"2024-04-24T23:39:22.814510+0000","last_fullsized":"2024-04-24T23:39:22.814510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822347+0000","last_change":"2024-04-24T23:38:34.150090+0000","last_active":"2024-04-24T23:39:22.822347+0000","last_peered":"2024-04-24T23:39:22.822347+0000","last_clean":"2024-04-24T23:39:22.822347+0000","last_became_active":"2024-04-24T23:38:34.149272+0000","last_became_peered":"2024-04-24T23:38:34.149272+0000","last_unstale":"2024-04-24T23:39:22.822347+0000","last_undegraded":"2024-04-24T23:39:22.822347+0000","last_fullsized":"2024-04-24T23:39:22.822347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.946769+0000","last_change":"2024-04-24T23:38:34.155641+0000","last_active":"2024-04-24T23:39:22.946769+0000","last_peered":"2024-04-24T23:39:22.946769+0000","last_clean":"2024-04-24T23:39:22.946769+0000","last_became_active":"2024-04-24T23:38:34.153683+0000","last_became_peered":"2024-04-24T23:38:34.153683+0000","last_unstale":"2024-04-24T23:39:22.946769+0000","last_undegraded":"2024-04-24T23:39:22.946769+0000","last_fullsized":"2024-04-24T23:39:22.946769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.814424+0000","last_change":"2024-04-24T23:38:34.173601+0000","last_active":"2024-04-24T23:39:22.814424+0000","last_peered":"2024-04-24T23:39:22.814424+0000","last_clean":"2024-04-24T23:39:22.814424+0000","last_became_active":"2024-04-24T23:38:34.165764+0000","last_became_peered":"2024-04-24T23:38:34.165764+0000","last_unstale":"2024-04-24T23:39:22.814424+0000","last_undegraded":"2024-04-24T23:39:22.814424+0000","last_fullsized":"2024-04-24T23:39:22.814424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.822583+0000","last_change":"2024-04-24T23:38:34.142409+0000","last_active":"2024-04-24T23:39:22.822583+0000","last_peered":"2024-04-24T23:39:22.822583+0000","last_clean":"2024-04-24T23:39:22.822583+0000","last_became_active":"2024-04-24T23:38:34.141699+0000","last_became_peered":"2024-04-24T23:38:34.141699+0000","last_unstale":"2024-04-24T23:39:22.822583+0000","last_undegraded":"2024-04-24T23:39:22.822583+0000","last_fullsized":"2024-04-24T23:39:22.822583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:53.017909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817092+0000","last_change":"2024-04-24T23:38:34.155964+0000","last_active":"2024-04-24T23:39:22.817092+0000","last_peered":"2024-04-24T23:39:22.817092+0000","last_clean":"2024-04-24T23:39:22.817092+0000","last_became_active":"2024-04-24T23:38:34.155106+0000","last_became_peered":"2024-04-24T23:38:34.155106+0000","last_unstale":"2024-04-24T23:39:22.817092+0000","last_undegraded":"2024-04-24T23:39:22.817092+0000","last_fullsized":"2024-04-24T23:39:22.817092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:45.835874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.817444+0000","last_change":"2024-04-24T23:38:34.157245+0000","last_active":"2024-04-24T23:39:22.817444+0000","last_peered":"2024-04-24T23:39:22.817444+0000","last_clean":"2024-04-24T23:39:22.817444+0000","last_became_active":"2024-04-24T23:38:34.156452+0000","last_became_peered":"2024-04-24T23:38:34.156452+0000","last_unstale":"2024-04-24T23:39:22.817444+0000","last_undegraded":"2024-04-24T23:39:22.817444+0000","last_fullsized":"2024-04-24T23:39:22.817444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:39:28.288470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.831864+0000","last_change":"2024-04-24T23:39:22.831864+0000","last_active":"2024-04-24T23:39:22.831864+0000","last_peered":"2024-04-24T23:39:22.831864+0000","last_clean":"2024-04-24T23:39:22.831864+0000","last_became_active":"2024-04-24T23:39:22.830955+0000","last_became_peered":"2024-04-24T23:39:22.830955+0000","last_unstale":"2024-04-24T23:39:22.831864+0000","last_undegraded":"2024-04-24T23:39:22.831864+0000","last_fullsized":"2024-04-24T23:39:22.831864+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:14:35.422279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.813772+0000","last_change":"2024-04-24T23:38:34.184693+0000","last_active":"2024-04-24T23:39:22.813772+0000","last_peered":"2024-04-24T23:39:22.813772+0000","last_clean":"2024-04-24T23:39:22.813772+0000","last_became_active":"2024-04-24T23:38:34.184367+0000","last_became_peered":"2024-04-24T23:38:34.184367+0000","last_unstale":"2024-04-24T23:39:22.813772+0000","last_undegraded":"2024-04-24T23:39:22.813772+0000","last_fullsized":"2024-04-24T23:39:22.813772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:30:58.955608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.824737+0000","last_change":"2024-04-24T23:38:34.176406+0000","last_active":"2024-04-24T23:39:22.824737+0000","last_peered":"2024-04-24T23:39:22.824737+0000","last_clean":"2024-04-24T23:39:22.824737+0000","last_became_active":"2024-04-24T23:38:34.165882+0000","last_became_peered":"2024-04-24T23:38:34.165882+0000","last_unstale":"2024-04-24T23:39:22.824737+0000","last_undegraded":"2024-04-24T23:39:22.824737+0000","last_fullsized":"2024-04-24T23:39:22.824737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:09:44.182605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.815044+0000","last_change":"2024-04-24T23:38:34.184368+0000","last_active":"2024-04-24T23:39:22.815044+0000","last_peered":"2024-04-24T23:39:22.815044+0000","last_clean":"2024-04-24T23:39:22.815044+0000","last_became_active":"2024-04-24T23:38:34.183652+0000","last_became_peered":"2024-04-24T23:38:34.183652+0000","last_unstale":"2024-04-24T23:39:22.815044+0000","last_undegraded":"2024-04-24T23:39:22.815044+0000","last_fullsized":"2024-04-24T23:39:22.815044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:57.767771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.826002+0000","last_change":"2024-04-24T23:38:34.176656+0000","last_active":"2024-04-24T23:39:22.826002+0000","last_peered":"2024-04-24T23:39:22.826002+0000","last_clean":"2024-04-24T23:39:22.826002+0000","last_became_active":"2024-04-24T23:38:34.165931+0000","last_became_peered":"2024-04-24T23:38:34.165931+0000","last_unstale":"2024-04-24T23:39:22.826002+0000","last_undegraded":"2024-04-24T23:39:22.826002+0000","last_fullsized":"2024-04-24T23:39:22.826002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:00:14.879972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.829857+0000","last_change":"2024-04-24T23:39:22.826478+0000","last_active":"2024-04-24T23:39:22.829857+0000","last_peered":"2024-04-24T23:39:22.829857+0000","last_clean":"2024-04-24T23:39:22.829857+0000","last_became_active":"2024-04-24T23:39:22.825554+0000","last_became_peered":"2024-04-24T23:39:22.825554+0000","last_unstale":"2024-04-24T23:39:22.829857+0000","last_undegraded":"2024-04-24T23:39:22.829857+0000","last_fullsized":"2024-04-24T23:39:22.829857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:25.599734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.947213+0000","last_change":"2024-04-24T23:38:34.150280+0000","last_active":"2024-04-24T23:39:22.947213+0000","last_peered":"2024-04-24T23:39:22.947213+0000","last_clean":"2024-04-24T23:39:22.947213+0000","last_became_active":"2024-04-24T23:38:34.148402+0000","last_became_peered":"2024-04-24T23:38:34.148402+0000","last_unstale":"2024-04-24T23:39:22.947213+0000","last_undegraded":"2024-04-24T23:39:22.947213+0000","last_fullsized":"2024-04-24T23:39:22.947213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.823841+0000","last_change":"2024-04-24T23:38:34.151749+0000","last_active":"2024-04-24T23:39:22.823841+0000","last_peered":"2024-04-24T23:39:22.823841+0000","last_clean":"2024-04-24T23:39:22.823841+0000","last_became_active":"2024-04-24T23:38:34.150987+0000","last_became_peered":"2024-04-24T23:38:34.150987+0000","last_unstale":"2024-04-24T23:39:22.823841+0000","last_undegraded":"2024-04-24T23:39:22.823841+0000","last_fullsized":"2024-04-24T23:39:22.823841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.828358+0000","last_change":"2024-04-24T23:38:34.194857+0000","last_active":"2024-04-24T23:39:22.828358+0000","last_peered":"2024-04-24T23:39:22.828358+0000","last_clean":"2024-04-24T23:39:22.828358+0000","last_became_active":"2024-04-24T23:38:34.194195+0000","last_became_peered":"2024-04-24T23:38:34.194195+0000","last_unstale":"2024-04-24T23:39:22.828358+0000","last_undegraded":"2024-04-24T23:39:22.828358+0000","last_fullsized":"2024-04-24T23:39:22.828358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:29:51.981646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":10368,"num_write":165,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40216,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":83,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":80432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67594,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31516,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":348160,"data_stored":705319,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":327680,"data_stored":153678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":114459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":290816,"data_stored":114495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31500,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340340,"statfs":{"total":96636764160,"available":96604508160,"internally_reserved":0,"allocated":331776,"data_stored":153787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":282624,"data_stored":114478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":114529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":356352,"data_stored":705375,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":39418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":39309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:40:10.938 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.938 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.939 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.939 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.939 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.939 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.939 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.939 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.939 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.939 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.940 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.940 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.940 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.940 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.940 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.940 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.940 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.940 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.940 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.940 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.941 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.941 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.941 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.941 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.941 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.941 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.941 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.941 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.941 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.942 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.942 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.942 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.942 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.942 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.942 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.942 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.942 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.943 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.943 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.943 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.943 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.943 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.943 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.943 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.943 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.943 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.943 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.944 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-24T23:38:27.959678+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.944 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.944 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.944 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.944 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.944 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.944 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.944 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.944 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.944 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.945 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.945 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.945 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.945 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.945 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.945 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.945 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.945 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.945 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.946 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.946 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.946 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.946 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.946 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.946 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.946 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.946 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.946 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.947 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.947 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.947 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.947 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.947 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.947 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.947 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.947 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.947 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.948 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.948 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.948 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.948 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.948 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.948 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.948 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.948 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.948 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.949 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-24T23:38:32.073715+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=32, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.949 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.949 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.949 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.949 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.949 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.949 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.949 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.949 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.949 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.950 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.950 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.950 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.950 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.950 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.950 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.950 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.950 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.950 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.951 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.951 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.951 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.951 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.951 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.951 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.951 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.951 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.951 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.952 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.952 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.952 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.952 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.952 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.952 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.952 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:10.952 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-24T23:40:30.953 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:40:31.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49ffc1e640 1 Processor -- start 2024-04-24T23:40:31.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49ffc1e640 1 -- start start 2024-04-24T23:40:31.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49ffc1e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f49f814f3c0 0x7f49f815a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:31.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49ffc1e640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49f814e8e0 con 0x7f49f814bc60 2024-04-24T23:40:31.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49ffc1e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49f814ebc0 con 0x7f49f80bdbe0 2024-04-24T23:40:31.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49ffc1e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f49f8152c20 con 0x7f49f814f3c0 2024-04-24T23:40:31.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49fd9ba640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f49f814bc60 0x7f49f806eb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55150/0 (socket says 172.21.15.57:55150) 2024-04-24T23:40:31.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49fd9ba640 1 -- 172.21.15.57:0/1129858378 learned_addr learned my addr 172.21.15.57:0/1129858378 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:40:31.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49fe1bb640 1 --2- 172.21.15.57:0/1129858378 >> v2:172.21.15.88:3300/0 conn(0x7f49f814f3c0 0x7f49f815a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:31.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49fc9b8640 1 -- 172.21.15.57:0/1129858378 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3493325533 0 0) 0x7f49f814e8e0 con 0x7f49f814bc60 2024-04-24T23:40:31.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49fc9b8640 1 -- 172.21.15.57:0/1129858378 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49e4003530 con 0x7f49f814bc60 2024-04-24T23:40:31.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49fc9b8640 1 -- 172.21.15.57:0/1129858378 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2514334236 0 0) 0x7f49e4003530 con 0x7f49f814bc60 2024-04-24T23:40:31.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49fc9b8640 1 -- 172.21.15.57:0/1129858378 >> v2:172.21.15.88:3300/0 conn(0x7f49f814f3c0 msgr2=0x7f49f815a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:31.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49fc9b8640 1 --2- 172.21.15.57:0/1129858378 >> v2:172.21.15.88:3300/0 conn(0x7f49f814f3c0 0x7f49f815a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:31.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49fc9b8640 1 -- 172.21.15.57:0/1129858378 >> v1:172.21.15.88:6789/0 conn(0x7f49f80bdbe0 legacy=0x7f49f80b6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:31.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49fc9b8640 1 -- 172.21.15.57:0/1129858378 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f806f260 con 0x7f49f814bc60 2024-04-24T23:40:31.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49fc9b8640 1 -- 172.21.15.57:0/1129858378 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7f49ec001a00 con 0x7f49f814bc60 2024-04-24T23:40:31.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49fc9b8640 1 -- 172.21.15.57:0/1129858378 >> v1:172.21.15.57:6789/0 conn(0x7f49f814bc60 legacy=0x7f49f806eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:31.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49fc9b8640 1 --2- 172.21.15.57:0/1129858378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49e40039c0 0x7f49e4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:31.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49fc9b8640 1 --2- 172.21.15.57:0/1129858378 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f49e4004810 0x7f49e4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:31.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49fc9b8640 1 --2- 172.21.15.57:0/1129858378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49e40051d0 0x7f49e400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:31.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49fc9b8640 1 -- 172.21.15.57:0/1129858378 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f49f8152c20 con 0x7f49e40051d0 2024-04-24T23:40:31.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49fc9b8640 1 -- 172.21.15.57:0/1129858378 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f49e400c070 con 0x7f49e40039c0 2024-04-24T23:40:31.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49fc9b8640 1 -- 172.21.15.57:0/1129858378 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f49e400c270 con 0x7f49e4004810 2024-04-24T23:40:31.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49fe1bb640 1 --2- 172.21.15.57:0/1129858378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49e40051d0 0x7f49e400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:31.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49fd9ba640 1 --2- 172.21.15.57:0/1129858378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49e40039c0 0x7f49e4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:31.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49fd1b9640 1 --2- 172.21.15.57:0/1129858378 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f49e4004810 0x7f49e4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:31.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49fe1bb640 1 -- 172.21.15.57:0/1129858378 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f49e4004810 msgr2=0x7f49e4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:31.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49fe1bb640 1 --2- 172.21.15.57:0/1129858378 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f49e4004810 0x7f49e4004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:31.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49fe1bb640 1 -- 172.21.15.57:0/1129858378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49e40039c0 msgr2=0x7f49e4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:31.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49fe1bb640 1 --2- 172.21.15.57:0/1129858378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49e40039c0 0x7f49e4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:31.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.088+0000 7f49fe1bb640 1 -- 172.21.15.57:0/1129858378 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e4003530 con 0x7f49e40051d0 2024-04-24T23:40:31.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.092+0000 7f49fe1bb640 1 -- 172.21.15.57:0/1129858378 reap_dead start 2024-04-24T23:40:31.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.092+0000 7f49fe1bb640 1 --2- 172.21.15.57:0/1129858378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49e40051d0 0x7f49e400b9d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f49f0009ae0 tx=0x7f49f001cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc4989eb4eee1be server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:31.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.092+0000 7f49fc9b8640 1 -- 172.21.15.57:0/1129858378 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f00096b0 con 0x7f49e40051d0 2024-04-24T23:40:31.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.092+0000 7f49fc9b8640 1 -- 172.21.15.57:0/1129858378 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49f0004020 con 0x7f49e40051d0 2024-04-24T23:40:31.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.092+0000 7f49fc9b8640 1 -- 172.21.15.57:0/1129858378 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f0004410 con 0x7f49e40051d0 2024-04-24T23:40:31.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.092+0000 7f49ffc1e640 1 -- 172.21.15.57:0/1129858378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49e40051d0 msgr2=0x7f49e400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:31.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.092+0000 7f49ffc1e640 1 --2- 172.21.15.57:0/1129858378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49e40051d0 0x7f49e400b9d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f49f0009ae0 tx=0x7f49f001cab0 comp rx=0 tx=0).stop 2024-04-24T23:40:31.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.092+0000 7f49ffc1e640 1 -- 172.21.15.57:0/1129858378 shutdown_connections 2024-04-24T23:40:31.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.092+0000 7f49ffc1e640 1 --2- 172.21.15.57:0/1129858378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49e40051d0 0x7f49e400b9d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:31.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.092+0000 7f49ffc1e640 1 -- 172.21.15.57:0/1129858378 >> 172.21.15.57:0/1129858378 conn(0x7f49f80beab0 msgr2=0x7f49f80beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:31.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.092+0000 7f49ffc1e640 1 -- 172.21.15.57:0/1129858378 shutdown_connections 2024-04-24T23:40:31.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.092+0000 7f49ffc1e640 1 -- 172.21.15.57:0/1129858378 wait complete. 2024-04-24T23:40:31.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.092+0000 7f49ffc1e640 1 Processor -- start 2024-04-24T23:40:31.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.092+0000 7f49ffc1e640 1 -- start start 2024-04-24T23:40:31.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.092+0000 7f49ffc1e640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f49e40051d0 0x7f49f80c13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:31.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.092+0000 7f49ffc1e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49f80c1930 0x7f49f81487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:31.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.092+0000 7f49ffc1e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49f8148d20 0x7f49f81e3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:31.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.092+0000 7f49ffc1e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f49f80bc730 con 0x7f49f80c1930 2024-04-24T23:40:31.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.092+0000 7f49ffc1e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f49f80bc5b0 con 0x7f49f8148d20 2024-04-24T23:40:31.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.092+0000 7f49ffc1e640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f49f8151cc0 con 0x7f49e40051d0 2024-04-24T23:40:31.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.092+0000 7f49fd1b9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49f80c1930 0x7f49f81487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:31.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.092+0000 7f49fd1b9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49f80c1930 0x7f49f81487e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43952/0 (socket says 172.21.15.57:43952) 2024-04-24T23:40:31.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.092+0000 7f49fd1b9640 1 -- 172.21.15.57:0/498725164 learned_addr learned my addr 172.21.15.57:0/498725164 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:31.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.092+0000 7f49fd9ba640 1 --2- 172.21.15.57:0/498725164 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f49e40051d0 0x7f49f80c13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:31.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.092+0000 7f49fe1bb640 1 --2- 172.21.15.57:0/498725164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49f8148d20 0x7f49f81e3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:31.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.096+0000 7f49fd1b9640 1 -- 172.21.15.57:0/498725164 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f49e40051d0 msgr2=0x7f49f80c13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:31.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.096+0000 7f49fd1b9640 1 --2- 172.21.15.57:0/498725164 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f49e40051d0 0x7f49f80c13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:31.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.096+0000 7f49fd1b9640 1 -- 172.21.15.57:0/498725164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49f8148d20 msgr2=0x7f49f81e3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:31.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.096+0000 7f49fd1b9640 1 --2- 172.21.15.57:0/498725164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49f8148d20 0x7f49f81e3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.096+0000 7f49fd1b9640 1 -- 172.21.15.57:0/498725164 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f80bc300 con 0x7f49f80c1930 2024-04-24T23:40:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.096+0000 7f49fd9ba640 1 --2- 172.21.15.57:0/498725164 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f49e40051d0 0x7f49f80c13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:40:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.096+0000 7f49fe1bb640 1 --2- 172.21.15.57:0/498725164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49f8148d20 0x7f49f81e3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:40:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.096+0000 7f49fd1b9640 1 --2- 172.21.15.57:0/498725164 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49f80c1930 0x7f49f81487e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f49f400d520 tx=0x7f49f400d9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.096+0000 7f49ea7fc640 1 -- 172.21.15.57:0/498725164 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f4005480 con 0x7f49f80c1930 2024-04-24T23:40:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.096+0000 7f49ea7fc640 1 -- 172.21.15.57:0/498725164 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49f4017070 con 0x7f49f80c1930 2024-04-24T23:40:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.096+0000 7f49ea7fc640 1 -- 172.21.15.57:0/498725164 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f4003840 con 0x7f49f80c1930 2024-04-24T23:40:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.096+0000 7f49ffc1e640 1 -- 172.21.15.57:0/498725164 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49f814c2f0 con 0x7f49f80c1930 2024-04-24T23:40:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.096+0000 7f49ffc1e640 1 -- 172.21.15.57:0/498725164 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49f80a7fd0 con 0x7f49f80c1930 2024-04-24T23:40:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.096+0000 7f49ffc1e640 1 -- 172.21.15.57:0/498725164 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49f8068220 con 0x7f49f80c1930 2024-04-24T23:40:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.096+0000 7f49ea7fc640 1 -- 172.21.15.57:0/498725164 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f49f40039e0 con 0x7f49f80c1930 2024-04-24T23:40:31.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.096+0000 7f49ea7fc640 1 --2- 172.21.15.57:0/498725164 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f49dc0678f0 0x7f49dc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:31.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.096+0000 7f49ea7fc640 1 -- 172.21.15.57:0/498725164 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f49f40859f0 con 0x7f49f80c1930 2024-04-24T23:40:31.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.096+0000 7f49fd9ba640 1 --2- 172.21.15.57:0/498725164 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f49dc0678f0 0x7f49dc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:31.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.096+0000 7f49fd9ba640 1 --2- 172.21.15.57:0/498725164 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f49dc0678f0 0x7f49dc069db0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f49ec001da0 tx=0x7f49ec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:31.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.100+0000 7f49ea7fc640 1 -- 172.21.15.57:0/498725164 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f49f4056180 con 0x7f49f80c1930 2024-04-24T23:40:31.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.260+0000 7f49ffc1e640 1 -- 172.21.15.57:0/498725164 --> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f49f8145ff0 con 0x7f49dc0678f0 2024-04-24T23:40:31.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.284+0000 7f49ea7fc640 1 -- 172.21.15.57:0/498725164 <== mgr.4105 v2:172.21.15.88:6832/3931748276 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332698 (secure 0 0 0) 0x7f49ec005de0 con 0x7f49dc0678f0 2024-04-24T23:40:31.289 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:40:31.291 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-24T23:40:31.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.288+0000 7f49ffc1e640 1 -- 172.21.15.57:0/498725164 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f49dc0678f0 msgr2=0x7f49dc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:31.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.288+0000 7f49ffc1e640 1 --2- 172.21.15.57:0/498725164 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f49dc0678f0 0x7f49dc069db0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f49ec001da0 tx=0x7f49ec009040 comp rx=0 tx=0).stop 2024-04-24T23:40:31.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.288+0000 7f49ffc1e640 1 -- 172.21.15.57:0/498725164 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49f80c1930 msgr2=0x7f49f81487e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:31.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.288+0000 7f49ffc1e640 1 --2- 172.21.15.57:0/498725164 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49f80c1930 0x7f49f81487e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f49f400d520 tx=0x7f49f400d9e0 comp rx=0 tx=0).stop 2024-04-24T23:40:31.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.288+0000 7f49ffc1e640 1 -- 172.21.15.57:0/498725164 shutdown_connections 2024-04-24T23:40:31.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.288+0000 7f49ffc1e640 1 --2- 172.21.15.57:0/498725164 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f49dc0678f0 0x7f49dc069db0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:31.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.288+0000 7f49ffc1e640 1 --2- 172.21.15.57:0/498725164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49f8148d20 0x7f49f81e3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:31.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.288+0000 7f49ffc1e640 1 --2- 172.21.15.57:0/498725164 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49f80c1930 0x7f49f81487e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:31.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.288+0000 7f49ffc1e640 1 --2- 172.21.15.57:0/498725164 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f49e40051d0 0x7f49f80c13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:31.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.288+0000 7f49ffc1e640 1 -- 172.21.15.57:0/498725164 >> 172.21.15.57:0/498725164 conn(0x7f49f80beab0 msgr2=0x7f49f8151570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:31.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.288+0000 7f49ffc1e640 1 -- 172.21.15.57:0/498725164 shutdown_connections 2024-04-24T23:40:31.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:31.288+0000 7f49ffc1e640 1 -- 172.21.15.57:0/498725164 wait complete. 2024-04-24T23:40:31.309 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2024-04-24T23:40:29.586618+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":630584,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":199,"num_read_kb":10469,"num_write":407,"num_write_kb":22968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":384,"ondisk_log_size":384,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":247696,"kb_used_data":2448,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754727024,"statfs":{"total":773094113280,"available":772840472576,"internally_reserved":0,"allocated":2506752,"data_stored":2176120,"data_compressed":67594,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004719"},"pg_stats":[{"pgid":"2.1f","version":"26'6","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:09.597922+0000","last_change":"2024-04-24T23:40:09.597987+0000","last_active":"2024-04-24T23:40:09.597922+0000","last_peered":"2024-04-24T23:40:09.597922+0000","last_clean":"2024-04-24T23:40:09.597922+0000","last_became_active":"2024-04-24T23:38:33.134584+0000","last_became_peered":"2024-04-24T23:38:33.134584+0000","last_unstale":"2024-04-24T23:40:09.597922+0000","last_undegraded":"2024-04-24T23:40:09.597922+0000","last_fullsized":"2024-04-24T23:40:09.597922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-24T23:40:09.597764+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-24T23:40:09.597764+0000","last_clean_scrub_stamp":"2024-04-24T23:40:09.597764+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:07:23.148275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:20.344078+0000","last_change":"2024-04-24T23:40:20.344131+0000","last_active":"2024-04-24T23:40:20.344078+0000","last_peered":"2024-04-24T23:40:20.344078+0000","last_clean":"2024-04-24T23:40:20.344078+0000","last_became_active":"2024-04-24T23:38:34.162093+0000","last_became_peered":"2024-04-24T23:38:34.162093+0000","last_unstale":"2024-04-24T23:40:20.344078+0000","last_undegraded":"2024-04-24T23:40:20.344078+0000","last_fullsized":"2024-04-24T23:40:20.344078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:20.343900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:20.343900+0000","last_clean_scrub_stamp":"2024-04-24T23:40:20.343900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:05.370568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.813888+0000","last_change":"2024-04-24T23:38:38.252169+0000","last_active":"2024-04-24T23:39:22.813888+0000","last_peered":"2024-04-24T23:39:22.813888+0000","last_clean":"2024-04-24T23:39:22.813888+0000","last_became_active":"2024-04-24T23:38:38.251653+0000","last_became_peered":"2024-04-24T23:38:38.251653+0000","last_unstale":"2024-04-24T23:39:22.813888+0000","last_undegraded":"2024-04-24T23:39:22.813888+0000","last_fullsized":"2024-04-24T23:39:22.813888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:14.356450+0000","last_change":"2024-04-24T23:40:14.356508+0000","last_active":"2024-04-24T23:40:14.356450+0000","last_peered":"2024-04-24T23:40:14.356450+0000","last_clean":"2024-04-24T23:40:14.356450+0000","last_became_active":"2024-04-24T23:38:33.123681+0000","last_became_peered":"2024-04-24T23:38:33.123681+0000","last_unstale":"2024-04-24T23:40:14.356450+0000","last_undegraded":"2024-04-24T23:40:14.356450+0000","last_fullsized":"2024-04-24T23:40:14.356450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-04-24T23:40:14.356265+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-04-24T23:40:14.356265+0000","last_clean_scrub_stamp":"2024-04-24T23:40:14.356265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:30.096872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:17.500506+0000","last_change":"2024-04-24T23:40:17.500559+0000","last_active":"2024-04-24T23:40:17.500506+0000","last_peered":"2024-04-24T23:40:17.500506+0000","last_clean":"2024-04-24T23:40:17.500506+0000","last_became_active":"2024-04-24T23:38:34.169115+0000","last_became_peered":"2024-04-24T23:38:34.169115+0000","last_unstale":"2024-04-24T23:40:17.500506+0000","last_undegraded":"2024-04-24T23:40:17.500506+0000","last_fullsized":"2024-04-24T23:40:17.500506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:17.500321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:17.500321+0000","last_clean_scrub_stamp":"2024-04-24T23:40:17.500321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:44:30.426350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:19.827370+0000","last_change":"2024-04-24T23:40:19.827480+0000","last_active":"2024-04-24T23:40:19.827370+0000","last_peered":"2024-04-24T23:40:19.827370+0000","last_clean":"2024-04-24T23:40:19.827370+0000","last_became_active":"2024-04-24T23:38:38.220392+0000","last_became_peered":"2024-04-24T23:38:38.220392+0000","last_unstale":"2024-04-24T23:40:19.827370+0000","last_undegraded":"2024-04-24T23:40:19.827370+0000","last_fullsized":"2024-04-24T23:40:19.827370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:19.827059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:19.827059+0000","last_clean_scrub_stamp":"2024-04-24T23:40:19.827059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:27:44.875083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'4","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:18.199331+0000","last_change":"2024-04-24T23:40:18.199397+0000","last_active":"2024-04-24T23:40:18.199331+0000","last_peered":"2024-04-24T23:40:18.199331+0000","last_clean":"2024-04-24T23:40:18.199331+0000","last_became_active":"2024-04-24T23:38:33.143542+0000","last_became_peered":"2024-04-24T23:38:33.143542+0000","last_unstale":"2024-04-24T23:40:18.199331+0000","last_undegraded":"2024-04-24T23:40:18.199331+0000","last_fullsized":"2024-04-24T23:40:18.199331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-24T23:40:18.199158+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-24T23:40:18.199158+0000","last_clean_scrub_stamp":"2024-04-24T23:40:18.199158+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:33.939764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:18.958853+0000","last_change":"2024-04-24T23:40:18.958909+0000","last_active":"2024-04-24T23:40:18.958853+0000","last_peered":"2024-04-24T23:40:18.958853+0000","last_clean":"2024-04-24T23:40:18.958853+0000","last_became_active":"2024-04-24T23:38:34.169908+0000","last_became_peered":"2024-04-24T23:38:34.169908+0000","last_unstale":"2024-04-24T23:40:18.958853+0000","last_undegraded":"2024-04-24T23:40:18.958853+0000","last_fullsized":"2024-04-24T23:40:18.958853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:18.958675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:18.958675+0000","last_clean_scrub_stamp":"2024-04-24T23:40:18.958675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:03:18.503924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:16.902481+0000","last_change":"2024-04-24T23:40:16.902543+0000","last_active":"2024-04-24T23:40:16.902481+0000","last_peered":"2024-04-24T23:40:16.902481+0000","last_clean":"2024-04-24T23:40:16.902481+0000","last_became_active":"2024-04-24T23:38:38.217390+0000","last_became_peered":"2024-04-24T23:38:38.217390+0000","last_unstale":"2024-04-24T23:40:16.902481+0000","last_undegraded":"2024-04-24T23:40:16.902481+0000","last_fullsized":"2024-04-24T23:40:16.902481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:16.902264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:16.902264+0000","last_clean_scrub_stamp":"2024-04-24T23:40:16.902264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:10:55.754733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'3","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:19.208330+0000","last_change":"2024-04-24T23:40:19.208396+0000","last_active":"2024-04-24T23:40:19.208330+0000","last_peered":"2024-04-24T23:40:19.208330+0000","last_clean":"2024-04-24T23:40:19.208330+0000","last_became_active":"2024-04-24T23:38:33.148510+0000","last_became_peered":"2024-04-24T23:38:33.148510+0000","last_unstale":"2024-04-24T23:40:19.208330+0000","last_undegraded":"2024-04-24T23:40:19.208330+0000","last_fullsized":"2024-04-24T23:40:19.208330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-04-24T23:40:19.208146+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-04-24T23:40:19.208146+0000","last_clean_scrub_stamp":"2024-04-24T23:40:19.208146+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:44:32.134174+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:17.932376+0000","last_change":"2024-04-24T23:40:17.932428+0000","last_active":"2024-04-24T23:40:17.932376+0000","last_peered":"2024-04-24T23:40:17.932376+0000","last_clean":"2024-04-24T23:40:17.932376+0000","last_became_active":"2024-04-24T23:38:34.152984+0000","last_became_peered":"2024-04-24T23:38:34.152984+0000","last_unstale":"2024-04-24T23:40:17.932376+0000","last_undegraded":"2024-04-24T23:40:17.932376+0000","last_fullsized":"2024-04-24T23:40:17.932376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:17.932208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:17.932208+0000","last_clean_scrub_stamp":"2024-04-24T23:40:17.932208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:23:01.968644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:20.869837+0000","last_change":"2024-04-24T23:40:20.869942+0000","last_active":"2024-04-24T23:40:20.869837+0000","last_peered":"2024-04-24T23:40:20.869837+0000","last_clean":"2024-04-24T23:40:20.869837+0000","last_became_active":"2024-04-24T23:38:38.220601+0000","last_became_peered":"2024-04-24T23:38:38.220601+0000","last_unstale":"2024-04-24T23:40:20.869837+0000","last_undegraded":"2024-04-24T23:40:20.869837+0000","last_fullsized":"2024-04-24T23:40:20.869837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:20.869623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:20.869623+0000","last_clean_scrub_stamp":"2024-04-24T23:40:20.869623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:16:59.583142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:15.167190+0000","last_change":"2024-04-24T23:40:15.167246+0000","last_active":"2024-04-24T23:40:15.167190+0000","last_peered":"2024-04-24T23:40:15.167190+0000","last_clean":"2024-04-24T23:40:15.167190+0000","last_became_active":"2024-04-24T23:38:34.141681+0000","last_became_peered":"2024-04-24T23:38:34.141681+0000","last_unstale":"2024-04-24T23:40:15.167190+0000","last_undegraded":"2024-04-24T23:40:15.167190+0000","last_fullsized":"2024-04-24T23:40:15.167190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:15.166987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:15.166987+0000","last_clean_scrub_stamp":"2024-04-24T23:40:15.166987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:45:10.180542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:15.241252+0000","last_change":"2024-04-24T23:40:15.241318+0000","last_active":"2024-04-24T23:40:15.241252+0000","last_peered":"2024-04-24T23:40:15.241252+0000","last_clean":"2024-04-24T23:40:15.241252+0000","last_became_active":"2024-04-24T23:38:33.139303+0000","last_became_peered":"2024-04-24T23:38:33.139303+0000","last_unstale":"2024-04-24T23:40:15.241252+0000","last_undegraded":"2024-04-24T23:40:15.241252+0000","last_fullsized":"2024-04-24T23:40:15.241252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-24T23:40:15.241081+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-24T23:40:15.241081+0000","last_clean_scrub_stamp":"2024-04-24T23:40:15.241081+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:55.140446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:15.864141+0000","last_change":"2024-04-24T23:40:15.864203+0000","last_active":"2024-04-24T23:40:15.864141+0000","last_peered":"2024-04-24T23:40:15.864141+0000","last_clean":"2024-04-24T23:40:15.864141+0000","last_became_active":"2024-04-24T23:38:38.214813+0000","last_became_peered":"2024-04-24T23:38:38.214813+0000","last_unstale":"2024-04-24T23:40:15.864141+0000","last_undegraded":"2024-04-24T23:40:15.864141+0000","last_fullsized":"2024-04-24T23:40:15.864141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:15.863944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:15.863944+0000","last_clean_scrub_stamp":"2024-04-24T23:40:15.863944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:28:56.975376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:09.285599+0000","last_change":"2024-04-24T23:40:09.285638+0000","last_active":"2024-04-24T23:40:09.285599+0000","last_peered":"2024-04-24T23:40:09.285599+0000","last_clean":"2024-04-24T23:40:09.285599+0000","last_became_active":"2024-04-24T23:38:34.174504+0000","last_became_peered":"2024-04-24T23:38:34.174504+0000","last_unstale":"2024-04-24T23:40:09.285599+0000","last_undegraded":"2024-04-24T23:40:09.285599+0000","last_fullsized":"2024-04-24T23:40:09.285599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:09.285504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:09.285504+0000","last_clean_scrub_stamp":"2024-04-24T23:40:09.285504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:48.184984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:12.688534+0000","last_change":"2024-04-24T23:40:12.688590+0000","last_active":"2024-04-24T23:40:12.688534+0000","last_peered":"2024-04-24T23:40:12.688534+0000","last_clean":"2024-04-24T23:40:12.688534+0000","last_became_active":"2024-04-24T23:38:33.125115+0000","last_became_peered":"2024-04-24T23:38:33.125115+0000","last_unstale":"2024-04-24T23:40:12.688534+0000","last_undegraded":"2024-04-24T23:40:12.688534+0000","last_fullsized":"2024-04-24T23:40:12.688534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:12.688360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:12.688360+0000","last_clean_scrub_stamp":"2024-04-24T23:40:12.688360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:28:53.799792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:18.840112+0000","last_change":"2024-04-24T23:40:18.840185+0000","last_active":"2024-04-24T23:40:18.840112+0000","last_peered":"2024-04-24T23:40:18.840112+0000","last_clean":"2024-04-24T23:40:18.840112+0000","last_became_active":"2024-04-24T23:38:38.219797+0000","last_became_peered":"2024-04-24T23:38:38.219797+0000","last_unstale":"2024-04-24T23:40:18.840112+0000","last_undegraded":"2024-04-24T23:40:18.840112+0000","last_fullsized":"2024-04-24T23:40:18.840112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:18.839899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:18.839899+0000","last_clean_scrub_stamp":"2024-04-24T23:40:18.839899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:11:04.318109+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:17.354685+0000","last_change":"2024-04-24T23:40:17.354742+0000","last_active":"2024-04-24T23:40:17.354685+0000","last_peered":"2024-04-24T23:40:17.354685+0000","last_clean":"2024-04-24T23:40:17.354685+0000","last_became_active":"2024-04-24T23:38:34.163291+0000","last_became_peered":"2024-04-24T23:38:34.163291+0000","last_unstale":"2024-04-24T23:40:17.354685+0000","last_undegraded":"2024-04-24T23:40:17.354685+0000","last_fullsized":"2024-04-24T23:40:17.354685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:17.354498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:17.354498+0000","last_clean_scrub_stamp":"2024-04-24T23:40:17.354498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:01.377586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:10.602694+0000","last_change":"2024-04-24T23:40:10.602734+0000","last_active":"2024-04-24T23:40:10.602694+0000","last_peered":"2024-04-24T23:40:10.602694+0000","last_clean":"2024-04-24T23:40:10.602694+0000","last_became_active":"2024-04-24T23:38:33.119052+0000","last_became_peered":"2024-04-24T23:38:33.119052+0000","last_unstale":"2024-04-24T23:40:10.602694+0000","last_undegraded":"2024-04-24T23:40:10.602694+0000","last_fullsized":"2024-04-24T23:40:10.602694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:10.602582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:10.602582+0000","last_clean_scrub_stamp":"2024-04-24T23:40:10.602582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:09.783355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'33","reported_seq":60,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:22.855191+0000","last_change":"2024-04-24T23:40:22.855253+0000","last_active":"2024-04-24T23:40:22.855191+0000","last_peered":"2024-04-24T23:40:22.855191+0000","last_clean":"2024-04-24T23:40:22.855191+0000","last_became_active":"2024-04-24T23:38:38.252138+0000","last_became_peered":"2024-04-24T23:38:38.252138+0000","last_unstale":"2024-04-24T23:40:22.855191+0000","last_undegraded":"2024-04-24T23:40:22.855191+0000","last_fullsized":"2024-04-24T23:40:22.855191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'33","last_scrub_stamp":"2024-04-24T23:40:22.855009+0000","last_deep_scrub":"26'33","last_deep_scrub_stamp":"2024-04-24T23:40:22.855009+0000","last_clean_scrub_stamp":"2024-04-24T23:40:22.855009+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:07.881677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:13.783521+0000","last_change":"2024-04-24T23:40:13.783580+0000","last_active":"2024-04-24T23:40:13.783521+0000","last_peered":"2024-04-24T23:40:13.783521+0000","last_clean":"2024-04-24T23:40:13.783521+0000","last_became_active":"2024-04-24T23:38:34.152682+0000","last_became_peered":"2024-04-24T23:38:34.152682+0000","last_unstale":"2024-04-24T23:40:13.783521+0000","last_undegraded":"2024-04-24T23:40:13.783521+0000","last_fullsized":"2024-04-24T23:40:13.783521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:13.783353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:13.783353+0000","last_clean_scrub_stamp":"2024-04-24T23:40:13.783353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:45:08.796907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:14.250174+0000","last_change":"2024-04-24T23:40:14.250269+0000","last_active":"2024-04-24T23:40:14.250174+0000","last_peered":"2024-04-24T23:40:14.250174+0000","last_clean":"2024-04-24T23:40:14.250174+0000","last_became_active":"2024-04-24T23:38:33.139175+0000","last_became_peered":"2024-04-24T23:38:33.139175+0000","last_unstale":"2024-04-24T23:40:14.250174+0000","last_undegraded":"2024-04-24T23:40:14.250174+0000","last_fullsized":"2024-04-24T23:40:14.250174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:14.249906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:14.249906+0000","last_clean_scrub_stamp":"2024-04-24T23:40:14.249906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:28:55.361338+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:23.909209+0000","last_change":"2024-04-24T23:40:23.909355+0000","last_active":"2024-04-24T23:40:23.909209+0000","last_peered":"2024-04-24T23:40:23.909209+0000","last_clean":"2024-04-24T23:40:23.909209+0000","last_became_active":"2024-04-24T23:39:22.831081+0000","last_became_peered":"2024-04-24T23:39:22.831081+0000","last_unstale":"2024-04-24T23:40:23.909209+0000","last_undegraded":"2024-04-24T23:40:23.909209+0000","last_fullsized":"2024-04-24T23:40:23.909209+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:23.908983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:23.908983+0000","last_clean_scrub_stamp":"2024-04-24T23:40:23.908983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:03:23.454232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:15.566704+0000","last_change":"2024-04-24T23:40:15.566768+0000","last_active":"2024-04-24T23:40:15.566704+0000","last_peered":"2024-04-24T23:40:15.566704+0000","last_clean":"2024-04-24T23:40:15.566704+0000","last_became_active":"2024-04-24T23:38:34.153967+0000","last_became_peered":"2024-04-24T23:38:34.153967+0000","last_unstale":"2024-04-24T23:40:15.566704+0000","last_undegraded":"2024-04-24T23:40:15.566704+0000","last_fullsized":"2024-04-24T23:40:15.566704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:15.566517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:15.566517+0000","last_clean_scrub_stamp":"2024-04-24T23:40:15.566517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:46:24.325796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'3","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:13.202571+0000","last_change":"2024-04-24T23:40:13.202644+0000","last_active":"2024-04-24T23:40:13.202571+0000","last_peered":"2024-04-24T23:40:13.202571+0000","last_clean":"2024-04-24T23:40:13.202571+0000","last_became_active":"2024-04-24T23:38:33.135225+0000","last_became_peered":"2024-04-24T23:38:33.135225+0000","last_unstale":"2024-04-24T23:40:13.202571+0000","last_undegraded":"2024-04-24T23:40:13.202571+0000","last_fullsized":"2024-04-24T23:40:13.202571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-04-24T23:40:13.202378+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-04-24T23:40:13.202378+0000","last_clean_scrub_stamp":"2024-04-24T23:40:13.202378+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:23.945654+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:21.854331+0000","last_change":"2024-04-24T23:40:21.854395+0000","last_active":"2024-04-24T23:40:21.854331+0000","last_peered":"2024-04-24T23:40:21.854331+0000","last_clean":"2024-04-24T23:40:21.854331+0000","last_became_active":"2024-04-24T23:38:38.251057+0000","last_became_peered":"2024-04-24T23:38:38.251057+0000","last_unstale":"2024-04-24T23:40:21.854331+0000","last_undegraded":"2024-04-24T23:40:21.854331+0000","last_fullsized":"2024-04-24T23:40:21.854331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:21.854142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:21.854142+0000","last_clean_scrub_stamp":"2024-04-24T23:40:21.854142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:34.514355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:16.640671+0000","last_change":"2024-04-24T23:40:16.640725+0000","last_active":"2024-04-24T23:40:16.640671+0000","last_peered":"2024-04-24T23:40:16.640671+0000","last_clean":"2024-04-24T23:40:16.640671+0000","last_became_active":"2024-04-24T23:39:22.833072+0000","last_became_peered":"2024-04-24T23:39:22.833072+0000","last_unstale":"2024-04-24T23:40:16.640671+0000","last_undegraded":"2024-04-24T23:40:16.640671+0000","last_fullsized":"2024-04-24T23:40:16.640671+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:16.640471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:16.640471+0000","last_clean_scrub_stamp":"2024-04-24T23:40:16.640471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:55.539951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"26'5","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:09.580930+0000","last_change":"2024-04-24T23:40:09.580994+0000","last_active":"2024-04-24T23:40:09.580930+0000","last_peered":"2024-04-24T23:40:09.580930+0000","last_clean":"2024-04-24T23:40:09.580930+0000","last_became_active":"2024-04-24T23:38:33.115039+0000","last_became_peered":"2024-04-24T23:38:33.115039+0000","last_unstale":"2024-04-24T23:40:09.580930+0000","last_undegraded":"2024-04-24T23:40:09.580930+0000","last_fullsized":"2024-04-24T23:40:09.580930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-04-24T23:40:09.580823+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-04-24T23:40:09.580823+0000","last_clean_scrub_stamp":"2024-04-24T23:40:09.580823+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:07:23.131334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:25.432523+0000","last_change":"2024-04-24T23:40:25.432672+0000","last_active":"2024-04-24T23:40:25.432523+0000","last_peered":"2024-04-24T23:40:25.432523+0000","last_clean":"2024-04-24T23:40:25.432523+0000","last_became_active":"2024-04-24T23:38:38.245775+0000","last_became_peered":"2024-04-24T23:38:38.245775+0000","last_unstale":"2024-04-24T23:40:25.432523+0000","last_undegraded":"2024-04-24T23:40:25.432523+0000","last_fullsized":"2024-04-24T23:40:25.432523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:25.432297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:25.432297+0000","last_clean_scrub_stamp":"2024-04-24T23:40:25.432297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:19.275549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:14.729218+0000","last_change":"2024-04-24T23:40:14.729280+0000","last_active":"2024-04-24T23:40:14.729218+0000","last_peered":"2024-04-24T23:40:14.729218+0000","last_clean":"2024-04-24T23:40:14.729218+0000","last_became_active":"2024-04-24T23:38:34.148122+0000","last_became_peered":"2024-04-24T23:38:34.148122+0000","last_unstale":"2024-04-24T23:40:14.729218+0000","last_undegraded":"2024-04-24T23:40:14.729218+0000","last_fullsized":"2024-04-24T23:40:14.729218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:14.729016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:14.729016+0000","last_clean_scrub_stamp":"2024-04-24T23:40:14.729016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:48:49.077136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:17.209025+0000","last_change":"2024-04-24T23:40:17.209127+0000","last_active":"2024-04-24T23:40:17.209025+0000","last_peered":"2024-04-24T23:40:17.209025+0000","last_clean":"2024-04-24T23:40:17.209025+0000","last_became_active":"2024-04-24T23:38:33.140003+0000","last_became_peered":"2024-04-24T23:38:33.140003+0000","last_unstale":"2024-04-24T23:40:17.209025+0000","last_undegraded":"2024-04-24T23:40:17.209025+0000","last_fullsized":"2024-04-24T23:40:17.209025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:17.208811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:17.208811+0000","last_clean_scrub_stamp":"2024-04-24T23:40:17.208811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:46:25.968089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:21.515741+0000","last_change":"2024-04-24T23:40:21.515872+0000","last_active":"2024-04-24T23:40:21.515741+0000","last_peered":"2024-04-24T23:40:21.515741+0000","last_clean":"2024-04-24T23:40:21.515741+0000","last_became_active":"2024-04-24T23:38:38.245611+0000","last_became_peered":"2024-04-24T23:38:38.245611+0000","last_unstale":"2024-04-24T23:40:21.515741+0000","last_undegraded":"2024-04-24T23:40:21.515741+0000","last_fullsized":"2024-04-24T23:40:21.515741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:21.515464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:21.515464+0000","last_clean_scrub_stamp":"2024-04-24T23:40:21.515464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:35:26.919665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:09.994625+0000","last_change":"2024-04-24T23:40:09.994678+0000","last_active":"2024-04-24T23:40:09.994625+0000","last_peered":"2024-04-24T23:40:09.994625+0000","last_clean":"2024-04-24T23:40:09.994625+0000","last_became_active":"2024-04-24T23:38:34.185023+0000","last_became_peered":"2024-04-24T23:38:34.185023+0000","last_unstale":"2024-04-24T23:40:09.994625+0000","last_undegraded":"2024-04-24T23:40:09.994625+0000","last_fullsized":"2024-04-24T23:40:09.994625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:09.994440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:09.994440+0000","last_clean_scrub_stamp":"2024-04-24T23:40:09.994440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:09.175212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:08.579145+0000","last_change":"2024-04-24T23:40:08.579197+0000","last_active":"2024-04-24T23:40:08.579145+0000","last_peered":"2024-04-24T23:40:08.579145+0000","last_clean":"2024-04-24T23:40:08.579145+0000","last_became_active":"2024-04-24T23:38:33.108102+0000","last_became_peered":"2024-04-24T23:38:33.108102+0000","last_unstale":"2024-04-24T23:40:08.579145+0000","last_undegraded":"2024-04-24T23:40:08.579145+0000","last_fullsized":"2024-04-24T23:40:08.579145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:08.578954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:08.578954+0000","last_clean_scrub_stamp":"2024-04-24T23:40:08.578954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:19.322231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:19.764759+0000","last_change":"2024-04-24T23:40:19.764820+0000","last_active":"2024-04-24T23:40:19.764759+0000","last_peered":"2024-04-24T23:40:19.764759+0000","last_clean":"2024-04-24T23:40:19.764759+0000","last_became_active":"2024-04-24T23:38:38.212691+0000","last_became_peered":"2024-04-24T23:38:38.212691+0000","last_unstale":"2024-04-24T23:40:19.764759+0000","last_undegraded":"2024-04-24T23:40:19.764759+0000","last_fullsized":"2024-04-24T23:40:19.764759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:19.764567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:19.764567+0000","last_clean_scrub_stamp":"2024-04-24T23:40:19.764567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:03.787655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:12.788544+0000","last_change":"2024-04-24T23:40:12.788608+0000","last_active":"2024-04-24T23:40:12.788544+0000","last_peered":"2024-04-24T23:40:12.788544+0000","last_clean":"2024-04-24T23:40:12.788544+0000","last_became_active":"2024-04-24T23:38:34.153372+0000","last_became_peered":"2024-04-24T23:38:34.153372+0000","last_unstale":"2024-04-24T23:40:12.788544+0000","last_undegraded":"2024-04-24T23:40:12.788544+0000","last_fullsized":"2024-04-24T23:40:12.788544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:12.788373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:12.788373+0000","last_clean_scrub_stamp":"2024-04-24T23:40:12.788373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:58:14.249783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:15.982125+0000","last_change":"2024-04-24T23:40:15.982177+0000","last_active":"2024-04-24T23:40:15.982125+0000","last_peered":"2024-04-24T23:40:15.982125+0000","last_clean":"2024-04-24T23:40:15.982125+0000","last_became_active":"2024-04-24T23:38:33.139012+0000","last_became_peered":"2024-04-24T23:38:33.139012+0000","last_unstale":"2024-04-24T23:40:15.982125+0000","last_undegraded":"2024-04-24T23:40:15.982125+0000","last_fullsized":"2024-04-24T23:40:15.982125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:15.981958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:15.981958+0000","last_clean_scrub_stamp":"2024-04-24T23:40:15.981958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:16:54.695477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.838464+0000","last_change":"2024-04-24T23:39:22.828208+0000","last_active":"2024-04-24T23:39:22.838464+0000","last_peered":"2024-04-24T23:39:22.838464+0000","last_clean":"2024-04-24T23:39:22.838464+0000","last_became_active":"2024-04-24T23:39:22.825860+0000","last_became_peered":"2024-04-24T23:39:22.825860+0000","last_unstale":"2024-04-24T23:39:22.838464+0000","last_undegraded":"2024-04-24T23:39:22.838464+0000","last_fullsized":"2024-04-24T23:39:22.838464+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:37.168597+0000","last_clean_scrub_stamp":"2024-04-24T23:38:37.168597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:17.815269+0000","last_change":"2024-04-24T23:40:17.815380+0000","last_active":"2024-04-24T23:40:17.815269+0000","last_peered":"2024-04-24T23:40:17.815269+0000","last_clean":"2024-04-24T23:40:17.815269+0000","last_became_active":"2024-04-24T23:38:34.151917+0000","last_became_peered":"2024-04-24T23:38:34.151917+0000","last_unstale":"2024-04-24T23:40:17.815269+0000","last_undegraded":"2024-04-24T23:40:17.815269+0000","last_fullsized":"2024-04-24T23:40:17.815269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:17.814962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:17.814962+0000","last_clean_scrub_stamp":"2024-04-24T23:40:17.814962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:44:30.740990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'2","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:09.660459+0000","last_change":"2024-04-24T23:40:09.660493+0000","last_active":"2024-04-24T23:40:09.660459+0000","last_peered":"2024-04-24T23:40:09.660459+0000","last_clean":"2024-04-24T23:40:09.660459+0000","last_became_active":"2024-04-24T23:38:33.123674+0000","last_became_peered":"2024-04-24T23:38:33.123674+0000","last_unstale":"2024-04-24T23:40:09.660459+0000","last_undegraded":"2024-04-24T23:40:09.660459+0000","last_fullsized":"2024-04-24T23:40:09.660459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-04-24T23:40:09.660363+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-04-24T23:40:09.660363+0000","last_clean_scrub_stamp":"2024-04-24T23:40:09.660363+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:29:23.325878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:20.783834+0000","last_change":"2024-04-24T23:40:20.783905+0000","last_active":"2024-04-24T23:40:20.783834+0000","last_peered":"2024-04-24T23:40:20.783834+0000","last_clean":"2024-04-24T23:40:20.783834+0000","last_became_active":"2024-04-24T23:38:38.214005+0000","last_became_peered":"2024-04-24T23:38:38.214005+0000","last_unstale":"2024-04-24T23:40:20.783834+0000","last_undegraded":"2024-04-24T23:40:20.783834+0000","last_fullsized":"2024-04-24T23:40:20.783834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:20.783637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:20.783637+0000","last_clean_scrub_stamp":"2024-04-24T23:40:20.783637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:23:17.726214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:10.634278+0000","last_change":"2024-04-24T23:40:10.634299+0000","last_active":"2024-04-24T23:40:10.634278+0000","last_peered":"2024-04-24T23:40:10.634278+0000","last_clean":"2024-04-24T23:40:10.634278+0000","last_became_active":"2024-04-24T23:38:34.138681+0000","last_became_peered":"2024-04-24T23:38:34.138681+0000","last_unstale":"2024-04-24T23:40:10.634278+0000","last_undegraded":"2024-04-24T23:40:10.634278+0000","last_fullsized":"2024-04-24T23:40:10.634278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:10.634193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:10.634193+0000","last_clean_scrub_stamp":"2024-04-24T23:40:10.634193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:09.814966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:16.197656+0000","last_change":"2024-04-24T23:40:16.197707+0000","last_active":"2024-04-24T23:40:16.197656+0000","last_peered":"2024-04-24T23:40:16.197656+0000","last_clean":"2024-04-24T23:40:16.197656+0000","last_became_active":"2024-04-24T23:38:33.140618+0000","last_became_peered":"2024-04-24T23:38:33.140618+0000","last_unstale":"2024-04-24T23:40:16.197656+0000","last_undegraded":"2024-04-24T23:40:16.197656+0000","last_fullsized":"2024-04-24T23:40:16.197656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:16.197458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:16.197458+0000","last_clean_scrub_stamp":"2024-04-24T23:40:16.197458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:48:50.545579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:22.469535+0000","last_change":"2024-04-24T23:40:22.469597+0000","last_active":"2024-04-24T23:40:22.469535+0000","last_peered":"2024-04-24T23:40:22.469535+0000","last_clean":"2024-04-24T23:40:22.469535+0000","last_became_active":"2024-04-24T23:38:38.249402+0000","last_became_peered":"2024-04-24T23:38:38.249402+0000","last_unstale":"2024-04-24T23:40:22.469535+0000","last_undegraded":"2024-04-24T23:40:22.469535+0000","last_fullsized":"2024-04-24T23:40:22.469535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:22.469357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:22.469357+0000","last_clean_scrub_stamp":"2024-04-24T23:40:22.469357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:07.496025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:21.384570+0000","last_change":"2024-04-24T23:40:21.384631+0000","last_active":"2024-04-24T23:40:21.384570+0000","last_peered":"2024-04-24T23:40:21.384570+0000","last_clean":"2024-04-24T23:40:21.384570+0000","last_became_active":"2024-04-24T23:38:34.187655+0000","last_became_peered":"2024-04-24T23:38:34.187655+0000","last_unstale":"2024-04-24T23:40:21.384570+0000","last_undegraded":"2024-04-24T23:40:21.384570+0000","last_fullsized":"2024-04-24T23:40:21.384570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:21.384342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:21.384342+0000","last_clean_scrub_stamp":"2024-04-24T23:40:21.384342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:57.570970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:12.974326+0000","last_change":"2024-04-24T23:40:12.974382+0000","last_active":"2024-04-24T23:40:12.974326+0000","last_peered":"2024-04-24T23:40:12.974326+0000","last_clean":"2024-04-24T23:40:12.974326+0000","last_became_active":"2024-04-24T23:38:33.115926+0000","last_became_peered":"2024-04-24T23:38:33.115926+0000","last_unstale":"2024-04-24T23:40:12.974326+0000","last_undegraded":"2024-04-24T23:40:12.974326+0000","last_fullsized":"2024-04-24T23:40:12.974326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:12.974087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:12.974087+0000","last_clean_scrub_stamp":"2024-04-24T23:40:12.974087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:10:19.395285+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":193,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:13.292305+0000","last_change":"2024-04-24T23:40:13.292375+0000","last_active":"2024-04-24T23:40:13.292305+0000","last_peered":"2024-04-24T23:40:13.292305+0000","last_clean":"2024-04-24T23:40:13.292305+0000","last_became_active":"2024-04-24T23:38:29.562027+0000","last_became_peered":"2024-04-24T23:38:29.562027+0000","last_unstale":"2024-04-24T23:40:13.292305+0000","last_undegraded":"2024-04-24T23:40:13.292305+0000","last_fullsized":"2024-04-24T23:40:13.292305+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-04-24T23:40:13.292141+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-04-24T23:40:13.292141+0000","last_clean_scrub_stamp":"2024-04-24T23:40:13.292141+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:42.000299+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'33","reported_seq":77,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:24.253413+0000","last_change":"2024-04-24T23:40:24.253475+0000","last_active":"2024-04-24T23:40:24.253413+0000","last_peered":"2024-04-24T23:40:24.253413+0000","last_clean":"2024-04-24T23:40:24.253413+0000","last_became_active":"2024-04-24T23:38:38.253792+0000","last_became_peered":"2024-04-24T23:38:38.253792+0000","last_unstale":"2024-04-24T23:40:24.253413+0000","last_undegraded":"2024-04-24T23:40:24.253413+0000","last_fullsized":"2024-04-24T23:40:24.253413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'33","last_scrub_stamp":"2024-04-24T23:40:24.253236+0000","last_deep_scrub":"26'33","last_deep_scrub_stamp":"2024-04-24T23:40:24.253236+0000","last_clean_scrub_stamp":"2024-04-24T23:40:24.253236+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:08.276324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":2176,"num_write":33,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:27.253647+0000","last_change":"2024-04-24T23:40:27.253749+0000","last_active":"2024-04-24T23:40:27.253647+0000","last_peered":"2024-04-24T23:40:27.253647+0000","last_clean":"2024-04-24T23:40:27.253647+0000","last_became_active":"2024-04-24T23:38:34.194530+0000","last_became_peered":"2024-04-24T23:38:34.194530+0000","last_unstale":"2024-04-24T23:40:27.253647+0000","last_undegraded":"2024-04-24T23:40:27.253647+0000","last_fullsized":"2024-04-24T23:40:27.253647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:27.253444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:27.253444+0000","last_clean_scrub_stamp":"2024-04-24T23:40:27.253444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:57.840747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:11.596939+0000","last_change":"2024-04-24T23:40:11.596993+0000","last_active":"2024-04-24T23:40:11.596939+0000","last_peered":"2024-04-24T23:40:11.596939+0000","last_clean":"2024-04-24T23:40:11.596939+0000","last_became_active":"2024-04-24T23:38:33.129888+0000","last_became_peered":"2024-04-24T23:38:33.129888+0000","last_unstale":"2024-04-24T23:40:11.596939+0000","last_undegraded":"2024-04-24T23:40:11.596939+0000","last_fullsized":"2024-04-24T23:40:11.596939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:11.596741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:11.596741+0000","last_clean_scrub_stamp":"2024-04-24T23:40:11.596741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:43:42.959616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'66","reported_seq":125,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:23.235646+0000","last_change":"2024-04-24T23:40:23.235712+0000","last_active":"2024-04-24T23:40:23.235646+0000","last_peered":"2024-04-24T23:40:23.235646+0000","last_clean":"2024-04-24T23:40:23.235646+0000","last_became_active":"2024-04-24T23:38:38.252899+0000","last_became_peered":"2024-04-24T23:38:38.252899+0000","last_unstale":"2024-04-24T23:40:23.235646+0000","last_undegraded":"2024-04-24T23:40:23.235646+0000","last_fullsized":"2024-04-24T23:40:23.235646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'66","last_scrub_stamp":"2024-04-24T23:40:23.235469+0000","last_deep_scrub":"26'66","last_deep_scrub_stamp":"2024-04-24T23:40:23.235469+0000","last_clean_scrub_stamp":"2024-04-24T23:40:23.235469+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:33:36.999829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":4096,"num_write":66,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:21.014626+0000","last_change":"2024-04-24T23:40:21.014738+0000","last_active":"2024-04-24T23:40:21.014626+0000","last_peered":"2024-04-24T23:40:21.014626+0000","last_clean":"2024-04-24T23:40:21.014626+0000","last_became_active":"2024-04-24T23:38:34.184929+0000","last_became_peered":"2024-04-24T23:38:34.184929+0000","last_unstale":"2024-04-24T23:40:21.014626+0000","last_undegraded":"2024-04-24T23:40:21.014626+0000","last_fullsized":"2024-04-24T23:40:21.014626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:21.014403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:21.014403+0000","last_clean_scrub_stamp":"2024-04-24T23:40:21.014403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:06.041071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'2","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:11.655152+0000","last_change":"2024-04-24T23:40:11.655220+0000","last_active":"2024-04-24T23:40:11.655152+0000","last_peered":"2024-04-24T23:40:11.655152+0000","last_clean":"2024-04-24T23:40:11.655152+0000","last_became_active":"2024-04-24T23:38:33.119790+0000","last_became_peered":"2024-04-24T23:38:33.119790+0000","last_unstale":"2024-04-24T23:40:11.655152+0000","last_undegraded":"2024-04-24T23:40:11.655152+0000","last_fullsized":"2024-04-24T23:40:11.655152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-04-24T23:40:11.654950+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-04-24T23:40:11.654950+0000","last_clean_scrub_stamp":"2024-04-24T23:40:11.654950+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:40.363108+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:20.465874+0000","last_change":"2024-04-24T23:40:20.465931+0000","last_active":"2024-04-24T23:40:20.465874+0000","last_peered":"2024-04-24T23:40:20.465874+0000","last_clean":"2024-04-24T23:40:20.465874+0000","last_became_active":"2024-04-24T23:38:38.215599+0000","last_became_peered":"2024-04-24T23:38:38.215599+0000","last_unstale":"2024-04-24T23:40:20.465874+0000","last_undegraded":"2024-04-24T23:40:20.465874+0000","last_fullsized":"2024-04-24T23:40:20.465874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:20.465677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:20.465677+0000","last_clean_scrub_stamp":"2024-04-24T23:40:20.465677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:23:17.408253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:25.253677+0000","last_change":"2024-04-24T23:40:25.253734+0000","last_active":"2024-04-24T23:40:25.253677+0000","last_peered":"2024-04-24T23:40:25.253677+0000","last_clean":"2024-04-24T23:40:25.253677+0000","last_became_active":"2024-04-24T23:38:34.188815+0000","last_became_peered":"2024-04-24T23:38:34.188815+0000","last_unstale":"2024-04-24T23:40:25.253677+0000","last_undegraded":"2024-04-24T23:40:25.253677+0000","last_fullsized":"2024-04-24T23:40:25.253677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:25.253507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:25.253507+0000","last_clean_scrub_stamp":"2024-04-24T23:40:25.253507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:11:01.440135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'3","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:10.634308+0000","last_change":"2024-04-24T23:40:10.634368+0000","last_active":"2024-04-24T23:40:10.634308+0000","last_peered":"2024-04-24T23:40:10.634308+0000","last_clean":"2024-04-24T23:40:10.634308+0000","last_became_active":"2024-04-24T23:38:33.124849+0000","last_became_peered":"2024-04-24T23:38:33.124849+0000","last_unstale":"2024-04-24T23:40:10.634308+0000","last_undegraded":"2024-04-24T23:40:10.634308+0000","last_fullsized":"2024-04-24T23:40:10.634308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-04-24T23:40:10.634167+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-04-24T23:40:10.634167+0000","last_clean_scrub_stamp":"2024-04-24T23:40:10.634167+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:18.133837+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:27.024051+0000","last_change":"2024-04-24T23:40:27.024192+0000","last_active":"2024-04-24T23:40:27.024051+0000","last_peered":"2024-04-24T23:40:27.024051+0000","last_clean":"2024-04-24T23:40:27.024051+0000","last_became_active":"2024-04-24T23:38:38.249521+0000","last_became_peered":"2024-04-24T23:38:38.249521+0000","last_unstale":"2024-04-24T23:40:27.024051+0000","last_undegraded":"2024-04-24T23:40:27.024051+0000","last_fullsized":"2024-04-24T23:40:27.024051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:27.023836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:27.023836+0000","last_clean_scrub_stamp":"2024-04-24T23:40:27.023836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:48.598910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:20.170162+0000","last_change":"2024-04-24T23:40:20.170214+0000","last_active":"2024-04-24T23:40:20.170162+0000","last_peered":"2024-04-24T23:40:20.170162+0000","last_clean":"2024-04-24T23:40:20.170162+0000","last_became_active":"2024-04-24T23:38:34.165229+0000","last_became_peered":"2024-04-24T23:38:34.165229+0000","last_unstale":"2024-04-24T23:40:20.170162+0000","last_undegraded":"2024-04-24T23:40:20.170162+0000","last_fullsized":"2024-04-24T23:40:20.170162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:20.169997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:20.169997+0000","last_clean_scrub_stamp":"2024-04-24T23:40:20.169997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:33:33.934357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:09.830892+0000","last_change":"2024-04-24T23:40:09.830955+0000","last_active":"2024-04-24T23:40:09.830892+0000","last_peered":"2024-04-24T23:40:09.830892+0000","last_clean":"2024-04-24T23:40:09.830892+0000","last_became_active":"2024-04-24T23:38:33.108928+0000","last_became_peered":"2024-04-24T23:38:33.108928+0000","last_unstale":"2024-04-24T23:40:09.830892+0000","last_undegraded":"2024-04-24T23:40:09.830892+0000","last_fullsized":"2024-04-24T23:40:09.830892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-04-24T23:40:09.830724+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-04-24T23:40:09.830724+0000","last_clean_scrub_stamp":"2024-04-24T23:40:09.830724+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:43:41.193599+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:22.876466+0000","last_change":"2024-04-24T23:40:22.876525+0000","last_active":"2024-04-24T23:40:22.876466+0000","last_peered":"2024-04-24T23:40:22.876466+0000","last_clean":"2024-04-24T23:40:22.876466+0000","last_became_active":"2024-04-24T23:39:22.831340+0000","last_became_peered":"2024-04-24T23:39:22.831340+0000","last_unstale":"2024-04-24T23:40:22.876466+0000","last_undegraded":"2024-04-24T23:40:22.876466+0000","last_fullsized":"2024-04-24T23:40:22.876466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:22.876284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:22.876284+0000","last_clean_scrub_stamp":"2024-04-24T23:40:22.876284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:23:06.912720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3,6],"acting":[4,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:11.333919+0000","last_change":"2024-04-24T23:40:11.334025+0000","last_active":"2024-04-24T23:40:11.333919+0000","last_peered":"2024-04-24T23:40:11.333919+0000","last_clean":"2024-04-24T23:40:11.333919+0000","last_became_active":"2024-04-24T23:38:34.188416+0000","last_became_peered":"2024-04-24T23:38:34.188416+0000","last_unstale":"2024-04-24T23:40:11.333919+0000","last_undegraded":"2024-04-24T23:40:11.333919+0000","last_fullsized":"2024-04-24T23:40:11.333919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:11.333696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:11.333696+0000","last_clean_scrub_stamp":"2024-04-24T23:40:11.333696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:07:24.884208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'12","reported_seq":47,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:08.659625+0000","last_change":"2024-04-24T23:40:08.659694+0000","last_active":"2024-04-24T23:40:08.659625+0000","last_peered":"2024-04-24T23:40:08.659625+0000","last_clean":"2024-04-24T23:40:08.659625+0000","last_became_active":"2024-04-24T23:38:33.100464+0000","last_became_peered":"2024-04-24T23:38:33.100464+0000","last_unstale":"2024-04-24T23:40:08.659625+0000","last_undegraded":"2024-04-24T23:40:08.659625+0000","last_fullsized":"2024-04-24T23:40:08.659625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12","last_scrub_stamp":"2024-04-24T23:40:08.659467+0000","last_deep_scrub":"26'12","last_deep_scrub_stamp":"2024-04-24T23:40:08.659467+0000","last_clean_scrub_stamp":"2024-04-24T23:40:08.659467+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:59.359391+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:19.504314+0000","last_change":"2024-04-24T23:40:19.504374+0000","last_active":"2024-04-24T23:40:19.504314+0000","last_peered":"2024-04-24T23:40:19.504314+0000","last_clean":"2024-04-24T23:40:19.504314+0000","last_became_active":"2024-04-24T23:38:38.207049+0000","last_became_peered":"2024-04-24T23:38:38.207049+0000","last_unstale":"2024-04-24T23:40:19.504314+0000","last_undegraded":"2024-04-24T23:40:19.504314+0000","last_fullsized":"2024-04-24T23:40:19.504314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:19.504136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:19.504136+0000","last_clean_scrub_stamp":"2024-04-24T23:40:19.504136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:03.527223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:19.281242+0000","last_change":"2024-04-24T23:40:19.281297+0000","last_active":"2024-04-24T23:40:19.281242+0000","last_peered":"2024-04-24T23:40:19.281242+0000","last_clean":"2024-04-24T23:40:19.281242+0000","last_became_active":"2024-04-24T23:38:34.158756+0000","last_became_peered":"2024-04-24T23:38:34.158756+0000","last_unstale":"2024-04-24T23:40:19.281242+0000","last_undegraded":"2024-04-24T23:40:19.281242+0000","last_fullsized":"2024-04-24T23:40:19.281242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:19.281068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:19.281068+0000","last_clean_scrub_stamp":"2024-04-24T23:40:19.281068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:48:53.629188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:11.160898+0000","last_change":"2024-04-24T23:40:11.160959+0000","last_active":"2024-04-24T23:40:11.160898+0000","last_peered":"2024-04-24T23:40:11.160898+0000","last_clean":"2024-04-24T23:40:11.160898+0000","last_became_active":"2024-04-24T23:38:33.115472+0000","last_became_peered":"2024-04-24T23:38:33.115472+0000","last_unstale":"2024-04-24T23:40:11.160898+0000","last_undegraded":"2024-04-24T23:40:11.160898+0000","last_fullsized":"2024-04-24T23:40:11.160898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:11.160712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:11.160712+0000","last_clean_scrub_stamp":"2024-04-24T23:40:11.160712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:40:24.066873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:26.481312+0000","last_change":"2024-04-24T23:40:26.481375+0000","last_active":"2024-04-24T23:40:26.481312+0000","last_peered":"2024-04-24T23:40:26.481312+0000","last_clean":"2024-04-24T23:40:26.481312+0000","last_became_active":"2024-04-24T23:38:38.248311+0000","last_became_peered":"2024-04-24T23:38:38.248311+0000","last_unstale":"2024-04-24T23:40:26.481312+0000","last_undegraded":"2024-04-24T23:40:26.481312+0000","last_fullsized":"2024-04-24T23:40:26.481312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:26.481133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:26.481133+0000","last_clean_scrub_stamp":"2024-04-24T23:40:26.481133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:48.056207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:24.258949+0000","last_change":"2024-04-24T23:40:24.259001+0000","last_active":"2024-04-24T23:40:24.258949+0000","last_peered":"2024-04-24T23:40:24.258949+0000","last_clean":"2024-04-24T23:40:24.258949+0000","last_became_active":"2024-04-24T23:38:34.179801+0000","last_became_peered":"2024-04-24T23:38:34.179801+0000","last_unstale":"2024-04-24T23:40:24.258949+0000","last_undegraded":"2024-04-24T23:40:24.258949+0000","last_fullsized":"2024-04-24T23:40:24.258949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:24.258765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:24.258765+0000","last_clean_scrub_stamp":"2024-04-24T23:40:24.258765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:09.285432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:16.971433+0000","last_change":"2024-04-24T23:40:16.971492+0000","last_active":"2024-04-24T23:40:16.971433+0000","last_peered":"2024-04-24T23:40:16.971433+0000","last_clean":"2024-04-24T23:40:16.971433+0000","last_became_active":"2024-04-24T23:38:33.145896+0000","last_became_peered":"2024-04-24T23:38:33.145896+0000","last_unstale":"2024-04-24T23:40:16.971433+0000","last_undegraded":"2024-04-24T23:40:16.971433+0000","last_fullsized":"2024-04-24T23:40:16.971433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:16.971253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:16.971253+0000","last_clean_scrub_stamp":"2024-04-24T23:40:16.971253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:29.631466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:27.514158+0000","last_change":"2024-04-24T23:40:27.514223+0000","last_active":"2024-04-24T23:40:27.514158+0000","last_peered":"2024-04-24T23:40:27.514158+0000","last_clean":"2024-04-24T23:40:27.514158+0000","last_became_active":"2024-04-24T23:38:38.251541+0000","last_became_peered":"2024-04-24T23:38:38.251541+0000","last_unstale":"2024-04-24T23:40:27.514158+0000","last_undegraded":"2024-04-24T23:40:27.514158+0000","last_fullsized":"2024-04-24T23:40:27.514158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:27.513957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:27.513957+0000","last_clean_scrub_stamp":"2024-04-24T23:40:27.513957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:30:56.939004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:07.639085+0000","last_change":"2024-04-24T23:40:07.639213+0000","last_active":"2024-04-24T23:40:07.639085+0000","last_peered":"2024-04-24T23:40:07.639085+0000","last_clean":"2024-04-24T23:40:07.639085+0000","last_became_active":"2024-04-24T23:38:34.164024+0000","last_became_peered":"2024-04-24T23:38:34.164024+0000","last_unstale":"2024-04-24T23:40:07.639085+0000","last_undegraded":"2024-04-24T23:40:07.639085+0000","last_fullsized":"2024-04-24T23:40:07.639085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:07.638833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:07.638833+0000","last_clean_scrub_stamp":"2024-04-24T23:40:07.638833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:13.497785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'4","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:08.635454+0000","last_change":"2024-04-24T23:40:08.635521+0000","last_active":"2024-04-24T23:40:08.635454+0000","last_peered":"2024-04-24T23:40:08.635454+0000","last_clean":"2024-04-24T23:40:08.635454+0000","last_became_active":"2024-04-24T23:38:33.109819+0000","last_became_peered":"2024-04-24T23:38:33.109819+0000","last_unstale":"2024-04-24T23:40:08.635454+0000","last_undegraded":"2024-04-24T23:40:08.635454+0000","last_fullsized":"2024-04-24T23:40:08.635454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-24T23:40:08.635280+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-24T23:40:08.635280+0000","last_clean_scrub_stamp":"2024-04-24T23:40:08.635280+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:19.378557+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:26.019046+0000","last_change":"2024-04-24T23:40:26.019159+0000","last_active":"2024-04-24T23:40:26.019046+0000","last_peered":"2024-04-24T23:40:26.019046+0000","last_clean":"2024-04-24T23:40:26.019046+0000","last_became_active":"2024-04-24T23:38:38.246172+0000","last_became_peered":"2024-04-24T23:38:38.246172+0000","last_unstale":"2024-04-24T23:40:26.019046+0000","last_undegraded":"2024-04-24T23:40:26.019046+0000","last_fullsized":"2024-04-24T23:40:26.019046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:26.018802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:26.018802+0000","last_clean_scrub_stamp":"2024-04-24T23:40:26.018802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:19.862054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:23.218071+0000","last_change":"2024-04-24T23:40:23.218125+0000","last_active":"2024-04-24T23:40:23.218071+0000","last_peered":"2024-04-24T23:40:23.218071+0000","last_clean":"2024-04-24T23:40:23.218071+0000","last_became_active":"2024-04-24T23:38:34.179433+0000","last_became_peered":"2024-04-24T23:38:34.179433+0000","last_unstale":"2024-04-24T23:40:23.218071+0000","last_undegraded":"2024-04-24T23:40:23.218071+0000","last_fullsized":"2024-04-24T23:40:23.218071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:23.217900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:23.217900+0000","last_clean_scrub_stamp":"2024-04-24T23:40:23.217900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:35:28.622101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'37","reported_seq":72,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:12.175299+0000","last_change":"2024-04-24T23:40:12.175379+0000","last_active":"2024-04-24T23:40:12.175299+0000","last_peered":"2024-04-24T23:40:12.175299+0000","last_clean":"2024-04-24T23:40:12.175299+0000","last_became_active":"2024-04-24T23:38:33.127122+0000","last_became_peered":"2024-04-24T23:38:33.127122+0000","last_unstale":"2024-04-24T23:40:12.175299+0000","last_undegraded":"2024-04-24T23:40:12.175299+0000","last_fullsized":"2024-04-24T23:40:12.175299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'37","last_scrub_stamp":"2024-04-24T23:40:12.175103+0000","last_deep_scrub":"26'37","last_deep_scrub_stamp":"2024-04-24T23:40:12.175103+0000","last_clean_scrub_stamp":"2024-04-24T23:40:12.175103+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:18.034056+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39309,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:21.804537+0000","last_change":"2024-04-24T23:40:21.804605+0000","last_active":"2024-04-24T23:40:21.804537+0000","last_peered":"2024-04-24T23:40:21.804537+0000","last_clean":"2024-04-24T23:40:21.804537+0000","last_became_active":"2024-04-24T23:38:38.215741+0000","last_became_peered":"2024-04-24T23:38:38.215741+0000","last_unstale":"2024-04-24T23:40:21.804537+0000","last_undegraded":"2024-04-24T23:40:21.804537+0000","last_fullsized":"2024-04-24T23:40:21.804537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:21.804346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:21.804346+0000","last_clean_scrub_stamp":"2024-04-24T23:40:21.804346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:35:27.208547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:14.833968+0000","last_change":"2024-04-24T23:40:14.834020+0000","last_active":"2024-04-24T23:40:14.833968+0000","last_peered":"2024-04-24T23:40:14.833968+0000","last_clean":"2024-04-24T23:40:14.833968+0000","last_became_active":"2024-04-24T23:38:34.166602+0000","last_became_peered":"2024-04-24T23:38:34.166602+0000","last_unstale":"2024-04-24T23:40:14.833968+0000","last_undegraded":"2024-04-24T23:40:14.833968+0000","last_fullsized":"2024-04-24T23:40:14.833968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:14.833790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:14.833790+0000","last_clean_scrub_stamp":"2024-04-24T23:40:14.833790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:43.541948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'6","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:13.708677+0000","last_change":"2024-04-24T23:40:13.708802+0000","last_active":"2024-04-24T23:40:13.708677+0000","last_peered":"2024-04-24T23:40:13.708677+0000","last_clean":"2024-04-24T23:40:13.708677+0000","last_became_active":"2024-04-24T23:38:33.146311+0000","last_became_peered":"2024-04-24T23:38:33.146311+0000","last_unstale":"2024-04-24T23:40:13.708677+0000","last_undegraded":"2024-04-24T23:40:13.708677+0000","last_fullsized":"2024-04-24T23:40:13.708677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-24T23:40:13.708440+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-24T23:40:13.708440+0000","last_clean_scrub_stamp":"2024-04-24T23:40:13.708440+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:53.607804+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:17.873525+0000","last_change":"2024-04-24T23:40:17.873637+0000","last_active":"2024-04-24T23:40:17.873525+0000","last_peered":"2024-04-24T23:40:17.873525+0000","last_clean":"2024-04-24T23:40:17.873525+0000","last_became_active":"2024-04-24T23:38:38.219482+0000","last_became_peered":"2024-04-24T23:38:38.219482+0000","last_unstale":"2024-04-24T23:40:17.873525+0000","last_undegraded":"2024-04-24T23:40:17.873525+0000","last_fullsized":"2024-04-24T23:40:17.873525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:17.873289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:17.873289+0000","last_clean_scrub_stamp":"2024-04-24T23:40:17.873289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:10:24.294487+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:18.540208+0000","last_change":"2024-04-24T23:40:18.540264+0000","last_active":"2024-04-24T23:40:18.540208+0000","last_peered":"2024-04-24T23:40:18.540208+0000","last_clean":"2024-04-24T23:40:18.540208+0000","last_became_active":"2024-04-24T23:38:34.169512+0000","last_became_peered":"2024-04-24T23:38:34.169512+0000","last_unstale":"2024-04-24T23:40:18.540208+0000","last_undegraded":"2024-04-24T23:40:18.540208+0000","last_fullsized":"2024-04-24T23:40:18.540208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:18.540029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:18.540029+0000","last_clean_scrub_stamp":"2024-04-24T23:40:18.540029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:33:32.304390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:13.956805+0000","last_change":"2024-04-24T23:40:13.956860+0000","last_active":"2024-04-24T23:40:13.956805+0000","last_peered":"2024-04-24T23:40:13.956805+0000","last_clean":"2024-04-24T23:40:13.956805+0000","last_became_active":"2024-04-24T23:38:33.130150+0000","last_became_peered":"2024-04-24T23:38:33.130150+0000","last_unstale":"2024-04-24T23:40:13.956805+0000","last_undegraded":"2024-04-24T23:40:13.956805+0000","last_fullsized":"2024-04-24T23:40:13.956805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:13.956618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:13.956618+0000","last_clean_scrub_stamp":"2024-04-24T23:40:13.956618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:46:22.715897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'35","reported_seq":95,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:22.401583+0000","last_change":"2024-04-24T23:40:22.401649+0000","last_active":"2024-04-24T23:40:22.401583+0000","last_peered":"2024-04-24T23:40:22.401583+0000","last_clean":"2024-04-24T23:40:22.401583+0000","last_became_active":"2024-04-24T23:38:38.208130+0000","last_became_peered":"2024-04-24T23:38:38.208130+0000","last_unstale":"2024-04-24T23:40:22.401583+0000","last_undegraded":"2024-04-24T23:40:22.401583+0000","last_fullsized":"2024-04-24T23:40:22.401583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'35","last_scrub_stamp":"2024-04-24T23:40:22.401405+0000","last_deep_scrub":"26'35","last_deep_scrub_stamp":"2024-04-24T23:40:22.401405+0000","last_clean_scrub_stamp":"2024-04-24T23:40:22.401405+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:52:37.496942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":4096,"num_write":33,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:24.017364+0000","last_change":"2024-04-24T23:40:24.017417+0000","last_active":"2024-04-24T23:40:24.017364+0000","last_peered":"2024-04-24T23:40:24.017364+0000","last_clean":"2024-04-24T23:40:24.017364+0000","last_became_active":"2024-04-24T23:38:34.199311+0000","last_became_peered":"2024-04-24T23:38:34.199311+0000","last_unstale":"2024-04-24T23:40:24.017364+0000","last_undegraded":"2024-04-24T23:40:24.017364+0000","last_fullsized":"2024-04-24T23:40:24.017364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:24.017169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:24.017169+0000","last_clean_scrub_stamp":"2024-04-24T23:40:24.017169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:54.604473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'1","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:14.215591+0000","last_change":"2024-04-24T23:40:14.215755+0000","last_active":"2024-04-24T23:40:14.215591+0000","last_peered":"2024-04-24T23:40:14.215591+0000","last_clean":"2024-04-24T23:40:14.215591+0000","last_became_active":"2024-04-24T23:38:33.139325+0000","last_became_peered":"2024-04-24T23:38:33.139325+0000","last_unstale":"2024-04-24T23:40:14.215591+0000","last_undegraded":"2024-04-24T23:40:14.215591+0000","last_fullsized":"2024-04-24T23:40:14.215591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1","last_scrub_stamp":"2024-04-24T23:40:14.215363+0000","last_deep_scrub":"26'1","last_deep_scrub_stamp":"2024-04-24T23:40:14.215363+0000","last_clean_scrub_stamp":"2024-04-24T23:40:14.215363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:07:27.765874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:24.453890+0000","last_change":"2024-04-24T23:40:24.453948+0000","last_active":"2024-04-24T23:40:24.453890+0000","last_peered":"2024-04-24T23:40:24.453890+0000","last_clean":"2024-04-24T23:40:24.453890+0000","last_became_active":"2024-04-24T23:38:38.245657+0000","last_became_peered":"2024-04-24T23:38:38.245657+0000","last_unstale":"2024-04-24T23:40:24.453890+0000","last_undegraded":"2024-04-24T23:40:24.453890+0000","last_fullsized":"2024-04-24T23:40:24.453890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:24.453675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:24.453675+0000","last_clean_scrub_stamp":"2024-04-24T23:40:24.453675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:11.875730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:23.479150+0000","last_change":"2024-04-24T23:40:23.479215+0000","last_active":"2024-04-24T23:40:23.479150+0000","last_peered":"2024-04-24T23:40:23.479150+0000","last_clean":"2024-04-24T23:40:23.479150+0000","last_became_active":"2024-04-24T23:38:38.250718+0000","last_became_peered":"2024-04-24T23:38:38.250718+0000","last_unstale":"2024-04-24T23:40:23.479150+0000","last_undegraded":"2024-04-24T23:40:23.479150+0000","last_fullsized":"2024-04-24T23:40:23.479150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:23.478937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:23.478937+0000","last_clean_scrub_stamp":"2024-04-24T23:40:23.478937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:59.665565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:18.798305+0000","last_change":"2024-04-24T23:40:18.798365+0000","last_active":"2024-04-24T23:40:18.798305+0000","last_peered":"2024-04-24T23:40:18.798305+0000","last_clean":"2024-04-24T23:40:18.798305+0000","last_became_active":"2024-04-24T23:38:34.174289+0000","last_became_peered":"2024-04-24T23:38:34.174289+0000","last_unstale":"2024-04-24T23:40:18.798305+0000","last_undegraded":"2024-04-24T23:40:18.798305+0000","last_fullsized":"2024-04-24T23:40:18.798305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:18.798100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:18.798100+0000","last_clean_scrub_stamp":"2024-04-24T23:40:18.798100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:33:32.562460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:14.964756+0000","last_change":"2024-04-24T23:40:14.964809+0000","last_active":"2024-04-24T23:40:14.964756+0000","last_peered":"2024-04-24T23:40:14.964756+0000","last_clean":"2024-04-24T23:40:14.964756+0000","last_became_active":"2024-04-24T23:38:33.130621+0000","last_became_peered":"2024-04-24T23:38:33.130621+0000","last_unstale":"2024-04-24T23:40:14.964756+0000","last_undegraded":"2024-04-24T23:40:14.964756+0000","last_fullsized":"2024-04-24T23:40:14.964756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:14.964562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:14.964562+0000","last_clean_scrub_stamp":"2024-04-24T23:40:14.964562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:30.705169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:22.216406+0000","last_change":"2024-04-24T23:40:22.216486+0000","last_active":"2024-04-24T23:40:22.216406+0000","last_peered":"2024-04-24T23:40:22.216406+0000","last_clean":"2024-04-24T23:40:22.216406+0000","last_became_active":"2024-04-24T23:38:38.213249+0000","last_became_peered":"2024-04-24T23:38:38.213249+0000","last_unstale":"2024-04-24T23:40:22.216406+0000","last_undegraded":"2024-04-24T23:40:22.216406+0000","last_fullsized":"2024-04-24T23:40:22.216406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:22.216236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:22.216236+0000","last_clean_scrub_stamp":"2024-04-24T23:40:22.216236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:44:35.142265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:19.325227+0000","last_change":"2024-04-24T23:40:19.325283+0000","last_active":"2024-04-24T23:40:19.325227+0000","last_peered":"2024-04-24T23:40:19.325227+0000","last_clean":"2024-04-24T23:40:19.325227+0000","last_became_active":"2024-04-24T23:38:34.163685+0000","last_became_peered":"2024-04-24T23:38:34.163685+0000","last_unstale":"2024-04-24T23:40:19.325227+0000","last_undegraded":"2024-04-24T23:40:19.325227+0000","last_fullsized":"2024-04-24T23:40:19.325227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:19.325052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:19.325052+0000","last_clean_scrub_stamp":"2024-04-24T23:40:19.325052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:35:24.729253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:13.374118+0000","last_change":"2024-04-24T23:40:13.374177+0000","last_active":"2024-04-24T23:40:13.374118+0000","last_peered":"2024-04-24T23:40:13.374118+0000","last_clean":"2024-04-24T23:40:13.374118+0000","last_became_active":"2024-04-24T23:38:33.113333+0000","last_became_peered":"2024-04-24T23:38:33.113333+0000","last_unstale":"2024-04-24T23:40:13.374118+0000","last_undegraded":"2024-04-24T23:40:13.374118+0000","last_fullsized":"2024-04-24T23:40:13.374118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:13.373932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:13.373932+0000","last_clean_scrub_stamp":"2024-04-24T23:40:13.373932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:46:22.133211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:10.187194+0000","last_change":"2024-04-24T23:40:10.187308+0000","last_active":"2024-04-24T23:40:10.187194+0000","last_peered":"2024-04-24T23:40:10.187194+0000","last_clean":"2024-04-24T23:40:10.187194+0000","last_became_active":"2024-04-24T23:38:33.110315+0000","last_became_peered":"2024-04-24T23:38:33.110315+0000","last_unstale":"2024-04-24T23:40:10.187194+0000","last_undegraded":"2024-04-24T23:40:10.187194+0000","last_fullsized":"2024-04-24T23:40:10.187194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-04-24T23:40:10.187009+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-04-24T23:40:10.187009+0000","last_clean_scrub_stamp":"2024-04-24T23:40:10.187009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:18:41.297396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:11.618396+0000","last_change":"2024-04-24T23:40:11.618492+0000","last_active":"2024-04-24T23:40:11.618396+0000","last_peered":"2024-04-24T23:40:11.618396+0000","last_clean":"2024-04-24T23:40:11.618396+0000","last_became_active":"2024-04-24T23:38:34.146909+0000","last_became_peered":"2024-04-24T23:38:34.146909+0000","last_unstale":"2024-04-24T23:40:11.618396+0000","last_undegraded":"2024-04-24T23:40:11.618396+0000","last_fullsized":"2024-04-24T23:40:11.618396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:11.618194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:11.618194+0000","last_clean_scrub_stamp":"2024-04-24T23:40:11.618194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:40.326352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:14.613967+0000","last_change":"2024-04-24T23:40:14.614025+0000","last_active":"2024-04-24T23:40:14.613967+0000","last_peered":"2024-04-24T23:40:14.613967+0000","last_clean":"2024-04-24T23:40:14.613967+0000","last_became_active":"2024-04-24T23:38:38.215395+0000","last_became_peered":"2024-04-24T23:38:38.215395+0000","last_unstale":"2024-04-24T23:40:14.613967+0000","last_undegraded":"2024-04-24T23:40:14.613967+0000","last_fullsized":"2024-04-24T23:40:14.613967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:14.613773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:14.613773+0000","last_clean_scrub_stamp":"2024-04-24T23:40:14.613773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:58:16.075183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:15.361423+0000","last_change":"2024-04-24T23:40:15.361484+0000","last_active":"2024-04-24T23:40:15.361423+0000","last_peered":"2024-04-24T23:40:15.361423+0000","last_clean":"2024-04-24T23:40:15.361423+0000","last_became_active":"2024-04-24T23:38:33.131314+0000","last_became_peered":"2024-04-24T23:38:33.131314+0000","last_unstale":"2024-04-24T23:40:15.361423+0000","last_undegraded":"2024-04-24T23:40:15.361423+0000","last_fullsized":"2024-04-24T23:40:15.361423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-04-24T23:40:15.361191+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-04-24T23:40:15.361191+0000","last_clean_scrub_stamp":"2024-04-24T23:40:15.361191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:44:28.287220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:11.747338+0000","last_change":"2024-04-24T23:40:11.747394+0000","last_active":"2024-04-24T23:40:11.747338+0000","last_peered":"2024-04-24T23:40:11.747338+0000","last_clean":"2024-04-24T23:40:11.747338+0000","last_became_active":"2024-04-24T23:38:34.149910+0000","last_became_peered":"2024-04-24T23:38:34.149910+0000","last_unstale":"2024-04-24T23:40:11.747338+0000","last_undegraded":"2024-04-24T23:40:11.747338+0000","last_fullsized":"2024-04-24T23:40:11.747338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:11.747152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:11.747152+0000","last_clean_scrub_stamp":"2024-04-24T23:40:11.747152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:57:17.168848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:23.438235+0000","last_change":"2024-04-24T23:40:23.438358+0000","last_active":"2024-04-24T23:40:23.438235+0000","last_peered":"2024-04-24T23:40:23.438235+0000","last_clean":"2024-04-24T23:40:23.438235+0000","last_became_active":"2024-04-24T23:38:38.219100+0000","last_became_peered":"2024-04-24T23:38:38.219100+0000","last_unstale":"2024-04-24T23:40:23.438235+0000","last_undegraded":"2024-04-24T23:40:23.438235+0000","last_fullsized":"2024-04-24T23:40:23.438235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:23.437990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:23.437990+0000","last_clean_scrub_stamp":"2024-04-24T23:40:23.437990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:04:14.614443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:20.253223+0000","last_change":"2024-04-24T23:40:20.253277+0000","last_active":"2024-04-24T23:40:20.253223+0000","last_peered":"2024-04-24T23:40:20.253223+0000","last_clean":"2024-04-24T23:40:20.253223+0000","last_became_active":"2024-04-24T23:38:34.159701+0000","last_became_peered":"2024-04-24T23:38:34.159701+0000","last_unstale":"2024-04-24T23:40:20.253223+0000","last_undegraded":"2024-04-24T23:40:20.253223+0000","last_fullsized":"2024-04-24T23:40:20.253223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:20.252997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:20.252997+0000","last_clean_scrub_stamp":"2024-04-24T23:40:20.252997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:46:29.012276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:12.578851+0000","last_change":"2024-04-24T23:40:12.578907+0000","last_active":"2024-04-24T23:40:12.578851+0000","last_peered":"2024-04-24T23:40:12.578851+0000","last_clean":"2024-04-24T23:40:12.578851+0000","last_became_active":"2024-04-24T23:38:34.155969+0000","last_became_peered":"2024-04-24T23:38:34.155969+0000","last_unstale":"2024-04-24T23:40:12.578851+0000","last_undegraded":"2024-04-24T23:40:12.578851+0000","last_fullsized":"2024-04-24T23:40:12.578851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:12.578639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:12.578639+0000","last_clean_scrub_stamp":"2024-04-24T23:40:12.578639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:40:25.484800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:22.025048+0000","last_change":"2024-04-24T23:40:22.025162+0000","last_active":"2024-04-24T23:40:22.025048+0000","last_peered":"2024-04-24T23:40:22.025048+0000","last_clean":"2024-04-24T23:40:22.025048+0000","last_became_active":"2024-04-24T23:38:34.186332+0000","last_became_peered":"2024-04-24T23:38:34.186332+0000","last_unstale":"2024-04-24T23:40:22.025048+0000","last_undegraded":"2024-04-24T23:40:22.025048+0000","last_fullsized":"2024-04-24T23:40:22.025048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:22.024817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:22.024817+0000","last_clean_scrub_stamp":"2024-04-24T23:40:22.024817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:58.211445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:13.638989+0000","last_change":"2024-04-24T23:40:13.639111+0000","last_active":"2024-04-24T23:40:13.638989+0000","last_peered":"2024-04-24T23:40:13.638989+0000","last_clean":"2024-04-24T23:40:13.638989+0000","last_became_active":"2024-04-24T23:38:34.147038+0000","last_became_peered":"2024-04-24T23:38:34.147038+0000","last_unstale":"2024-04-24T23:40:13.638989+0000","last_undegraded":"2024-04-24T23:40:13.638989+0000","last_fullsized":"2024-04-24T23:40:13.638989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:13.638745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:13.638745+0000","last_clean_scrub_stamp":"2024-04-24T23:40:13.638745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:53.538110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:18.368700+0000","last_change":"2024-04-24T23:40:18.368756+0000","last_active":"2024-04-24T23:40:18.368700+0000","last_peered":"2024-04-24T23:40:18.368700+0000","last_clean":"2024-04-24T23:40:18.368700+0000","last_became_active":"2024-04-24T23:38:34.163761+0000","last_became_peered":"2024-04-24T23:38:34.163761+0000","last_unstale":"2024-04-24T23:40:18.368700+0000","last_undegraded":"2024-04-24T23:40:18.368700+0000","last_fullsized":"2024-04-24T23:40:18.368700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:18.368512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:18.368512+0000","last_clean_scrub_stamp":"2024-04-24T23:40:18.368512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:23:15.311089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:23.814784+0000","last_change":"2024-04-24T23:40:23.814840+0000","last_active":"2024-04-24T23:40:23.814784+0000","last_peered":"2024-04-24T23:40:23.814784+0000","last_clean":"2024-04-24T23:40:23.814784+0000","last_became_active":"2024-04-24T23:39:22.828227+0000","last_became_peered":"2024-04-24T23:39:22.828227+0000","last_unstale":"2024-04-24T23:40:23.814784+0000","last_undegraded":"2024-04-24T23:40:23.814784+0000","last_fullsized":"2024-04-24T23:40:23.814784+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:23.814607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:23.814607+0000","last_clean_scrub_stamp":"2024-04-24T23:40:23.814607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:11:00.001235+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:21.208069+0000","last_change":"2024-04-24T23:40:21.208121+0000","last_active":"2024-04-24T23:40:21.208069+0000","last_peered":"2024-04-24T23:40:21.208069+0000","last_clean":"2024-04-24T23:40:21.208069+0000","last_became_active":"2024-04-24T23:38:34.178651+0000","last_became_peered":"2024-04-24T23:38:34.178651+0000","last_unstale":"2024-04-24T23:40:21.208069+0000","last_undegraded":"2024-04-24T23:40:21.208069+0000","last_fullsized":"2024-04-24T23:40:21.208069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:21.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:21.207870+0000","last_clean_scrub_stamp":"2024-04-24T23:40:21.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:36.948476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:16.350775+0000","last_change":"2024-04-24T23:40:16.350828+0000","last_active":"2024-04-24T23:40:16.350775+0000","last_peered":"2024-04-24T23:40:16.350775+0000","last_clean":"2024-04-24T23:40:16.350775+0000","last_became_active":"2024-04-24T23:38:34.162156+0000","last_became_peered":"2024-04-24T23:38:34.162156+0000","last_unstale":"2024-04-24T23:40:16.350775+0000","last_undegraded":"2024-04-24T23:40:16.350775+0000","last_fullsized":"2024-04-24T23:40:16.350775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:16.350596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:16.350596+0000","last_clean_scrub_stamp":"2024-04-24T23:40:16.350596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:33:30.114956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:10.996254+0000","last_change":"2024-04-24T23:40:10.996307+0000","last_active":"2024-04-24T23:40:10.996254+0000","last_peered":"2024-04-24T23:40:10.996254+0000","last_clean":"2024-04-24T23:40:10.996254+0000","last_became_active":"2024-04-24T23:38:34.184827+0000","last_became_peered":"2024-04-24T23:38:34.184827+0000","last_unstale":"2024-04-24T23:40:10.996254+0000","last_undegraded":"2024-04-24T23:40:10.996254+0000","last_fullsized":"2024-04-24T23:40:10.996254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:10.996085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:10.996085+0000","last_clean_scrub_stamp":"2024-04-24T23:40:10.996085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:39.704243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:12.335821+0000","last_change":"2024-04-24T23:40:12.335874+0000","last_active":"2024-04-24T23:40:12.335821+0000","last_peered":"2024-04-24T23:40:12.335821+0000","last_clean":"2024-04-24T23:40:12.335821+0000","last_became_active":"2024-04-24T23:38:34.165531+0000","last_became_peered":"2024-04-24T23:38:34.165531+0000","last_unstale":"2024-04-24T23:40:12.335821+0000","last_undegraded":"2024-04-24T23:40:12.335821+0000","last_fullsized":"2024-04-24T23:40:12.335821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:12.335621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:12.335621+0000","last_clean_scrub_stamp":"2024-04-24T23:40:12.335621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:48:46.683741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:23.063564+0000","last_change":"2024-04-24T23:40:23.063619+0000","last_active":"2024-04-24T23:40:23.063564+0000","last_peered":"2024-04-24T23:40:23.063564+0000","last_clean":"2024-04-24T23:40:23.063564+0000","last_became_active":"2024-04-24T23:38:34.199173+0000","last_became_peered":"2024-04-24T23:38:34.199173+0000","last_unstale":"2024-04-24T23:40:23.063564+0000","last_undegraded":"2024-04-24T23:40:23.063564+0000","last_fullsized":"2024-04-24T23:40:23.063564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:23.063370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:23.063370+0000","last_clean_scrub_stamp":"2024-04-24T23:40:23.063370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:52:38.158907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:16.549595+0000","last_change":"2024-04-24T23:40:16.549654+0000","last_active":"2024-04-24T23:40:16.549595+0000","last_peered":"2024-04-24T23:40:16.549595+0000","last_clean":"2024-04-24T23:40:16.549595+0000","last_became_active":"2024-04-24T23:38:34.165000+0000","last_became_peered":"2024-04-24T23:38:34.165000+0000","last_unstale":"2024-04-24T23:40:16.549595+0000","last_undegraded":"2024-04-24T23:40:16.549595+0000","last_fullsized":"2024-04-24T23:40:16.549595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:16.549427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:16.549427+0000","last_clean_scrub_stamp":"2024-04-24T23:40:16.549427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:32.290034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:16.214999+0000","last_change":"2024-04-24T23:40:16.215051+0000","last_active":"2024-04-24T23:40:16.214999+0000","last_peered":"2024-04-24T23:40:16.214999+0000","last_clean":"2024-04-24T23:40:16.214999+0000","last_became_active":"2024-04-24T23:38:34.146096+0000","last_became_peered":"2024-04-24T23:38:34.146096+0000","last_unstale":"2024-04-24T23:40:16.214999+0000","last_undegraded":"2024-04-24T23:40:16.214999+0000","last_fullsized":"2024-04-24T23:40:16.214999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:16.214792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:16.214792+0000","last_clean_scrub_stamp":"2024-04-24T23:40:16.214792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:55.114272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:21.168564+0000","last_change":"2024-04-24T23:40:21.168629+0000","last_active":"2024-04-24T23:40:21.168564+0000","last_peered":"2024-04-24T23:40:21.168564+0000","last_clean":"2024-04-24T23:40:21.168564+0000","last_became_active":"2024-04-24T23:38:34.177451+0000","last_became_peered":"2024-04-24T23:38:34.177451+0000","last_unstale":"2024-04-24T23:40:21.168564+0000","last_undegraded":"2024-04-24T23:40:21.168564+0000","last_fullsized":"2024-04-24T23:40:21.168564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:21.168350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:21.168350+0000","last_clean_scrub_stamp":"2024-04-24T23:40:21.168350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:05.191438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:13.602979+0000","last_change":"2024-04-24T23:40:13.603079+0000","last_active":"2024-04-24T23:40:13.602979+0000","last_peered":"2024-04-24T23:40:13.602979+0000","last_clean":"2024-04-24T23:40:13.602979+0000","last_became_active":"2024-04-24T23:38:34.159252+0000","last_became_peered":"2024-04-24T23:38:34.159252+0000","last_unstale":"2024-04-24T23:40:13.602979+0000","last_undegraded":"2024-04-24T23:40:13.602979+0000","last_fullsized":"2024-04-24T23:40:13.602979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:13.602733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:13.602733+0000","last_clean_scrub_stamp":"2024-04-24T23:40:13.602733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:57:19.024430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:24.993035+0000","last_change":"2024-04-24T23:40:24.993088+0000","last_active":"2024-04-24T23:40:24.993035+0000","last_peered":"2024-04-24T23:40:24.993035+0000","last_clean":"2024-04-24T23:40:24.993035+0000","last_became_active":"2024-04-24T23:38:34.199464+0000","last_became_peered":"2024-04-24T23:38:34.199464+0000","last_unstale":"2024-04-24T23:40:24.993035+0000","last_undegraded":"2024-04-24T23:40:24.993035+0000","last_fullsized":"2024-04-24T23:40:24.993035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:24.992851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:24.992851+0000","last_clean_scrub_stamp":"2024-04-24T23:40:24.992851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:12.414905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'1","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:20.000603+0000","last_change":"2024-04-24T23:40:20.000723+0000","last_active":"2024-04-24T23:40:20.000603+0000","last_peered":"2024-04-24T23:40:20.000603+0000","last_clean":"2024-04-24T23:40:20.000603+0000","last_became_active":"2024-04-24T23:38:34.181459+0000","last_became_peered":"2024-04-24T23:38:34.181459+0000","last_unstale":"2024-04-24T23:40:20.000603+0000","last_undegraded":"2024-04-24T23:40:20.000603+0000","last_fullsized":"2024-04-24T23:40:20.000603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1","last_scrub_stamp":"2024-04-24T23:40:20.000384+0000","last_deep_scrub":"26'1","last_deep_scrub_stamp":"2024-04-24T23:40:20.000384+0000","last_clean_scrub_stamp":"2024-04-24T23:40:20.000384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:35:25.404585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:15.752264+0000","last_change":"2024-04-24T23:40:15.752318+0000","last_active":"2024-04-24T23:40:15.752264+0000","last_peered":"2024-04-24T23:40:15.752264+0000","last_clean":"2024-04-24T23:40:15.752264+0000","last_became_active":"2024-04-24T23:38:34.149272+0000","last_became_peered":"2024-04-24T23:38:34.149272+0000","last_unstale":"2024-04-24T23:40:15.752264+0000","last_undegraded":"2024-04-24T23:40:15.752264+0000","last_fullsized":"2024-04-24T23:40:15.752264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:15.752055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:15.752055+0000","last_clean_scrub_stamp":"2024-04-24T23:40:15.752055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:46:24.511333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:14.598172+0000","last_change":"2024-04-24T23:40:14.598231+0000","last_active":"2024-04-24T23:40:14.598172+0000","last_peered":"2024-04-24T23:40:14.598172+0000","last_clean":"2024-04-24T23:40:14.598172+0000","last_became_active":"2024-04-24T23:38:34.153683+0000","last_became_peered":"2024-04-24T23:38:34.153683+0000","last_unstale":"2024-04-24T23:40:14.598172+0000","last_undegraded":"2024-04-24T23:40:14.598172+0000","last_fullsized":"2024-04-24T23:40:14.598172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:14.597971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:14.597971+0000","last_clean_scrub_stamp":"2024-04-24T23:40:14.597971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:48:48.946092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:10.332883+0000","last_change":"2024-04-24T23:40:10.332904+0000","last_active":"2024-04-24T23:40:10.332883+0000","last_peered":"2024-04-24T23:40:10.332883+0000","last_clean":"2024-04-24T23:40:10.332883+0000","last_became_active":"2024-04-24T23:38:34.165764+0000","last_became_peered":"2024-04-24T23:38:34.165764+0000","last_unstale":"2024-04-24T23:40:10.332883+0000","last_undegraded":"2024-04-24T23:40:10.332883+0000","last_fullsized":"2024-04-24T23:40:10.332883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:10.332799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:10.332799+0000","last_clean_scrub_stamp":"2024-04-24T23:40:10.332799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:28:51.444231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:10.791361+0000","last_change":"2024-04-24T23:40:10.791417+0000","last_active":"2024-04-24T23:40:10.791361+0000","last_peered":"2024-04-24T23:40:10.791361+0000","last_clean":"2024-04-24T23:40:10.791361+0000","last_became_active":"2024-04-24T23:38:34.141699+0000","last_became_peered":"2024-04-24T23:38:34.141699+0000","last_unstale":"2024-04-24T23:40:10.791361+0000","last_undegraded":"2024-04-24T23:40:10.791361+0000","last_fullsized":"2024-04-24T23:40:10.791361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:10.791199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:10.791199+0000","last_clean_scrub_stamp":"2024-04-24T23:40:10.791199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:40:23.697360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:17.204725+0000","last_change":"2024-04-24T23:40:17.204792+0000","last_active":"2024-04-24T23:40:17.204725+0000","last_peered":"2024-04-24T23:40:17.204725+0000","last_clean":"2024-04-24T23:40:17.204725+0000","last_became_active":"2024-04-24T23:38:34.155106+0000","last_became_peered":"2024-04-24T23:38:34.155106+0000","last_unstale":"2024-04-24T23:40:17.204725+0000","last_undegraded":"2024-04-24T23:40:17.204725+0000","last_fullsized":"2024-04-24T23:40:17.204725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:17.204526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:17.204526+0000","last_clean_scrub_stamp":"2024-04-24T23:40:17.204526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:28:58.315958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:18.237211+0000","last_change":"2024-04-24T23:40:18.237270+0000","last_active":"2024-04-24T23:40:18.237211+0000","last_peered":"2024-04-24T23:40:18.237211+0000","last_clean":"2024-04-24T23:40:18.237211+0000","last_became_active":"2024-04-24T23:38:34.156452+0000","last_became_peered":"2024-04-24T23:38:34.156452+0000","last_unstale":"2024-04-24T23:40:18.237211+0000","last_undegraded":"2024-04-24T23:40:18.237211+0000","last_fullsized":"2024-04-24T23:40:18.237211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:18.237022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:18.237022+0000","last_clean_scrub_stamp":"2024-04-24T23:40:18.237022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:58.136387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:39:22.833483+0000","last_change":"2024-04-24T23:39:22.831864+0000","last_active":"2024-04-24T23:39:22.833483+0000","last_peered":"2024-04-24T23:39:22.833483+0000","last_clean":"2024-04-24T23:39:22.833483+0000","last_became_active":"2024-04-24T23:39:22.830955+0000","last_became_peered":"2024-04-24T23:39:22.830955+0000","last_unstale":"2024-04-24T23:39:22.833483+0000","last_undegraded":"2024-04-24T23:39:22.833483+0000","last_fullsized":"2024-04-24T23:39:22.833483+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:38:33.084198+0000","last_clean_scrub_stamp":"2024-04-24T23:38:33.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:11.359445+0000","last_change":"2024-04-24T23:40:11.359496+0000","last_active":"2024-04-24T23:40:11.359445+0000","last_peered":"2024-04-24T23:40:11.359445+0000","last_clean":"2024-04-24T23:40:11.359445+0000","last_became_active":"2024-04-24T23:38:34.184367+0000","last_became_peered":"2024-04-24T23:38:34.184367+0000","last_unstale":"2024-04-24T23:40:11.359445+0000","last_undegraded":"2024-04-24T23:40:11.359445+0000","last_fullsized":"2024-04-24T23:40:11.359445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:11.359272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:11.359272+0000","last_clean_scrub_stamp":"2024-04-24T23:40:11.359272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:51.258637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:12.305030+0000","last_change":"2024-04-24T23:40:12.305136+0000","last_active":"2024-04-24T23:40:12.305030+0000","last_peered":"2024-04-24T23:40:12.305030+0000","last_clean":"2024-04-24T23:40:12.305030+0000","last_became_active":"2024-04-24T23:38:34.165882+0000","last_became_peered":"2024-04-24T23:38:34.165882+0000","last_unstale":"2024-04-24T23:40:12.305030+0000","last_undegraded":"2024-04-24T23:40:12.305030+0000","last_fullsized":"2024-04-24T23:40:12.305030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:12.304821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:12.304821+0000","last_clean_scrub_stamp":"2024-04-24T23:40:12.304821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:11.485594+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:12.018948+0000","last_change":"2024-04-24T23:40:12.019007+0000","last_active":"2024-04-24T23:40:12.018948+0000","last_peered":"2024-04-24T23:40:12.018948+0000","last_clean":"2024-04-24T23:40:12.018948+0000","last_became_active":"2024-04-24T23:38:34.183652+0000","last_became_peered":"2024-04-24T23:38:34.183652+0000","last_unstale":"2024-04-24T23:40:12.018948+0000","last_undegraded":"2024-04-24T23:40:12.018948+0000","last_fullsized":"2024-04-24T23:40:12.018948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:12.018727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:12.018727+0000","last_clean_scrub_stamp":"2024-04-24T23:40:12.018727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:11:28.853479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:22.169768+0000","last_change":"2024-04-24T23:40:22.169827+0000","last_active":"2024-04-24T23:40:22.169768+0000","last_peered":"2024-04-24T23:40:22.169768+0000","last_clean":"2024-04-24T23:40:22.169768+0000","last_became_active":"2024-04-24T23:38:34.165931+0000","last_became_peered":"2024-04-24T23:38:34.165931+0000","last_unstale":"2024-04-24T23:40:22.169768+0000","last_undegraded":"2024-04-24T23:40:22.169768+0000","last_fullsized":"2024-04-24T23:40:22.169768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:22.169589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:22.169589+0000","last_clean_scrub_stamp":"2024-04-24T23:40:22.169589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:23:19.112166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:15.642771+0000","last_change":"2024-04-24T23:40:15.642827+0000","last_active":"2024-04-24T23:40:15.642771+0000","last_peered":"2024-04-24T23:40:15.642771+0000","last_clean":"2024-04-24T23:40:15.642771+0000","last_became_active":"2024-04-24T23:39:22.825554+0000","last_became_peered":"2024-04-24T23:39:22.825554+0000","last_unstale":"2024-04-24T23:40:15.642771+0000","last_undegraded":"2024-04-24T23:40:15.642771+0000","last_fullsized":"2024-04-24T23:40:15.642771+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:15.642565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:15.642565+0000","last_clean_scrub_stamp":"2024-04-24T23:40:15.642565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:05:06.802505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:12.623735+0000","last_change":"2024-04-24T23:40:12.623789+0000","last_active":"2024-04-24T23:40:12.623735+0000","last_peered":"2024-04-24T23:40:12.623735+0000","last_clean":"2024-04-24T23:40:12.623735+0000","last_became_active":"2024-04-24T23:38:34.148402+0000","last_became_peered":"2024-04-24T23:38:34.148402+0000","last_unstale":"2024-04-24T23:40:12.623735+0000","last_undegraded":"2024-04-24T23:40:12.623735+0000","last_fullsized":"2024-04-24T23:40:12.623735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:12.623558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:12.623558+0000","last_clean_scrub_stamp":"2024-04-24T23:40:12.623558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:28:53.734990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:16.779066+0000","last_change":"2024-04-24T23:40:16.779118+0000","last_active":"2024-04-24T23:40:16.779066+0000","last_peered":"2024-04-24T23:40:16.779066+0000","last_clean":"2024-04-24T23:40:16.779066+0000","last_became_active":"2024-04-24T23:38:34.150987+0000","last_became_peered":"2024-04-24T23:38:34.150987+0000","last_unstale":"2024-04-24T23:40:16.779066+0000","last_undegraded":"2024-04-24T23:40:16.779066+0000","last_fullsized":"2024-04-24T23:40:16.779066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:16.778890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:16.778890+0000","last_clean_scrub_stamp":"2024-04-24T23:40:16.778890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:32.519497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:26.284808+0000","last_change":"2024-04-24T23:40:26.284912+0000","last_active":"2024-04-24T23:40:26.284808+0000","last_peered":"2024-04-24T23:40:26.284808+0000","last_clean":"2024-04-24T23:40:26.284808+0000","last_became_active":"2024-04-24T23:38:34.194195+0000","last_became_peered":"2024-04-24T23:38:34.194195+0000","last_unstale":"2024-04-24T23:40:26.284808+0000","last_undegraded":"2024-04-24T23:40:26.284808+0000","last_fullsized":"2024-04-24T23:40:26.284808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:26.284603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:26.284603+0000","last_clean_scrub_stamp":"2024-04-24T23:40:26.284603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:52:41.380140+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":10368,"num_write":165,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40216,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":83,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":80432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67594,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31516,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":348160,"data_stored":705319,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":327680,"data_stored":153678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":114459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":290816,"data_stored":114495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31500,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340340,"statfs":{"total":96636764160,"available":96604508160,"internally_reserved":0,"allocated":331776,"data_stored":153787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":282624,"data_stored":114478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":114529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":356352,"data_stored":705375,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":39418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":39309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:40:31.316 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:31.316 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-24T23:38:37.168597+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=37, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:31.318 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-24T23:38:33.084198+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=40, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:40:31.318 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-24T23:40:37.634 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:40:37.637 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:40:37.640 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:40:37.642 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:40:51.319 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:40:51.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.452+0000 7ffaccf99640 1 Processor -- start 2024-04-24T23:40:51.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.452+0000 7ffaccf99640 1 -- start start 2024-04-24T23:40:51.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.452+0000 7ffaccf99640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffac80c32d0 0x7ffac814d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:51.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.452+0000 7ffaccf99640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffac814dea0 0x7ffac8151300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:51.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.452+0000 7ffaccf99640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffac80bd6c0 con 0x7ffac80c1080 2024-04-24T23:40:51.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.452+0000 7ffaccf99640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7ffac80bf4a0 con 0x7ffac80c32d0 2024-04-24T23:40:51.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.452+0000 7ffaccf99640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7ffac80bd470 con 0x7ffac814dea0 2024-04-24T23:40:51.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.452+0000 7ffac659c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffac80c32d0 0x7ffac814d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:51.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.452+0000 7ffac6d9d640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffac814dea0 0x7ffac8151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:51.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.452+0000 7ffac5d9b640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ffac80c1080 0x7ffac8150bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.57:44440/0 (socket says 172.21.15.57:44440) 2024-04-24T23:40:51.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.452+0000 7ffac659c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffac80c32d0 0x7ffac814d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.57:50252/0 (socket says 172.21.15.57:50252) 2024-04-24T23:40:51.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.452+0000 7ffac5d9b640 1 -- 172.21.15.57:0/3537529042 learned_addr learned my addr 172.21.15.57:0/3537529042 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:40:51.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.452+0000 7ffac659c640 1 -- 172.21.15.57:0/3537529042 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffac814dea0 msgr2=0x7ffac8151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:51.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.452+0000 7ffac659c640 1 --2- 172.21.15.57:0/3537529042 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffac814dea0 0x7ffac8151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:51.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.452+0000 7ffac659c640 1 -- 172.21.15.57:0/3537529042 >> v1:172.21.15.88:6789/0 conn(0x7ffac80c1080 legacy=0x7ffac8150bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:51.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.452+0000 7ffac659c640 1 -- 172.21.15.57:0/3537529042 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac80bd9a0 con 0x7ffac80c32d0 2024-04-24T23:40:51.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.456+0000 7ffac659c640 1 --2- 172.21.15.57:0/3537529042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffac80c32d0 0x7ffac814d960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ffab80097c0 tx=0x7ffab801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2e55e2cf581fae2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:51.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.456+0000 7ffac559a640 1 -- 172.21.15.57:0/3537529042 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab80b0070 con 0x7ffac80c32d0 2024-04-24T23:40:51.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.456+0000 7ffac559a640 1 -- 172.21.15.57:0/3537529042 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffab80ab600 con 0x7ffac80c32d0 2024-04-24T23:40:51.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.456+0000 7ffac559a640 1 -- 172.21.15.57:0/3537529042 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab80ab9d0 con 0x7ffac80c32d0 2024-04-24T23:40:51.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.456+0000 7ffaccf99640 1 -- 172.21.15.57:0/3537529042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffac80c32d0 msgr2=0x7ffac814d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:51.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.456+0000 7ffaccf99640 1 --2- 172.21.15.57:0/3537529042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffac80c32d0 0x7ffac814d960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ffab80097c0 tx=0x7ffab801c410 comp rx=0 tx=0).stop 2024-04-24T23:40:51.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.456+0000 7ffaccf99640 1 -- 172.21.15.57:0/3537529042 shutdown_connections 2024-04-24T23:40:51.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.456+0000 7ffaccf99640 1 --2- 172.21.15.57:0/3537529042 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffac814dea0 0x7ffac8151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:51.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.456+0000 7ffaccf99640 1 --2- 172.21.15.57:0/3537529042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffac80c32d0 0x7ffac814d960 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:51.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.456+0000 7ffaccf99640 1 -- 172.21.15.57:0/3537529042 >> 172.21.15.57:0/3537529042 conn(0x7ffac8067350 msgr2=0x7ffac8067760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:51.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.456+0000 7ffaccf99640 1 -- 172.21.15.57:0/3537529042 shutdown_connections 2024-04-24T23:40:51.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.456+0000 7ffaccf99640 1 -- 172.21.15.57:0/3537529042 wait complete. 2024-04-24T23:40:51.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.456+0000 7ffaccf99640 1 Processor -- start 2024-04-24T23:40:51.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.456+0000 7ffaccf99640 1 -- start start 2024-04-24T23:40:51.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.460+0000 7ffaccf99640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffac80c1080 0x7ffac81ece60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:51.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.460+0000 7ffaccf99640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffac80c32d0 0x7ffac8144d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:51.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.460+0000 7ffaccf99640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffac814dea0 0x7ffac814ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:51.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.460+0000 7ffaccf99640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ffac80c1760 con 0x7ffac80c32d0 2024-04-24T23:40:51.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.460+0000 7ffaccf99640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ffac80c15e0 con 0x7ffac814dea0 2024-04-24T23:40:51.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.460+0000 7ffaccf99640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7ffac815d940 con 0x7ffac80c1080 2024-04-24T23:40:51.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.460+0000 7ffac5d9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffac80c32d0 0x7ffac8144d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:51.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.460+0000 7ffac5d9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffac80c32d0 0x7ffac8144d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44834/0 (socket says 172.21.15.57:44834) 2024-04-24T23:40:51.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.460+0000 7ffac5d9b640 1 -- 172.21.15.57:0/1094904538 learned_addr learned my addr 172.21.15.57:0/1094904538 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:51.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.460+0000 7ffac6d9d640 1 --2- 172.21.15.57:0/1094904538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffac814dea0 0x7ffac814ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:51.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.460+0000 7ffac659c640 1 --2- 172.21.15.57:0/1094904538 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffac80c1080 0x7ffac81ece60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:51.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.460+0000 7ffac5d9b640 1 -- 172.21.15.57:0/1094904538 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffac80c1080 msgr2=0x7ffac81ece60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:51.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.460+0000 7ffac5d9b640 1 --2- 172.21.15.57:0/1094904538 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffac80c1080 0x7ffac81ece60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:51.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.460+0000 7ffac5d9b640 1 -- 172.21.15.57:0/1094904538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffac814dea0 msgr2=0x7ffac814ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:51.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.460+0000 7ffac5d9b640 1 --2- 172.21.15.57:0/1094904538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffac814dea0 0x7ffac814ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:51.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.460+0000 7ffac5d9b640 1 -- 172.21.15.57:0/1094904538 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac81e9c80 con 0x7ffac80c32d0 2024-04-24T23:40:51.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.460+0000 7ffac6d9d640 1 --2- 172.21.15.57:0/1094904538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffac814dea0 0x7ffac814ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:40:51.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.460+0000 7ffac5d9b640 1 --2- 172.21.15.57:0/1094904538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffac80c32d0 0x7ffac8144d90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ffabc00c3a0 tx=0x7ffabc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:51.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.460+0000 7ffab6ffd640 1 -- 172.21.15.57:0/1094904538 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc017070 con 0x7ffac80c32d0 2024-04-24T23:40:51.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.460+0000 7ffab6ffd640 1 -- 172.21.15.57:0/1094904538 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffabc005cf0 con 0x7ffac80c32d0 2024-04-24T23:40:51.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.460+0000 7ffab6ffd640 1 -- 172.21.15.57:0/1094904538 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0072f0 con 0x7ffac80c32d0 2024-04-24T23:40:51.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.460+0000 7ffaccf99640 1 -- 172.21.15.57:0/1094904538 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffac81ec380 con 0x7ffac80c32d0 2024-04-24T23:40:51.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.460+0000 7ffaccf99640 1 -- 172.21.15.57:0/1094904538 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffac81ec940 con 0x7ffac80c32d0 2024-04-24T23:40:51.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.460+0000 7ffaccf99640 1 -- 172.21.15.57:0/1094904538 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffac81ecb40 con 0x7ffac80c32d0 2024-04-24T23:40:51.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.460+0000 7ffab6ffd640 1 -- 172.21.15.57:0/1094904538 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffabc01a070 con 0x7ffac80c32d0 2024-04-24T23:40:51.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.460+0000 7ffab6ffd640 1 --2- 172.21.15.57:0/1094904538 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ffaa80678f0 0x7ffaa8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:51.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.460+0000 7ffab6ffd640 1 -- 172.21.15.57:0/1094904538 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ffabc0853f0 con 0x7ffac80c32d0 2024-04-24T23:40:51.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.460+0000 7ffac659c640 1 --2- 172.21.15.57:0/1094904538 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ffaa80678f0 0x7ffaa8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:51.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.464+0000 7ffac659c640 1 --2- 172.21.15.57:0/1094904538 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ffaa80678f0 0x7ffaa8069db0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ffab80ad000 tx=0x7ffab80a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:51.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.464+0000 7ffab6ffd640 1 -- 172.21.15.57:0/1094904538 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7ffac81ecb40 con 0x7ffac80c32d0 2024-04-24T23:40:51.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.624+0000 7ffaccf99640 1 -- 172.21.15.57:0/1094904538 --> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffac8068220 con 0x7ffaa80678f0 2024-04-24T23:40:51.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.648+0000 7ffab6ffd640 1 -- 172.21.15.57:0/1094904538 <== mgr.4105 v2:172.21.15.88:6832/3931748276 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332773 (secure 0 0 0) 0x7ffac8068220 con 0x7ffaa80678f0 2024-04-24T23:40:51.654 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:40:51.656 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-24T23:40:51.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.652+0000 7ffaccf99640 1 -- 172.21.15.57:0/1094904538 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ffaa80678f0 msgr2=0x7ffaa8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:51.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.652+0000 7ffaccf99640 1 --2- 172.21.15.57:0/1094904538 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ffaa80678f0 0x7ffaa8069db0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ffab80ad000 tx=0x7ffab80a6000 comp rx=0 tx=0).stop 2024-04-24T23:40:51.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.652+0000 7ffaccf99640 1 -- 172.21.15.57:0/1094904538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffac80c32d0 msgr2=0x7ffac8144d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:51.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.652+0000 7ffaccf99640 1 --2- 172.21.15.57:0/1094904538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffac80c32d0 0x7ffac8144d90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ffabc00c3a0 tx=0x7ffabc00c860 comp rx=0 tx=0).stop 2024-04-24T23:40:51.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.652+0000 7ffaccf99640 1 -- 172.21.15.57:0/1094904538 shutdown_connections 2024-04-24T23:40:51.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.652+0000 7ffaccf99640 1 --2- 172.21.15.57:0/1094904538 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ffaa80678f0 0x7ffaa8069db0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:51.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.652+0000 7ffaccf99640 1 --2- 172.21.15.57:0/1094904538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffac814dea0 0x7ffac814ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:51.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.652+0000 7ffaccf99640 1 --2- 172.21.15.57:0/1094904538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffac80c32d0 0x7ffac8144d90 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:51.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.652+0000 7ffaccf99640 1 --2- 172.21.15.57:0/1094904538 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffac80c1080 0x7ffac81ece60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:51.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.652+0000 7ffaccf99640 1 -- 172.21.15.57:0/1094904538 >> 172.21.15.57:0/1094904538 conn(0x7ffac8067350 msgr2=0x7ffac814be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:51.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.652+0000 7ffaccf99640 1 -- 172.21.15.57:0/1094904538 shutdown_connections 2024-04-24T23:40:51.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.652+0000 7ffaccf99640 1 -- 172.21.15.57:0/1094904538 wait complete. 2024-04-24T23:40:51.671 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2024-04-24T23:40:51.595439+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":630584,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":199,"num_read_kb":10469,"num_write":407,"num_write_kb":22968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":384,"ondisk_log_size":384,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":247696,"kb_used_data":2448,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754727024,"statfs":{"total":773094113280,"available":772840472576,"internally_reserved":0,"allocated":2506752,"data_stored":2176120,"data_compressed":67594,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004945"},"pg_stats":[{"pgid":"2.1f","version":"26'6","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:09.597987+0000","last_change":"2024-04-24T23:40:09.597987+0000","last_active":"2024-04-24T23:40:09.597987+0000","last_peered":"2024-04-24T23:40:09.597987+0000","last_clean":"2024-04-24T23:40:09.597987+0000","last_became_active":"2024-04-24T23:38:33.134584+0000","last_became_peered":"2024-04-24T23:38:33.134584+0000","last_unstale":"2024-04-24T23:40:09.597987+0000","last_undegraded":"2024-04-24T23:40:09.597987+0000","last_fullsized":"2024-04-24T23:40:09.597987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-24T23:40:09.597764+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-24T23:40:09.597764+0000","last_clean_scrub_stamp":"2024-04-24T23:40:09.597764+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:07:23.148275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:20.344131+0000","last_change":"2024-04-24T23:40:20.344131+0000","last_active":"2024-04-24T23:40:20.344131+0000","last_peered":"2024-04-24T23:40:20.344131+0000","last_clean":"2024-04-24T23:40:20.344131+0000","last_became_active":"2024-04-24T23:38:34.162093+0000","last_became_peered":"2024-04-24T23:38:34.162093+0000","last_unstale":"2024-04-24T23:40:20.344131+0000","last_undegraded":"2024-04-24T23:40:20.344131+0000","last_fullsized":"2024-04-24T23:40:20.344131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:20.343900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:20.343900+0000","last_clean_scrub_stamp":"2024-04-24T23:40:20.343900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:05.370568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:28.469358+0000","last_change":"2024-04-24T23:40:28.469419+0000","last_active":"2024-04-24T23:40:28.469358+0000","last_peered":"2024-04-24T23:40:28.469358+0000","last_clean":"2024-04-24T23:40:28.469358+0000","last_became_active":"2024-04-24T23:38:38.251653+0000","last_became_peered":"2024-04-24T23:38:38.251653+0000","last_unstale":"2024-04-24T23:40:28.469358+0000","last_undegraded":"2024-04-24T23:40:28.469358+0000","last_fullsized":"2024-04-24T23:40:28.469358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:28.469181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:28.469181+0000","last_clean_scrub_stamp":"2024-04-24T23:40:28.469181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:07:36.607747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:14.356508+0000","last_change":"2024-04-24T23:40:14.356508+0000","last_active":"2024-04-24T23:40:14.356508+0000","last_peered":"2024-04-24T23:40:14.356508+0000","last_clean":"2024-04-24T23:40:14.356508+0000","last_became_active":"2024-04-24T23:38:33.123681+0000","last_became_peered":"2024-04-24T23:38:33.123681+0000","last_unstale":"2024-04-24T23:40:14.356508+0000","last_undegraded":"2024-04-24T23:40:14.356508+0000","last_fullsized":"2024-04-24T23:40:14.356508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-04-24T23:40:14.356265+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-04-24T23:40:14.356265+0000","last_clean_scrub_stamp":"2024-04-24T23:40:14.356265+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:30.096872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:17.500559+0000","last_change":"2024-04-24T23:40:17.500559+0000","last_active":"2024-04-24T23:40:17.500559+0000","last_peered":"2024-04-24T23:40:17.500559+0000","last_clean":"2024-04-24T23:40:17.500559+0000","last_became_active":"2024-04-24T23:38:34.169115+0000","last_became_peered":"2024-04-24T23:38:34.169115+0000","last_unstale":"2024-04-24T23:40:17.500559+0000","last_undegraded":"2024-04-24T23:40:17.500559+0000","last_fullsized":"2024-04-24T23:40:17.500559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:17.500321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:17.500321+0000","last_clean_scrub_stamp":"2024-04-24T23:40:17.500321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:44:30.426350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:19.827370+0000","last_change":"2024-04-24T23:40:19.827480+0000","last_active":"2024-04-24T23:40:19.827370+0000","last_peered":"2024-04-24T23:40:19.827370+0000","last_clean":"2024-04-24T23:40:19.827370+0000","last_became_active":"2024-04-24T23:38:38.220392+0000","last_became_peered":"2024-04-24T23:38:38.220392+0000","last_unstale":"2024-04-24T23:40:19.827370+0000","last_undegraded":"2024-04-24T23:40:19.827370+0000","last_fullsized":"2024-04-24T23:40:19.827370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:19.827059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:19.827059+0000","last_clean_scrub_stamp":"2024-04-24T23:40:19.827059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:27:44.875083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'4","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:18.199331+0000","last_change":"2024-04-24T23:40:18.199397+0000","last_active":"2024-04-24T23:40:18.199331+0000","last_peered":"2024-04-24T23:40:18.199331+0000","last_clean":"2024-04-24T23:40:18.199331+0000","last_became_active":"2024-04-24T23:38:33.143542+0000","last_became_peered":"2024-04-24T23:38:33.143542+0000","last_unstale":"2024-04-24T23:40:18.199331+0000","last_undegraded":"2024-04-24T23:40:18.199331+0000","last_fullsized":"2024-04-24T23:40:18.199331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-24T23:40:18.199158+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-24T23:40:18.199158+0000","last_clean_scrub_stamp":"2024-04-24T23:40:18.199158+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:33.939764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:18.958853+0000","last_change":"2024-04-24T23:40:18.958909+0000","last_active":"2024-04-24T23:40:18.958853+0000","last_peered":"2024-04-24T23:40:18.958853+0000","last_clean":"2024-04-24T23:40:18.958853+0000","last_became_active":"2024-04-24T23:38:34.169908+0000","last_became_peered":"2024-04-24T23:38:34.169908+0000","last_unstale":"2024-04-24T23:40:18.958853+0000","last_undegraded":"2024-04-24T23:40:18.958853+0000","last_fullsized":"2024-04-24T23:40:18.958853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:18.958675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:18.958675+0000","last_clean_scrub_stamp":"2024-04-24T23:40:18.958675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:03:18.503924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:16.902481+0000","last_change":"2024-04-24T23:40:16.902543+0000","last_active":"2024-04-24T23:40:16.902481+0000","last_peered":"2024-04-24T23:40:16.902481+0000","last_clean":"2024-04-24T23:40:16.902481+0000","last_became_active":"2024-04-24T23:38:38.217390+0000","last_became_peered":"2024-04-24T23:38:38.217390+0000","last_unstale":"2024-04-24T23:40:16.902481+0000","last_undegraded":"2024-04-24T23:40:16.902481+0000","last_fullsized":"2024-04-24T23:40:16.902481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:16.902264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:16.902264+0000","last_clean_scrub_stamp":"2024-04-24T23:40:16.902264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:10:55.754733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'3","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:19.208330+0000","last_change":"2024-04-24T23:40:19.208396+0000","last_active":"2024-04-24T23:40:19.208330+0000","last_peered":"2024-04-24T23:40:19.208330+0000","last_clean":"2024-04-24T23:40:19.208330+0000","last_became_active":"2024-04-24T23:38:33.148510+0000","last_became_peered":"2024-04-24T23:38:33.148510+0000","last_unstale":"2024-04-24T23:40:19.208330+0000","last_undegraded":"2024-04-24T23:40:19.208330+0000","last_fullsized":"2024-04-24T23:40:19.208330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-04-24T23:40:19.208146+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-04-24T23:40:19.208146+0000","last_clean_scrub_stamp":"2024-04-24T23:40:19.208146+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:44:32.134174+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:17.932376+0000","last_change":"2024-04-24T23:40:17.932428+0000","last_active":"2024-04-24T23:40:17.932376+0000","last_peered":"2024-04-24T23:40:17.932376+0000","last_clean":"2024-04-24T23:40:17.932376+0000","last_became_active":"2024-04-24T23:38:34.152984+0000","last_became_peered":"2024-04-24T23:38:34.152984+0000","last_unstale":"2024-04-24T23:40:17.932376+0000","last_undegraded":"2024-04-24T23:40:17.932376+0000","last_fullsized":"2024-04-24T23:40:17.932376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:17.932208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:17.932208+0000","last_clean_scrub_stamp":"2024-04-24T23:40:17.932208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:23:01.968644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:20.869837+0000","last_change":"2024-04-24T23:40:20.869942+0000","last_active":"2024-04-24T23:40:20.869837+0000","last_peered":"2024-04-24T23:40:20.869837+0000","last_clean":"2024-04-24T23:40:20.869837+0000","last_became_active":"2024-04-24T23:38:38.220601+0000","last_became_peered":"2024-04-24T23:38:38.220601+0000","last_unstale":"2024-04-24T23:40:20.869837+0000","last_undegraded":"2024-04-24T23:40:20.869837+0000","last_fullsized":"2024-04-24T23:40:20.869837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:20.869623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:20.869623+0000","last_clean_scrub_stamp":"2024-04-24T23:40:20.869623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:16:59.583142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:15.167246+0000","last_change":"2024-04-24T23:40:15.167246+0000","last_active":"2024-04-24T23:40:15.167246+0000","last_peered":"2024-04-24T23:40:15.167246+0000","last_clean":"2024-04-24T23:40:15.167246+0000","last_became_active":"2024-04-24T23:38:34.141681+0000","last_became_peered":"2024-04-24T23:38:34.141681+0000","last_unstale":"2024-04-24T23:40:15.167246+0000","last_undegraded":"2024-04-24T23:40:15.167246+0000","last_fullsized":"2024-04-24T23:40:15.167246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:15.166987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:15.166987+0000","last_clean_scrub_stamp":"2024-04-24T23:40:15.166987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:45:10.180542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:15.241318+0000","last_change":"2024-04-24T23:40:15.241318+0000","last_active":"2024-04-24T23:40:15.241318+0000","last_peered":"2024-04-24T23:40:15.241318+0000","last_clean":"2024-04-24T23:40:15.241318+0000","last_became_active":"2024-04-24T23:38:33.139303+0000","last_became_peered":"2024-04-24T23:38:33.139303+0000","last_unstale":"2024-04-24T23:40:15.241318+0000","last_undegraded":"2024-04-24T23:40:15.241318+0000","last_fullsized":"2024-04-24T23:40:15.241318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-24T23:40:15.241081+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-24T23:40:15.241081+0000","last_clean_scrub_stamp":"2024-04-24T23:40:15.241081+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:55.140446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:15.864141+0000","last_change":"2024-04-24T23:40:15.864203+0000","last_active":"2024-04-24T23:40:15.864141+0000","last_peered":"2024-04-24T23:40:15.864141+0000","last_clean":"2024-04-24T23:40:15.864141+0000","last_became_active":"2024-04-24T23:38:38.214813+0000","last_became_peered":"2024-04-24T23:38:38.214813+0000","last_unstale":"2024-04-24T23:40:15.864141+0000","last_undegraded":"2024-04-24T23:40:15.864141+0000","last_fullsized":"2024-04-24T23:40:15.864141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:15.863944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:15.863944+0000","last_clean_scrub_stamp":"2024-04-24T23:40:15.863944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:28:56.975376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:09.285599+0000","last_change":"2024-04-24T23:40:09.285638+0000","last_active":"2024-04-24T23:40:09.285599+0000","last_peered":"2024-04-24T23:40:09.285599+0000","last_clean":"2024-04-24T23:40:09.285599+0000","last_became_active":"2024-04-24T23:38:34.174504+0000","last_became_peered":"2024-04-24T23:38:34.174504+0000","last_unstale":"2024-04-24T23:40:09.285599+0000","last_undegraded":"2024-04-24T23:40:09.285599+0000","last_fullsized":"2024-04-24T23:40:09.285599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:09.285504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:09.285504+0000","last_clean_scrub_stamp":"2024-04-24T23:40:09.285504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:48.184984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:12.688590+0000","last_change":"2024-04-24T23:40:12.688590+0000","last_active":"2024-04-24T23:40:12.688590+0000","last_peered":"2024-04-24T23:40:12.688590+0000","last_clean":"2024-04-24T23:40:12.688590+0000","last_became_active":"2024-04-24T23:38:33.125115+0000","last_became_peered":"2024-04-24T23:38:33.125115+0000","last_unstale":"2024-04-24T23:40:12.688590+0000","last_undegraded":"2024-04-24T23:40:12.688590+0000","last_fullsized":"2024-04-24T23:40:12.688590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:12.688360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:12.688360+0000","last_clean_scrub_stamp":"2024-04-24T23:40:12.688360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:28:53.799792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:18.840112+0000","last_change":"2024-04-24T23:40:18.840185+0000","last_active":"2024-04-24T23:40:18.840112+0000","last_peered":"2024-04-24T23:40:18.840112+0000","last_clean":"2024-04-24T23:40:18.840112+0000","last_became_active":"2024-04-24T23:38:38.219797+0000","last_became_peered":"2024-04-24T23:38:38.219797+0000","last_unstale":"2024-04-24T23:40:18.840112+0000","last_undegraded":"2024-04-24T23:40:18.840112+0000","last_fullsized":"2024-04-24T23:40:18.840112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:18.839899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:18.839899+0000","last_clean_scrub_stamp":"2024-04-24T23:40:18.839899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:11:04.318109+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:17.354742+0000","last_change":"2024-04-24T23:40:17.354742+0000","last_active":"2024-04-24T23:40:17.354742+0000","last_peered":"2024-04-24T23:40:17.354742+0000","last_clean":"2024-04-24T23:40:17.354742+0000","last_became_active":"2024-04-24T23:38:34.163291+0000","last_became_peered":"2024-04-24T23:38:34.163291+0000","last_unstale":"2024-04-24T23:40:17.354742+0000","last_undegraded":"2024-04-24T23:40:17.354742+0000","last_fullsized":"2024-04-24T23:40:17.354742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:17.354498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:17.354498+0000","last_clean_scrub_stamp":"2024-04-24T23:40:17.354498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:01.377586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:10.602734+0000","last_change":"2024-04-24T23:40:10.602734+0000","last_active":"2024-04-24T23:40:10.602734+0000","last_peered":"2024-04-24T23:40:10.602734+0000","last_clean":"2024-04-24T23:40:10.602734+0000","last_became_active":"2024-04-24T23:38:33.119052+0000","last_became_peered":"2024-04-24T23:38:33.119052+0000","last_unstale":"2024-04-24T23:40:10.602734+0000","last_undegraded":"2024-04-24T23:40:10.602734+0000","last_fullsized":"2024-04-24T23:40:10.602734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:10.602582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:10.602582+0000","last_clean_scrub_stamp":"2024-04-24T23:40:10.602582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:09.783355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'33","reported_seq":60,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:22.855191+0000","last_change":"2024-04-24T23:40:22.855253+0000","last_active":"2024-04-24T23:40:22.855191+0000","last_peered":"2024-04-24T23:40:22.855191+0000","last_clean":"2024-04-24T23:40:22.855191+0000","last_became_active":"2024-04-24T23:38:38.252138+0000","last_became_peered":"2024-04-24T23:38:38.252138+0000","last_unstale":"2024-04-24T23:40:22.855191+0000","last_undegraded":"2024-04-24T23:40:22.855191+0000","last_fullsized":"2024-04-24T23:40:22.855191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'33","last_scrub_stamp":"2024-04-24T23:40:22.855009+0000","last_deep_scrub":"26'33","last_deep_scrub_stamp":"2024-04-24T23:40:22.855009+0000","last_clean_scrub_stamp":"2024-04-24T23:40:22.855009+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:07.881677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:13.783580+0000","last_change":"2024-04-24T23:40:13.783580+0000","last_active":"2024-04-24T23:40:13.783580+0000","last_peered":"2024-04-24T23:40:13.783580+0000","last_clean":"2024-04-24T23:40:13.783580+0000","last_became_active":"2024-04-24T23:38:34.152682+0000","last_became_peered":"2024-04-24T23:38:34.152682+0000","last_unstale":"2024-04-24T23:40:13.783580+0000","last_undegraded":"2024-04-24T23:40:13.783580+0000","last_fullsized":"2024-04-24T23:40:13.783580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:13.783353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:13.783353+0000","last_clean_scrub_stamp":"2024-04-24T23:40:13.783353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:45:08.796907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:14.250269+0000","last_change":"2024-04-24T23:40:14.250269+0000","last_active":"2024-04-24T23:40:14.250269+0000","last_peered":"2024-04-24T23:40:14.250269+0000","last_clean":"2024-04-24T23:40:14.250269+0000","last_became_active":"2024-04-24T23:38:33.139175+0000","last_became_peered":"2024-04-24T23:38:33.139175+0000","last_unstale":"2024-04-24T23:40:14.250269+0000","last_undegraded":"2024-04-24T23:40:14.250269+0000","last_fullsized":"2024-04-24T23:40:14.250269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:14.249906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:14.249906+0000","last_clean_scrub_stamp":"2024-04-24T23:40:14.249906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:28:55.361338+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:23.909209+0000","last_change":"2024-04-24T23:40:23.909355+0000","last_active":"2024-04-24T23:40:23.909209+0000","last_peered":"2024-04-24T23:40:23.909209+0000","last_clean":"2024-04-24T23:40:23.909209+0000","last_became_active":"2024-04-24T23:39:22.831081+0000","last_became_peered":"2024-04-24T23:39:22.831081+0000","last_unstale":"2024-04-24T23:40:23.909209+0000","last_undegraded":"2024-04-24T23:40:23.909209+0000","last_fullsized":"2024-04-24T23:40:23.909209+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:23.908983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:23.908983+0000","last_clean_scrub_stamp":"2024-04-24T23:40:23.908983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:03:23.454232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:15.566768+0000","last_change":"2024-04-24T23:40:15.566768+0000","last_active":"2024-04-24T23:40:15.566768+0000","last_peered":"2024-04-24T23:40:15.566768+0000","last_clean":"2024-04-24T23:40:15.566768+0000","last_became_active":"2024-04-24T23:38:34.153967+0000","last_became_peered":"2024-04-24T23:38:34.153967+0000","last_unstale":"2024-04-24T23:40:15.566768+0000","last_undegraded":"2024-04-24T23:40:15.566768+0000","last_fullsized":"2024-04-24T23:40:15.566768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:15.566517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:15.566517+0000","last_clean_scrub_stamp":"2024-04-24T23:40:15.566517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:46:24.325796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'3","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:13.202644+0000","last_change":"2024-04-24T23:40:13.202644+0000","last_active":"2024-04-24T23:40:13.202644+0000","last_peered":"2024-04-24T23:40:13.202644+0000","last_clean":"2024-04-24T23:40:13.202644+0000","last_became_active":"2024-04-24T23:38:33.135225+0000","last_became_peered":"2024-04-24T23:38:33.135225+0000","last_unstale":"2024-04-24T23:40:13.202644+0000","last_undegraded":"2024-04-24T23:40:13.202644+0000","last_fullsized":"2024-04-24T23:40:13.202644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-04-24T23:40:13.202378+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-04-24T23:40:13.202378+0000","last_clean_scrub_stamp":"2024-04-24T23:40:13.202378+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:23.945654+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:21.854395+0000","last_change":"2024-04-24T23:40:21.854395+0000","last_active":"2024-04-24T23:40:21.854395+0000","last_peered":"2024-04-24T23:40:21.854395+0000","last_clean":"2024-04-24T23:40:21.854395+0000","last_became_active":"2024-04-24T23:38:38.251057+0000","last_became_peered":"2024-04-24T23:38:38.251057+0000","last_unstale":"2024-04-24T23:40:21.854395+0000","last_undegraded":"2024-04-24T23:40:21.854395+0000","last_fullsized":"2024-04-24T23:40:21.854395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:21.854142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:21.854142+0000","last_clean_scrub_stamp":"2024-04-24T23:40:21.854142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:34.514355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:16.640671+0000","last_change":"2024-04-24T23:40:16.640725+0000","last_active":"2024-04-24T23:40:16.640671+0000","last_peered":"2024-04-24T23:40:16.640671+0000","last_clean":"2024-04-24T23:40:16.640671+0000","last_became_active":"2024-04-24T23:39:22.833072+0000","last_became_peered":"2024-04-24T23:39:22.833072+0000","last_unstale":"2024-04-24T23:40:16.640671+0000","last_undegraded":"2024-04-24T23:40:16.640671+0000","last_fullsized":"2024-04-24T23:40:16.640671+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:16.640471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:16.640471+0000","last_clean_scrub_stamp":"2024-04-24T23:40:16.640471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:55.539951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"26'5","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:09.580994+0000","last_change":"2024-04-24T23:40:09.580994+0000","last_active":"2024-04-24T23:40:09.580994+0000","last_peered":"2024-04-24T23:40:09.580994+0000","last_clean":"2024-04-24T23:40:09.580994+0000","last_became_active":"2024-04-24T23:38:33.115039+0000","last_became_peered":"2024-04-24T23:38:33.115039+0000","last_unstale":"2024-04-24T23:40:09.580994+0000","last_undegraded":"2024-04-24T23:40:09.580994+0000","last_fullsized":"2024-04-24T23:40:09.580994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-04-24T23:40:09.580823+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-04-24T23:40:09.580823+0000","last_clean_scrub_stamp":"2024-04-24T23:40:09.580823+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:07:23.131334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:25.432672+0000","last_change":"2024-04-24T23:40:25.432672+0000","last_active":"2024-04-24T23:40:25.432672+0000","last_peered":"2024-04-24T23:40:25.432672+0000","last_clean":"2024-04-24T23:40:25.432672+0000","last_became_active":"2024-04-24T23:38:38.245775+0000","last_became_peered":"2024-04-24T23:38:38.245775+0000","last_unstale":"2024-04-24T23:40:25.432672+0000","last_undegraded":"2024-04-24T23:40:25.432672+0000","last_fullsized":"2024-04-24T23:40:25.432672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:25.432297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:25.432297+0000","last_clean_scrub_stamp":"2024-04-24T23:40:25.432297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:19.275549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:14.729280+0000","last_change":"2024-04-24T23:40:14.729280+0000","last_active":"2024-04-24T23:40:14.729280+0000","last_peered":"2024-04-24T23:40:14.729280+0000","last_clean":"2024-04-24T23:40:14.729280+0000","last_became_active":"2024-04-24T23:38:34.148122+0000","last_became_peered":"2024-04-24T23:38:34.148122+0000","last_unstale":"2024-04-24T23:40:14.729280+0000","last_undegraded":"2024-04-24T23:40:14.729280+0000","last_fullsized":"2024-04-24T23:40:14.729280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:14.729016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:14.729016+0000","last_clean_scrub_stamp":"2024-04-24T23:40:14.729016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:48:49.077136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:17.209127+0000","last_change":"2024-04-24T23:40:17.209127+0000","last_active":"2024-04-24T23:40:17.209127+0000","last_peered":"2024-04-24T23:40:17.209127+0000","last_clean":"2024-04-24T23:40:17.209127+0000","last_became_active":"2024-04-24T23:38:33.140003+0000","last_became_peered":"2024-04-24T23:38:33.140003+0000","last_unstale":"2024-04-24T23:40:17.209127+0000","last_undegraded":"2024-04-24T23:40:17.209127+0000","last_fullsized":"2024-04-24T23:40:17.209127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:17.208811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:17.208811+0000","last_clean_scrub_stamp":"2024-04-24T23:40:17.208811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:46:25.968089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:21.515872+0000","last_change":"2024-04-24T23:40:21.515872+0000","last_active":"2024-04-24T23:40:21.515872+0000","last_peered":"2024-04-24T23:40:21.515872+0000","last_clean":"2024-04-24T23:40:21.515872+0000","last_became_active":"2024-04-24T23:38:38.245611+0000","last_became_peered":"2024-04-24T23:38:38.245611+0000","last_unstale":"2024-04-24T23:40:21.515872+0000","last_undegraded":"2024-04-24T23:40:21.515872+0000","last_fullsized":"2024-04-24T23:40:21.515872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:21.515464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:21.515464+0000","last_clean_scrub_stamp":"2024-04-24T23:40:21.515464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:35:26.919665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:09.994678+0000","last_change":"2024-04-24T23:40:09.994678+0000","last_active":"2024-04-24T23:40:09.994678+0000","last_peered":"2024-04-24T23:40:09.994678+0000","last_clean":"2024-04-24T23:40:09.994678+0000","last_became_active":"2024-04-24T23:38:34.185023+0000","last_became_peered":"2024-04-24T23:38:34.185023+0000","last_unstale":"2024-04-24T23:40:09.994678+0000","last_undegraded":"2024-04-24T23:40:09.994678+0000","last_fullsized":"2024-04-24T23:40:09.994678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:09.994440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:09.994440+0000","last_clean_scrub_stamp":"2024-04-24T23:40:09.994440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:09.175212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:08.579197+0000","last_change":"2024-04-24T23:40:08.579197+0000","last_active":"2024-04-24T23:40:08.579197+0000","last_peered":"2024-04-24T23:40:08.579197+0000","last_clean":"2024-04-24T23:40:08.579197+0000","last_became_active":"2024-04-24T23:38:33.108102+0000","last_became_peered":"2024-04-24T23:38:33.108102+0000","last_unstale":"2024-04-24T23:40:08.579197+0000","last_undegraded":"2024-04-24T23:40:08.579197+0000","last_fullsized":"2024-04-24T23:40:08.579197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:08.578954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:08.578954+0000","last_clean_scrub_stamp":"2024-04-24T23:40:08.578954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:19.322231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:19.764820+0000","last_change":"2024-04-24T23:40:19.764820+0000","last_active":"2024-04-24T23:40:19.764820+0000","last_peered":"2024-04-24T23:40:19.764820+0000","last_clean":"2024-04-24T23:40:19.764820+0000","last_became_active":"2024-04-24T23:38:38.212691+0000","last_became_peered":"2024-04-24T23:38:38.212691+0000","last_unstale":"2024-04-24T23:40:19.764820+0000","last_undegraded":"2024-04-24T23:40:19.764820+0000","last_fullsized":"2024-04-24T23:40:19.764820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:19.764567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:19.764567+0000","last_clean_scrub_stamp":"2024-04-24T23:40:19.764567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:03.787655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:12.788608+0000","last_change":"2024-04-24T23:40:12.788608+0000","last_active":"2024-04-24T23:40:12.788608+0000","last_peered":"2024-04-24T23:40:12.788608+0000","last_clean":"2024-04-24T23:40:12.788608+0000","last_became_active":"2024-04-24T23:38:34.153372+0000","last_became_peered":"2024-04-24T23:38:34.153372+0000","last_unstale":"2024-04-24T23:40:12.788608+0000","last_undegraded":"2024-04-24T23:40:12.788608+0000","last_fullsized":"2024-04-24T23:40:12.788608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:12.788373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:12.788373+0000","last_clean_scrub_stamp":"2024-04-24T23:40:12.788373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:58:14.249783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:15.982177+0000","last_change":"2024-04-24T23:40:15.982177+0000","last_active":"2024-04-24T23:40:15.982177+0000","last_peered":"2024-04-24T23:40:15.982177+0000","last_clean":"2024-04-24T23:40:15.982177+0000","last_became_active":"2024-04-24T23:38:33.139012+0000","last_became_peered":"2024-04-24T23:38:33.139012+0000","last_unstale":"2024-04-24T23:40:15.982177+0000","last_undegraded":"2024-04-24T23:40:15.982177+0000","last_fullsized":"2024-04-24T23:40:15.982177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:15.981958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:15.981958+0000","last_clean_scrub_stamp":"2024-04-24T23:40:15.981958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:16:54.695477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:28.026543+0000","last_change":"2024-04-24T23:40:28.026600+0000","last_active":"2024-04-24T23:40:28.026543+0000","last_peered":"2024-04-24T23:40:28.026543+0000","last_clean":"2024-04-24T23:40:28.026543+0000","last_became_active":"2024-04-24T23:39:22.825860+0000","last_became_peered":"2024-04-24T23:39:22.825860+0000","last_unstale":"2024-04-24T23:40:28.026543+0000","last_undegraded":"2024-04-24T23:40:28.026543+0000","last_fullsized":"2024-04-24T23:40:28.026543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:28.026360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:28.026360+0000","last_clean_scrub_stamp":"2024-04-24T23:40:28.026360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:30:57.451407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:17.815380+0000","last_change":"2024-04-24T23:40:17.815380+0000","last_active":"2024-04-24T23:40:17.815380+0000","last_peered":"2024-04-24T23:40:17.815380+0000","last_clean":"2024-04-24T23:40:17.815380+0000","last_became_active":"2024-04-24T23:38:34.151917+0000","last_became_peered":"2024-04-24T23:38:34.151917+0000","last_unstale":"2024-04-24T23:40:17.815380+0000","last_undegraded":"2024-04-24T23:40:17.815380+0000","last_fullsized":"2024-04-24T23:40:17.815380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:17.814962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:17.814962+0000","last_clean_scrub_stamp":"2024-04-24T23:40:17.814962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:44:30.740990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'2","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:09.660493+0000","last_change":"2024-04-24T23:40:09.660493+0000","last_active":"2024-04-24T23:40:09.660493+0000","last_peered":"2024-04-24T23:40:09.660493+0000","last_clean":"2024-04-24T23:40:09.660493+0000","last_became_active":"2024-04-24T23:38:33.123674+0000","last_became_peered":"2024-04-24T23:38:33.123674+0000","last_unstale":"2024-04-24T23:40:09.660493+0000","last_undegraded":"2024-04-24T23:40:09.660493+0000","last_fullsized":"2024-04-24T23:40:09.660493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-04-24T23:40:09.660363+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-04-24T23:40:09.660363+0000","last_clean_scrub_stamp":"2024-04-24T23:40:09.660363+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:29:23.325878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:20.783905+0000","last_change":"2024-04-24T23:40:20.783905+0000","last_active":"2024-04-24T23:40:20.783905+0000","last_peered":"2024-04-24T23:40:20.783905+0000","last_clean":"2024-04-24T23:40:20.783905+0000","last_became_active":"2024-04-24T23:38:38.214005+0000","last_became_peered":"2024-04-24T23:38:38.214005+0000","last_unstale":"2024-04-24T23:40:20.783905+0000","last_undegraded":"2024-04-24T23:40:20.783905+0000","last_fullsized":"2024-04-24T23:40:20.783905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:20.783637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:20.783637+0000","last_clean_scrub_stamp":"2024-04-24T23:40:20.783637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:23:17.726214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:10.634299+0000","last_change":"2024-04-24T23:40:10.634299+0000","last_active":"2024-04-24T23:40:10.634299+0000","last_peered":"2024-04-24T23:40:10.634299+0000","last_clean":"2024-04-24T23:40:10.634299+0000","last_became_active":"2024-04-24T23:38:34.138681+0000","last_became_peered":"2024-04-24T23:38:34.138681+0000","last_unstale":"2024-04-24T23:40:10.634299+0000","last_undegraded":"2024-04-24T23:40:10.634299+0000","last_fullsized":"2024-04-24T23:40:10.634299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:10.634193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:10.634193+0000","last_clean_scrub_stamp":"2024-04-24T23:40:10.634193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:09.814966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:16.197707+0000","last_change":"2024-04-24T23:40:16.197707+0000","last_active":"2024-04-24T23:40:16.197707+0000","last_peered":"2024-04-24T23:40:16.197707+0000","last_clean":"2024-04-24T23:40:16.197707+0000","last_became_active":"2024-04-24T23:38:33.140618+0000","last_became_peered":"2024-04-24T23:38:33.140618+0000","last_unstale":"2024-04-24T23:40:16.197707+0000","last_undegraded":"2024-04-24T23:40:16.197707+0000","last_fullsized":"2024-04-24T23:40:16.197707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:16.197458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:16.197458+0000","last_clean_scrub_stamp":"2024-04-24T23:40:16.197458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:48:50.545579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:22.469597+0000","last_change":"2024-04-24T23:40:22.469597+0000","last_active":"2024-04-24T23:40:22.469597+0000","last_peered":"2024-04-24T23:40:22.469597+0000","last_clean":"2024-04-24T23:40:22.469597+0000","last_became_active":"2024-04-24T23:38:38.249402+0000","last_became_peered":"2024-04-24T23:38:38.249402+0000","last_unstale":"2024-04-24T23:40:22.469597+0000","last_undegraded":"2024-04-24T23:40:22.469597+0000","last_fullsized":"2024-04-24T23:40:22.469597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:22.469357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:22.469357+0000","last_clean_scrub_stamp":"2024-04-24T23:40:22.469357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:07.496025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:21.384631+0000","last_change":"2024-04-24T23:40:21.384631+0000","last_active":"2024-04-24T23:40:21.384631+0000","last_peered":"2024-04-24T23:40:21.384631+0000","last_clean":"2024-04-24T23:40:21.384631+0000","last_became_active":"2024-04-24T23:38:34.187655+0000","last_became_peered":"2024-04-24T23:38:34.187655+0000","last_unstale":"2024-04-24T23:40:21.384631+0000","last_undegraded":"2024-04-24T23:40:21.384631+0000","last_fullsized":"2024-04-24T23:40:21.384631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:21.384342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:21.384342+0000","last_clean_scrub_stamp":"2024-04-24T23:40:21.384342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:57.570970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:12.974382+0000","last_change":"2024-04-24T23:40:12.974382+0000","last_active":"2024-04-24T23:40:12.974382+0000","last_peered":"2024-04-24T23:40:12.974382+0000","last_clean":"2024-04-24T23:40:12.974382+0000","last_became_active":"2024-04-24T23:38:33.115926+0000","last_became_peered":"2024-04-24T23:38:33.115926+0000","last_unstale":"2024-04-24T23:40:12.974382+0000","last_undegraded":"2024-04-24T23:40:12.974382+0000","last_fullsized":"2024-04-24T23:40:12.974382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:12.974087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:12.974087+0000","last_clean_scrub_stamp":"2024-04-24T23:40:12.974087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:10:19.395285+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":194,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:13.292375+0000","last_change":"2024-04-24T23:40:13.292375+0000","last_active":"2024-04-24T23:40:13.292375+0000","last_peered":"2024-04-24T23:40:13.292375+0000","last_clean":"2024-04-24T23:40:13.292375+0000","last_became_active":"2024-04-24T23:38:29.562027+0000","last_became_peered":"2024-04-24T23:38:29.562027+0000","last_unstale":"2024-04-24T23:40:13.292375+0000","last_undegraded":"2024-04-24T23:40:13.292375+0000","last_fullsized":"2024-04-24T23:40:13.292375+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-04-24T23:40:13.292141+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-04-24T23:40:13.292141+0000","last_clean_scrub_stamp":"2024-04-24T23:40:13.292141+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:42.000299+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'33","reported_seq":78,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:24.253475+0000","last_change":"2024-04-24T23:40:24.253475+0000","last_active":"2024-04-24T23:40:24.253475+0000","last_peered":"2024-04-24T23:40:24.253475+0000","last_clean":"2024-04-24T23:40:24.253475+0000","last_became_active":"2024-04-24T23:38:38.253792+0000","last_became_peered":"2024-04-24T23:38:38.253792+0000","last_unstale":"2024-04-24T23:40:24.253475+0000","last_undegraded":"2024-04-24T23:40:24.253475+0000","last_fullsized":"2024-04-24T23:40:24.253475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'33","last_scrub_stamp":"2024-04-24T23:40:24.253236+0000","last_deep_scrub":"26'33","last_deep_scrub_stamp":"2024-04-24T23:40:24.253236+0000","last_clean_scrub_stamp":"2024-04-24T23:40:24.253236+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:08.276324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":2176,"num_write":33,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:27.253647+0000","last_change":"2024-04-24T23:40:27.253749+0000","last_active":"2024-04-24T23:40:27.253647+0000","last_peered":"2024-04-24T23:40:27.253647+0000","last_clean":"2024-04-24T23:40:27.253647+0000","last_became_active":"2024-04-24T23:38:34.194530+0000","last_became_peered":"2024-04-24T23:38:34.194530+0000","last_unstale":"2024-04-24T23:40:27.253647+0000","last_undegraded":"2024-04-24T23:40:27.253647+0000","last_fullsized":"2024-04-24T23:40:27.253647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:27.253444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:27.253444+0000","last_clean_scrub_stamp":"2024-04-24T23:40:27.253444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:57.840747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:11.596993+0000","last_change":"2024-04-24T23:40:11.596993+0000","last_active":"2024-04-24T23:40:11.596993+0000","last_peered":"2024-04-24T23:40:11.596993+0000","last_clean":"2024-04-24T23:40:11.596993+0000","last_became_active":"2024-04-24T23:38:33.129888+0000","last_became_peered":"2024-04-24T23:38:33.129888+0000","last_unstale":"2024-04-24T23:40:11.596993+0000","last_undegraded":"2024-04-24T23:40:11.596993+0000","last_fullsized":"2024-04-24T23:40:11.596993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:11.596741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:11.596741+0000","last_clean_scrub_stamp":"2024-04-24T23:40:11.596741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:43:42.959616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'66","reported_seq":126,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:23.235712+0000","last_change":"2024-04-24T23:40:23.235712+0000","last_active":"2024-04-24T23:40:23.235712+0000","last_peered":"2024-04-24T23:40:23.235712+0000","last_clean":"2024-04-24T23:40:23.235712+0000","last_became_active":"2024-04-24T23:38:38.252899+0000","last_became_peered":"2024-04-24T23:38:38.252899+0000","last_unstale":"2024-04-24T23:40:23.235712+0000","last_undegraded":"2024-04-24T23:40:23.235712+0000","last_fullsized":"2024-04-24T23:40:23.235712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'66","last_scrub_stamp":"2024-04-24T23:40:23.235469+0000","last_deep_scrub":"26'66","last_deep_scrub_stamp":"2024-04-24T23:40:23.235469+0000","last_clean_scrub_stamp":"2024-04-24T23:40:23.235469+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:33:36.999829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":4096,"num_write":66,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:21.014626+0000","last_change":"2024-04-24T23:40:21.014738+0000","last_active":"2024-04-24T23:40:21.014626+0000","last_peered":"2024-04-24T23:40:21.014626+0000","last_clean":"2024-04-24T23:40:21.014626+0000","last_became_active":"2024-04-24T23:38:34.184929+0000","last_became_peered":"2024-04-24T23:38:34.184929+0000","last_unstale":"2024-04-24T23:40:21.014626+0000","last_undegraded":"2024-04-24T23:40:21.014626+0000","last_fullsized":"2024-04-24T23:40:21.014626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:21.014403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:21.014403+0000","last_clean_scrub_stamp":"2024-04-24T23:40:21.014403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:06.041071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'2","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:11.655220+0000","last_change":"2024-04-24T23:40:11.655220+0000","last_active":"2024-04-24T23:40:11.655220+0000","last_peered":"2024-04-24T23:40:11.655220+0000","last_clean":"2024-04-24T23:40:11.655220+0000","last_became_active":"2024-04-24T23:38:33.119790+0000","last_became_peered":"2024-04-24T23:38:33.119790+0000","last_unstale":"2024-04-24T23:40:11.655220+0000","last_undegraded":"2024-04-24T23:40:11.655220+0000","last_fullsized":"2024-04-24T23:40:11.655220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-04-24T23:40:11.654950+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-04-24T23:40:11.654950+0000","last_clean_scrub_stamp":"2024-04-24T23:40:11.654950+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:40.363108+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:20.465874+0000","last_change":"2024-04-24T23:40:20.465931+0000","last_active":"2024-04-24T23:40:20.465874+0000","last_peered":"2024-04-24T23:40:20.465874+0000","last_clean":"2024-04-24T23:40:20.465874+0000","last_became_active":"2024-04-24T23:38:38.215599+0000","last_became_peered":"2024-04-24T23:38:38.215599+0000","last_unstale":"2024-04-24T23:40:20.465874+0000","last_undegraded":"2024-04-24T23:40:20.465874+0000","last_fullsized":"2024-04-24T23:40:20.465874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:20.465677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:20.465677+0000","last_clean_scrub_stamp":"2024-04-24T23:40:20.465677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:23:17.408253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:25.253677+0000","last_change":"2024-04-24T23:40:25.253734+0000","last_active":"2024-04-24T23:40:25.253677+0000","last_peered":"2024-04-24T23:40:25.253677+0000","last_clean":"2024-04-24T23:40:25.253677+0000","last_became_active":"2024-04-24T23:38:34.188815+0000","last_became_peered":"2024-04-24T23:38:34.188815+0000","last_unstale":"2024-04-24T23:40:25.253677+0000","last_undegraded":"2024-04-24T23:40:25.253677+0000","last_fullsized":"2024-04-24T23:40:25.253677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:25.253507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:25.253507+0000","last_clean_scrub_stamp":"2024-04-24T23:40:25.253507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:11:01.440135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'3","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:10.634368+0000","last_change":"2024-04-24T23:40:10.634368+0000","last_active":"2024-04-24T23:40:10.634368+0000","last_peered":"2024-04-24T23:40:10.634368+0000","last_clean":"2024-04-24T23:40:10.634368+0000","last_became_active":"2024-04-24T23:38:33.124849+0000","last_became_peered":"2024-04-24T23:38:33.124849+0000","last_unstale":"2024-04-24T23:40:10.634368+0000","last_undegraded":"2024-04-24T23:40:10.634368+0000","last_fullsized":"2024-04-24T23:40:10.634368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-04-24T23:40:10.634167+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-04-24T23:40:10.634167+0000","last_clean_scrub_stamp":"2024-04-24T23:40:10.634167+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:18.133837+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:27.024192+0000","last_change":"2024-04-24T23:40:27.024192+0000","last_active":"2024-04-24T23:40:27.024192+0000","last_peered":"2024-04-24T23:40:27.024192+0000","last_clean":"2024-04-24T23:40:27.024192+0000","last_became_active":"2024-04-24T23:38:38.249521+0000","last_became_peered":"2024-04-24T23:38:38.249521+0000","last_unstale":"2024-04-24T23:40:27.024192+0000","last_undegraded":"2024-04-24T23:40:27.024192+0000","last_fullsized":"2024-04-24T23:40:27.024192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:27.023836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:27.023836+0000","last_clean_scrub_stamp":"2024-04-24T23:40:27.023836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:48.598910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:20.170162+0000","last_change":"2024-04-24T23:40:20.170214+0000","last_active":"2024-04-24T23:40:20.170162+0000","last_peered":"2024-04-24T23:40:20.170162+0000","last_clean":"2024-04-24T23:40:20.170162+0000","last_became_active":"2024-04-24T23:38:34.165229+0000","last_became_peered":"2024-04-24T23:38:34.165229+0000","last_unstale":"2024-04-24T23:40:20.170162+0000","last_undegraded":"2024-04-24T23:40:20.170162+0000","last_fullsized":"2024-04-24T23:40:20.170162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:20.169997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:20.169997+0000","last_clean_scrub_stamp":"2024-04-24T23:40:20.169997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:33:33.934357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:09.830955+0000","last_change":"2024-04-24T23:40:09.830955+0000","last_active":"2024-04-24T23:40:09.830955+0000","last_peered":"2024-04-24T23:40:09.830955+0000","last_clean":"2024-04-24T23:40:09.830955+0000","last_became_active":"2024-04-24T23:38:33.108928+0000","last_became_peered":"2024-04-24T23:38:33.108928+0000","last_unstale":"2024-04-24T23:40:09.830955+0000","last_undegraded":"2024-04-24T23:40:09.830955+0000","last_fullsized":"2024-04-24T23:40:09.830955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-04-24T23:40:09.830724+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-04-24T23:40:09.830724+0000","last_clean_scrub_stamp":"2024-04-24T23:40:09.830724+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:43:41.193599+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:22.876525+0000","last_change":"2024-04-24T23:40:22.876525+0000","last_active":"2024-04-24T23:40:22.876525+0000","last_peered":"2024-04-24T23:40:22.876525+0000","last_clean":"2024-04-24T23:40:22.876525+0000","last_became_active":"2024-04-24T23:39:22.831340+0000","last_became_peered":"2024-04-24T23:39:22.831340+0000","last_unstale":"2024-04-24T23:40:22.876525+0000","last_undegraded":"2024-04-24T23:40:22.876525+0000","last_fullsized":"2024-04-24T23:40:22.876525+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:22.876284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:22.876284+0000","last_clean_scrub_stamp":"2024-04-24T23:40:22.876284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:23:06.912720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3,6],"acting":[4,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:11.333919+0000","last_change":"2024-04-24T23:40:11.334025+0000","last_active":"2024-04-24T23:40:11.333919+0000","last_peered":"2024-04-24T23:40:11.333919+0000","last_clean":"2024-04-24T23:40:11.333919+0000","last_became_active":"2024-04-24T23:38:34.188416+0000","last_became_peered":"2024-04-24T23:38:34.188416+0000","last_unstale":"2024-04-24T23:40:11.333919+0000","last_undegraded":"2024-04-24T23:40:11.333919+0000","last_fullsized":"2024-04-24T23:40:11.333919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:11.333696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:11.333696+0000","last_clean_scrub_stamp":"2024-04-24T23:40:11.333696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:07:24.884208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'12","reported_seq":47,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:08.659625+0000","last_change":"2024-04-24T23:40:08.659694+0000","last_active":"2024-04-24T23:40:08.659625+0000","last_peered":"2024-04-24T23:40:08.659625+0000","last_clean":"2024-04-24T23:40:08.659625+0000","last_became_active":"2024-04-24T23:38:33.100464+0000","last_became_peered":"2024-04-24T23:38:33.100464+0000","last_unstale":"2024-04-24T23:40:08.659625+0000","last_undegraded":"2024-04-24T23:40:08.659625+0000","last_fullsized":"2024-04-24T23:40:08.659625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12","last_scrub_stamp":"2024-04-24T23:40:08.659467+0000","last_deep_scrub":"26'12","last_deep_scrub_stamp":"2024-04-24T23:40:08.659467+0000","last_clean_scrub_stamp":"2024-04-24T23:40:08.659467+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:59.359391+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:19.504314+0000","last_change":"2024-04-24T23:40:19.504374+0000","last_active":"2024-04-24T23:40:19.504314+0000","last_peered":"2024-04-24T23:40:19.504314+0000","last_clean":"2024-04-24T23:40:19.504314+0000","last_became_active":"2024-04-24T23:38:38.207049+0000","last_became_peered":"2024-04-24T23:38:38.207049+0000","last_unstale":"2024-04-24T23:40:19.504314+0000","last_undegraded":"2024-04-24T23:40:19.504314+0000","last_fullsized":"2024-04-24T23:40:19.504314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:19.504136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:19.504136+0000","last_clean_scrub_stamp":"2024-04-24T23:40:19.504136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:03.527223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:19.281242+0000","last_change":"2024-04-24T23:40:19.281297+0000","last_active":"2024-04-24T23:40:19.281242+0000","last_peered":"2024-04-24T23:40:19.281242+0000","last_clean":"2024-04-24T23:40:19.281242+0000","last_became_active":"2024-04-24T23:38:34.158756+0000","last_became_peered":"2024-04-24T23:38:34.158756+0000","last_unstale":"2024-04-24T23:40:19.281242+0000","last_undegraded":"2024-04-24T23:40:19.281242+0000","last_fullsized":"2024-04-24T23:40:19.281242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:19.281068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:19.281068+0000","last_clean_scrub_stamp":"2024-04-24T23:40:19.281068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:48:53.629188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:11.160898+0000","last_change":"2024-04-24T23:40:11.160959+0000","last_active":"2024-04-24T23:40:11.160898+0000","last_peered":"2024-04-24T23:40:11.160898+0000","last_clean":"2024-04-24T23:40:11.160898+0000","last_became_active":"2024-04-24T23:38:33.115472+0000","last_became_peered":"2024-04-24T23:38:33.115472+0000","last_unstale":"2024-04-24T23:40:11.160898+0000","last_undegraded":"2024-04-24T23:40:11.160898+0000","last_fullsized":"2024-04-24T23:40:11.160898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:11.160712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:11.160712+0000","last_clean_scrub_stamp":"2024-04-24T23:40:11.160712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:40:24.066873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:26.481312+0000","last_change":"2024-04-24T23:40:26.481375+0000","last_active":"2024-04-24T23:40:26.481312+0000","last_peered":"2024-04-24T23:40:26.481312+0000","last_clean":"2024-04-24T23:40:26.481312+0000","last_became_active":"2024-04-24T23:38:38.248311+0000","last_became_peered":"2024-04-24T23:38:38.248311+0000","last_unstale":"2024-04-24T23:40:26.481312+0000","last_undegraded":"2024-04-24T23:40:26.481312+0000","last_fullsized":"2024-04-24T23:40:26.481312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:26.481133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:26.481133+0000","last_clean_scrub_stamp":"2024-04-24T23:40:26.481133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:48.056207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:24.258949+0000","last_change":"2024-04-24T23:40:24.259001+0000","last_active":"2024-04-24T23:40:24.258949+0000","last_peered":"2024-04-24T23:40:24.258949+0000","last_clean":"2024-04-24T23:40:24.258949+0000","last_became_active":"2024-04-24T23:38:34.179801+0000","last_became_peered":"2024-04-24T23:38:34.179801+0000","last_unstale":"2024-04-24T23:40:24.258949+0000","last_undegraded":"2024-04-24T23:40:24.258949+0000","last_fullsized":"2024-04-24T23:40:24.258949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:24.258765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:24.258765+0000","last_clean_scrub_stamp":"2024-04-24T23:40:24.258765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:09.285432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:16.971433+0000","last_change":"2024-04-24T23:40:16.971492+0000","last_active":"2024-04-24T23:40:16.971433+0000","last_peered":"2024-04-24T23:40:16.971433+0000","last_clean":"2024-04-24T23:40:16.971433+0000","last_became_active":"2024-04-24T23:38:33.145896+0000","last_became_peered":"2024-04-24T23:38:33.145896+0000","last_unstale":"2024-04-24T23:40:16.971433+0000","last_undegraded":"2024-04-24T23:40:16.971433+0000","last_fullsized":"2024-04-24T23:40:16.971433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:16.971253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:16.971253+0000","last_clean_scrub_stamp":"2024-04-24T23:40:16.971253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:29.631466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:27.514158+0000","last_change":"2024-04-24T23:40:27.514223+0000","last_active":"2024-04-24T23:40:27.514158+0000","last_peered":"2024-04-24T23:40:27.514158+0000","last_clean":"2024-04-24T23:40:27.514158+0000","last_became_active":"2024-04-24T23:38:38.251541+0000","last_became_peered":"2024-04-24T23:38:38.251541+0000","last_unstale":"2024-04-24T23:40:27.514158+0000","last_undegraded":"2024-04-24T23:40:27.514158+0000","last_fullsized":"2024-04-24T23:40:27.514158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:27.513957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:27.513957+0000","last_clean_scrub_stamp":"2024-04-24T23:40:27.513957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:30:56.939004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:07.639085+0000","last_change":"2024-04-24T23:40:07.639213+0000","last_active":"2024-04-24T23:40:07.639085+0000","last_peered":"2024-04-24T23:40:07.639085+0000","last_clean":"2024-04-24T23:40:07.639085+0000","last_became_active":"2024-04-24T23:38:34.164024+0000","last_became_peered":"2024-04-24T23:38:34.164024+0000","last_unstale":"2024-04-24T23:40:07.639085+0000","last_undegraded":"2024-04-24T23:40:07.639085+0000","last_fullsized":"2024-04-24T23:40:07.639085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:07.638833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:07.638833+0000","last_clean_scrub_stamp":"2024-04-24T23:40:07.638833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:13.497785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'4","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:08.635454+0000","last_change":"2024-04-24T23:40:08.635521+0000","last_active":"2024-04-24T23:40:08.635454+0000","last_peered":"2024-04-24T23:40:08.635454+0000","last_clean":"2024-04-24T23:40:08.635454+0000","last_became_active":"2024-04-24T23:38:33.109819+0000","last_became_peered":"2024-04-24T23:38:33.109819+0000","last_unstale":"2024-04-24T23:40:08.635454+0000","last_undegraded":"2024-04-24T23:40:08.635454+0000","last_fullsized":"2024-04-24T23:40:08.635454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-24T23:40:08.635280+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-24T23:40:08.635280+0000","last_clean_scrub_stamp":"2024-04-24T23:40:08.635280+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:30:19.378557+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:26.019046+0000","last_change":"2024-04-24T23:40:26.019159+0000","last_active":"2024-04-24T23:40:26.019046+0000","last_peered":"2024-04-24T23:40:26.019046+0000","last_clean":"2024-04-24T23:40:26.019046+0000","last_became_active":"2024-04-24T23:38:38.246172+0000","last_became_peered":"2024-04-24T23:38:38.246172+0000","last_unstale":"2024-04-24T23:40:26.019046+0000","last_undegraded":"2024-04-24T23:40:26.019046+0000","last_fullsized":"2024-04-24T23:40:26.019046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:26.018802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:26.018802+0000","last_clean_scrub_stamp":"2024-04-24T23:40:26.018802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:19.862054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:23.218071+0000","last_change":"2024-04-24T23:40:23.218125+0000","last_active":"2024-04-24T23:40:23.218071+0000","last_peered":"2024-04-24T23:40:23.218071+0000","last_clean":"2024-04-24T23:40:23.218071+0000","last_became_active":"2024-04-24T23:38:34.179433+0000","last_became_peered":"2024-04-24T23:38:34.179433+0000","last_unstale":"2024-04-24T23:40:23.218071+0000","last_undegraded":"2024-04-24T23:40:23.218071+0000","last_fullsized":"2024-04-24T23:40:23.218071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:23.217900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:23.217900+0000","last_clean_scrub_stamp":"2024-04-24T23:40:23.217900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:35:28.622101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'37","reported_seq":72,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:12.175299+0000","last_change":"2024-04-24T23:40:12.175379+0000","last_active":"2024-04-24T23:40:12.175299+0000","last_peered":"2024-04-24T23:40:12.175299+0000","last_clean":"2024-04-24T23:40:12.175299+0000","last_became_active":"2024-04-24T23:38:33.127122+0000","last_became_peered":"2024-04-24T23:38:33.127122+0000","last_unstale":"2024-04-24T23:40:12.175299+0000","last_undegraded":"2024-04-24T23:40:12.175299+0000","last_fullsized":"2024-04-24T23:40:12.175299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'37","last_scrub_stamp":"2024-04-24T23:40:12.175103+0000","last_deep_scrub":"26'37","last_deep_scrub_stamp":"2024-04-24T23:40:12.175103+0000","last_clean_scrub_stamp":"2024-04-24T23:40:12.175103+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:18.034056+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39309,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:21.804537+0000","last_change":"2024-04-24T23:40:21.804605+0000","last_active":"2024-04-24T23:40:21.804537+0000","last_peered":"2024-04-24T23:40:21.804537+0000","last_clean":"2024-04-24T23:40:21.804537+0000","last_became_active":"2024-04-24T23:38:38.215741+0000","last_became_peered":"2024-04-24T23:38:38.215741+0000","last_unstale":"2024-04-24T23:40:21.804537+0000","last_undegraded":"2024-04-24T23:40:21.804537+0000","last_fullsized":"2024-04-24T23:40:21.804537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:21.804346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:21.804346+0000","last_clean_scrub_stamp":"2024-04-24T23:40:21.804346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:35:27.208547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:14.833968+0000","last_change":"2024-04-24T23:40:14.834020+0000","last_active":"2024-04-24T23:40:14.833968+0000","last_peered":"2024-04-24T23:40:14.833968+0000","last_clean":"2024-04-24T23:40:14.833968+0000","last_became_active":"2024-04-24T23:38:34.166602+0000","last_became_peered":"2024-04-24T23:38:34.166602+0000","last_unstale":"2024-04-24T23:40:14.833968+0000","last_undegraded":"2024-04-24T23:40:14.833968+0000","last_fullsized":"2024-04-24T23:40:14.833968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:14.833790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:14.833790+0000","last_clean_scrub_stamp":"2024-04-24T23:40:14.833790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:43.541948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'6","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:13.708677+0000","last_change":"2024-04-24T23:40:13.708802+0000","last_active":"2024-04-24T23:40:13.708677+0000","last_peered":"2024-04-24T23:40:13.708677+0000","last_clean":"2024-04-24T23:40:13.708677+0000","last_became_active":"2024-04-24T23:38:33.146311+0000","last_became_peered":"2024-04-24T23:38:33.146311+0000","last_unstale":"2024-04-24T23:40:13.708677+0000","last_undegraded":"2024-04-24T23:40:13.708677+0000","last_fullsized":"2024-04-24T23:40:13.708677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-24T23:40:13.708440+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-24T23:40:13.708440+0000","last_clean_scrub_stamp":"2024-04-24T23:40:13.708440+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:53.607804+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:17.873525+0000","last_change":"2024-04-24T23:40:17.873637+0000","last_active":"2024-04-24T23:40:17.873525+0000","last_peered":"2024-04-24T23:40:17.873525+0000","last_clean":"2024-04-24T23:40:17.873525+0000","last_became_active":"2024-04-24T23:38:38.219482+0000","last_became_peered":"2024-04-24T23:38:38.219482+0000","last_unstale":"2024-04-24T23:40:17.873525+0000","last_undegraded":"2024-04-24T23:40:17.873525+0000","last_fullsized":"2024-04-24T23:40:17.873525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:17.873289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:17.873289+0000","last_clean_scrub_stamp":"2024-04-24T23:40:17.873289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:10:24.294487+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:18.540208+0000","last_change":"2024-04-24T23:40:18.540264+0000","last_active":"2024-04-24T23:40:18.540208+0000","last_peered":"2024-04-24T23:40:18.540208+0000","last_clean":"2024-04-24T23:40:18.540208+0000","last_became_active":"2024-04-24T23:38:34.169512+0000","last_became_peered":"2024-04-24T23:38:34.169512+0000","last_unstale":"2024-04-24T23:40:18.540208+0000","last_undegraded":"2024-04-24T23:40:18.540208+0000","last_fullsized":"2024-04-24T23:40:18.540208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:18.540029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:18.540029+0000","last_clean_scrub_stamp":"2024-04-24T23:40:18.540029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:33:32.304390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:13.956805+0000","last_change":"2024-04-24T23:40:13.956860+0000","last_active":"2024-04-24T23:40:13.956805+0000","last_peered":"2024-04-24T23:40:13.956805+0000","last_clean":"2024-04-24T23:40:13.956805+0000","last_became_active":"2024-04-24T23:38:33.130150+0000","last_became_peered":"2024-04-24T23:38:33.130150+0000","last_unstale":"2024-04-24T23:40:13.956805+0000","last_undegraded":"2024-04-24T23:40:13.956805+0000","last_fullsized":"2024-04-24T23:40:13.956805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:13.956618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:13.956618+0000","last_clean_scrub_stamp":"2024-04-24T23:40:13.956618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:46:22.715897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'35","reported_seq":95,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:22.401583+0000","last_change":"2024-04-24T23:40:22.401649+0000","last_active":"2024-04-24T23:40:22.401583+0000","last_peered":"2024-04-24T23:40:22.401583+0000","last_clean":"2024-04-24T23:40:22.401583+0000","last_became_active":"2024-04-24T23:38:38.208130+0000","last_became_peered":"2024-04-24T23:38:38.208130+0000","last_unstale":"2024-04-24T23:40:22.401583+0000","last_undegraded":"2024-04-24T23:40:22.401583+0000","last_fullsized":"2024-04-24T23:40:22.401583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'35","last_scrub_stamp":"2024-04-24T23:40:22.401405+0000","last_deep_scrub":"26'35","last_deep_scrub_stamp":"2024-04-24T23:40:22.401405+0000","last_clean_scrub_stamp":"2024-04-24T23:40:22.401405+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:52:37.496942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":4096,"num_write":33,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:24.017364+0000","last_change":"2024-04-24T23:40:24.017417+0000","last_active":"2024-04-24T23:40:24.017364+0000","last_peered":"2024-04-24T23:40:24.017364+0000","last_clean":"2024-04-24T23:40:24.017364+0000","last_became_active":"2024-04-24T23:38:34.199311+0000","last_became_peered":"2024-04-24T23:38:34.199311+0000","last_unstale":"2024-04-24T23:40:24.017364+0000","last_undegraded":"2024-04-24T23:40:24.017364+0000","last_fullsized":"2024-04-24T23:40:24.017364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:24.017169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:24.017169+0000","last_clean_scrub_stamp":"2024-04-24T23:40:24.017169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:54.604473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'1","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:14.215591+0000","last_change":"2024-04-24T23:40:14.215755+0000","last_active":"2024-04-24T23:40:14.215591+0000","last_peered":"2024-04-24T23:40:14.215591+0000","last_clean":"2024-04-24T23:40:14.215591+0000","last_became_active":"2024-04-24T23:38:33.139325+0000","last_became_peered":"2024-04-24T23:38:33.139325+0000","last_unstale":"2024-04-24T23:40:14.215591+0000","last_undegraded":"2024-04-24T23:40:14.215591+0000","last_fullsized":"2024-04-24T23:40:14.215591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1","last_scrub_stamp":"2024-04-24T23:40:14.215363+0000","last_deep_scrub":"26'1","last_deep_scrub_stamp":"2024-04-24T23:40:14.215363+0000","last_clean_scrub_stamp":"2024-04-24T23:40:14.215363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:07:27.765874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:24.453890+0000","last_change":"2024-04-24T23:40:24.453948+0000","last_active":"2024-04-24T23:40:24.453890+0000","last_peered":"2024-04-24T23:40:24.453890+0000","last_clean":"2024-04-24T23:40:24.453890+0000","last_became_active":"2024-04-24T23:38:38.245657+0000","last_became_peered":"2024-04-24T23:38:38.245657+0000","last_unstale":"2024-04-24T23:40:24.453890+0000","last_undegraded":"2024-04-24T23:40:24.453890+0000","last_fullsized":"2024-04-24T23:40:24.453890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:24.453675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:24.453675+0000","last_clean_scrub_stamp":"2024-04-24T23:40:24.453675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:11.875730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:23.479215+0000","last_change":"2024-04-24T23:40:23.479215+0000","last_active":"2024-04-24T23:40:23.479215+0000","last_peered":"2024-04-24T23:40:23.479215+0000","last_clean":"2024-04-24T23:40:23.479215+0000","last_became_active":"2024-04-24T23:38:38.250718+0000","last_became_peered":"2024-04-24T23:38:38.250718+0000","last_unstale":"2024-04-24T23:40:23.479215+0000","last_undegraded":"2024-04-24T23:40:23.479215+0000","last_fullsized":"2024-04-24T23:40:23.479215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:23.478937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:23.478937+0000","last_clean_scrub_stamp":"2024-04-24T23:40:23.478937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:59.665565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:18.798305+0000","last_change":"2024-04-24T23:40:18.798365+0000","last_active":"2024-04-24T23:40:18.798305+0000","last_peered":"2024-04-24T23:40:18.798305+0000","last_clean":"2024-04-24T23:40:18.798305+0000","last_became_active":"2024-04-24T23:38:34.174289+0000","last_became_peered":"2024-04-24T23:38:34.174289+0000","last_unstale":"2024-04-24T23:40:18.798305+0000","last_undegraded":"2024-04-24T23:40:18.798305+0000","last_fullsized":"2024-04-24T23:40:18.798305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:18.798100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:18.798100+0000","last_clean_scrub_stamp":"2024-04-24T23:40:18.798100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:33:32.562460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:14.964756+0000","last_change":"2024-04-24T23:40:14.964809+0000","last_active":"2024-04-24T23:40:14.964756+0000","last_peered":"2024-04-24T23:40:14.964756+0000","last_clean":"2024-04-24T23:40:14.964756+0000","last_became_active":"2024-04-24T23:38:33.130621+0000","last_became_peered":"2024-04-24T23:38:33.130621+0000","last_unstale":"2024-04-24T23:40:14.964756+0000","last_undegraded":"2024-04-24T23:40:14.964756+0000","last_fullsized":"2024-04-24T23:40:14.964756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:14.964562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:14.964562+0000","last_clean_scrub_stamp":"2024-04-24T23:40:14.964562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:30.705169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:22.216486+0000","last_change":"2024-04-24T23:40:22.216486+0000","last_active":"2024-04-24T23:40:22.216486+0000","last_peered":"2024-04-24T23:40:22.216486+0000","last_clean":"2024-04-24T23:40:22.216486+0000","last_became_active":"2024-04-24T23:38:38.213249+0000","last_became_peered":"2024-04-24T23:38:38.213249+0000","last_unstale":"2024-04-24T23:40:22.216486+0000","last_undegraded":"2024-04-24T23:40:22.216486+0000","last_fullsized":"2024-04-24T23:40:22.216486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:22.216236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:22.216236+0000","last_clean_scrub_stamp":"2024-04-24T23:40:22.216236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:44:35.142265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:19.325227+0000","last_change":"2024-04-24T23:40:19.325283+0000","last_active":"2024-04-24T23:40:19.325227+0000","last_peered":"2024-04-24T23:40:19.325227+0000","last_clean":"2024-04-24T23:40:19.325227+0000","last_became_active":"2024-04-24T23:38:34.163685+0000","last_became_peered":"2024-04-24T23:38:34.163685+0000","last_unstale":"2024-04-24T23:40:19.325227+0000","last_undegraded":"2024-04-24T23:40:19.325227+0000","last_fullsized":"2024-04-24T23:40:19.325227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:19.325052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:19.325052+0000","last_clean_scrub_stamp":"2024-04-24T23:40:19.325052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:35:24.729253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:13.374118+0000","last_change":"2024-04-24T23:40:13.374177+0000","last_active":"2024-04-24T23:40:13.374118+0000","last_peered":"2024-04-24T23:40:13.374118+0000","last_clean":"2024-04-24T23:40:13.374118+0000","last_became_active":"2024-04-24T23:38:33.113333+0000","last_became_peered":"2024-04-24T23:38:33.113333+0000","last_unstale":"2024-04-24T23:40:13.374118+0000","last_undegraded":"2024-04-24T23:40:13.374118+0000","last_fullsized":"2024-04-24T23:40:13.374118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:13.373932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:13.373932+0000","last_clean_scrub_stamp":"2024-04-24T23:40:13.373932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:46:22.133211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:10.187194+0000","last_change":"2024-04-24T23:40:10.187308+0000","last_active":"2024-04-24T23:40:10.187194+0000","last_peered":"2024-04-24T23:40:10.187194+0000","last_clean":"2024-04-24T23:40:10.187194+0000","last_became_active":"2024-04-24T23:38:33.110315+0000","last_became_peered":"2024-04-24T23:38:33.110315+0000","last_unstale":"2024-04-24T23:40:10.187194+0000","last_undegraded":"2024-04-24T23:40:10.187194+0000","last_fullsized":"2024-04-24T23:40:10.187194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-04-24T23:40:10.187009+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-04-24T23:40:10.187009+0000","last_clean_scrub_stamp":"2024-04-24T23:40:10.187009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:18:41.297396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:11.618396+0000","last_change":"2024-04-24T23:40:11.618492+0000","last_active":"2024-04-24T23:40:11.618396+0000","last_peered":"2024-04-24T23:40:11.618396+0000","last_clean":"2024-04-24T23:40:11.618396+0000","last_became_active":"2024-04-24T23:38:34.146909+0000","last_became_peered":"2024-04-24T23:38:34.146909+0000","last_unstale":"2024-04-24T23:40:11.618396+0000","last_undegraded":"2024-04-24T23:40:11.618396+0000","last_fullsized":"2024-04-24T23:40:11.618396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:11.618194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:11.618194+0000","last_clean_scrub_stamp":"2024-04-24T23:40:11.618194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:40.326352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:14.613967+0000","last_change":"2024-04-24T23:40:14.614025+0000","last_active":"2024-04-24T23:40:14.613967+0000","last_peered":"2024-04-24T23:40:14.613967+0000","last_clean":"2024-04-24T23:40:14.613967+0000","last_became_active":"2024-04-24T23:38:38.215395+0000","last_became_peered":"2024-04-24T23:38:38.215395+0000","last_unstale":"2024-04-24T23:40:14.613967+0000","last_undegraded":"2024-04-24T23:40:14.613967+0000","last_fullsized":"2024-04-24T23:40:14.613967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:14.613773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:14.613773+0000","last_clean_scrub_stamp":"2024-04-24T23:40:14.613773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:58:16.075183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:15.361423+0000","last_change":"2024-04-24T23:40:15.361484+0000","last_active":"2024-04-24T23:40:15.361423+0000","last_peered":"2024-04-24T23:40:15.361423+0000","last_clean":"2024-04-24T23:40:15.361423+0000","last_became_active":"2024-04-24T23:38:33.131314+0000","last_became_peered":"2024-04-24T23:38:33.131314+0000","last_unstale":"2024-04-24T23:40:15.361423+0000","last_undegraded":"2024-04-24T23:40:15.361423+0000","last_fullsized":"2024-04-24T23:40:15.361423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-04-24T23:40:15.361191+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-04-24T23:40:15.361191+0000","last_clean_scrub_stamp":"2024-04-24T23:40:15.361191+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:44:28.287220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:11.747338+0000","last_change":"2024-04-24T23:40:11.747394+0000","last_active":"2024-04-24T23:40:11.747338+0000","last_peered":"2024-04-24T23:40:11.747338+0000","last_clean":"2024-04-24T23:40:11.747338+0000","last_became_active":"2024-04-24T23:38:34.149910+0000","last_became_peered":"2024-04-24T23:38:34.149910+0000","last_unstale":"2024-04-24T23:40:11.747338+0000","last_undegraded":"2024-04-24T23:40:11.747338+0000","last_fullsized":"2024-04-24T23:40:11.747338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:11.747152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:11.747152+0000","last_clean_scrub_stamp":"2024-04-24T23:40:11.747152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:57:17.168848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:23.438235+0000","last_change":"2024-04-24T23:40:23.438358+0000","last_active":"2024-04-24T23:40:23.438235+0000","last_peered":"2024-04-24T23:40:23.438235+0000","last_clean":"2024-04-24T23:40:23.438235+0000","last_became_active":"2024-04-24T23:38:38.219100+0000","last_became_peered":"2024-04-24T23:38:38.219100+0000","last_unstale":"2024-04-24T23:40:23.438235+0000","last_undegraded":"2024-04-24T23:40:23.438235+0000","last_fullsized":"2024-04-24T23:40:23.438235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:23.437990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:23.437990+0000","last_clean_scrub_stamp":"2024-04-24T23:40:23.437990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:04:14.614443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:20.253277+0000","last_change":"2024-04-24T23:40:20.253277+0000","last_active":"2024-04-24T23:40:20.253277+0000","last_peered":"2024-04-24T23:40:20.253277+0000","last_clean":"2024-04-24T23:40:20.253277+0000","last_became_active":"2024-04-24T23:38:34.159701+0000","last_became_peered":"2024-04-24T23:38:34.159701+0000","last_unstale":"2024-04-24T23:40:20.253277+0000","last_undegraded":"2024-04-24T23:40:20.253277+0000","last_fullsized":"2024-04-24T23:40:20.253277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:20.252997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:20.252997+0000","last_clean_scrub_stamp":"2024-04-24T23:40:20.252997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:46:29.012276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:12.578907+0000","last_change":"2024-04-24T23:40:12.578907+0000","last_active":"2024-04-24T23:40:12.578907+0000","last_peered":"2024-04-24T23:40:12.578907+0000","last_clean":"2024-04-24T23:40:12.578907+0000","last_became_active":"2024-04-24T23:38:34.155969+0000","last_became_peered":"2024-04-24T23:38:34.155969+0000","last_unstale":"2024-04-24T23:40:12.578907+0000","last_undegraded":"2024-04-24T23:40:12.578907+0000","last_fullsized":"2024-04-24T23:40:12.578907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:12.578639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:12.578639+0000","last_clean_scrub_stamp":"2024-04-24T23:40:12.578639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:40:25.484800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:22.025162+0000","last_change":"2024-04-24T23:40:22.025162+0000","last_active":"2024-04-24T23:40:22.025162+0000","last_peered":"2024-04-24T23:40:22.025162+0000","last_clean":"2024-04-24T23:40:22.025162+0000","last_became_active":"2024-04-24T23:38:34.186332+0000","last_became_peered":"2024-04-24T23:38:34.186332+0000","last_unstale":"2024-04-24T23:40:22.025162+0000","last_undegraded":"2024-04-24T23:40:22.025162+0000","last_fullsized":"2024-04-24T23:40:22.025162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:22.024817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:22.024817+0000","last_clean_scrub_stamp":"2024-04-24T23:40:22.024817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:58.211445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:13.639111+0000","last_change":"2024-04-24T23:40:13.639111+0000","last_active":"2024-04-24T23:40:13.639111+0000","last_peered":"2024-04-24T23:40:13.639111+0000","last_clean":"2024-04-24T23:40:13.639111+0000","last_became_active":"2024-04-24T23:38:34.147038+0000","last_became_peered":"2024-04-24T23:38:34.147038+0000","last_unstale":"2024-04-24T23:40:13.639111+0000","last_undegraded":"2024-04-24T23:40:13.639111+0000","last_fullsized":"2024-04-24T23:40:13.639111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:13.638745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:13.638745+0000","last_clean_scrub_stamp":"2024-04-24T23:40:13.638745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:53.538110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:18.368756+0000","last_change":"2024-04-24T23:40:18.368756+0000","last_active":"2024-04-24T23:40:18.368756+0000","last_peered":"2024-04-24T23:40:18.368756+0000","last_clean":"2024-04-24T23:40:18.368756+0000","last_became_active":"2024-04-24T23:38:34.163761+0000","last_became_peered":"2024-04-24T23:38:34.163761+0000","last_unstale":"2024-04-24T23:40:18.368756+0000","last_undegraded":"2024-04-24T23:40:18.368756+0000","last_fullsized":"2024-04-24T23:40:18.368756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:18.368512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:18.368512+0000","last_clean_scrub_stamp":"2024-04-24T23:40:18.368512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:23:15.311089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:23.814840+0000","last_change":"2024-04-24T23:40:23.814840+0000","last_active":"2024-04-24T23:40:23.814840+0000","last_peered":"2024-04-24T23:40:23.814840+0000","last_clean":"2024-04-24T23:40:23.814840+0000","last_became_active":"2024-04-24T23:39:22.828227+0000","last_became_peered":"2024-04-24T23:39:22.828227+0000","last_unstale":"2024-04-24T23:40:23.814840+0000","last_undegraded":"2024-04-24T23:40:23.814840+0000","last_fullsized":"2024-04-24T23:40:23.814840+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:23.814607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:23.814607+0000","last_clean_scrub_stamp":"2024-04-24T23:40:23.814607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:11:00.001235+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:21.208121+0000","last_change":"2024-04-24T23:40:21.208121+0000","last_active":"2024-04-24T23:40:21.208121+0000","last_peered":"2024-04-24T23:40:21.208121+0000","last_clean":"2024-04-24T23:40:21.208121+0000","last_became_active":"2024-04-24T23:38:34.178651+0000","last_became_peered":"2024-04-24T23:38:34.178651+0000","last_unstale":"2024-04-24T23:40:21.208121+0000","last_undegraded":"2024-04-24T23:40:21.208121+0000","last_fullsized":"2024-04-24T23:40:21.208121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:21.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:21.207870+0000","last_clean_scrub_stamp":"2024-04-24T23:40:21.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:36.948476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:16.350828+0000","last_change":"2024-04-24T23:40:16.350828+0000","last_active":"2024-04-24T23:40:16.350828+0000","last_peered":"2024-04-24T23:40:16.350828+0000","last_clean":"2024-04-24T23:40:16.350828+0000","last_became_active":"2024-04-24T23:38:34.162156+0000","last_became_peered":"2024-04-24T23:38:34.162156+0000","last_unstale":"2024-04-24T23:40:16.350828+0000","last_undegraded":"2024-04-24T23:40:16.350828+0000","last_fullsized":"2024-04-24T23:40:16.350828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:16.350596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:16.350596+0000","last_clean_scrub_stamp":"2024-04-24T23:40:16.350596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:33:30.114956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:10.996307+0000","last_change":"2024-04-24T23:40:10.996307+0000","last_active":"2024-04-24T23:40:10.996307+0000","last_peered":"2024-04-24T23:40:10.996307+0000","last_clean":"2024-04-24T23:40:10.996307+0000","last_became_active":"2024-04-24T23:38:34.184827+0000","last_became_peered":"2024-04-24T23:38:34.184827+0000","last_unstale":"2024-04-24T23:40:10.996307+0000","last_undegraded":"2024-04-24T23:40:10.996307+0000","last_fullsized":"2024-04-24T23:40:10.996307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:10.996085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:10.996085+0000","last_clean_scrub_stamp":"2024-04-24T23:40:10.996085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:39.704243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:12.335821+0000","last_change":"2024-04-24T23:40:12.335874+0000","last_active":"2024-04-24T23:40:12.335821+0000","last_peered":"2024-04-24T23:40:12.335821+0000","last_clean":"2024-04-24T23:40:12.335821+0000","last_became_active":"2024-04-24T23:38:34.165531+0000","last_became_peered":"2024-04-24T23:38:34.165531+0000","last_unstale":"2024-04-24T23:40:12.335821+0000","last_undegraded":"2024-04-24T23:40:12.335821+0000","last_fullsized":"2024-04-24T23:40:12.335821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:12.335621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:12.335621+0000","last_clean_scrub_stamp":"2024-04-24T23:40:12.335621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:48:46.683741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:23.063564+0000","last_change":"2024-04-24T23:40:23.063619+0000","last_active":"2024-04-24T23:40:23.063564+0000","last_peered":"2024-04-24T23:40:23.063564+0000","last_clean":"2024-04-24T23:40:23.063564+0000","last_became_active":"2024-04-24T23:38:34.199173+0000","last_became_peered":"2024-04-24T23:38:34.199173+0000","last_unstale":"2024-04-24T23:40:23.063564+0000","last_undegraded":"2024-04-24T23:40:23.063564+0000","last_fullsized":"2024-04-24T23:40:23.063564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:23.063370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:23.063370+0000","last_clean_scrub_stamp":"2024-04-24T23:40:23.063370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:52:38.158907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:16.549595+0000","last_change":"2024-04-24T23:40:16.549654+0000","last_active":"2024-04-24T23:40:16.549595+0000","last_peered":"2024-04-24T23:40:16.549595+0000","last_clean":"2024-04-24T23:40:16.549595+0000","last_became_active":"2024-04-24T23:38:34.165000+0000","last_became_peered":"2024-04-24T23:38:34.165000+0000","last_unstale":"2024-04-24T23:40:16.549595+0000","last_undegraded":"2024-04-24T23:40:16.549595+0000","last_fullsized":"2024-04-24T23:40:16.549595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:16.549427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:16.549427+0000","last_clean_scrub_stamp":"2024-04-24T23:40:16.549427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:32.290034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:16.214999+0000","last_change":"2024-04-24T23:40:16.215051+0000","last_active":"2024-04-24T23:40:16.214999+0000","last_peered":"2024-04-24T23:40:16.214999+0000","last_clean":"2024-04-24T23:40:16.214999+0000","last_became_active":"2024-04-24T23:38:34.146096+0000","last_became_peered":"2024-04-24T23:38:34.146096+0000","last_unstale":"2024-04-24T23:40:16.214999+0000","last_undegraded":"2024-04-24T23:40:16.214999+0000","last_fullsized":"2024-04-24T23:40:16.214999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:16.214792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:16.214792+0000","last_clean_scrub_stamp":"2024-04-24T23:40:16.214792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:55.114272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:21.168564+0000","last_change":"2024-04-24T23:40:21.168629+0000","last_active":"2024-04-24T23:40:21.168564+0000","last_peered":"2024-04-24T23:40:21.168564+0000","last_clean":"2024-04-24T23:40:21.168564+0000","last_became_active":"2024-04-24T23:38:34.177451+0000","last_became_peered":"2024-04-24T23:38:34.177451+0000","last_unstale":"2024-04-24T23:40:21.168564+0000","last_undegraded":"2024-04-24T23:40:21.168564+0000","last_fullsized":"2024-04-24T23:40:21.168564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:21.168350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:21.168350+0000","last_clean_scrub_stamp":"2024-04-24T23:40:21.168350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:05.191438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:13.602979+0000","last_change":"2024-04-24T23:40:13.603079+0000","last_active":"2024-04-24T23:40:13.602979+0000","last_peered":"2024-04-24T23:40:13.602979+0000","last_clean":"2024-04-24T23:40:13.602979+0000","last_became_active":"2024-04-24T23:38:34.159252+0000","last_became_peered":"2024-04-24T23:38:34.159252+0000","last_unstale":"2024-04-24T23:40:13.602979+0000","last_undegraded":"2024-04-24T23:40:13.602979+0000","last_fullsized":"2024-04-24T23:40:13.602979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:13.602733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:13.602733+0000","last_clean_scrub_stamp":"2024-04-24T23:40:13.602733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:57:19.024430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:24.993035+0000","last_change":"2024-04-24T23:40:24.993088+0000","last_active":"2024-04-24T23:40:24.993035+0000","last_peered":"2024-04-24T23:40:24.993035+0000","last_clean":"2024-04-24T23:40:24.993035+0000","last_became_active":"2024-04-24T23:38:34.199464+0000","last_became_peered":"2024-04-24T23:38:34.199464+0000","last_unstale":"2024-04-24T23:40:24.993035+0000","last_undegraded":"2024-04-24T23:40:24.993035+0000","last_fullsized":"2024-04-24T23:40:24.993035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:24.992851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:24.992851+0000","last_clean_scrub_stamp":"2024-04-24T23:40:24.992851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:12.414905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'1","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:20.000603+0000","last_change":"2024-04-24T23:40:20.000723+0000","last_active":"2024-04-24T23:40:20.000603+0000","last_peered":"2024-04-24T23:40:20.000603+0000","last_clean":"2024-04-24T23:40:20.000603+0000","last_became_active":"2024-04-24T23:38:34.181459+0000","last_became_peered":"2024-04-24T23:38:34.181459+0000","last_unstale":"2024-04-24T23:40:20.000603+0000","last_undegraded":"2024-04-24T23:40:20.000603+0000","last_fullsized":"2024-04-24T23:40:20.000603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1","last_scrub_stamp":"2024-04-24T23:40:20.000384+0000","last_deep_scrub":"26'1","last_deep_scrub_stamp":"2024-04-24T23:40:20.000384+0000","last_clean_scrub_stamp":"2024-04-24T23:40:20.000384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:35:25.404585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:15.752264+0000","last_change":"2024-04-24T23:40:15.752318+0000","last_active":"2024-04-24T23:40:15.752264+0000","last_peered":"2024-04-24T23:40:15.752264+0000","last_clean":"2024-04-24T23:40:15.752264+0000","last_became_active":"2024-04-24T23:38:34.149272+0000","last_became_peered":"2024-04-24T23:38:34.149272+0000","last_unstale":"2024-04-24T23:40:15.752264+0000","last_undegraded":"2024-04-24T23:40:15.752264+0000","last_fullsized":"2024-04-24T23:40:15.752264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:15.752055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:15.752055+0000","last_clean_scrub_stamp":"2024-04-24T23:40:15.752055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:46:24.511333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:14.598172+0000","last_change":"2024-04-24T23:40:14.598231+0000","last_active":"2024-04-24T23:40:14.598172+0000","last_peered":"2024-04-24T23:40:14.598172+0000","last_clean":"2024-04-24T23:40:14.598172+0000","last_became_active":"2024-04-24T23:38:34.153683+0000","last_became_peered":"2024-04-24T23:38:34.153683+0000","last_unstale":"2024-04-24T23:40:14.598172+0000","last_undegraded":"2024-04-24T23:40:14.598172+0000","last_fullsized":"2024-04-24T23:40:14.598172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:14.597971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:14.597971+0000","last_clean_scrub_stamp":"2024-04-24T23:40:14.597971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:48:48.946092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:10.332883+0000","last_change":"2024-04-24T23:40:10.332904+0000","last_active":"2024-04-24T23:40:10.332883+0000","last_peered":"2024-04-24T23:40:10.332883+0000","last_clean":"2024-04-24T23:40:10.332883+0000","last_became_active":"2024-04-24T23:38:34.165764+0000","last_became_peered":"2024-04-24T23:38:34.165764+0000","last_unstale":"2024-04-24T23:40:10.332883+0000","last_undegraded":"2024-04-24T23:40:10.332883+0000","last_fullsized":"2024-04-24T23:40:10.332883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:10.332799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:10.332799+0000","last_clean_scrub_stamp":"2024-04-24T23:40:10.332799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:28:51.444231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:10.791361+0000","last_change":"2024-04-24T23:40:10.791417+0000","last_active":"2024-04-24T23:40:10.791361+0000","last_peered":"2024-04-24T23:40:10.791361+0000","last_clean":"2024-04-24T23:40:10.791361+0000","last_became_active":"2024-04-24T23:38:34.141699+0000","last_became_peered":"2024-04-24T23:38:34.141699+0000","last_unstale":"2024-04-24T23:40:10.791361+0000","last_undegraded":"2024-04-24T23:40:10.791361+0000","last_fullsized":"2024-04-24T23:40:10.791361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:10.791199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:10.791199+0000","last_clean_scrub_stamp":"2024-04-24T23:40:10.791199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:40:23.697360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:17.204725+0000","last_change":"2024-04-24T23:40:17.204792+0000","last_active":"2024-04-24T23:40:17.204725+0000","last_peered":"2024-04-24T23:40:17.204725+0000","last_clean":"2024-04-24T23:40:17.204725+0000","last_became_active":"2024-04-24T23:38:34.155106+0000","last_became_peered":"2024-04-24T23:38:34.155106+0000","last_unstale":"2024-04-24T23:40:17.204725+0000","last_undegraded":"2024-04-24T23:40:17.204725+0000","last_fullsized":"2024-04-24T23:40:17.204725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:17.204526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:17.204526+0000","last_clean_scrub_stamp":"2024-04-24T23:40:17.204526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:28:58.315958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:18.237211+0000","last_change":"2024-04-24T23:40:18.237270+0000","last_active":"2024-04-24T23:40:18.237211+0000","last_peered":"2024-04-24T23:40:18.237211+0000","last_clean":"2024-04-24T23:40:18.237211+0000","last_became_active":"2024-04-24T23:38:34.156452+0000","last_became_peered":"2024-04-24T23:38:34.156452+0000","last_unstale":"2024-04-24T23:40:18.237211+0000","last_undegraded":"2024-04-24T23:40:18.237211+0000","last_fullsized":"2024-04-24T23:40:18.237211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:18.237022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:18.237022+0000","last_clean_scrub_stamp":"2024-04-24T23:40:18.237022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:58.136387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:28.232356+0000","last_change":"2024-04-24T23:40:28.232406+0000","last_active":"2024-04-24T23:40:28.232356+0000","last_peered":"2024-04-24T23:40:28.232356+0000","last_clean":"2024-04-24T23:40:28.232356+0000","last_became_active":"2024-04-24T23:39:22.830955+0000","last_became_peered":"2024-04-24T23:39:22.830955+0000","last_unstale":"2024-04-24T23:40:28.232356+0000","last_undegraded":"2024-04-24T23:40:28.232356+0000","last_fullsized":"2024-04-24T23:40:28.232356+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:28.232181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:28.232181+0000","last_clean_scrub_stamp":"2024-04-24T23:40:28.232181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:15.654236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:11.359445+0000","last_change":"2024-04-24T23:40:11.359496+0000","last_active":"2024-04-24T23:40:11.359445+0000","last_peered":"2024-04-24T23:40:11.359445+0000","last_clean":"2024-04-24T23:40:11.359445+0000","last_became_active":"2024-04-24T23:38:34.184367+0000","last_became_peered":"2024-04-24T23:38:34.184367+0000","last_unstale":"2024-04-24T23:40:11.359445+0000","last_undegraded":"2024-04-24T23:40:11.359445+0000","last_fullsized":"2024-04-24T23:40:11.359445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:11.359272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:11.359272+0000","last_clean_scrub_stamp":"2024-04-24T23:40:11.359272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:51.258637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:12.305030+0000","last_change":"2024-04-24T23:40:12.305136+0000","last_active":"2024-04-24T23:40:12.305030+0000","last_peered":"2024-04-24T23:40:12.305030+0000","last_clean":"2024-04-24T23:40:12.305030+0000","last_became_active":"2024-04-24T23:38:34.165882+0000","last_became_peered":"2024-04-24T23:38:34.165882+0000","last_unstale":"2024-04-24T23:40:12.305030+0000","last_undegraded":"2024-04-24T23:40:12.305030+0000","last_fullsized":"2024-04-24T23:40:12.305030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:12.304821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:12.304821+0000","last_clean_scrub_stamp":"2024-04-24T23:40:12.304821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:11.485594+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:12.018948+0000","last_change":"2024-04-24T23:40:12.019007+0000","last_active":"2024-04-24T23:40:12.018948+0000","last_peered":"2024-04-24T23:40:12.018948+0000","last_clean":"2024-04-24T23:40:12.018948+0000","last_became_active":"2024-04-24T23:38:34.183652+0000","last_became_peered":"2024-04-24T23:38:34.183652+0000","last_unstale":"2024-04-24T23:40:12.018948+0000","last_undegraded":"2024-04-24T23:40:12.018948+0000","last_fullsized":"2024-04-24T23:40:12.018948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:12.018727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:12.018727+0000","last_clean_scrub_stamp":"2024-04-24T23:40:12.018727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:11:28.853479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:22.169768+0000","last_change":"2024-04-24T23:40:22.169827+0000","last_active":"2024-04-24T23:40:22.169768+0000","last_peered":"2024-04-24T23:40:22.169768+0000","last_clean":"2024-04-24T23:40:22.169768+0000","last_became_active":"2024-04-24T23:38:34.165931+0000","last_became_peered":"2024-04-24T23:38:34.165931+0000","last_unstale":"2024-04-24T23:40:22.169768+0000","last_undegraded":"2024-04-24T23:40:22.169768+0000","last_fullsized":"2024-04-24T23:40:22.169768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:22.169589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:22.169589+0000","last_clean_scrub_stamp":"2024-04-24T23:40:22.169589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:23:19.112166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:15.642771+0000","last_change":"2024-04-24T23:40:15.642827+0000","last_active":"2024-04-24T23:40:15.642771+0000","last_peered":"2024-04-24T23:40:15.642771+0000","last_clean":"2024-04-24T23:40:15.642771+0000","last_became_active":"2024-04-24T23:39:22.825554+0000","last_became_peered":"2024-04-24T23:39:22.825554+0000","last_unstale":"2024-04-24T23:40:15.642771+0000","last_undegraded":"2024-04-24T23:40:15.642771+0000","last_fullsized":"2024-04-24T23:40:15.642771+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:15.642565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:15.642565+0000","last_clean_scrub_stamp":"2024-04-24T23:40:15.642565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:05:06.802505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:12.623789+0000","last_change":"2024-04-24T23:40:12.623789+0000","last_active":"2024-04-24T23:40:12.623789+0000","last_peered":"2024-04-24T23:40:12.623789+0000","last_clean":"2024-04-24T23:40:12.623789+0000","last_became_active":"2024-04-24T23:38:34.148402+0000","last_became_peered":"2024-04-24T23:38:34.148402+0000","last_unstale":"2024-04-24T23:40:12.623789+0000","last_undegraded":"2024-04-24T23:40:12.623789+0000","last_fullsized":"2024-04-24T23:40:12.623789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:12.623558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:12.623558+0000","last_clean_scrub_stamp":"2024-04-24T23:40:12.623558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:28:53.734990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:16.779118+0000","last_change":"2024-04-24T23:40:16.779118+0000","last_active":"2024-04-24T23:40:16.779118+0000","last_peered":"2024-04-24T23:40:16.779118+0000","last_clean":"2024-04-24T23:40:16.779118+0000","last_became_active":"2024-04-24T23:38:34.150987+0000","last_became_peered":"2024-04-24T23:38:34.150987+0000","last_unstale":"2024-04-24T23:40:16.779118+0000","last_undegraded":"2024-04-24T23:40:16.779118+0000","last_fullsized":"2024-04-24T23:40:16.779118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:16.778890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:16.778890+0000","last_clean_scrub_stamp":"2024-04-24T23:40:16.778890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:32.519497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-24T23:40:26.284912+0000","last_change":"2024-04-24T23:40:26.284912+0000","last_active":"2024-04-24T23:40:26.284912+0000","last_peered":"2024-04-24T23:40:26.284912+0000","last_clean":"2024-04-24T23:40:26.284912+0000","last_became_active":"2024-04-24T23:38:34.194195+0000","last_became_peered":"2024-04-24T23:38:34.194195+0000","last_unstale":"2024-04-24T23:40:26.284912+0000","last_undegraded":"2024-04-24T23:40:26.284912+0000","last_fullsized":"2024-04-24T23:40:26.284912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:40:26.284603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:40:26.284603+0000","last_clean_scrub_stamp":"2024-04-24T23:40:26.284603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:52:41.380140+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":10368,"num_write":165,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40216,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":83,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":80432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67594,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31516,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":348160,"data_stored":705319,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":327680,"data_stored":153678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":114459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":290816,"data_stored":114495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31500,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340340,"statfs":{"total":96636764160,"available":96604508160,"internally_reserved":0,"allocated":331776,"data_stored":153787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":282624,"data_stored":114478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":114529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":356352,"data_stored":705375,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33797,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":39418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":39309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:40:51.679 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-24T23:40:51.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.844+0000 7f430b667640 1 Processor -- start 2024-04-24T23:40:51.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.844+0000 7f430b667640 1 -- start start 2024-04-24T23:40:51.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.844+0000 7f430b667640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f430414deb0 0x7f43040c2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:51.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.844+0000 7f430b667640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f43040b8660 0x7f430415b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:51.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.844+0000 7f430b667640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4304151270 con 0x7f43040c3490 2024-04-24T23:40:51.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.844+0000 7f430b667640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f43040c0a90 con 0x7f430414deb0 2024-04-24T23:40:51.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.844+0000 7f430b667640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f43040c0d70 con 0x7f43040b8660 2024-04-24T23:40:51.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.844+0000 7f4309403640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f430414deb0 0x7f43040c2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:51.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.844+0000 7f4309403640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f430414deb0 0x7f43040c2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44846/0 (socket says 172.21.15.57:44846) 2024-04-24T23:40:51.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.844+0000 7f4309403640 1 -- 172.21.15.57:0/3949508051 learned_addr learned my addr 172.21.15.57:0/3949508051 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:51.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.844+0000 7f4309c04640 1 --2- 172.21.15.57:0/3949508051 >> v2:172.21.15.88:3300/0 conn(0x7f43040b8660 0x7f430415b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:51.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.844+0000 7f4309403640 1 -- 172.21.15.57:0/3949508051 >> v2:172.21.15.88:3300/0 conn(0x7f43040b8660 msgr2=0x7f430415b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:51.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.844+0000 7f4309403640 1 --2- 172.21.15.57:0/3949508051 >> v2:172.21.15.88:3300/0 conn(0x7f43040b8660 0x7f430415b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:51.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.844+0000 7f4309403640 1 -- 172.21.15.57:0/3949508051 >> v1:172.21.15.88:6789/0 conn(0x7f43040c3490 legacy=0x7f43040c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:51.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.844+0000 7f4309403640 1 -- 172.21.15.57:0/3949508051 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4304151550 con 0x7f430414deb0 2024-04-24T23:40:51.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.848+0000 7f4309403640 1 --2- 172.21.15.57:0/3949508051 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f430414deb0 0x7f43040c2f50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f43040c71a0 tx=0x7f430001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53f8e5aaa379ff84 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:51.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.848+0000 7f42fbfff640 1 -- 172.21.15.57:0/3949508051 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43000b5070 con 0x7f430414deb0 2024-04-24T23:40:51.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.848+0000 7f42fbfff640 1 -- 172.21.15.57:0/3949508051 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43000a8a10 con 0x7f430414deb0 2024-04-24T23:40:51.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.848+0000 7f42fbfff640 1 -- 172.21.15.57:0/3949508051 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43000a8de0 con 0x7f430414deb0 2024-04-24T23:40:51.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.848+0000 7f430b667640 1 -- 172.21.15.57:0/3949508051 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f430414deb0 msgr2=0x7f43040c2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:51.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.848+0000 7f430b667640 1 --2- 172.21.15.57:0/3949508051 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f430414deb0 0x7f43040c2f50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f43040c71a0 tx=0x7f430001ed10 comp rx=0 tx=0).stop 2024-04-24T23:40:51.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.848+0000 7f430b667640 1 -- 172.21.15.57:0/3949508051 shutdown_connections 2024-04-24T23:40:51.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.848+0000 7f430b667640 1 --2- 172.21.15.57:0/3949508051 >> v2:172.21.15.88:3300/0 conn(0x7f43040b8660 0x7f430415b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:51.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.848+0000 7f430b667640 1 --2- 172.21.15.57:0/3949508051 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f430414deb0 0x7f43040c2f50 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:51.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.848+0000 7f430b667640 1 -- 172.21.15.57:0/3949508051 >> 172.21.15.57:0/3949508051 conn(0x7f4304067120 msgr2=0x7f4304067530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:51.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.848+0000 7f430b667640 1 -- 172.21.15.57:0/3949508051 shutdown_connections 2024-04-24T23:40:51.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.848+0000 7f430b667640 1 -- 172.21.15.57:0/3949508051 wait complete. 2024-04-24T23:40:51.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.848+0000 7f430b667640 1 Processor -- start 2024-04-24T23:40:51.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.848+0000 7f430b667640 1 -- start start 2024-04-24T23:40:51.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.852+0000 7f430b667640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43040b8660 0x7f43041db280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:51.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.852+0000 7f430b667640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43040c3490 0x7f4304153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:51.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.852+0000 7f430b667640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f430414deb0 0x7f43040bdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:51.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.852+0000 7f430b667640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f43040c1910 con 0x7f43040c3490 2024-04-24T23:40:51.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.852+0000 7f430b667640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f430414e290 con 0x7f430414deb0 2024-04-24T23:40:51.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.852+0000 7f430b667640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f43040b91f0 con 0x7f43040b8660 2024-04-24T23:40:51.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.852+0000 7f4308c02640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43040c3490 0x7f4304153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:51.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.852+0000 7f4308c02640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43040c3490 0x7f4304153ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44858/0 (socket says 172.21.15.57:44858) 2024-04-24T23:40:51.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.852+0000 7f4308c02640 1 -- 172.21.15.57:0/640052287 learned_addr learned my addr 172.21.15.57:0/640052287 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:51.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.852+0000 7f4309403640 1 --2- 172.21.15.57:0/640052287 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43040b8660 0x7f43041db280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:51.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.852+0000 7f4309c04640 1 --2- 172.21.15.57:0/640052287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f430414deb0 0x7f43040bdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:51.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.852+0000 7f4308c02640 1 -- 172.21.15.57:0/640052287 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43040b8660 msgr2=0x7f43041db280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:51.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.852+0000 7f4308c02640 1 --2- 172.21.15.57:0/640052287 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43040b8660 0x7f43041db280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:51.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.852+0000 7f4308c02640 1 -- 172.21.15.57:0/640052287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f430414deb0 msgr2=0x7f43040bdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:51.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.852+0000 7f4308c02640 1 --2- 172.21.15.57:0/640052287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f430414deb0 0x7f43040bdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:51.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.852+0000 7f4308c02640 1 -- 172.21.15.57:0/640052287 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4304154530 con 0x7f43040c3490 2024-04-24T23:40:51.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.852+0000 7f4308c02640 1 --2- 172.21.15.57:0/640052287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43040c3490 0x7f4304153ff0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f42f400c460 tx=0x7f42f400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:51.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.852+0000 7f42f9ffb640 1 -- 172.21.15.57:0/640052287 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f4016020 con 0x7f43040c3490 2024-04-24T23:40:51.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.852+0000 7f42f9ffb640 1 -- 172.21.15.57:0/640052287 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f40052d0 con 0x7f43040c3490 2024-04-24T23:40:51.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.852+0000 7f42f9ffb640 1 -- 172.21.15.57:0/640052287 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f4007260 con 0x7f43040c3490 2024-04-24T23:40:51.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.852+0000 7f430b667640 1 -- 172.21.15.57:0/640052287 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f430414a910 con 0x7f43040c3490 2024-04-24T23:40:51.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.852+0000 7f430b667640 1 -- 172.21.15.57:0/640052287 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43041da2f0 con 0x7f43040c3490 2024-04-24T23:40:51.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.852+0000 7f430b667640 1 -- 172.21.15.57:0/640052287 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4304068290 con 0x7f43040c3490 2024-04-24T23:40:51.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.852+0000 7f42f9ffb640 1 -- 172.21.15.57:0/640052287 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f42f4007400 con 0x7f43040c3490 2024-04-24T23:40:51.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.852+0000 7f42f9ffb640 1 --2- 172.21.15.57:0/640052287 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f42e80678c0 0x7f42e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:51.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.852+0000 7f42f9ffb640 1 -- 172.21.15.57:0/640052287 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f42f4085980 con 0x7f43040c3490 2024-04-24T23:40:51.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.852+0000 7f4309403640 1 --2- 172.21.15.57:0/640052287 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f42e80678c0 0x7f42e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:51.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.856+0000 7f4309403640 1 --2- 172.21.15.57:0/640052287 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f42e80678c0 0x7f42e8069d80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f43000b2000 tx=0x7f4300008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:51.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:51.856+0000 7f42f9ffb640 1 -- 172.21.15.57:0/640052287 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f42f4020020 con 0x7f43040c3490 2024-04-24T23:40:52.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.020+0000 7f430b667640 1 -- 172.21.15.57:0/640052287 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f43040c23d0 con 0x7f43040c3490 2024-04-24T23:40:52.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.028+0000 7f42f9ffb640 1 -- 172.21.15.57:0/640052287 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f42f4005480 con 0x7f43040c3490 2024-04-24T23:40:52.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.032+0000 7f42f9ffb640 1 -- 172.21.15.57:0/640052287 <== mon.0 v2:172.21.15.57:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f42f4055a50 con 0x7f43040c3490 2024-04-24T23:40:52.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.032+0000 7f430b667640 1 -- 172.21.15.57:0/640052287 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f42e80678c0 msgr2=0x7f42e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:52.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.032+0000 7f430b667640 1 --2- 172.21.15.57:0/640052287 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f42e80678c0 0x7f42e8069d80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f43000b2000 tx=0x7f4300008040 comp rx=0 tx=0).stop 2024-04-24T23:40:52.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.032+0000 7f430b667640 1 -- 172.21.15.57:0/640052287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43040c3490 msgr2=0x7f4304153ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:52.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.032+0000 7f430b667640 1 --2- 172.21.15.57:0/640052287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43040c3490 0x7f4304153ff0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f42f400c460 tx=0x7f42f400c920 comp rx=0 tx=0).stop 2024-04-24T23:40:52.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.032+0000 7f430b667640 1 -- 172.21.15.57:0/640052287 shutdown_connections 2024-04-24T23:40:52.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.032+0000 7f430b667640 1 --2- 172.21.15.57:0/640052287 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f42e80678c0 0x7f42e8069d80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.032+0000 7f430b667640 1 --2- 172.21.15.57:0/640052287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f430414deb0 0x7f43040bdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.032+0000 7f430b667640 1 --2- 172.21.15.57:0/640052287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43040c3490 0x7f4304153ff0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.032+0000 7f430b667640 1 --2- 172.21.15.57:0/640052287 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43040b8660 0x7f43041db280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.032+0000 7f430b667640 1 -- 172.21.15.57:0/640052287 >> 172.21.15.57:0/640052287 conn(0x7f4304067120 msgr2=0x7f43040ba410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:52.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.032+0000 7f430b667640 1 -- 172.21.15.57:0/640052287 shutdown_connections 2024-04-24T23:40:52.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.032+0000 7f430b667640 1 -- 172.21.15.57:0/640052287 wait complete. 2024-04-24T23:40:52.049 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-24T23:40:52.050 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:40:52.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61c3a65640 1 Processor -- start 2024-04-24T23:40:52.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61c3a65640 1 -- start start 2024-04-24T23:40:52.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61c3a65640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f61bc14bc60 0x7f61bc06eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:52.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61c3a65640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61bc14e8e0 con 0x7f61bc0bdbe0 2024-04-24T23:40:52.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61c3a65640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61bc14ebc0 con 0x7f61bc06f090 2024-04-24T23:40:52.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61c3a65640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f61bc152c20 con 0x7f61bc14bc60 2024-04-24T23:40:52.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61c2002640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f61bc0bdbe0 0x7f61bc159050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:50648/0 (socket says 172.21.15.57:50648) 2024-04-24T23:40:52.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61c2002640 1 -- 172.21.15.57:0/1714321621 learned_addr learned my addr 172.21.15.57:0/1714321621 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:40:52.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61c1801640 1 --2- 172.21.15.57:0/1714321621 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f61bc14bc60 0x7f61bc06eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:52.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61b3fff640 1 -- 172.21.15.57:0/1714321621 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 895041527 0 0) 0x7f61bc14e8e0 con 0x7f61bc0bdbe0 2024-04-24T23:40:52.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61b3fff640 1 -- 172.21.15.57:0/1714321621 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61a8003530 con 0x7f61bc0bdbe0 2024-04-24T23:40:52.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61b3fff640 1 -- 172.21.15.57:0/1714321621 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3367851951 0 0) 0x7f61a8003530 con 0x7f61bc0bdbe0 2024-04-24T23:40:52.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61b3fff640 1 -- 172.21.15.57:0/1714321621 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f61bc14bc60 msgr2=0x7f61bc06eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:52.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61b3fff640 1 --2- 172.21.15.57:0/1714321621 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f61bc14bc60 0x7f61bc06eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61b3fff640 1 -- 172.21.15.57:0/1714321621 >> v1:172.21.15.88:6789/0 conn(0x7f61bc06f090 legacy=0x7f61bc0b6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:52.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61b3fff640 1 -- 172.21.15.57:0/1714321621 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61bc0b76e0 con 0x7f61bc0bdbe0 2024-04-24T23:40:52.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61b3fff640 1 -- 172.21.15.57:0/1714321621 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7f61b4001a00 con 0x7f61bc0bdbe0 2024-04-24T23:40:52.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61b3fff640 1 -- 172.21.15.57:0/1714321621 >> v1:172.21.15.57:6789/0 conn(0x7f61bc0bdbe0 legacy=0x7f61bc159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:52.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61b3fff640 1 --2- 172.21.15.57:0/1714321621 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61a80039f0 0x7f61a8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:52.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61b3fff640 1 --2- 172.21.15.57:0/1714321621 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61a8004810 0x7f61a8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:52.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61b3fff640 1 --2- 172.21.15.57:0/1714321621 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f61bc14bc60 0x7f61a80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:52.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61b3fff640 1 -- 172.21.15.57:0/1714321621 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc152c20 con 0x7f61a80039f0 2024-04-24T23:40:52.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61b3fff640 1 -- 172.21.15.57:0/1714321621 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f61a800ba80 con 0x7f61a8004810 2024-04-24T23:40:52.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61b3fff640 1 -- 172.21.15.57:0/1714321621 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f61a800bc80 con 0x7f61bc14bc60 2024-04-24T23:40:52.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61c1801640 1 --2- 172.21.15.57:0/1714321621 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61a80039f0 0x7f61a8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:52.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61c1000640 1 --2- 172.21.15.57:0/1714321621 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61a8004810 0x7f61a8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:52.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61c2002640 1 --2- 172.21.15.57:0/1714321621 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f61bc14bc60 0x7f61a80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:52.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61c1801640 1 -- 172.21.15.57:0/1714321621 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f61bc14bc60 msgr2=0x7f61a80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:52.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61c1801640 1 --2- 172.21.15.57:0/1714321621 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f61bc14bc60 0x7f61a80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61c1801640 1 -- 172.21.15.57:0/1714321621 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61a8004810 msgr2=0x7f61a8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:52.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61c1801640 1 --2- 172.21.15.57:0/1714321621 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61a8004810 0x7f61a8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.168+0000 7f61c1801640 1 -- 172.21.15.57:0/1714321621 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a8003530 con 0x7f61a80039f0 2024-04-24T23:40:52.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.172+0000 7f61c1801640 1 --2- 172.21.15.57:0/1714321621 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61a80039f0 0x7f61a8003e10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f61ac009ab0 tx=0x7f61ac01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=169d0d1567182190 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:52.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.172+0000 7f61b3fff640 1 -- 172.21.15.57:0/1714321621 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac0096b0 con 0x7f61a80039f0 2024-04-24T23:40:52.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.172+0000 7f61b3fff640 1 -- 172.21.15.57:0/1714321621 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f61ac0a6410 con 0x7f61a80039f0 2024-04-24T23:40:52.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.172+0000 7f61b3fff640 1 -- 172.21.15.57:0/1714321621 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac0a6820 con 0x7f61a80039f0 2024-04-24T23:40:52.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.172+0000 7f61c3a65640 1 -- 172.21.15.57:0/1714321621 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61a80039f0 msgr2=0x7f61a8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:52.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.172+0000 7f61c3a65640 1 --2- 172.21.15.57:0/1714321621 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61a80039f0 0x7f61a8003e10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f61ac009ab0 tx=0x7f61ac01ca30 comp rx=0 tx=0).stop 2024-04-24T23:40:52.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.172+0000 7f61c2002640 1 -- 172.21.15.57:0/1714321621 reap_dead start 2024-04-24T23:40:52.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.172+0000 7f61c3a65640 1 -- 172.21.15.57:0/1714321621 shutdown_connections 2024-04-24T23:40:52.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.172+0000 7f61c3a65640 1 -- 172.21.15.57:0/1714321621 >> 172.21.15.57:0/1714321621 conn(0x7f61bc0beab0 msgr2=0x7f61bc0beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:52.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.172+0000 7f61c3a65640 1 -- 172.21.15.57:0/1714321621 shutdown_connections 2024-04-24T23:40:52.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.172+0000 7f61c3a65640 1 -- 172.21.15.57:0/1714321621 wait complete. 2024-04-24T23:40:52.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.172+0000 7f61c3a65640 1 Processor -- start 2024-04-24T23:40:52.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.172+0000 7f61c3a65640 1 -- start start 2024-04-24T23:40:52.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.172+0000 7f61c3a65640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f61a80039f0 0x7f61bc140d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:52.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.172+0000 7f61c3a65640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61bc146240 0x7f61bc1eac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:52.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.172+0000 7f61c3a65640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61bc1eb170 0x7f61bc142080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:52.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.172+0000 7f61c3a65640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc15b100 con 0x7f61bc146240 2024-04-24T23:40:52.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.172+0000 7f61c3a65640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc15af80 con 0x7f61bc1eb170 2024-04-24T23:40:52.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.172+0000 7f61c3a65640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f61bc15b280 con 0x7f61a80039f0 2024-04-24T23:40:52.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.172+0000 7f61c1000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61bc146240 0x7f61bc1eac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:52.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.172+0000 7f61c1000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61bc146240 0x7f61bc1eac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44876/0 (socket says 172.21.15.57:44876) 2024-04-24T23:40:52.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.172+0000 7f61c1000640 1 -- 172.21.15.57:0/532543105 learned_addr learned my addr 172.21.15.57:0/532543105 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:52.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.172+0000 7f61c2002640 1 --2- 172.21.15.57:0/532543105 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61bc1eb170 0x7f61bc142080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:52.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.172+0000 7f61c1801640 1 --2- 172.21.15.57:0/532543105 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f61a80039f0 0x7f61bc140d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:52.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.176+0000 7f61c1000640 1 -- 172.21.15.57:0/532543105 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f61a80039f0 msgr2=0x7f61bc140d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:52.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.176+0000 7f61c1000640 1 --2- 172.21.15.57:0/532543105 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f61a80039f0 0x7f61bc140d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.176+0000 7f61c1000640 1 -- 172.21.15.57:0/532543105 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61bc1eb170 msgr2=0x7f61bc142080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:52.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.176+0000 7f61c1000640 1 --2- 172.21.15.57:0/532543105 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61bc1eb170 0x7f61bc142080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.176+0000 7f61c1000640 1 -- 172.21.15.57:0/532543105 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61bc0ba690 con 0x7f61bc146240 2024-04-24T23:40:52.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.176+0000 7f61c1000640 1 --2- 172.21.15.57:0/532543105 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61bc146240 0x7f61bc1eac30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f61b800e4d0 tx=0x7f61b800e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:52.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.176+0000 7f61b1ffb640 1 -- 172.21.15.57:0/532543105 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b80053a0 con 0x7f61bc146240 2024-04-24T23:40:52.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.176+0000 7f61b1ffb640 1 -- 172.21.15.57:0/532543105 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f61b8018070 con 0x7f61bc146240 2024-04-24T23:40:52.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.176+0000 7f61c3a65640 1 -- 172.21.15.57:0/532543105 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61bc1eb650 con 0x7f61bc146240 2024-04-24T23:40:52.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.176+0000 7f61b1ffb640 1 -- 172.21.15.57:0/532543105 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b8003840 con 0x7f61bc146240 2024-04-24T23:40:52.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.176+0000 7f61c3a65640 1 -- 172.21.15.57:0/532543105 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61bc0ba340 con 0x7f61bc146240 2024-04-24T23:40:52.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.176+0000 7f61c3a65640 1 -- 172.21.15.57:0/532543105 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61bc068220 con 0x7f61bc146240 2024-04-24T23:40:52.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.176+0000 7f61b1ffb640 1 -- 172.21.15.57:0/532543105 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f61b80039e0 con 0x7f61bc146240 2024-04-24T23:40:52.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.176+0000 7f61b1ffb640 1 --2- 172.21.15.57:0/532543105 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f61a00678f0 0x7f61a0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:52.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.176+0000 7f61b1ffb640 1 -- 172.21.15.57:0/532543105 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f61b80867c0 con 0x7f61bc146240 2024-04-24T23:40:52.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.176+0000 7f61c1801640 1 --2- 172.21.15.57:0/532543105 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f61a00678f0 0x7f61a0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:52.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.176+0000 7f61c1801640 1 --2- 172.21.15.57:0/532543105 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f61a00678f0 0x7f61a0069db0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0ad000 tx=0x7f61ac0b2040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:52.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.180+0000 7f61b1ffb640 1 -- 172.21.15.57:0/532543105 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f61b8056f60 con 0x7f61bc146240 2024-04-24T23:40:52.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.372+0000 7f61c3a65640 1 -- 172.21.15.57:0/532543105 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61bc0bd9c0 con 0x7f61bc146240 2024-04-24T23:40:52.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.376+0000 7f61b1ffb640 1 -- 172.21.15.57:0/532543105 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+4350 (secure 0 0 0) 0x7f61b8056860 con 0x7f61bc146240 2024-04-24T23:40:52.376 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:40:52.376 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2925410225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2925410225},{"type":"v1","addr":"172.21.15.88:6835","nonce":2925410225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4227,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/173597347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":173597347},{"type":"v1","addr":"172.21.15.57:6834","nonce":173597347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:38:33.449139+0000","modified":"2024-04-24T23:38:57.042000+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4230":{"gid":4230,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/1701414040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":1701414040},{"type":"v1","addr":"172.21.15.57:6835","nonce":1701414040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4230,"qdb_cluster":[4230]},"id":1}]} 2024-04-24T23:40:52.376 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 9 2024-04-24T23:40:52.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.376+0000 7f61c3a65640 1 -- 172.21.15.57:0/532543105 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f61a00678f0 msgr2=0x7f61a0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:52.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.376+0000 7f61c3a65640 1 --2- 172.21.15.57:0/532543105 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f61a00678f0 0x7f61a0069db0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0ad000 tx=0x7f61ac0b2040 comp rx=0 tx=0).stop 2024-04-24T23:40:52.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.376+0000 7f61c3a65640 1 -- 172.21.15.57:0/532543105 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61bc146240 msgr2=0x7f61bc1eac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:52.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.376+0000 7f61c3a65640 1 --2- 172.21.15.57:0/532543105 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61bc146240 0x7f61bc1eac30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f61b800e4d0 tx=0x7f61b800e990 comp rx=0 tx=0).stop 2024-04-24T23:40:52.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.376+0000 7f61c3a65640 1 -- 172.21.15.57:0/532543105 shutdown_connections 2024-04-24T23:40:52.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.376+0000 7f61c3a65640 1 --2- 172.21.15.57:0/532543105 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f61a00678f0 0x7f61a0069db0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.376+0000 7f61c3a65640 1 --2- 172.21.15.57:0/532543105 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61bc1eb170 0x7f61bc142080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.376+0000 7f61c3a65640 1 --2- 172.21.15.57:0/532543105 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61bc146240 0x7f61bc1eac30 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.376+0000 7f61c3a65640 1 --2- 172.21.15.57:0/532543105 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f61a80039f0 0x7f61bc140d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.376+0000 7f61c3a65640 1 -- 172.21.15.57:0/532543105 >> 172.21.15.57:0/532543105 conn(0x7f61bc0beab0 msgr2=0x7f61bc14a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:52.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.376+0000 7f61c3a65640 1 -- 172.21.15.57:0/532543105 shutdown_connections 2024-04-24T23:40:52.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.376+0000 7f61c3a65640 1 -- 172.21.15.57:0/532543105 wait complete. 2024-04-24T23:40:52.394 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:40:52.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.504+0000 7f3fe26f6640 1 Processor -- start 2024-04-24T23:40:52.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.504+0000 7f3fe26f6640 1 -- start start 2024-04-24T23:40:52.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.504+0000 7f3fe26f6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3fdc0b8800 0x7f3fdc0b8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:52.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.504+0000 7f3fe26f6640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3fdc0bdbf0 0x7f3fdc0be040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:52.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.504+0000 7f3fe26f6640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3fdc071650 0x7f3fdc071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:52.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.504+0000 7f3fe26f6640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f3fdc0be580 con 0x7f3fdc0bdbf0 2024-04-24T23:40:52.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.504+0000 7f3fe26f6640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f3fdc14d7b0 con 0x7f3fdc0b8800 2024-04-24T23:40:52.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.504+0000 7f3fe26f6640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f3fdc14da90 con 0x7f3fdc071650 2024-04-24T23:40:52.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.504+0000 7f3fdb7fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3fdc0bdbf0 0x7f3fdc0be040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:52.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.504+0000 7f3fdb7fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3fdc0bdbf0 0x7f3fdc0be040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44888/0 (socket says 172.21.15.57:44888) 2024-04-24T23:40:52.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.504+0000 7f3fdb7fe640 1 -- 172.21.15.57:0/358008743 learned_addr learned my addr 172.21.15.57:0/358008743 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:52.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.504+0000 7f3fe0c93640 1 --2- 172.21.15.57:0/358008743 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3fdc071650 0x7f3fdc071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:52.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.504+0000 7f3fdbfff640 1 --2- 172.21.15.57:0/358008743 >> v2:172.21.15.88:3300/0 conn(0x7f3fdc0b8800 0x7f3fdc0b8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:52.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.504+0000 7f3fdb7fe640 1 -- 172.21.15.57:0/358008743 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3fdc071650 msgr2=0x7f3fdc071ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:52.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.504+0000 7f3fdb7fe640 1 --2- 172.21.15.57:0/358008743 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3fdc071650 0x7f3fdc071ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.504+0000 7f3fdb7fe640 1 -- 172.21.15.57:0/358008743 >> v2:172.21.15.88:3300/0 conn(0x7f3fdc0b8800 msgr2=0x7f3fdc0b8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:52.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.504+0000 7f3fdb7fe640 1 --2- 172.21.15.57:0/358008743 >> v2:172.21.15.88:3300/0 conn(0x7f3fdc0b8800 0x7f3fdc0b8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.504+0000 7f3fdb7fe640 1 -- 172.21.15.57:0/358008743 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fdc0730b0 con 0x7f3fdc0bdbf0 2024-04-24T23:40:52.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.504+0000 7f3fe0c93640 1 --2- 172.21.15.57:0/358008743 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3fdc071650 0x7f3fdc071ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:40:52.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.504+0000 7f3fdb7fe640 1 --2- 172.21.15.57:0/358008743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fdc0bdbf0 0x7f3fdc0be040 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009870 tx=0x7f3fd001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2384cfcbbab9db0e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:52.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fdaffd640 1 -- 172.21.15.57:0/358008743 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd00b0070 con 0x7f3fdc0bdbf0 2024-04-24T23:40:52.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fdaffd640 1 -- 172.21.15.57:0/358008743 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3fd00ab600 con 0x7f3fdc0bdbf0 2024-04-24T23:40:52.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fdaffd640 1 -- 172.21.15.57:0/358008743 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd00ab9f0 con 0x7f3fdc0bdbf0 2024-04-24T23:40:52.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fe26f6640 1 -- 172.21.15.57:0/358008743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fdc0bdbf0 msgr2=0x7f3fdc0be040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:52.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fe26f6640 1 --2- 172.21.15.57:0/358008743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fdc0bdbf0 0x7f3fdc0be040 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009870 tx=0x7f3fd001c520 comp rx=0 tx=0).stop 2024-04-24T23:40:52.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fe26f6640 1 -- 172.21.15.57:0/358008743 shutdown_connections 2024-04-24T23:40:52.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fe26f6640 1 --2- 172.21.15.57:0/358008743 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3fdc071650 0x7f3fdc071ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fe26f6640 1 --2- 172.21.15.57:0/358008743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fdc0bdbf0 0x7f3fdc0be040 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fe26f6640 1 --2- 172.21.15.57:0/358008743 >> v2:172.21.15.88:3300/0 conn(0x7f3fdc0b8800 0x7f3fdc0b8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fe26f6640 1 -- 172.21.15.57:0/358008743 >> 172.21.15.57:0/358008743 conn(0x7f3fdc0beab0 msgr2=0x7f3fdc0beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:52.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fe26f6640 1 -- 172.21.15.57:0/358008743 shutdown_connections 2024-04-24T23:40:52.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fe26f6640 1 -- 172.21.15.57:0/358008743 wait complete. 2024-04-24T23:40:52.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fe26f6640 1 Processor -- start 2024-04-24T23:40:52.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fe26f6640 1 -- start start 2024-04-24T23:40:52.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fe26f6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fdc071650 0x7f3fdc1484b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:52.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fe26f6640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3fdc0b8800 0x7f3fdc155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:52.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fe26f6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fdc0bdbf0 0x7f3fdc146210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:52.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fe26f6640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3fdc0b8110 con 0x7f3fdc071650 2024-04-24T23:40:52.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fe26f6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f3fdc0a81a0 con 0x7f3fdc0bdbf0 2024-04-24T23:40:52.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fe26f6640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f3fdc150320 con 0x7f3fdc0b8800 2024-04-24T23:40:52.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fdbfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fdc071650 0x7f3fdc1484b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:52.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fdbfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fdc071650 0x7f3fdc1484b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44900/0 (socket says 172.21.15.57:44900) 2024-04-24T23:40:52.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fdbfff640 1 -- 172.21.15.57:0/1771947251 learned_addr learned my addr 172.21.15.57:0/1771947251 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:52.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fe0c93640 1 --2- 172.21.15.57:0/1771947251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fdc0bdbf0 0x7f3fdc146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:52.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fdb7fe640 1 --2- 172.21.15.57:0/1771947251 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3fdc0b8800 0x7f3fdc155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:52.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fdbfff640 1 -- 172.21.15.57:0/1771947251 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3fdc0b8800 msgr2=0x7f3fdc155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:52.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fdbfff640 1 --2- 172.21.15.57:0/1771947251 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3fdc0b8800 0x7f3fdc155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fdbfff640 1 -- 172.21.15.57:0/1771947251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fdc0bdbf0 msgr2=0x7f3fdc146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:52.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fdbfff640 1 --2- 172.21.15.57:0/1771947251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fdc0bdbf0 0x7f3fdc146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fdbfff640 1 -- 172.21.15.57:0/1771947251 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fdc1489f0 con 0x7f3fdc071650 2024-04-24T23:40:52.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fdb7fe640 1 --2- 172.21.15.57:0/1771947251 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3fdc0b8800 0x7f3fdc155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:40:52.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fdbfff640 1 --2- 172.21.15.57:0/1771947251 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fdc071650 0x7f3fdc1484b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc00d830 tx=0x7f3fcc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:52.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fd8ff9640 1 -- 172.21.15.57:0/1771947251 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc00b6c0 con 0x7f3fdc071650 2024-04-24T23:40:52.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fd8ff9640 1 -- 172.21.15.57:0/1771947251 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3fcc019070 con 0x7f3fdc071650 2024-04-24T23:40:52.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fe26f6640 1 -- 172.21.15.57:0/1771947251 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fdc156230 con 0x7f3fdc071650 2024-04-24T23:40:52.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fd8ff9640 1 -- 172.21.15.57:0/1771947251 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc00ba80 con 0x7f3fdc071650 2024-04-24T23:40:52.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.508+0000 7f3fe26f6640 1 -- 172.21.15.57:0/1771947251 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fdc149980 con 0x7f3fdc071650 2024-04-24T23:40:52.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.512+0000 7f3fe26f6640 1 -- 172.21.15.57:0/1771947251 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fdc068220 con 0x7f3fdc071650 2024-04-24T23:40:52.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.512+0000 7f3fd8ff9640 1 -- 172.21.15.57:0/1771947251 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3fcc01e460 con 0x7f3fdc071650 2024-04-24T23:40:52.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.512+0000 7f3fd8ff9640 1 --2- 172.21.15.57:0/1771947251 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f3fc80678f0 0x7f3fc8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:52.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.512+0000 7f3fd8ff9640 1 -- 172.21.15.57:0/1771947251 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f3fcc087250 con 0x7f3fdc071650 2024-04-24T23:40:52.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.512+0000 7f3fdb7fe640 1 --2- 172.21.15.57:0/1771947251 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f3fc80678f0 0x7f3fc8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:52.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.512+0000 7f3fdb7fe640 1 --2- 172.21.15.57:0/1771947251 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f3fc80678f0 0x7f3fc8069db0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3fd00ad000 tx=0x7f3fd00a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:52.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.516+0000 7f3fd8ff9640 1 -- 172.21.15.57:0/1771947251 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f3fdc156230 con 0x7f3fdc071650 2024-04-24T23:40:52.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.704+0000 7f3fe26f6640 1 -- 172.21.15.57:0/1771947251 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3fdc06f470 con 0x7f3fdc071650 2024-04-24T23:40:52.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.708+0000 7f3fd8ff9640 1 -- 172.21.15.57:0/1771947251 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+4350 (secure 0 0 0) 0x7f3fcc0579e0 con 0x7f3fdc071650 2024-04-24T23:40:52.709 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:40:52.709 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2925410225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2925410225},{"type":"v1","addr":"172.21.15.88:6835","nonce":2925410225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4227,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/173597347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":173597347},{"type":"v1","addr":"172.21.15.57:6834","nonce":173597347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:38:33.449139+0000","modified":"2024-04-24T23:38:57.042000+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4230":{"gid":4230,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/1701414040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":1701414040},{"type":"v1","addr":"172.21.15.57:6835","nonce":1701414040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4230,"qdb_cluster":[4230]},"id":1}]} 2024-04-24T23:40:52.709 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 9 2024-04-24T23:40:52.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.708+0000 7f3fe26f6640 1 -- 172.21.15.57:0/1771947251 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f3fc80678f0 msgr2=0x7f3fc8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:52.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.708+0000 7f3fe26f6640 1 --2- 172.21.15.57:0/1771947251 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f3fc80678f0 0x7f3fc8069db0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3fd00ad000 tx=0x7f3fd00a6000 comp rx=0 tx=0).stop 2024-04-24T23:40:52.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.708+0000 7f3fe26f6640 1 -- 172.21.15.57:0/1771947251 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fdc071650 msgr2=0x7f3fdc1484b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:52.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.708+0000 7f3fe26f6640 1 --2- 172.21.15.57:0/1771947251 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fdc071650 0x7f3fdc1484b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc00d830 tx=0x7f3fcc00dcf0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.708+0000 7f3fe26f6640 1 -- 172.21.15.57:0/1771947251 shutdown_connections 2024-04-24T23:40:52.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.708+0000 7f3fe26f6640 1 --2- 172.21.15.57:0/1771947251 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f3fc80678f0 0x7f3fc8069db0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.708+0000 7f3fe26f6640 1 --2- 172.21.15.57:0/1771947251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fdc0bdbf0 0x7f3fdc146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.708+0000 7f3fe26f6640 1 --2- 172.21.15.57:0/1771947251 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3fdc0b8800 0x7f3fdc155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.708+0000 7f3fe26f6640 1 --2- 172.21.15.57:0/1771947251 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fdc071650 0x7f3fdc1484b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.708+0000 7f3fe26f6640 1 -- 172.21.15.57:0/1771947251 >> 172.21.15.57:0/1771947251 conn(0x7f3fdc0beab0 msgr2=0x7f3fdc156e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:52.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.708+0000 7f3fe26f6640 1 -- 172.21.15.57:0/1771947251 shutdown_connections 2024-04-24T23:40:52.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.708+0000 7f3fe26f6640 1 -- 172.21.15.57:0/1771947251 wait complete. 2024-04-24T23:40:52.726 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:40:52.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.848+0000 7ff09d70c640 1 Processor -- start 2024-04-24T23:40:52.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.848+0000 7ff09d70c640 1 -- start start 2024-04-24T23:40:52.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.848+0000 7ff09d70c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff0980bdbe0 0x7ff0980b6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:52.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.848+0000 7ff09d70c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff0980b7510 0x7ff098159050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:52.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.848+0000 7ff09d70c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff09814e8e0 con 0x7ff09814bc60 2024-04-24T23:40:52.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.848+0000 7ff09d70c640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7ff098152c20 con 0x7ff0980b7510 2024-04-24T23:40:52.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.848+0000 7ff09d70c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7ff09814ebc0 con 0x7ff0980bdbe0 2024-04-24T23:40:52.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.848+0000 7ff0977fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff0980b7510 0x7ff098159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:52.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.848+0000 7ff0977fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff0980b7510 0x7ff098159050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44914/0 (socket says 172.21.15.57:44914) 2024-04-24T23:40:52.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.848+0000 7ff0977fe640 1 -- 172.21.15.57:0/1721508037 learned_addr learned my addr 172.21.15.57:0/1721508037 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:52.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.848+0000 7ff0967fc640 1 --2- 172.21.15.57:0/1721508037 >> v2:172.21.15.88:3300/0 conn(0x7ff0980bdbe0 0x7ff0980b6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:52.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.848+0000 7ff0977fe640 1 -- 172.21.15.57:0/1721508037 >> v2:172.21.15.88:3300/0 conn(0x7ff0980bdbe0 msgr2=0x7ff0980b6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:52.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.848+0000 7ff0977fe640 1 --2- 172.21.15.57:0/1721508037 >> v2:172.21.15.88:3300/0 conn(0x7ff0980bdbe0 0x7ff0980b6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.848+0000 7ff0977fe640 1 -- 172.21.15.57:0/1721508037 >> v1:172.21.15.88:6789/0 conn(0x7ff09814bc60 legacy=0x7ff09806eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:52.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.848+0000 7ff0977fe640 1 -- 172.21.15.57:0/1721508037 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09806f260 con 0x7ff0980b7510 2024-04-24T23:40:52.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.848+0000 7ff0967fc640 1 --2- 172.21.15.57:0/1721508037 >> v2:172.21.15.88:3300/0 conn(0x7ff0980bdbe0 0x7ff0980b6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:40:52.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff0977fe640 1 --2- 172.21.15.57:0/1721508037 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0980b7510 0x7ff098159050 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff0980b9a40 tx=0x7ff09001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85188a92880359ea server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:52.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff095ffb640 1 -- 172.21.15.57:0/1721508037 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0900a56c0 con 0x7ff0980b7510 2024-04-24T23:40:52.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff095ffb640 1 -- 172.21.15.57:0/1721508037 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff0900a5860 con 0x7ff0980b7510 2024-04-24T23:40:52.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff095ffb640 1 -- 172.21.15.57:0/1721508037 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0900a5c50 con 0x7ff0980b7510 2024-04-24T23:40:52.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff09d70c640 1 -- 172.21.15.57:0/1721508037 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0980b7510 msgr2=0x7ff098159050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:52.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff09d70c640 1 --2- 172.21.15.57:0/1721508037 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0980b7510 0x7ff098159050 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff0980b9a40 tx=0x7ff09001c9f0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff09d70c640 1 -- 172.21.15.57:0/1721508037 shutdown_connections 2024-04-24T23:40:52.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff09d70c640 1 --2- 172.21.15.57:0/1721508037 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0980b7510 0x7ff098159050 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff09d70c640 1 --2- 172.21.15.57:0/1721508037 >> v2:172.21.15.88:3300/0 conn(0x7ff0980bdbe0 0x7ff0980b6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff09d70c640 1 -- 172.21.15.57:0/1721508037 >> 172.21.15.57:0/1721508037 conn(0x7ff0980beab0 msgr2=0x7ff0980beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:52.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff09d70c640 1 -- 172.21.15.57:0/1721508037 shutdown_connections 2024-04-24T23:40:52.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff09d70c640 1 -- 172.21.15.57:0/1721508037 wait complete. 2024-04-24T23:40:52.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff09d70c640 1 Processor -- start 2024-04-24T23:40:52.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff09d70c640 1 -- start start 2024-04-24T23:40:52.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff09d70c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0980b7510 0x7ff0981587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:52.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff09d70c640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff0980bdbe0 0x7ff098072100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:52.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff09d70c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff09814bc60 0x7ff0981ec990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:52.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff09d70c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff09815bf30 con 0x7ff09814bc60 2024-04-24T23:40:52.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff09d70c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff09815bdb0 con 0x7ff0980b7510 2024-04-24T23:40:52.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff09d70c640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7ff09815c0b0 con 0x7ff0980bdbe0 2024-04-24T23:40:52.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff0977fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff09814bc60 0x7ff0981ec990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:52.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff0977fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff09814bc60 0x7ff0981ec990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44918/0 (socket says 172.21.15.57:44918) 2024-04-24T23:40:52.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff0977fe640 1 -- 172.21.15.57:0/816579953 learned_addr learned my addr 172.21.15.57:0/816579953 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:52.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff0967fc640 1 --2- 172.21.15.57:0/816579953 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff0980bdbe0 0x7ff098072100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:52.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff096ffd640 1 --2- 172.21.15.57:0/816579953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0980b7510 0x7ff0981587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:52.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff0977fe640 1 -- 172.21.15.57:0/816579953 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff0980bdbe0 msgr2=0x7ff098072100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:52.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff0977fe640 1 --2- 172.21.15.57:0/816579953 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff0980bdbe0 0x7ff098072100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff0977fe640 1 -- 172.21.15.57:0/816579953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0980b7510 msgr2=0x7ff0981587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:52.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff0977fe640 1 --2- 172.21.15.57:0/816579953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0980b7510 0x7ff0981587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:52.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff0977fe640 1 -- 172.21.15.57:0/816579953 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0981ea140 con 0x7ff09814bc60 2024-04-24T23:40:52.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff096ffd640 1 --2- 172.21.15.57:0/816579953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0980b7510 0x7ff0981587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:40:52.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.852+0000 7ff0967fc640 1 --2- 172.21.15.57:0/816579953 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff0980bdbe0 0x7ff098072100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:40:52.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.856+0000 7ff0977fe640 1 --2- 172.21.15.57:0/816579953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff09814bc60 0x7ff0981ec990 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff0900af040 tx=0x7ff090019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:52.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.856+0000 7ff07f7fe640 1 -- 172.21.15.57:0/816579953 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0900b8670 con 0x7ff09814bc60 2024-04-24T23:40:52.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.856+0000 7ff07f7fe640 1 -- 172.21.15.57:0/816579953 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff0900be070 con 0x7ff09814bc60 2024-04-24T23:40:52.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.856+0000 7ff09d70c640 1 -- 172.21.15.57:0/816579953 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff09814dc60 con 0x7ff09814bc60 2024-04-24T23:40:52.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.856+0000 7ff07f7fe640 1 -- 172.21.15.57:0/816579953 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0900b8a90 con 0x7ff09814bc60 2024-04-24T23:40:52.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.856+0000 7ff09d70c640 1 -- 172.21.15.57:0/816579953 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff098158d10 con 0x7ff09814bc60 2024-04-24T23:40:52.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.856+0000 7ff09d70c640 1 -- 172.21.15.57:0/816579953 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff098068220 con 0x7ff09814bc60 2024-04-24T23:40:52.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.856+0000 7ff07f7fe640 1 -- 172.21.15.57:0/816579953 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff0900b8c30 con 0x7ff09814bc60 2024-04-24T23:40:52.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.856+0000 7ff07f7fe640 1 --2- 172.21.15.57:0/816579953 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ff0840678f0 0x7ff084069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:52.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.856+0000 7ff07f7fe640 1 -- 172.21.15.57:0/816579953 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ff090121330 con 0x7ff09814bc60 2024-04-24T23:40:52.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.856+0000 7ff096ffd640 1 --2- 172.21.15.57:0/816579953 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ff0840678f0 0x7ff084069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:52.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.856+0000 7ff096ffd640 1 --2- 172.21.15.57:0/816579953 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ff0840678f0 0x7ff084069db0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff088001650 tx=0x7ff088009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:52.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:52.860+0000 7ff07f7fe640 1 -- 172.21.15.57:0/816579953 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7ff0900165e0 con 0x7ff09814bc60 2024-04-24T23:40:53.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.020+0000 7ff09d70c640 1 -- 172.21.15.57:0/816579953 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff09806e070 con 0x7ff09814bc60 2024-04-24T23:40:53.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.020+0000 7ff07f7fe640 1 -- 172.21.15.57:0/816579953 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18853 (secure 0 0 0) 0x7ff0900f1aa0 con 0x7ff09814bc60 2024-04-24T23:40:53.022 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T23:40:53.022 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"fsid":"1ea31698-444a-4667-bcd9-b2608ad103c3","created":"2024-04-24T23:38:16.748774+0000","modified":"2024-04-24T23:39:22.806760+0000","last_up_change":"2024-04-24T23:38:26.956537+0000","last_in_change":"2024-04-24T23:38:18.972175+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:38:27.611782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:38:31.718061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:38:32.469413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:38:36.215724+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"35ce67bc-9b25-416e-ab1e-774c717631f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6825","nonce":671364028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6827","nonce":671364028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6831","nonce":671364028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":671364028},{"type":"v1","addr":"172.21.15.57:6829","nonce":671364028}]},"public_addr":"172.21.15.57:6825/671364028","cluster_addr":"172.21.15.57:6827/671364028","heartbeat_back_addr":"172.21.15.57:6831/671364028","heartbeat_front_addr":"172.21.15.57:6829/671364028","state":["exists","up"]},{"osd":1,"uuid":"38f6f4ef-3bc2-4453-9946-7d1d17e735ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6801","nonce":2653552037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6803","nonce":2653552037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6807","nonce":2653552037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2653552037},{"type":"v1","addr":"172.21.15.57:6805","nonce":2653552037}]},"public_addr":"172.21.15.57:6801/2653552037","cluster_addr":"172.21.15.57:6803/2653552037","heartbeat_back_addr":"172.21.15.57:6807/2653552037","heartbeat_front_addr":"172.21.15.57:6805/2653552037","state":["exists","up"]},{"osd":2,"uuid":"d77a0a49-b39a-464e-a1c9-49e19280c440","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6816","nonce":1565874109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6819","nonce":1565874109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6823","nonce":1565874109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1565874109},{"type":"v1","addr":"172.21.15.57:6821","nonce":1565874109}]},"public_addr":"172.21.15.57:6816/1565874109","cluster_addr":"172.21.15.57:6819/1565874109","heartbeat_back_addr":"172.21.15.57:6823/1565874109","heartbeat_front_addr":"172.21.15.57:6821/1565874109","state":["exists","up"]},{"osd":3,"uuid":"f8ea9bfe-d839-44a6-a185-0f0985da314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6809","nonce":3474703186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6811","nonce":3474703186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6817","nonce":3474703186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3474703186},{"type":"v1","addr":"172.21.15.57:6813","nonce":3474703186}]},"public_addr":"172.21.15.57:6809/3474703186","cluster_addr":"172.21.15.57:6811/3474703186","heartbeat_back_addr":"172.21.15.57:6817/3474703186","heartbeat_front_addr":"172.21.15.57:6813/3474703186","state":["exists","up"]},{"osd":4,"uuid":"454647d4-6ac2-46b4-8451-320eb951a87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6801","nonce":1271707713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6803","nonce":1271707713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6807","nonce":1271707713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1271707713},{"type":"v1","addr":"172.21.15.88:6805","nonce":1271707713}]},"public_addr":"172.21.15.88:6801/1271707713","cluster_addr":"172.21.15.88:6803/1271707713","heartbeat_back_addr":"172.21.15.88:6807/1271707713","heartbeat_front_addr":"172.21.15.88:6805/1271707713","state":["exists","up"]},{"osd":5,"uuid":"f71c03a3-7ad8-46d3-89c9-d61de102586b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6809","nonce":2035054888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6813","nonce":2035054888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6820","nonce":2035054888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":2035054888},{"type":"v1","addr":"172.21.15.88:6816","nonce":2035054888}]},"public_addr":"172.21.15.88:6809/2035054888","cluster_addr":"172.21.15.88:6813/2035054888","heartbeat_back_addr":"172.21.15.88:6820/2035054888","heartbeat_front_addr":"172.21.15.88:6816/2035054888","state":["exists","up"]},{"osd":6,"uuid":"ec7ae2b7-9cb4-4059-8f98-0022c9763f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6825","nonce":1752291242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6827","nonce":1752291242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6831","nonce":1752291242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1752291242},{"type":"v1","addr":"172.21.15.88:6829","nonce":1752291242}]},"public_addr":"172.21.15.88:6825/1752291242","cluster_addr":"172.21.15.88:6827/1752291242","heartbeat_back_addr":"172.21.15.88:6831/1752291242","heartbeat_front_addr":"172.21.15.88:6829/1752291242","state":["exists","up"]},{"osd":7,"uuid":"c0ee7505-60c1-40ba-9902-47313a04dafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6812","nonce":1782800372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6817","nonce":1782800372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6823","nonce":1782800372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1782800372},{"type":"v1","addr":"172.21.15.88:6821","nonce":1782800372}]},"public_addr":"172.21.15.88:6812/1782800372","cluster_addr":"172.21.15.88:6817/1782800372","heartbeat_back_addr":"172.21.15.88:6823/1782800372","heartbeat_front_addr":"172.21.15.88:6821/1782800372","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.698562+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.682587+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.680197+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.561753+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.011095+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.493320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.353451+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T23:38:24.423877+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:40:53.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.024+0000 7ff09d70c640 1 -- 172.21.15.57:0/816579953 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ff0840678f0 msgr2=0x7ff084069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:53.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.024+0000 7ff09d70c640 1 --2- 172.21.15.57:0/816579953 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ff0840678f0 0x7ff084069db0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff088001650 tx=0x7ff088009040 comp rx=0 tx=0).stop 2024-04-24T23:40:53.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.024+0000 7ff09d70c640 1 -- 172.21.15.57:0/816579953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff09814bc60 msgr2=0x7ff0981ec990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:53.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.024+0000 7ff09d70c640 1 --2- 172.21.15.57:0/816579953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff09814bc60 0x7ff0981ec990 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff0900af040 tx=0x7ff090019790 comp rx=0 tx=0).stop 2024-04-24T23:40:53.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.024+0000 7ff09d70c640 1 -- 172.21.15.57:0/816579953 shutdown_connections 2024-04-24T23:40:53.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.024+0000 7ff09d70c640 1 --2- 172.21.15.57:0/816579953 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7ff0840678f0 0x7ff084069db0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:53.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.024+0000 7ff09d70c640 1 --2- 172.21.15.57:0/816579953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff09814bc60 0x7ff0981ec990 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:53.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.024+0000 7ff09d70c640 1 --2- 172.21.15.57:0/816579953 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff0980bdbe0 0x7ff098072100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:53.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.024+0000 7ff09d70c640 1 --2- 172.21.15.57:0/816579953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0980b7510 0x7ff0981587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:53.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.024+0000 7ff09d70c640 1 -- 172.21.15.57:0/816579953 >> 172.21.15.57:0/816579953 conn(0x7ff0980beab0 msgr2=0x7ff0980bee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:53.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.024+0000 7ff09d70c640 1 -- 172.21.15.57:0/816579953 shutdown_connections 2024-04-24T23:40:53.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.024+0000 7ff09d70c640 1 -- 172.21.15.57:0/816579953 wait complete. 2024-04-24T23:40:53.039 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-24T23:40:53.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.164+0000 7f5e51278640 1 Processor -- start 2024-04-24T23:40:53.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.164+0000 7f5e51278640 1 -- start start 2024-04-24T23:40:53.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.164+0000 7f5e51278640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e4c072200 0x7f5e4c14d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:53.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.164+0000 7f5e51278640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5e4c06e520 0x7f5e4c0be8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:53.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.164+0000 7f5e51278640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e4c0bd870 con 0x7f5e4c0bf3a0 2024-04-24T23:40:53.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.164+0000 7f5e51278640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f5e4c14e350 con 0x7f5e4c06e520 2024-04-24T23:40:53.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.164+0000 7f5e51278640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f5e4c0be440 con 0x7f5e4c072200 2024-04-24T23:40:53.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.164+0000 7f5e4a7fc640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5e4c06e520 0x7f5e4c0be8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:53.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.164+0000 7f5e4b7fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5e4c0bf3a0 0x7f5e4c14a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:50656/0 (socket says 172.21.15.57:50656) 2024-04-24T23:40:53.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.164+0000 7f5e4b7fe640 1 -- 172.21.15.57:0/2868426208 learned_addr learned my addr 172.21.15.57:0/2868426208 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:40:53.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.164+0000 7f5e4affd640 1 --2- 172.21.15.57:0/2868426208 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e4c072200 0x7f5e4c14d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:53.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.164+0000 7f5e49ffb640 1 -- 172.21.15.57:0/2868426208 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3554397453 0 0) 0x7f5e4c0bd870 con 0x7f5e4c0bf3a0 2024-04-24T23:40:53.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.164+0000 7f5e49ffb640 1 -- 172.21.15.57:0/2868426208 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e34003530 con 0x7f5e4c0bf3a0 2024-04-24T23:40:53.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.164+0000 7f5e4a7fc640 1 -- 172.21.15.57:0/2868426208 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e4c072200 msgr2=0x7f5e4c14d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:53.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.164+0000 7f5e4a7fc640 1 --2- 172.21.15.57:0/2868426208 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e4c072200 0x7f5e4c14d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:53.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.164+0000 7f5e4a7fc640 1 -- 172.21.15.57:0/2868426208 >> v1:172.21.15.57:6789/0 conn(0x7f5e4c0bf3a0 legacy=0x7f5e4c14a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:53.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.164+0000 7f5e4a7fc640 1 -- 172.21.15.57:0/2868426208 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e4c0bdb10 con 0x7f5e4c06e520 2024-04-24T23:40:53.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.168+0000 7f5e4a7fc640 1 --2- 172.21.15.57:0/2868426208 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e4c06e520 0x7f5e4c0be8d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5e400097f0 tx=0x7f5e4001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4412cad94b70c73 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:53.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.168+0000 7f5e49ffb640 1 -- 172.21.15.57:0/2868426208 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e400b5070 con 0x7f5e4c06e520 2024-04-24T23:40:53.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.168+0000 7f5e49ffb640 1 -- 172.21.15.57:0/2868426208 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5e400a8990 con 0x7f5e4c06e520 2024-04-24T23:40:53.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.168+0000 7f5e49ffb640 1 -- 172.21.15.57:0/2868426208 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e400a8d40 con 0x7f5e4c06e520 2024-04-24T23:40:53.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.168+0000 7f5e51278640 1 -- 172.21.15.57:0/2868426208 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e4c06e520 msgr2=0x7f5e4c0be8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:53.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.168+0000 7f5e51278640 1 --2- 172.21.15.57:0/2868426208 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e4c06e520 0x7f5e4c0be8d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5e400097f0 tx=0x7f5e4001ec90 comp rx=0 tx=0).stop 2024-04-24T23:40:53.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.168+0000 7f5e51278640 1 -- 172.21.15.57:0/2868426208 shutdown_connections 2024-04-24T23:40:53.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.168+0000 7f5e51278640 1 --2- 172.21.15.57:0/2868426208 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e4c06e520 0x7f5e4c0be8d0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:53.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.168+0000 7f5e51278640 1 --2- 172.21.15.57:0/2868426208 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e4c072200 0x7f5e4c14d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:53.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.168+0000 7f5e51278640 1 -- 172.21.15.57:0/2868426208 >> 172.21.15.57:0/2868426208 conn(0x7f5e4c0c2e70 msgr2=0x7f5e4c0c3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:53.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.168+0000 7f5e51278640 1 -- 172.21.15.57:0/2868426208 shutdown_connections 2024-04-24T23:40:53.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.168+0000 7f5e51278640 1 -- 172.21.15.57:0/2868426208 wait complete. 2024-04-24T23:40:53.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.168+0000 7f5e51278640 1 Processor -- start 2024-04-24T23:40:53.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.168+0000 7f5e51278640 1 -- start start 2024-04-24T23:40:53.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.168+0000 7f5e51278640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e4c06e520 0x7f5e4c1433b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:53.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.168+0000 7f5e51278640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e4c072200 0x7f5e4c136880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:53.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.168+0000 7f5e51278640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e4c0bf3a0 0x7f5e4c136dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:53.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.168+0000 7f5e51278640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4c0725e0 con 0x7f5e4c06e520 2024-04-24T23:40:53.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.168+0000 7f5e51278640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4c0be0d0 con 0x7f5e4c0bf3a0 2024-04-24T23:40:53.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.168+0000 7f5e51278640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f5e4c072760 con 0x7f5e4c072200 2024-04-24T23:40:53.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.168+0000 7f5e4affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e4c06e520 0x7f5e4c1433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:53.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.168+0000 7f5e4affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e4c06e520 0x7f5e4c1433b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44934/0 (socket says 172.21.15.57:44934) 2024-04-24T23:40:53.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.168+0000 7f5e4affd640 1 -- 172.21.15.57:0/734911636 learned_addr learned my addr 172.21.15.57:0/734911636 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:53.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.168+0000 7f5e4b7fe640 1 --2- 172.21.15.57:0/734911636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e4c0bf3a0 0x7f5e4c136dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:53.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.168+0000 7f5e4a7fc640 1 --2- 172.21.15.57:0/734911636 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e4c072200 0x7f5e4c136880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:53.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.172+0000 7f5e4affd640 1 -- 172.21.15.57:0/734911636 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e4c072200 msgr2=0x7f5e4c136880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:53.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.172+0000 7f5e4affd640 1 --2- 172.21.15.57:0/734911636 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e4c072200 0x7f5e4c136880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:53.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.172+0000 7f5e4affd640 1 -- 172.21.15.57:0/734911636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e4c0bf3a0 msgr2=0x7f5e4c136dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:53.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.172+0000 7f5e4affd640 1 --2- 172.21.15.57:0/734911636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e4c0bf3a0 0x7f5e4c136dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:53.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.172+0000 7f5e4affd640 1 -- 172.21.15.57:0/734911636 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e4c1438f0 con 0x7f5e4c06e520 2024-04-24T23:40:53.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.172+0000 7f5e4affd640 1 --2- 172.21.15.57:0/734911636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e4c06e520 0x7f5e4c1433b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5e44007ef0 tx=0x7f5e4400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:53.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.172+0000 7f5e337fe640 1 -- 172.21.15.57:0/734911636 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e44014620 con 0x7f5e4c06e520 2024-04-24T23:40:53.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.172+0000 7f5e337fe640 1 -- 172.21.15.57:0/734911636 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5e44019070 con 0x7f5e4c06e520 2024-04-24T23:40:53.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.172+0000 7f5e51278640 1 -- 172.21.15.57:0/734911636 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e4c0ba3d0 con 0x7f5e4c06e520 2024-04-24T23:40:53.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.172+0000 7f5e337fe640 1 -- 172.21.15.57:0/734911636 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e44014a20 con 0x7f5e4c06e520 2024-04-24T23:40:53.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.172+0000 7f5e51278640 1 -- 172.21.15.57:0/734911636 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e4c137300 con 0x7f5e4c06e520 2024-04-24T23:40:53.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.172+0000 7f5e51278640 1 -- 172.21.15.57:0/734911636 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e4c068930 con 0x7f5e4c06e520 2024-04-24T23:40:53.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.172+0000 7f5e337fe640 1 -- 172.21.15.57:0/734911636 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5e44014bc0 con 0x7f5e4c06e520 2024-04-24T23:40:53.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.172+0000 7f5e337fe640 1 --2- 172.21.15.57:0/734911636 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f5e380678c0 0x7f5e38069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:53.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.172+0000 7f5e337fe640 1 -- 172.21.15.57:0/734911636 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f5e44086ac0 con 0x7f5e4c06e520 2024-04-24T23:40:53.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.172+0000 7f5e4a7fc640 1 --2- 172.21.15.57:0/734911636 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f5e380678c0 0x7f5e38069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:53.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.172+0000 7f5e4a7fc640 1 --2- 172.21.15.57:0/734911636 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f5e380678c0 0x7f5e38069d80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5e400b2000 tx=0x7f5e40008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:53.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.176+0000 7f5e337fe640 1 -- 172.21.15.57:0/734911636 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f5e4c1438f0 con 0x7f5e4c06e520 2024-04-24T23:40:53.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.364+0000 7f5e51278640 1 -- 172.21.15.57:0/734911636 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f5e4c0c2990 con 0x7f5e4c06e520 2024-04-24T23:40:53.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.368+0000 7f5e337fe640 1 -- 172.21.15.57:0/734911636 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f5e44057160 con 0x7f5e4c06e520 2024-04-24T23:40:53.370 INFO:teuthology.orchestra.run.smithi057.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-24T23:40:53.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.372+0000 7f5e51278640 1 -- 172.21.15.57:0/734911636 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f5e380678c0 msgr2=0x7f5e38069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:53.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.372+0000 7f5e51278640 1 --2- 172.21.15.57:0/734911636 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f5e380678c0 0x7f5e38069d80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5e400b2000 tx=0x7f5e40008040 comp rx=0 tx=0).stop 2024-04-24T23:40:53.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.372+0000 7f5e51278640 1 -- 172.21.15.57:0/734911636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e4c06e520 msgr2=0x7f5e4c1433b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:53.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.372+0000 7f5e51278640 1 --2- 172.21.15.57:0/734911636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e4c06e520 0x7f5e4c1433b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5e44007ef0 tx=0x7f5e4400e4b0 comp rx=0 tx=0).stop 2024-04-24T23:40:53.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.372+0000 7f5e51278640 1 -- 172.21.15.57:0/734911636 shutdown_connections 2024-04-24T23:40:53.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.372+0000 7f5e51278640 1 --2- 172.21.15.57:0/734911636 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f5e380678c0 0x7f5e38069d80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:53.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.372+0000 7f5e51278640 1 --2- 172.21.15.57:0/734911636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e4c0bf3a0 0x7f5e4c136dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:53.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.372+0000 7f5e51278640 1 --2- 172.21.15.57:0/734911636 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e4c072200 0x7f5e4c136880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:53.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.372+0000 7f5e51278640 1 --2- 172.21.15.57:0/734911636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e4c06e520 0x7f5e4c1433b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:53.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.372+0000 7f5e51278640 1 -- 172.21.15.57:0/734911636 >> 172.21.15.57:0/734911636 conn(0x7f5e4c0c2e70 msgr2=0x7f5e4c144360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:53.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.372+0000 7f5e51278640 1 -- 172.21.15.57:0/734911636 shutdown_connections 2024-04-24T23:40:53.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.372+0000 7f5e51278640 1 -- 172.21.15.57:0/734911636 wait complete. 2024-04-24T23:40:53.390 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-24T23:40:53.425 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2024-04-24T23:40:53.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.500+0000 7fd3b8b65640 1 Processor -- start 2024-04-24T23:40:53.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.500+0000 7fd3b8b65640 1 -- start start 2024-04-24T23:40:53.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.504+0000 7fd3b8b65640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd3b414bc60 0x7fd3b40c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:53.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.504+0000 7fd3b8b65640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd3b40bd5f0 0x7fd3b4158f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:53.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.504+0000 7fd3b8b65640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3b40bd200 con 0x7fd3b40c2d00 2024-04-24T23:40:53.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.504+0000 7fd3b8b65640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fd3b40bde20 con 0x7fd3b40bd5f0 2024-04-24T23:40:53.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.504+0000 7fd3b8b65640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fd3b40be070 con 0x7fd3b414bc60 2024-04-24T23:40:53.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.504+0000 7fd3b259c640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd3b414bc60 0x7fd3b40c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:53.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.504+0000 7fd3b2d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd3b40bd5f0 0x7fd3b4158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:53.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.504+0000 7fd3b259c640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd3b414bc60 0x7fd3b40c27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.57:45078/0 (socket says 172.21.15.57:45078) 2024-04-24T23:40:53.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.504+0000 7fd3b259c640 1 -- 172.21.15.57:0/852452462 learned_addr learned my addr 172.21.15.57:0/852452462 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:53.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.504+0000 7fd3b259c640 1 -- 172.21.15.57:0/852452462 >> v2:172.21.15.88:3300/0 conn(0x7fd3b40bd5f0 msgr2=0x7fd3b4158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:53.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.504+0000 7fd3b259c640 1 --2- 172.21.15.57:0/852452462 >> v2:172.21.15.88:3300/0 conn(0x7fd3b40bd5f0 0x7fd3b4158f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:53.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.504+0000 7fd3b259c640 1 -- 172.21.15.57:0/852452462 >> v1:172.21.15.88:6789/0 conn(0x7fd3b40c2d00 legacy=0x7fd3b4151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:53.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.504+0000 7fd3b259c640 1 -- 172.21.15.57:0/852452462 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3b40be350 con 0x7fd3b414bc60 2024-04-24T23:40:53.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.504+0000 7fd3b259c640 1 --2- 172.21.15.57:0/852452462 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd3b414bc60 0x7fd3b40c27c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8009870 tx=0x7fd3a801c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=359ed354c60e4fdf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:53.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.504+0000 7fd3b159a640 1 -- 172.21.15.57:0/852452462 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a80b0070 con 0x7fd3b414bc60 2024-04-24T23:40:53.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.504+0000 7fd3b159a640 1 -- 172.21.15.57:0/852452462 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd3a80ab600 con 0x7fd3b414bc60 2024-04-24T23:40:53.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.504+0000 7fd3b159a640 1 -- 172.21.15.57:0/852452462 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a80ab9f0 con 0x7fd3b414bc60 2024-04-24T23:40:53.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b8b65640 1 -- 172.21.15.57:0/852452462 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd3b414bc60 msgr2=0x7fd3b40c27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:53.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b8b65640 1 --2- 172.21.15.57:0/852452462 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd3b414bc60 0x7fd3b40c27c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8009870 tx=0x7fd3a801c440 comp rx=0 tx=0).stop 2024-04-24T23:40:53.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b8b65640 1 -- 172.21.15.57:0/852452462 shutdown_connections 2024-04-24T23:40:53.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b8b65640 1 --2- 172.21.15.57:0/852452462 >> v2:172.21.15.88:3300/0 conn(0x7fd3b40bd5f0 0x7fd3b4158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:53.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b8b65640 1 --2- 172.21.15.57:0/852452462 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd3b414bc60 0x7fd3b40c27c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:53.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b8b65640 1 -- 172.21.15.57:0/852452462 >> 172.21.15.57:0/852452462 conn(0x7fd3b406b920 msgr2=0x7fd3b40c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:53.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b8b65640 1 -- 172.21.15.57:0/852452462 shutdown_connections 2024-04-24T23:40:53.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b8b65640 1 -- 172.21.15.57:0/852452462 wait complete. 2024-04-24T23:40:53.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b8b65640 1 Processor -- start 2024-04-24T23:40:53.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b8b65640 1 -- start start 2024-04-24T23:40:53.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b8b65640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd3b40bd5f0 0x7fd3b40c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:53.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b8b65640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3b40c2d00 0x7fd3b41485a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:53.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b8b65640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3b414bc60 0x7fd3b4071e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:53.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b8b65640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b415be70 con 0x7fd3b414bc60 2024-04-24T23:40:53.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b8b65640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b415bcf0 con 0x7fd3b40c2d00 2024-04-24T23:40:53.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b8b65640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fd3b415bff0 con 0x7fd3b40bd5f0 2024-04-24T23:40:53.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b2d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3b414bc60 0x7fd3b4071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:53.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b2d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3b414bc60 0x7fd3b4071e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44960/0 (socket says 172.21.15.57:44960) 2024-04-24T23:40:53.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b2d9d640 1 -- 172.21.15.57:0/1967571905 learned_addr learned my addr 172.21.15.57:0/1967571905 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:53.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b259c640 1 --2- 172.21.15.57:0/1967571905 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd3b40bd5f0 0x7fd3b40c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:53.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b1d9b640 1 --2- 172.21.15.57:0/1967571905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3b40c2d00 0x7fd3b41485a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:53.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b2d9d640 1 -- 172.21.15.57:0/1967571905 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd3b40bd5f0 msgr2=0x7fd3b40c12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:53.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b2d9d640 1 --2- 172.21.15.57:0/1967571905 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd3b40bd5f0 0x7fd3b40c12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:53.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b2d9d640 1 -- 172.21.15.57:0/1967571905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3b40c2d00 msgr2=0x7fd3b41485a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:53.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b2d9d640 1 --2- 172.21.15.57:0/1967571905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3b40c2d00 0x7fd3b41485a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:53.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b2d9d640 1 -- 172.21.15.57:0/1967571905 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3b40c1950 con 0x7fd3b414bc60 2024-04-24T23:40:53.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b259c640 1 --2- 172.21.15.57:0/1967571905 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd3b40bd5f0 0x7fd3b40c12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:40:53.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b1d9b640 1 --2- 172.21.15.57:0/1967571905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3b40c2d00 0x7fd3b41485a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:40:53.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b2d9d640 1 --2- 172.21.15.57:0/1967571905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3b414bc60 0x7fd3b4071e30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac009e30 tx=0x7fd3ac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:53.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3a2ffd640 1 -- 172.21.15.57:0/1967571905 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac018020 con 0x7fd3b414bc60 2024-04-24T23:40:53.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3a2ffd640 1 -- 172.21.15.57:0/1967571905 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd3ac014480 con 0x7fd3b414bc60 2024-04-24T23:40:53.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3a2ffd640 1 -- 172.21.15.57:0/1967571905 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac014890 con 0x7fd3b414bc60 2024-04-24T23:40:53.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b8b65640 1 -- 172.21.15.57:0/1967571905 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3b40c08b0 con 0x7fd3b414bc60 2024-04-24T23:40:53.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.508+0000 7fd3b8b65640 1 -- 172.21.15.57:0/1967571905 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3b40c05b0 con 0x7fd3b414bc60 2024-04-24T23:40:53.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.512+0000 7fd3b8b65640 1 -- 172.21.15.57:0/1967571905 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3b4068290 con 0x7fd3b414bc60 2024-04-24T23:40:53.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.512+0000 7fd3a2ffd640 1 -- 172.21.15.57:0/1967571905 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd3ac01b020 con 0x7fd3b414bc60 2024-04-24T23:40:53.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.512+0000 7fd3a2ffd640 1 --2- 172.21.15.57:0/1967571905 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd3940678c0 0x7fd394069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:53.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.512+0000 7fd3a2ffd640 1 -- 172.21.15.57:0/1967571905 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6821+0+0 (secure 0 0 0) 0x7fd3ac086f90 con 0x7fd3b414bc60 2024-04-24T23:40:53.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.512+0000 7fd3b259c640 1 --2- 172.21.15.57:0/1967571905 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd3940678c0 0x7fd394069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:53.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.512+0000 7fd3b259c640 1 --2- 172.21.15.57:0/1967571905 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd3940678c0 0x7fd394069d80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd3a80ad000 tx=0x7fd3a80a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:53.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.516+0000 7fd3a2ffd640 1 -- 172.21.15.57:0/1967571905 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fd3ac022030 con 0x7fd3b414bc60 2024-04-24T23:40:53.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:53.708+0000 7fd3b8b65640 1 -- 172.21.15.57:0/1967571905 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd3b406e4c0 con 0x7fd3b414bc60 2024-04-24T23:40:54.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.372+0000 7fd3a2ffd640 1 -- 172.21.15.57:0/1967571905 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7fd3ac010040 con 0x7fd3b414bc60 2024-04-24T23:40:54.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.376+0000 7fd3b8b65640 1 -- 172.21.15.57:0/1967571905 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd3940678c0 msgr2=0x7fd394069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:54.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.376+0000 7fd3b8b65640 1 --2- 172.21.15.57:0/1967571905 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd3940678c0 0x7fd394069d80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd3a80ad000 tx=0x7fd3a80a6000 comp rx=0 tx=0).stop 2024-04-24T23:40:54.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.376+0000 7fd3b8b65640 1 -- 172.21.15.57:0/1967571905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3b414bc60 msgr2=0x7fd3b4071e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:54.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.376+0000 7fd3b8b65640 1 --2- 172.21.15.57:0/1967571905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3b414bc60 0x7fd3b4071e30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac009e30 tx=0x7fd3ac00c490 comp rx=0 tx=0).stop 2024-04-24T23:40:54.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.376+0000 7fd3b8b65640 1 -- 172.21.15.57:0/1967571905 shutdown_connections 2024-04-24T23:40:54.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.376+0000 7fd3b8b65640 1 --2- 172.21.15.57:0/1967571905 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fd3940678c0 0x7fd394069d80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:54.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.376+0000 7fd3b8b65640 1 --2- 172.21.15.57:0/1967571905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3b414bc60 0x7fd3b4071e30 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:54.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.376+0000 7fd3b8b65640 1 --2- 172.21.15.57:0/1967571905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3b40c2d00 0x7fd3b41485a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:54.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.376+0000 7fd3b8b65640 1 --2- 172.21.15.57:0/1967571905 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd3b40bd5f0 0x7fd3b40c12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:54.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.376+0000 7fd3b8b65640 1 -- 172.21.15.57:0/1967571905 >> 172.21.15.57:0/1967571905 conn(0x7fd3b406b920 msgr2=0x7fd3b4150940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:54.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.376+0000 7fd3b8b65640 1 -- 172.21.15.57:0/1967571905 shutdown_connections 2024-04-24T23:40:54.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.376+0000 7fd3b8b65640 1 -- 172.21.15.57:0/1967571905 wait complete. 2024-04-24T23:40:54.401 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-24T23:40:54.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.576+0000 7fc79e3dd640 1 Processor -- start 2024-04-24T23:40:54.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.576+0000 7fc79e3dd640 1 -- start start 2024-04-24T23:40:54.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.576+0000 7fc79e3dd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc7980675b0 0x7fc79814f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:54.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.576+0000 7fc79e3dd640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc79814f790 con 0x7fc79814bc70 2024-04-24T23:40:54.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.576+0000 7fc79e3dd640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc798071b60 con 0x7fc79806c480 2024-04-24T23:40:54.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.576+0000 7fc79e3dd640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fc798072d70 con 0x7fc7980675b0 2024-04-24T23:40:54.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.576+0000 7fc79c97a640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc79814bc70 0x7fc7981590a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:50682/0 (socket says 172.21.15.57:50682) 2024-04-24T23:40:54.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.576+0000 7fc79c97a640 1 -- 172.21.15.57:0/968249833 learned_addr learned my addr 172.21.15.57:0/968249833 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:40:54.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.576+0000 7fc7977fe640 1 --2- 172.21.15.57:0/968249833 >> v2:172.21.15.88:3300/0 conn(0x7fc7980675b0 0x7fc79814f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:54.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.576+0000 7fc796ffd640 1 -- 172.21.15.57:0/968249833 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1726836760 0 0) 0x7fc79814f790 con 0x7fc79814bc70 2024-04-24T23:40:54.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.576+0000 7fc796ffd640 1 -- 172.21.15.57:0/968249833 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc784003530 con 0x7fc79814bc70 2024-04-24T23:40:54.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc796ffd640 1 -- 172.21.15.57:0/968249833 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 177066644 0 0) 0x7fc784003530 con 0x7fc79814bc70 2024-04-24T23:40:54.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc796ffd640 1 -- 172.21.15.57:0/968249833 >> v2:172.21.15.88:3300/0 conn(0x7fc7980675b0 msgr2=0x7fc79814f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:54.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc796ffd640 1 --2- 172.21.15.57:0/968249833 >> v2:172.21.15.88:3300/0 conn(0x7fc7980675b0 0x7fc79814f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:54.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc796ffd640 1 -- 172.21.15.57:0/968249833 >> v1:172.21.15.88:6789/0 conn(0x7fc79806c480 legacy=0x7fc79806fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:54.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc796ffd640 1 -- 172.21.15.57:0/968249833 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7980a7cc0 con 0x7fc79814bc70 2024-04-24T23:40:54.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc796ffd640 1 -- 172.21.15.57:0/968249833 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7fc790001a00 con 0x7fc79814bc70 2024-04-24T23:40:54.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc796ffd640 1 -- 172.21.15.57:0/968249833 >> v1:172.21.15.57:6789/0 conn(0x7fc79814bc70 legacy=0x7fc7981590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:54.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc796ffd640 1 --2- 172.21.15.57:0/968249833 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc7840039c0 0x7fc784003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:54.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc796ffd640 1 --2- 172.21.15.57:0/968249833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc784004810 0x7fc784004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:54.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc796ffd640 1 --2- 172.21.15.57:0/968249833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7840051d0 0x7fc78400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:54.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc796ffd640 1 -- 172.21.15.57:0/968249833 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc798072d70 con 0x7fc7840051d0 2024-04-24T23:40:54.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc796ffd640 1 -- 172.21.15.57:0/968249833 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc78400c070 con 0x7fc784004810 2024-04-24T23:40:54.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc796ffd640 1 -- 172.21.15.57:0/968249833 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fc78400c270 con 0x7fc7840039c0 2024-04-24T23:40:54.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc79c97a640 1 --2- 172.21.15.57:0/968249833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7840051d0 0x7fc78400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:54.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc7977fe640 1 --2- 172.21.15.57:0/968249833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc784004810 0x7fc784004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:54.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc797fff640 1 --2- 172.21.15.57:0/968249833 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc7840039c0 0x7fc784003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:54.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc79c97a640 1 -- 172.21.15.57:0/968249833 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc7840039c0 msgr2=0x7fc784003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:54.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc79c97a640 1 --2- 172.21.15.57:0/968249833 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc7840039c0 0x7fc784003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:54.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc79c97a640 1 -- 172.21.15.57:0/968249833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc784004810 msgr2=0x7fc784004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:54.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc79c97a640 1 --2- 172.21.15.57:0/968249833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc784004810 0x7fc784004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:54.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc79c97a640 1 -- 172.21.15.57:0/968249833 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc784003530 con 0x7fc7840051d0 2024-04-24T23:40:54.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc797fff640 1 --2- 172.21.15.57:0/968249833 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc7840039c0 0x7fc784003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:40:54.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc79c97a640 1 -- 172.21.15.57:0/968249833 reap_dead start 2024-04-24T23:40:54.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc79c97a640 1 --2- 172.21.15.57:0/968249833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7840051d0 0x7fc78400b9d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc79000a850 tx=0x7fc79001d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=167c31fa0d79b8fb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:54.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc796ffd640 1 -- 172.21.15.57:0/968249833 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79000a4a0 con 0x7fc7840051d0 2024-04-24T23:40:54.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc796ffd640 1 -- 172.21.15.57:0/968249833 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc7900ad650 con 0x7fc7840051d0 2024-04-24T23:40:54.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc796ffd640 1 -- 172.21.15.57:0/968249833 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7900ada60 con 0x7fc7840051d0 2024-04-24T23:40:54.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc79e3dd640 1 -- 172.21.15.57:0/968249833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7840051d0 msgr2=0x7fc78400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:54.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc79e3dd640 1 --2- 172.21.15.57:0/968249833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7840051d0 0x7fc78400b9d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc79000a850 tx=0x7fc79001d3a0 comp rx=0 tx=0).stop 2024-04-24T23:40:54.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc79e3dd640 1 -- 172.21.15.57:0/968249833 shutdown_connections 2024-04-24T23:40:54.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc79e3dd640 1 --2- 172.21.15.57:0/968249833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7840051d0 0x7fc78400b9d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:54.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc79e3dd640 1 -- 172.21.15.57:0/968249833 >> 172.21.15.57:0/968249833 conn(0x7fc7980bf370 msgr2=0x7fc7980bf780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:54.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc79e3dd640 1 -- 172.21.15.57:0/968249833 shutdown_connections 2024-04-24T23:40:54.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.580+0000 7fc79e3dd640 1 -- 172.21.15.57:0/968249833 wait complete. 2024-04-24T23:40:54.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.584+0000 7fc79e3dd640 1 Processor -- start 2024-04-24T23:40:54.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.584+0000 7fc79e3dd640 1 -- start start 2024-04-24T23:40:54.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.584+0000 7fc79e3dd640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc7840051d0 0x7fc79814a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:54.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.584+0000 7fc79e3dd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc798150050 0x7fc7980be2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:54.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.584+0000 7fc79e3dd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7980be830 0x7fc798151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:54.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.584+0000 7fc79e3dd640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc79806c860 con 0x7fc7980be830 2024-04-24T23:40:54.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.584+0000 7fc79e3dd640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc7980728e0 con 0x7fc798150050 2024-04-24T23:40:54.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.584+0000 7fc79e3dd640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fc79806c9e0 con 0x7fc7840051d0 2024-04-24T23:40:54.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.584+0000 7fc79c97a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7980be830 0x7fc798151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:54.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.584+0000 7fc79c97a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7980be830 0x7fc798151160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44988/0 (socket says 172.21.15.57:44988) 2024-04-24T23:40:54.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.584+0000 7fc79c97a640 1 -- 172.21.15.57:0/3688504122 learned_addr learned my addr 172.21.15.57:0/3688504122 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:54.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.584+0000 7fc7977fe640 1 --2- 172.21.15.57:0/3688504122 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc798150050 0x7fc7980be2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:54.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.584+0000 7fc79c97a640 1 -- 172.21.15.57:0/3688504122 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc7840051d0 msgr2=0x7fc79814a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:54.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.584+0000 7fc797fff640 1 --2- 172.21.15.57:0/3688504122 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc7840051d0 0x7fc79814a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:54.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.584+0000 7fc79c97a640 1 --2- 172.21.15.57:0/3688504122 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc7840051d0 0x7fc79814a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:54.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.584+0000 7fc79c97a640 1 -- 172.21.15.57:0/3688504122 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc798150050 msgr2=0x7fc7980be2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:54.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.584+0000 7fc79c97a640 1 --2- 172.21.15.57:0/3688504122 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc798150050 0x7fc7980be2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:54.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.584+0000 7fc79c97a640 1 -- 172.21.15.57:0/3688504122 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7981e7ec0 con 0x7fc7980be830 2024-04-24T23:40:54.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.584+0000 7fc7977fe640 1 --2- 172.21.15.57:0/3688504122 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc798150050 0x7fc7980be2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:40:54.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.584+0000 7fc79c97a640 1 --2- 172.21.15.57:0/3688504122 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7980be830 0x7fc798151160 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc79001ce10 tx=0x7fc784005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:54.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.584+0000 7fc794ff9640 1 -- 172.21.15.57:0/3688504122 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7900019c0 con 0x7fc7980be830 2024-04-24T23:40:54.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.584+0000 7fc794ff9640 1 -- 172.21.15.57:0/3688504122 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc7900b4070 con 0x7fc7980be830 2024-04-24T23:40:54.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.584+0000 7fc79e3dd640 1 -- 172.21.15.57:0/3688504122 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc798150690 con 0x7fc7980be830 2024-04-24T23:40:54.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.584+0000 7fc794ff9640 1 -- 172.21.15.57:0/3688504122 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7900ada00 con 0x7fc7980be830 2024-04-24T23:40:54.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.584+0000 7fc79e3dd640 1 -- 172.21.15.57:0/3688504122 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7980c2000 con 0x7fc7980be830 2024-04-24T23:40:54.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.584+0000 7fc79e3dd640 1 -- 172.21.15.57:0/3688504122 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc798068290 con 0x7fc7980be830 2024-04-24T23:40:54.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.588+0000 7fc794ff9640 1 -- 172.21.15.57:0/3688504122 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc7900adba0 con 0x7fc7980be830 2024-04-24T23:40:54.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.588+0000 7fc794ff9640 1 --2- 172.21.15.57:0/3688504122 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc7780678c0 0x7fc778069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:54.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.588+0000 7fc794ff9640 1 -- 172.21.15.57:0/3688504122 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6821+0+0 (secure 0 0 0) 0x7fc790120c70 con 0x7fc7980be830 2024-04-24T23:40:54.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.588+0000 7fc797fff640 1 --2- 172.21.15.57:0/3688504122 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc7780678c0 0x7fc778069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:54.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.588+0000 7fc797fff640 1 --2- 172.21.15.57:0/3688504122 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc7780678c0 0x7fc778069d80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc7880015e0 tx=0x7fc788009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:54.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.592+0000 7fc794ff9640 1 -- 172.21.15.57:0/3688504122 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fc7900c8080 con 0x7fc7980be830 2024-04-24T23:40:54.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:54.748+0000 7fc79e3dd640 1 -- 172.21.15.57:0/3688504122 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc798150ec0 con 0x7fc7980be830 2024-04-24T23:40:55.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.728+0000 7fc794ff9640 1 -- 172.21.15.57:0/3688504122 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) ==== 181+0+0 (secure 0 0 0) 0x7fc7900170b0 con 0x7fc7980be830 2024-04-24T23:40:55.728 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' removed 2024-04-24T23:40:55.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.728+0000 7fc79e3dd640 1 -- 172.21.15.57:0/3688504122 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc7780678c0 msgr2=0x7fc778069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:55.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.728+0000 7fc79e3dd640 1 --2- 172.21.15.57:0/3688504122 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc7780678c0 0x7fc778069d80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc7880015e0 tx=0x7fc788009040 comp rx=0 tx=0).stop 2024-04-24T23:40:55.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.728+0000 7fc79e3dd640 1 -- 172.21.15.57:0/3688504122 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7980be830 msgr2=0x7fc798151160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:55.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.728+0000 7fc79e3dd640 1 --2- 172.21.15.57:0/3688504122 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7980be830 0x7fc798151160 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc79001ce10 tx=0x7fc784005840 comp rx=0 tx=0).stop 2024-04-24T23:40:55.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.732+0000 7fc79e3dd640 1 -- 172.21.15.57:0/3688504122 shutdown_connections 2024-04-24T23:40:55.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.732+0000 7fc79e3dd640 1 --2- 172.21.15.57:0/3688504122 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fc7780678c0 0x7fc778069d80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:55.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.732+0000 7fc79e3dd640 1 --2- 172.21.15.57:0/3688504122 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7980be830 0x7fc798151160 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:55.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.732+0000 7fc79e3dd640 1 --2- 172.21.15.57:0/3688504122 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc798150050 0x7fc7980be2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:55.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.732+0000 7fc79e3dd640 1 --2- 172.21.15.57:0/3688504122 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc7840051d0 0x7fc79814a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:55.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.732+0000 7fc79e3dd640 1 -- 172.21.15.57:0/3688504122 >> 172.21.15.57:0/3688504122 conn(0x7fc7980bf370 msgr2=0x7fc7980c11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:55.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.732+0000 7fc79e3dd640 1 -- 172.21.15.57:0/3688504122 shutdown_connections 2024-04-24T23:40:55.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.732+0000 7fc79e3dd640 1 -- 172.21.15.57:0/3688504122 wait complete. 2024-04-24T23:40:55.758 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-24T23:40:55.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.884+0000 7fdd6b909640 1 Processor -- start 2024-04-24T23:40:55.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.884+0000 7fdd6b909640 1 -- start start 2024-04-24T23:40:55.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.884+0000 7fdd6b909640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd64151680 0x7fdd6415c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:55.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.884+0000 7fdd6b909640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd640718f0 con 0x7fdd640bd590 2024-04-24T23:40:55.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.884+0000 7fdd6b909640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd64071330 con 0x7fdd64070b50 2024-04-24T23:40:55.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.884+0000 7fdd6b909640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fdd64071610 con 0x7fdd64151680 2024-04-24T23:40:55.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.884+0000 7fdd696a5640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fdd640bd590 0x7fdd6414da60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:50684/0 (socket says 172.21.15.57:50684) 2024-04-24T23:40:55.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.884+0000 7fdd696a5640 1 -- 172.21.15.57:0/1982826403 learned_addr learned my addr 172.21.15.57:0/1982826403 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T23:40:55.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.884+0000 7fdd69ea6640 1 --2- 172.21.15.57:0/1982826403 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd64151680 0x7fdd6415c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:55.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.884+0000 7fdd63fff640 1 -- 172.21.15.57:0/1982826403 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2843680778 0 0) 0x7fdd640718f0 con 0x7fdd640bd590 2024-04-24T23:40:55.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.884+0000 7fdd63fff640 1 -- 172.21.15.57:0/1982826403 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd4c003530 con 0x7fdd640bd590 2024-04-24T23:40:55.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.884+0000 7fdd63fff640 1 -- 172.21.15.57:0/1982826403 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 999929239 0 0) 0x7fdd64071330 con 0x7fdd64070b50 2024-04-24T23:40:55.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.884+0000 7fdd63fff640 1 -- 172.21.15.57:0/1982826403 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd640718f0 con 0x7fdd64070b50 2024-04-24T23:40:55.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.884+0000 7fdd63fff640 1 -- 172.21.15.57:0/1982826403 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4084458232 0 0) 0x7fdd4c003530 con 0x7fdd640bd590 2024-04-24T23:40:55.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.884+0000 7fdd63fff640 1 -- 172.21.15.57:0/1982826403 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd64151680 msgr2=0x7fdd6415c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:55.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.884+0000 7fdd63fff640 1 --2- 172.21.15.57:0/1982826403 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd64151680 0x7fdd6415c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:55.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.884+0000 7fdd63fff640 1 -- 172.21.15.57:0/1982826403 >> v1:172.21.15.88:6789/0 conn(0x7fdd64070b50 legacy=0x7fdd64150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:55.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.884+0000 7fdd63fff640 1 -- 172.21.15.57:0/1982826403 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd64150a50 con 0x7fdd640bd590 2024-04-24T23:40:55.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.884+0000 7fdd63fff640 1 -- 172.21.15.57:0/1982826403 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3481534796 0 0) 0x7fdd5c001980 con 0x7fdd640bd590 2024-04-24T23:40:55.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.884+0000 7fdd63fff640 1 -- 172.21.15.57:0/1982826403 >> v1:172.21.15.57:6789/0 conn(0x7fdd640bd590 legacy=0x7fdd6414da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:55.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.884+0000 7fdd63fff640 1 --2- 172.21.15.57:0/1982826403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd4c003b80 0x7fdd4c003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:55.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.884+0000 7fdd63fff640 1 --2- 172.21.15.57:0/1982826403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd4c004810 0x7fdd4c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:55.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.884+0000 7fdd63fff640 1 --2- 172.21.15.57:0/1982826403 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd64151680 0x7fdd4c0052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:55.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.884+0000 7fdd63fff640 1 -- 172.21.15.57:0/1982826403 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fdd64071610 con 0x7fdd4c003b80 2024-04-24T23:40:55.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.884+0000 7fdd63fff640 1 -- 172.21.15.57:0/1982826403 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4c00bbd0 con 0x7fdd4c004810 2024-04-24T23:40:55.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.884+0000 7fdd63fff640 1 -- 172.21.15.57:0/1982826403 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fdd4c00bdd0 con 0x7fdd64151680 2024-04-24T23:40:55.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.888+0000 7fdd696a5640 1 --2- 172.21.15.57:0/1982826403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd4c003b80 0x7fdd4c003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:55.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.888+0000 7fdd68ea4640 1 --2- 172.21.15.57:0/1982826403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd4c004810 0x7fdd4c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:55.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.888+0000 7fdd69ea6640 1 --2- 172.21.15.57:0/1982826403 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd64151680 0x7fdd4c0052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:55.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.888+0000 7fdd696a5640 1 -- 172.21.15.57:0/1982826403 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd64151680 msgr2=0x7fdd4c0052d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:55.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.888+0000 7fdd696a5640 1 --2- 172.21.15.57:0/1982826403 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd64151680 0x7fdd4c0052d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:55.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.888+0000 7fdd696a5640 1 -- 172.21.15.57:0/1982826403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd4c004810 msgr2=0x7fdd4c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:55.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.888+0000 7fdd696a5640 1 --2- 172.21.15.57:0/1982826403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd4c004810 0x7fdd4c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:55.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.888+0000 7fdd696a5640 1 -- 172.21.15.57:0/1982826403 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4c003530 con 0x7fdd4c003b80 2024-04-24T23:40:55.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.888+0000 7fdd69ea6640 1 --2- 172.21.15.57:0/1982826403 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd64151680 0x7fdd4c0052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:40:55.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.888+0000 7fdd696a5640 1 --2- 172.21.15.57:0/1982826403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd4c003b80 0x7fdd4c003f80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c00a6d0 tx=0x7fdd5c01d1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e28ac922010e4457 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:55.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.888+0000 7fdd63fff640 1 -- 172.21.15.57:0/1982826403 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c00a2f0 con 0x7fdd4c003b80 2024-04-24T23:40:55.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.888+0000 7fdd63fff640 1 -- 172.21.15.57:0/1982826403 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fdd5c007350 con 0x7fdd4c003b80 2024-04-24T23:40:55.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.888+0000 7fdd63fff640 1 -- 172.21.15.57:0/1982826403 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c0077a0 con 0x7fdd4c003b80 2024-04-24T23:40:55.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.888+0000 7fdd6b909640 1 -- 172.21.15.57:0/1982826403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd4c003b80 msgr2=0x7fdd4c003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:55.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.888+0000 7fdd6b909640 1 --2- 172.21.15.57:0/1982826403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd4c003b80 0x7fdd4c003f80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c00a6d0 tx=0x7fdd5c01d1e0 comp rx=0 tx=0).stop 2024-04-24T23:40:55.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.888+0000 7fdd69ea6640 1 -- 172.21.15.57:0/1982826403 reap_dead start 2024-04-24T23:40:55.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.888+0000 7fdd6b909640 1 -- 172.21.15.57:0/1982826403 shutdown_connections 2024-04-24T23:40:55.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.888+0000 7fdd6b909640 1 -- 172.21.15.57:0/1982826403 >> 172.21.15.57:0/1982826403 conn(0x7fdd640c0a00 msgr2=0x7fdd640c0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:55.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.888+0000 7fdd6b909640 1 -- 172.21.15.57:0/1982826403 shutdown_connections 2024-04-24T23:40:55.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.888+0000 7fdd6b909640 1 -- 172.21.15.57:0/1982826403 wait complete. 2024-04-24T23:40:55.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.892+0000 7fdd6b909640 1 Processor -- start 2024-04-24T23:40:55.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.892+0000 7fdd6b909640 1 -- start start 2024-04-24T23:40:55.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.892+0000 7fdd6b909640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd4c003b80 0x7fdd64148310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:55.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.892+0000 7fdd6b909640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd6413ffe0 0x7fdd64149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:55.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.892+0000 7fdd6b909640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd6406d900 0x7fdd641495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:55.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.892+0000 7fdd6b909640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6414e2f0 con 0x7fdd4c003b80 2024-04-24T23:40:55.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.892+0000 7fdd6b909640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6414e170 con 0x7fdd6406d900 2024-04-24T23:40:55.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.892+0000 7fdd6b909640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7fdd6415ca70 con 0x7fdd6413ffe0 2024-04-24T23:40:55.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.892+0000 7fdd696a5640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd4c003b80 0x7fdd64148310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:55.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.892+0000 7fdd696a5640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd4c003b80 0x7fdd64148310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45012/0 (socket says 172.21.15.57:45012) 2024-04-24T23:40:55.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.892+0000 7fdd696a5640 1 -- 172.21.15.57:0/1110591128 learned_addr learned my addr 172.21.15.57:0/1110591128 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:55.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.892+0000 7fdd69ea6640 1 --2- 172.21.15.57:0/1110591128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd6406d900 0x7fdd641495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:55.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.892+0000 7fdd68ea4640 1 --2- 172.21.15.57:0/1110591128 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd6413ffe0 0x7fdd64149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:55.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.892+0000 7fdd696a5640 1 -- 172.21.15.57:0/1110591128 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd6413ffe0 msgr2=0x7fdd64149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:55.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.892+0000 7fdd696a5640 1 --2- 172.21.15.57:0/1110591128 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd6413ffe0 0x7fdd64149090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:55.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.892+0000 7fdd696a5640 1 -- 172.21.15.57:0/1110591128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd6406d900 msgr2=0x7fdd641495d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:55.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.892+0000 7fdd696a5640 1 --2- 172.21.15.57:0/1110591128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd6406d900 0x7fdd641495d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:55.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.892+0000 7fdd696a5640 1 -- 172.21.15.57:0/1110591128 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd64148850 con 0x7fdd4c003b80 2024-04-24T23:40:55.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.892+0000 7fdd69ea6640 1 --2- 172.21.15.57:0/1110591128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd6406d900 0x7fdd641495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:40:55.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.892+0000 7fdd696a5640 1 --2- 172.21.15.57:0/1110591128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd4c003b80 0x7fdd64148310 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c00a6d0 tx=0x7fdd4c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:55.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.892+0000 7fdd61ffb640 1 -- 172.21.15.57:0/1110591128 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c0be070 con 0x7fdd4c003b80 2024-04-24T23:40:55.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.892+0000 7fdd61ffb640 1 -- 172.21.15.57:0/1110591128 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fdd5c0b3040 con 0x7fdd4c003b80 2024-04-24T23:40:55.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.892+0000 7fdd6b909640 1 -- 172.21.15.57:0/1110591128 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd6406c4c0 con 0x7fdd4c003b80 2024-04-24T23:40:55.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.892+0000 7fdd61ffb640 1 -- 172.21.15.57:0/1110591128 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c007500 con 0x7fdd4c003b80 2024-04-24T23:40:55.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.892+0000 7fdd6b909640 1 -- 172.21.15.57:0/1110591128 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd6414b4f0 con 0x7fdd4c003b80 2024-04-24T23:40:55.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.892+0000 7fdd6b909640 1 -- 172.21.15.57:0/1110591128 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd64068930 con 0x7fdd4c003b80 2024-04-24T23:40:55.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.892+0000 7fdd61ffb640 1 -- 172.21.15.57:0/1110591128 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdd5c0c1070 con 0x7fdd4c003b80 2024-04-24T23:40:55.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.896+0000 7fdd61ffb640 1 --2- 172.21.15.57:0/1110591128 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fdd500678f0 0x7fdd50069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:55.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.896+0000 7fdd61ffb640 1 -- 172.21.15.57:0/1110591128 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6383+0+0 (secure 0 0 0) 0x7fdd5c1209d0 con 0x7fdd4c003b80 2024-04-24T23:40:55.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.896+0000 7fdd68ea4640 1 --2- 172.21.15.57:0/1110591128 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fdd500678f0 0x7fdd50069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:55.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.896+0000 7fdd68ea4640 1 --2- 172.21.15.57:0/1110591128 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fdd500678f0 0x7fdd50069db0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdd64154fb0 tx=0x7fdd58009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:55.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:55.900+0000 7fdd61ffb640 1 -- 172.21.15.57:0/1110591128 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fdd64148850 con 0x7fdd4c003b80 2024-04-24T23:40:56.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.060+0000 7fdd6b909640 1 -- 172.21.15.57:0/1110591128 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdd640be140 con 0x7fdd4c003b80 2024-04-24T23:40:56.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.740+0000 7fdd61ffb640 1 -- 172.21.15.57:0/1110591128 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) ==== 169+0+0 (secure 0 0 0) 0x7fdd5c016ef0 con 0x7fdd4c003b80 2024-04-24T23:40:56.742 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' removed 2024-04-24T23:40:56.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.744+0000 7fdd6b909640 1 -- 172.21.15.57:0/1110591128 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fdd500678f0 msgr2=0x7fdd50069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:56.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.744+0000 7fdd6b909640 1 --2- 172.21.15.57:0/1110591128 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fdd500678f0 0x7fdd50069db0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdd64154fb0 tx=0x7fdd58009040 comp rx=0 tx=0).stop 2024-04-24T23:40:56.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.744+0000 7fdd6b909640 1 -- 172.21.15.57:0/1110591128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd4c003b80 msgr2=0x7fdd64148310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:56.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.744+0000 7fdd6b909640 1 --2- 172.21.15.57:0/1110591128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd4c003b80 0x7fdd64148310 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c00a6d0 tx=0x7fdd4c005840 comp rx=0 tx=0).stop 2024-04-24T23:40:56.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.744+0000 7fdd6b909640 1 -- 172.21.15.57:0/1110591128 shutdown_connections 2024-04-24T23:40:56.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.744+0000 7fdd6b909640 1 --2- 172.21.15.57:0/1110591128 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7fdd500678f0 0x7fdd50069db0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:56.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.744+0000 7fdd6b909640 1 --2- 172.21.15.57:0/1110591128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd6406d900 0x7fdd641495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:56.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.744+0000 7fdd6b909640 1 --2- 172.21.15.57:0/1110591128 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd6413ffe0 0x7fdd64149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:56.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.744+0000 7fdd6b909640 1 --2- 172.21.15.57:0/1110591128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd4c003b80 0x7fdd64148310 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:56.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.744+0000 7fdd6b909640 1 -- 172.21.15.57:0/1110591128 >> 172.21.15.57:0/1110591128 conn(0x7fdd640c0a00 msgr2=0x7fdd640700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:56.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.744+0000 7fdd6b909640 1 -- 172.21.15.57:0/1110591128 shutdown_connections 2024-04-24T23:40:56.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.744+0000 7fdd6b909640 1 -- 172.21.15.57:0/1110591128 wait complete. 2024-04-24T23:40:56.771 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-24T23:40:56.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.896+0000 7f6f60715640 1 Processor -- start 2024-04-24T23:40:56.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.896+0000 7f6f60715640 1 -- start start 2024-04-24T23:40:56.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.896+0000 7f6f60715640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6f5814bc60 0x7f6f580c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:56.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.896+0000 7f6f60715640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6f580c2d00 0x7f6f58151c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:56.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.896+0000 7f6f60715640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6f580bd5f0 0x7f6f58152160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:56.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.896+0000 7f6f60715640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f6f581526a0 con 0x7f6f580c2d00 2024-04-24T23:40:56.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.896+0000 7f6f60715640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f6f580bde20 con 0x7f6f580bd5f0 2024-04-24T23:40:56.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.896+0000 7f6f60715640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f6f580bd200 con 0x7f6f5814bc60 2024-04-24T23:40:56.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.896+0000 7f6f5dcb0640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6f580c2d00 0x7f6f58151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:56.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.896+0000 7f6f5dcb0640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6f580c2d00 0x7f6f58151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45026/0 (socket says 172.21.15.57:45026) 2024-04-24T23:40:56.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.896+0000 7f6f5dcb0640 1 -- 172.21.15.57:0/669361929 learned_addr learned my addr 172.21.15.57:0/669361929 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:56.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.896+0000 7f6f5ecb2640 1 --2- 172.21.15.57:0/669361929 >> v2:172.21.15.88:3300/0 conn(0x7f6f580bd5f0 0x7f6f58152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:56.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.896+0000 7f6f5e4b1640 1 --2- 172.21.15.57:0/669361929 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6f5814bc60 0x7f6f580c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:56.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.896+0000 7f6f5dcb0640 1 -- 172.21.15.57:0/669361929 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6f5814bc60 msgr2=0x7f6f580c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:56.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.896+0000 7f6f5dcb0640 1 --2- 172.21.15.57:0/669361929 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6f5814bc60 0x7f6f580c27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:56.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.896+0000 7f6f5dcb0640 1 -- 172.21.15.57:0/669361929 >> v2:172.21.15.88:3300/0 conn(0x7f6f580bd5f0 msgr2=0x7f6f58152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:40:56.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.896+0000 7f6f5dcb0640 1 --2- 172.21.15.57:0/669361929 >> v2:172.21.15.88:3300/0 conn(0x7f6f580bd5f0 0x7f6f58152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:56.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.896+0000 7f6f5dcb0640 1 -- 172.21.15.57:0/669361929 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f580be070 con 0x7f6f580c2d00 2024-04-24T23:40:56.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.896+0000 7f6f5e4b1640 1 --2- 172.21.15.57:0/669361929 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6f5814bc60 0x7f6f580c27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:40:56.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.900+0000 7f6f5dcb0640 1 --2- 172.21.15.57:0/669361929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f580c2d00 0x7f6f58151c20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6f580bcb40 tx=0x7f6f4801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d26aa3fb64c560e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:56.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.900+0000 7f6f5d4af640 1 -- 172.21.15.57:0/669361929 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f480b0070 con 0x7f6f580c2d00 2024-04-24T23:40:56.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.900+0000 7f6f5d4af640 1 -- 172.21.15.57:0/669361929 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6f480ab600 con 0x7f6f580c2d00 2024-04-24T23:40:56.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.900+0000 7f6f5d4af640 1 -- 172.21.15.57:0/669361929 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f480ab9f0 con 0x7f6f580c2d00 2024-04-24T23:40:56.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.900+0000 7f6f60715640 1 -- 172.21.15.57:0/669361929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f580c2d00 msgr2=0x7f6f58151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:56.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.900+0000 7f6f60715640 1 --2- 172.21.15.57:0/669361929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f580c2d00 0x7f6f58151c20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6f580bcb40 tx=0x7f6f4801c400 comp rx=0 tx=0).stop 2024-04-24T23:40:56.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.900+0000 7f6f60715640 1 -- 172.21.15.57:0/669361929 shutdown_connections 2024-04-24T23:40:56.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.900+0000 7f6f60715640 1 --2- 172.21.15.57:0/669361929 >> v2:172.21.15.88:3300/0 conn(0x7f6f580bd5f0 0x7f6f58152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:56.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.900+0000 7f6f60715640 1 --2- 172.21.15.57:0/669361929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f580c2d00 0x7f6f58151c20 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:56.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.900+0000 7f6f60715640 1 --2- 172.21.15.57:0/669361929 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6f5814bc60 0x7f6f580c27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:56.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.900+0000 7f6f60715640 1 -- 172.21.15.57:0/669361929 >> 172.21.15.57:0/669361929 conn(0x7f6f5806b920 msgr2=0x7f6f580c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:56.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.900+0000 7f6f60715640 1 -- 172.21.15.57:0/669361929 shutdown_connections 2024-04-24T23:40:56.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.900+0000 7f6f60715640 1 -- 172.21.15.57:0/669361929 wait complete. 2024-04-24T23:40:56.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.900+0000 7f6f60715640 1 Processor -- start 2024-04-24T23:40:56.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.900+0000 7f6f60715640 1 -- start start 2024-04-24T23:40:56.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.904+0000 7f6f60715640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f580bd5f0 0x7f6f580bb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:56.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.904+0000 7f6f60715640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f580c2d00 0x7f6f5814e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:56.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.904+0000 7f6f60715640 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6f5814bc60 0x7f6f581e7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:56.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.904+0000 7f6f60715640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6f580bcfe0 con 0x7f6f580bd5f0 2024-04-24T23:40:56.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.904+0000 7f6f60715640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6f580bce60 con 0x7f6f580c2d00 2024-04-24T23:40:56.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.904+0000 7f6f60715640 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 -- 0x7f6f5806dee0 con 0x7f6f5814bc60 2024-04-24T23:40:56.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.904+0000 7f6f5e4b1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f580bd5f0 0x7f6f580bb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:56.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.904+0000 7f6f5e4b1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f580bd5f0 0x7f6f580bb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45038/0 (socket says 172.21.15.57:45038) 2024-04-24T23:40:56.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.904+0000 7f6f5e4b1640 1 -- 172.21.15.57:0/3110972474 learned_addr learned my addr 172.21.15.57:0/3110972474 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T23:40:56.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.904+0000 7f6f5dcb0640 1 --2- 172.21.15.57:0/3110972474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f580c2d00 0x7f6f5814e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:56.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.904+0000 7f6f5ecb2640 1 --2- 172.21.15.57:0/3110972474 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6f5814bc60 0x7f6f581e7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:56.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.904+0000 7f6f5e4b1640 1 -- 172.21.15.57:0/3110972474 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6f5814bc60 msgr2=0x7f6f581e7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:56.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.904+0000 7f6f5e4b1640 1 --2- 172.21.15.57:0/3110972474 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6f5814bc60 0x7f6f581e7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:56.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.904+0000 7f6f5e4b1640 1 -- 172.21.15.57:0/3110972474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f580c2d00 msgr2=0x7f6f5814e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:56.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.904+0000 7f6f5e4b1640 1 --2- 172.21.15.57:0/3110972474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f580c2d00 0x7f6f5814e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:56.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.904+0000 7f6f5e4b1640 1 -- 172.21.15.57:0/3110972474 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f5814ee90 con 0x7f6f580bd5f0 2024-04-24T23:40:56.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.904+0000 7f6f5dcb0640 1 --2- 172.21.15.57:0/3110972474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f580c2d00 0x7f6f5814e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:40:56.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.904+0000 7f6f5e4b1640 1 --2- 172.21.15.57:0/3110972474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f580bd5f0 0x7f6f580bb110 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000ce00 tx=0x7f6f5000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:56.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.904+0000 7f6f4effd640 1 -- 172.21.15.57:0/3110972474 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5000f890 con 0x7f6f580bd5f0 2024-04-24T23:40:56.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.904+0000 7f6f4effd640 1 -- 172.21.15.57:0/3110972474 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6f5000fa30 con 0x7f6f580bd5f0 2024-04-24T23:40:56.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.904+0000 7f6f60715640 1 -- 172.21.15.57:0/3110972474 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f581eb050 con 0x7f6f580bd5f0 2024-04-24T23:40:56.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.904+0000 7f6f4effd640 1 -- 172.21.15.57:0/3110972474 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5000fe60 con 0x7f6f580bd5f0 2024-04-24T23:40:56.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.904+0000 7f6f60715640 1 -- 172.21.15.57:0/3110972474 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f580b8bd0 con 0x7f6f580bd5f0 2024-04-24T23:40:56.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.904+0000 7f6f60715640 1 -- 172.21.15.57:0/3110972474 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f58068290 con 0x7f6f580bd5f0 2024-04-24T23:40:56.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.904+0000 7f6f4effd640 1 -- 172.21.15.57:0/3110972474 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6f50018400 con 0x7f6f580bd5f0 2024-04-24T23:40:56.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.904+0000 7f6f4effd640 1 --2- 172.21.15.57:0/3110972474 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6f3c0678c0 0x7f6f3c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:40:56.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.904+0000 7f6f4effd640 1 -- 172.21.15.57:0/3110972474 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5853+0+0 (secure 0 0 0) 0x7f6f50086d30 con 0x7f6f580bd5f0 2024-04-24T23:40:56.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.904+0000 7f6f5dcb0640 1 --2- 172.21.15.57:0/3110972474 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6f3c0678c0 0x7f6f3c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:40:56.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.908+0000 7f6f5dcb0640 1 --2- 172.21.15.57:0/3110972474 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6f3c0678c0 0x7f6f3c069d80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6f480ad000 tx=0x7f6f48008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:40:56.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:56.908+0000 7f6f4effd640 1 -- 172.21.15.57:0/3110972474 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f6f5814ee90 con 0x7f6f580bd5f0 2024-04-24T23:40:57.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:57.084+0000 7f6f60715640 1 -- 172.21.15.57:0/3110972474 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6f5806ef70 con 0x7f6f580bd5f0 2024-04-24T23:40:57.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:57.744+0000 7f6f4effd640 1 -- 172.21.15.57:0/3110972474 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) ==== 178+0+0 (secure 0 0 0) 0x7f6f50014030 con 0x7f6f580bd5f0 2024-04-24T23:40:57.745 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data_ec' removed 2024-04-24T23:40:57.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:57.744+0000 7f6f60715640 1 -- 172.21.15.57:0/3110972474 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6f3c0678c0 msgr2=0x7f6f3c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:57.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:57.744+0000 7f6f60715640 1 --2- 172.21.15.57:0/3110972474 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6f3c0678c0 0x7f6f3c069d80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6f480ad000 tx=0x7f6f48008040 comp rx=0 tx=0).stop 2024-04-24T23:40:57.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:57.744+0000 7f6f60715640 1 -- 172.21.15.57:0/3110972474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f580bd5f0 msgr2=0x7f6f580bb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:40:57.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:57.744+0000 7f6f60715640 1 --2- 172.21.15.57:0/3110972474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f580bd5f0 0x7f6f580bb110 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000ce00 tx=0x7f6f5000a650 comp rx=0 tx=0).stop 2024-04-24T23:40:57.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:57.748+0000 7f6f60715640 1 -- 172.21.15.57:0/3110972474 shutdown_connections 2024-04-24T23:40:57.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:57.748+0000 7f6f60715640 1 --2- 172.21.15.57:0/3110972474 >> [v2:172.21.15.88:6832/3931748276,v1:172.21.15.88:6833/3931748276] conn(0x7f6f3c0678c0 0x7f6f3c069d80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:57.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:57.748+0000 7f6f60715640 1 --2- 172.21.15.57:0/3110972474 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6f5814bc60 0x7f6f581e7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:57.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:57.748+0000 7f6f60715640 1 --2- 172.21.15.57:0/3110972474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f580c2d00 0x7f6f5814e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:57.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:57.748+0000 7f6f60715640 1 --2- 172.21.15.57:0/3110972474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f580bd5f0 0x7f6f580bb110 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:40:57.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:57.748+0000 7f6f60715640 1 -- 172.21.15.57:0/3110972474 >> 172.21.15.57:0/3110972474 conn(0x7f6f5806b920 msgr2=0x7f6f58150730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:40:57.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:57.748+0000 7f6f60715640 1 -- 172.21.15.57:0/3110972474 shutdown_connections 2024-04-24T23:40:57.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T23:40:57.748+0000 7f6f60715640 1 -- 172.21.15.57:0/3110972474 wait complete. 2024-04-24T23:40:57.774 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-24T23:40:57.774 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-24T23:40:57.774 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:40:57.785 INFO:tasks.ceph.mds.a:Stopped 2024-04-24T23:40:57.786 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-24T23:40:57.786 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:40:57.840 INFO:tasks.ceph.mds.c:Stopped 2024-04-24T23:40:57.840 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-24T23:40:57.840 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:40:57.853 INFO:tasks.ceph.mds.b:Stopped 2024-04-24T23:40:57.854 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-24T23:40:57.854 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-24T23:40:57.854 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:40:59.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-04-24T23:41:03.955 INFO:tasks.ceph.osd.0:Stopped 2024-04-24T23:41:03.956 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-24T23:41:03.956 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:41:04.014 INFO:tasks.ceph.osd.1:Stopped 2024-04-24T23:41:04.014 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-24T23:41:04.015 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:41:04.097 INFO:tasks.ceph.osd.2:Stopped 2024-04-24T23:41:04.097 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-24T23:41:04.097 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:41:04.184 INFO:tasks.ceph.osd.3:Stopped 2024-04-24T23:41:04.184 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-24T23:41:04.184 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:41:04.271 INFO:tasks.ceph.osd.4:Stopped 2024-04-24T23:41:04.271 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-24T23:41:04.272 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:41:04.349 INFO:tasks.ceph.osd.5:Stopped 2024-04-24T23:41:04.349 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-24T23:41:04.350 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:41:04.419 INFO:tasks.ceph.osd.6:Stopped 2024-04-24T23:41:04.420 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-24T23:41:04.420 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:41:05.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-24T23:41:05.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-04-24T23:41:07.682 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:41:07.685 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:41:07.687 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:41:07.690 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:41:10.521 INFO:tasks.ceph.osd.7:Stopped 2024-04-24T23:41:10.522 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-24T23:41:10.522 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-24T23:41:10.522 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:41:10.528 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-24T23:41:10.528 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-04-24T23:41:10.550 INFO:tasks.ceph.mgr.y:Stopped 2024-04-24T23:41:10.551 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-24T23:41:10.551 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:41:10.580 INFO:tasks.ceph.mgr.x:Stopped 2024-04-24T23:41:10.580 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-24T23:41:10.580 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-24T23:41:10.580 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:41:10.611 INFO:tasks.ceph.mon.a:Stopped 2024-04-24T23:41:10.612 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-24T23:41:10.612 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:41:10.634 INFO:tasks.ceph.mon.b:Stopped 2024-04-24T23:41:10.634 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-24T23:41:10.634 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:41:10.699 INFO:tasks.ceph.mon.c:Stopped 2024-04-24T23:41:10.699 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-24T23:41:10.700 DEBUG:teuthology.orchestra.run.smithi057:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-24T23:41:10.718 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi057.front.sepia.ceph.com 2024-04-24T23:41:10.718 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-24T23:41:11.318 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi057.front.sepia.ceph.com 2024-04-24T23:41:11.319 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-24T23:41:11.536 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi057.front.sepia.ceph.com 2024-04-24T23:41:11.536 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-24T23:41:11.712 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi057.front.sepia.ceph.com 2024-04-24T23:41:11.712 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-24T23:41:11.895 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi088.front.sepia.ceph.com 2024-04-24T23:41:11.896 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-24T23:41:12.077 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi088.front.sepia.ceph.com 2024-04-24T23:41:12.077 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-24T23:41:12.357 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi088.front.sepia.ceph.com 2024-04-24T23:41:12.358 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-24T23:41:12.553 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi088.front.sepia.ceph.com 2024-04-24T23:41:12.553 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-24T23:41:12.759 INFO:tasks.ceph:Archiving mon data... 2024-04-24T23:41:12.760 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672197/data/mon.a.tgz 2024-04-24T23:41:12.760 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2024-04-24T23:41:12.767 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.rNHHftw0wz 2024-04-24T23:41:12.767 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.rNHHftw0wz 2024-04-24T23:41:12.888 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.rNHHftw0wz 2024-04-24T23:41:12.952 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.rNHHftw0wz is 286KB 2024-04-24T23:41:13.018 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.rNHHftw0wz 2024-04-24T23:41:13.024 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672197/data/mon.b.tgz 2024-04-24T23:41:13.024 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2024-04-24T23:41:13.030 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.AneXSF93CQ 2024-04-24T23:41:13.030 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.AneXSF93CQ 2024-04-24T23:41:13.166 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.AneXSF93CQ 2024-04-24T23:41:13.226 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.AneXSF93CQ is 388KB 2024-04-24T23:41:13.288 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.AneXSF93CQ 2024-04-24T23:41:13.294 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672197/data/mon.c.tgz 2024-04-24T23:41:13.294 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2024-04-24T23:41:13.343 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.knB24hhzPn 2024-04-24T23:41:13.343 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.knB24hhzPn 2024-04-24T23:41:13.481 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.knB24hhzPn 2024-04-24T23:41:13.546 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.knB24hhzPn is 388KB 2024-04-24T23:41:13.609 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.knB24hhzPn 2024-04-24T23:41:13.614 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-24T23:41:13.615 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-24T23:41:13.617 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-24T23:41:13.660 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-24T23:41:13.663 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-24T23:41:13.684 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-24T23:41:13.719 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-24T23:41:13.724 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-24T23:41:13.730 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-24T23:41:13.730 INFO:tasks.ceph:Archiving crash dumps... 2024-04-24T23:41:13.732 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672197/remote/smithi057/crash 2024-04-24T23:41:13.732 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-24T23:41:13.747 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672197/remote/smithi088/crash 2024-04-24T23:41:13.748 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-24T23:41:13.774 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672197/remote/smithi116/crash 2024-04-24T23:41:13.775 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-24T23:41:13.789 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672197/remote/smithi174/crash 2024-04-24T23:41:13.790 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-24T23:41:13.803 INFO:tasks.ceph:Shutting down logrotate 2024-04-24T23:41:13.803 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:41:13.806 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:41:13.819 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:41:13.836 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:41:13.889 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-24T23:41:13.903 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-24T23:41:13.916 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-24T23:41:13.930 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-24T23:41:13.946 INFO:tasks.ceph:Compressing logs... 2024-04-24T23:41:13.946 DEBUG:teuthology.orchestra.run.smithi057:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-24T23:41:13.949 DEBUG:teuthology.orchestra.run.smithi088:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-24T23:41:13.959 DEBUG:teuthology.orchestra.run.smithi116:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-24T23:41:13.967 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32293.log 2024-04-24T23:41:13.968 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32579.log 2024-04-24T23:41:13.969 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.32293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32369.log 2024-04-24T23:41:13.969 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32293.log.gz 2024-04-24T23:41:13.969 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.32579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32365.log 2024-04-24T23:41:13.969 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32579.log.gz 2024-04-24T23:41:13.972 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33255.log 2024-04-24T23:41:13.973 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.32369.log: /var/log/ceph/ceph-client.admin.32365.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-24T23:41:13.973 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.33255.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32365.log.gz 2024-04-24T23:41:13.973 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34026.log 2024-04-24T23:41:13.973 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32369.log.gz 2024-04-24T23:41:13.973 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33255.log.gz 2024-04-24T23:41:13.973 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27424.log 2024-04-24T23:41:13.973 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.34026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34496.log 2024-04-24T23:41:13.974 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34182.log 2024-04-24T23:41:13.974 INFO:teuthology.orchestra.run.smithi057.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34026.log.gz 2024-04-24T23:41:13.974 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.34496.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.27424.log.gz 2024-04-24T23:41:13.974 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33047.log 2024-04-24T23:41:13.974 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34496.log.gz 2024-04-24T23:41:13.974 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32788.log 2024-04-24T23:41:13.981 DEBUG:teuthology.orchestra.run.smithi174:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-24T23:41:13.997 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27809.log 2024-04-24T23:41:13.997 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-24T23:41:13.997 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-24T23:41:13.997 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.27809.log: /var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27713.log 2024-04-24T23:41:13.997 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27785.log 2024-04-24T23:41:13.997 INFO:teuthology.orchestra.run.smithi088.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.27809.log.gz 2024-04-24T23:41:13.997 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.27713.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-24T23:41:13.997 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.27713.log.gz 2024-04-24T23:41:13.998 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.27785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27665.log 2024-04-24T23:41:13.998 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27785.log.gz 2024-04-24T23:41:13.998 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-24T23:41:13.998 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.27665.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-24T23:41:13.998 INFO:teuthology.orchestra.run.smithi088.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.27665.log.gz 2024-04-24T23:41:13.998 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-24T23:41:13.998 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27737.log 2024-04-24T23:41:13.998 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-24T23:41:13.998 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.27737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27641.log 2024-04-24T23:41:13.998 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% 91.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-24T23:41:13.999 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.27737.log.gz/var/log/ceph/ceph.audit.log: 2024-04-24T23:41:13.999 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27689.log 2024-04-24T23:41:13.999 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.27641.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-24T23:41:13.999 INFO:teuthology.orchestra.run.smithi088.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.27641.log.gz/var/log/ceph/ceph-client.admin.27689.log: 2024-04-24T23:41:13.999 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0% 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-24T23:41:13.999 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.27689.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-24T23:41:13.999 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-04-24T23:41:13.999 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-24T23:41:13.999 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27761.log 2024-04-24T23:41:13.999 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.4.log: 91.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-24T23:41:13.999 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.27761.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.27761.log.gz 2024-04-24T23:41:14.004 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.23030.log 2024-04-24T23:41:14.004 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22849.log 2024-04-24T23:41:14.004 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.23030.log: /var/log/ceph/ceph-client.admin.22849.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.22849.log.gz 2024-04-24T23:41:14.010 INFO:teuthology.orchestra.run.smithi116.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.0.23030.log.gz 2024-04-24T23:41:14.010 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-04-24T23:41:14.010 INFO:teuthology.orchestra.run.smithi116.stderr:real 0m0.028s 2024-04-24T23:41:14.010 INFO:teuthology.orchestra.run.smithi116.stderr:user 0m0.027s 2024-04-24T23:41:14.011 INFO:teuthology.orchestra.run.smithi116.stderr:sys 0m0.006s 2024-04-24T23:41:14.019 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.22859.log 2024-04-24T23:41:14.024 INFO:teuthology.orchestra.run.smithi088.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-24T23:41:14.032 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.1.22859.log: 95.1% -- replaced with /var/log/ceph/ceph-client.1.22859.log.gz 2024-04-24T23:41:14.032 INFO:teuthology.orchestra.run.smithi174.stderr: 2024-04-24T23:41:14.032 INFO:teuthology.orchestra.run.smithi174.stderr:real 0m0.033s 2024-04-24T23:41:14.032 INFO:teuthology.orchestra.run.smithi174.stderr:user 0m0.018s 2024-04-24T23:41:14.032 INFO:teuthology.orchestra.run.smithi174.stderr:sys 0m0.012s 2024-04-24T23:41:14.068 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.34182.log: /var/log/ceph/ceph-client.admin.33047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34312.log 2024-04-24T23:41:14.069 INFO:teuthology.orchestra.run.smithi057.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34182.log.gz 2024-04-24T23:41:14.069 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.32788.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33047.log.gz 2024-04-24T23:41:14.069 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-24T23:41:14.069 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32788.log.gz 2024-04-24T23:41:14.069 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.34312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32577.log 2024-04-24T23:41:14.069 INFO:teuthology.orchestra.run.smithi057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34312.log.gz 2024-04-24T23:41:14.069 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31877.log 2024-04-24T23:41:14.069 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.32577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31721.log 2024-04-24T23:41:14.069 INFO:teuthology.orchestra.run.smithi057.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-24T23:41:14.070 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32577.log.gz 2024-04-24T23:41:14.070 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.31877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33974.log 2024-04-24T23:41:14.070 INFO:teuthology.orchestra.run.smithi057.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31877.log.gz 2024-04-24T23:41:14.070 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33413.log 2024-04-24T23:41:14.070 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.31721.log: /var/log/ceph/ceph-client.admin.33974.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31721.log.gz 2024-04-24T23:41:14.070 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32359.log 2024-04-24T23:41:14.070 INFO:teuthology.orchestra.run.smithi057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33974.log.gz 2024-04-24T23:41:14.070 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.33413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31312.log 2024-04-24T23:41:14.070 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.32359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33740.log 2024-04-24T23:41:14.070 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32359.log.gz 2024-04-24T23:41:14.070 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.31312.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.33413.log.gz 2024-04-24T23:41:14.070 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33792.log 2024-04-24T23:41:14.070 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31312.log.gz 2024-04-24T23:41:14.071 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33766.log 2024-04-24T23:41:14.071 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.33740.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.33792.log: /var/log/ceph/ceph-client.admin.31903.log 2024-04-24T23:41:14.071 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.33766.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.33740.log.gz 2024-04-24T23:41:14.071 INFO:teuthology.orchestra.run.smithi057.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.31851.log 2024-04-24T23:41:14.071 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33792.log.gz 2024-04-24T23:41:14.071 INFO:teuthology.orchestra.run.smithi057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33766.log.gz 2024-04-24T23:41:14.071 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.31903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34522.log 2024-04-24T23:41:14.071 INFO:teuthology.orchestra.run.smithi057.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31903.log.gz 2024-04-24T23:41:14.071 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.31851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32995.log 2024-04-24T23:41:14.071 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.34522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33922.log 2024-04-24T23:41:14.071 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31851.log.gz 2024-04-24T23:41:14.072 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.32995.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34522.log.gz 2024-04-24T23:41:14.072 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32137.log 2024-04-24T23:41:14.072 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32995.log.gz 2024-04-24T23:41:14.072 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33610.log 2024-04-24T23:41:14.072 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.33922.log: /var/log/ceph/ceph-client.admin.32137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32789.log 2024-04-24T23:41:14.072 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.33610.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33922.log.gz 2024-04-24T23:41:14.072 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32033.log 2024-04-24T23:41:14.072 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32137.log.gz 2024-04-24T23:41:14.072 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0%/var/log/ceph/ceph-client.admin.32789.log: -- replaced with /var/log/ceph/ceph-client.admin.33610.log.gz 2024-04-24T23:41:14.073 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31280.log 2024-04-24T23:41:14.073 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32789.log.gz 2024-04-24T23:41:14.073 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34392.log 2024-04-24T23:41:14.073 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.32033.log: /var/log/ceph/ceph-client.admin.31280.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-24T23:41:14.073 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32033.log.gz 2024-04-24T23:41:14.073 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31280.log.gz 2024-04-24T23:41:14.073 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.34392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31619.log 2024-04-24T23:41:14.073 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34392.log.gz 2024-04-24T23:41:14.073 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32215.log 2024-04-24T23:41:14.073 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.31619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33532.log 2024-04-24T23:41:14.073 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.32215.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31619.log.gz 2024-04-24T23:41:14.073 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31216.log 2024-04-24T23:41:14.073 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32215.log.gz 2024-04-24T23:41:14.073 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33844.log 2024-04-24T23:41:14.074 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.33532.log: /var/log/ceph/ceph-client.admin.31216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32163.log 2024-04-24T23:41:14.074 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31216.log.gz 2024-04-24T23:41:14.074 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.33844.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33532.log.gz 2024-04-24T23:41:14.074 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-24T23:41:14.074 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33844.log.gz 2024-04-24T23:41:14.074 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33177.log 2024-04-24T23:41:14.074 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.32163.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32560.log 2024-04-24T23:41:14.074 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.33177.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32163.log.gz 2024-04-24T23:41:14.074 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32969.log 2024-04-24T23:41:14.074 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33177.log.gz 2024-04-24T23:41:14.074 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.32560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31394.log 2024-04-24T23:41:14.075 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32560.log.gz 2024-04-24T23:41:14.075 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.32969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31671.log 2024-04-24T23:41:14.075 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.31394.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32969.log.gz 2024-04-24T23:41:14.075 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34574.log 2024-04-24T23:41:14.075 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31394.log.gz 2024-04-24T23:41:14.075 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32267.log 2024-04-24T23:41:14.075 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.31671.log: /var/log/ceph/ceph-client.admin.34574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34652.log 2024-04-24T23:41:14.075 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.32267.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34574.log.gz 2024-04-24T23:41:14.075 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22647.log 2024-04-24T23:41:14.076 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32267.log.gz 2024-04-24T23:41:14.076 INFO:teuthology.orchestra.run.smithi057.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.31671.log.gz 2024-04-24T23:41:14.076 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.34652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32371.log 2024-04-24T23:41:14.076 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph.tmp-client.admin.22647.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34652.log.gz 2024-04-24T23:41:14.076 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22647.log.gz 2024-04-24T23:41:14.076 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32241.log 2024-04-24T23:41:14.076 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34887.log 2024-04-24T23:41:14.076 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.32371.log: /var/log/ceph/ceph-client.admin.32241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31366.log 2024-04-24T23:41:14.076 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.32241.log.gz 2024-04-24T23:41:14.076 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32371.log.gz 2024-04-24T23:41:14.076 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.34887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31981.log 2024-04-24T23:41:14.076 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.31366.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34887.log.gz 2024-04-24T23:41:14.076 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31929.log 2024-04-24T23:41:14.076 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31366.log.gz 2024-04-24T23:41:14.077 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.31981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33714.log 2024-04-24T23:41:14.077 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.31929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33361.log 2024-04-24T23:41:14.077 INFO:teuthology.orchestra.run.smithi057.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31981.log.gz 2024-04-24T23:41:14.077 INFO:teuthology.orchestra.run.smithi057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31929.log.gz 2024-04-24T23:41:14.077 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-24T23:41:14.077 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.33714.log: /var/log/ceph/ceph-client.admin.33361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34958.log 2024-04-24T23:41:14.077 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33714.log.gz 2024-04-24T23:41:14.077 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33361.log.gz 2024-04-24T23:41:14.077 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31254.log 2024-04-24T23:41:14.077 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34861.log 2024-04-24T23:41:14.077 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.34958.log: /var/log/ceph/ceph-client.admin.31254.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33281.log 2024-04-24T23:41:14.077 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34958.log.gz 2024-04-24T23:41:14.077 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31254.log.gz 2024-04-24T23:41:14.078 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34733.log 2024-04-24T23:41:14.078 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.34861.log: /var/log/ceph/ceph-client.admin.33281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31076.log 2024-04-24T23:41:14.078 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34861.log.gz/var/log/ceph/ceph-client.admin.34733.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33281.log.gz 2024-04-24T23:41:14.078 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-04-24T23:41:14.078 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33688.log 2024-04-24T23:41:14.078 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34733.log.gz 2024-04-24T23:41:14.078 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34104.log 2024-04-24T23:41:14.079 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.31076.log: /var/log/ceph/ceph-client.admin.33688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32578.log 2024-04-24T23:41:14.079 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33688.log.gz 2024-04-24T23:41:14.079 INFO:teuthology.orchestra.run.smithi057.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31076.log.gz 2024-04-24T23:41:14.079 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31109.log 2024-04-24T23:41:14.079 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.34104.log: /var/log/ceph/ceph-client.admin.32578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33203.log 2024-04-24T23:41:14.079 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34104.log.gz 2024-04-24T23:41:14.079 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.31109.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32578.log.gz 2024-04-24T23:41:14.079 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33099.log 2024-04-24T23:41:14.079 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31109.log.gz 2024-04-24T23:41:14.079 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32370.log 2024-04-24T23:41:14.079 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.33203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34444.log 2024-04-24T23:41:14.079 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33203.log.gz 2024-04-24T23:41:14.080 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.33099.log: /var/log/ceph/ceph-client.admin.32370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33558.log 2024-04-24T23:41:14.080 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33099.log.gz 87.2% 2024-04-24T23:41:14.080 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32370.log.gz/var/log/ceph/ceph-client.admin.34444.log: 2024-04-24T23:41:14.080 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-24T23:41:14.080 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34444.log.gz 2024-04-24T23:41:14.080 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33636.log 2024-04-24T23:41:14.080 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.33558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34835.log 2024-04-24T23:41:14.080 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-osd.1.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33558.log.gz 2024-04-24T23:41:14.080 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.33636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34809.log 2024-04-24T23:41:14.080 INFO:teuthology.orchestra.run.smithi057.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33636.log.gz/var/log/ceph/ceph-client.admin.34835.log: 2024-04-24T23:41:14.080 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32372.log 2024-04-24T23:41:14.080 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34835.log.gz 2024-04-24T23:41:14.080 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.34809.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34809.log.gz 2024-04-24T23:41:14.080 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31593.log 2024-04-24T23:41:14.080 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.32372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32581.log 2024-04-24T23:41:14.081 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.31593.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32372.log.gz 2024-04-24T23:41:14.081 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32765.log 2024-04-24T23:41:14.081 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34600.log 2024-04-24T23:41:14.081 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31593.log.gz/var/log/ceph/ceph-client.admin.32581.log: 2024-04-24T23:41:14.081 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.32765.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32581.log.gz 2024-04-24T23:41:14.081 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32765.log.gz 2024-04-24T23:41:14.081 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31541.log 2024-04-24T23:41:14.081 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.34600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32571.log 2024-04-24T23:41:14.081 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5%/var/log/ceph/ceph-client.admin.31541.log: -- replaced with /var/log/ceph/ceph-client.admin.34600.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32787.log 2024-04-24T23:41:14.081 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-04-24T23:41:14.081 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31541.log.gz 2024-04-24T23:41:14.082 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.32571.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32571.log.gz 2024-04-24T23:41:14.082 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34156.log 2024-04-24T23:41:14.082 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.32787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34626.log 2024-04-24T23:41:14.082 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4%/var/log/ceph/ceph-client.admin.34156.log: -- replaced with /var/log/ceph/ceph-client.admin.32787.log.gz 2024-04-24T23:41:14.082 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34078.log 2024-04-24T23:41:14.082 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34156.log.gz 2024-04-24T23:41:14.082 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.34626.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34626.log.gz 2024-04-24T23:41:14.082 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34705.log 2024-04-24T23:41:14.082 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.34078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31799.log 2024-04-24T23:41:14.082 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9%/var/log/ceph/ceph-client.admin.34705.log: -- replaced with /var/log/ceph/ceph-client.admin.34078.log.gzgzip 2024-04-24T23:41:14.082 INFO:teuthology.orchestra.run.smithi057.stderr: -5 --verbose -- /var/log/ceph/ceph.log 2024-04-24T23:41:14.083 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34705.log.gz 2024-04-24T23:41:14.083 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.31799.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31799.log.gz 2024-04-24T23:41:14.083 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34984.log 2024-04-24T23:41:14.083 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31338.log 2024-04-24T23:41:14.083 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.34984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31645.log 2024-04-24T23:41:14.083 INFO:teuthology.orchestra.run.smithi057.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34984.log.gz 2024-04-24T23:41:14.083 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.31338.log: 85.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-24T23:41:14.083 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31338.log.gz 2024-04-24T23:41:14.083 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32780.log 2024-04-24T23:41:14.083 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.31645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32373.log 2024-04-24T23:41:14.083 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8%/var/log/ceph/ceph-client.admin.32780.log: -- replaced with /var/log/ceph/ceph-client.admin.31645.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27533.log 2024-04-24T23:41:14.083 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-04-24T23:41:14.083 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32780.log.gz 2024-04-24T23:41:14.083 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.32373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34234.log 2024-04-24T23:41:14.084 INFO:teuthology.orchestra.run.smithi057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.32373.log.gz 2024-04-24T23:41:14.084 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33818.log 2024-04-24T23:41:14.084 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.27533.log.gz/var/log/ceph/ceph-client.admin.34234.log: 2024-04-24T23:41:14.084 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34932.log 2024-04-24T23:41:14.084 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34234.log.gz 2024-04-24T23:41:14.084 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.33818.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33818.log.gz 2024-04-24T23:41:14.084 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32362.log 2024-04-24T23:41:14.084 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.34932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31825.log 2024-04-24T23:41:14.084 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.32362.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34932.log.gz 2024-04-24T23:41:14.084 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33870.log 2024-04-24T23:41:14.084 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34130.log 2024-04-24T23:41:14.085 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32362.log.gz 2024-04-24T23:41:14.085 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.33870.log: /var/log/ceph/ceph-client.admin.31825.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33870.log.gz 2024-04-24T23:41:14.085 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31825.log.gz 2024-04-24T23:41:14.085 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27643.log 2024-04-24T23:41:14.085 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.34130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31487.log 2024-04-24T23:41:14.085 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27643.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34130.log.gz 2024-04-24T23:41:14.085 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32085.log 2024-04-24T23:41:14.085 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33489.log 2024-04-24T23:41:14.085 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.27643.log.gz 2024-04-24T23:41:14.085 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.31487.log: /var/log/ceph/ceph-client.admin.32085.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32085.log.gz 2024-04-24T23:41:14.086 INFO:teuthology.orchestra.run.smithi057.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31487.log.gz 2024-04-24T23:41:14.086 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33335.log 2024-04-24T23:41:14.086 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.33489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32319.log 2024-04-24T23:41:14.086 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9%/var/log/ceph/ceph-client.admin.33335.log: -- replaced with /var/log/ceph/ceph-client.admin.33489.log.gz 2024-04-24T23:41:14.086 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33387.log 2024-04-24T23:41:14.086 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33335.log.gz 2024-04-24T23:41:14.086 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.32319.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32319.log.gz 2024-04-24T23:41:14.086 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34000.log 2024-04-24T23:41:14.086 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.33387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34418.log 2024-04-24T23:41:14.086 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.34000.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-24T23:41:14.086 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33387.log.gz 2024-04-24T23:41:14.087 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34000.log.gz 2024-04-24T23:41:14.087 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.34418.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34418.log.gz 2024-04-24T23:41:14.087 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-24T23:41:14.087 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32007.log 2024-04-24T23:41:14.087 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-24T23:41:14.087 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.32007.log: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-24T23:41:14.087 INFO:teuthology.orchestra.run.smithi057.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-24T23:41:14.087 INFO:teuthology.orchestra.run.smithi057.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32007.log.gz 2024-04-24T23:41:14.087 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31773.log 2024-04-24T23:41:14.087 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32059.log 2024-04-24T23:41:14.087 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.31773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33151.log 2024-04-24T23:41:14.088 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31773.log.gz/var/log/ceph/ceph-client.admin.32059.log: 2024-04-24T23:41:14.088 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32059.log.gz 2024-04-24T23:41:14.088 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31429.log 2024-04-24T23:41:14.088 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.33151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34366.log 2024-04-24T23:41:14.088 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33151.log.gz 2024-04-24T23:41:14.088 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.31429.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31429.log.gz 2024-04-24T23:41:14.088 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32572.log 2024-04-24T23:41:14.088 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34052.log 2024-04-24T23:41:14.088 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.34366.log: /var/log/ceph/ceph-client.admin.32572.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34366.log.gz 2024-04-24T23:41:14.088 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32572.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31747.log 2024-04-24T23:41:14.089 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-04-24T23:41:14.089 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.34052.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34052.log.gz 2024-04-24T23:41:14.089 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33896.log 2024-04-24T23:41:14.089 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31567.log 2024-04-24T23:41:14.089 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.31747.log: /var/log/ceph/ceph-client.admin.33896.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31747.log.gz 2024-04-24T23:41:14.089 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33896.log.gz 2024-04-24T23:41:14.089 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31459.log 2024-04-24T23:41:14.089 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.31567.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31567.log.gz 2024-04-24T23:41:14.089 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31176.log 2024-04-24T23:41:14.089 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31955.log 2024-04-24T23:41:14.089 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.31459.log: /var/log/ceph/ceph-client.admin.31176.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31459.log.gz 2024-04-24T23:41:14.089 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34208.log 2024-04-24T23:41:14.089 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31176.log.gz 2024-04-24T23:41:14.090 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.31955.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31955.log.gz 2024-04-24T23:41:14.090 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32783.log 2024-04-24T23:41:14.090 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34338.log 2024-04-24T23:41:14.090 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.34208.log: /var/log/ceph/ceph-client.admin.32783.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34208.log.gz 2024-04-24T23:41:14.090 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 89.3% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.32783.log.gz /var/log/ceph/ceph-client.admin.33307.log 2024-04-24T23:41:14.090 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-04-24T23:41:14.090 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.34338.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34338.log.gz 2024-04-24T23:41:14.090 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31515.log 2024-04-24T23:41:14.090 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33073.log 2024-04-24T23:41:14.091 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.33307.log: /var/log/ceph/ceph-client.admin.31515.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33307.log.gz 2024-04-24T23:41:14.091 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31515.log.gz 2024-04-24T23:41:14.091 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33229.log 2024-04-24T23:41:14.091 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34470.log 2024-04-24T23:41:14.091 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.33073.log: /var/log/ceph/ceph-client.admin.33229.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33229.log.gz 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33073.log.gz 2024-04-24T23:41:14.091 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-04-24T23:41:14.091 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34783.log 2024-04-24T23:41:14.091 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33584.log 2024-04-24T23:41:14.091 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.34470.log: /var/log/ceph/ceph-client.admin.34783.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34470.log.gz 2024-04-24T23:41:14.092 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33463.log 2024-04-24T23:41:14.092 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34783.log.gz 2024-04-24T23:41:14.092 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.33584.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33584.log.gz 2024-04-24T23:41:14.092 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34286.log 2024-04-24T23:41:14.092 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33662.log 2024-04-24T23:41:14.092 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.33463.log: /var/log/ceph/ceph-client.admin.34286.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33463.log.gz 2024-04-24T23:41:14.092 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34286.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33125.log 2024-04-24T23:41:14.092 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-04-24T23:41:14.092 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.33662.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33662.log.gz 2024-04-24T23:41:14.092 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32580.log 2024-04-24T23:41:14.092 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32761.log 2024-04-24T23:41:14.092 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.33125.log: /var/log/ceph/ceph-client.admin.32580.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33125.log.gz 2024-04-24T23:41:14.092 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32111.log 2024-04-24T23:41:14.092 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32580.log.gz 2024-04-24T23:41:14.093 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.32761.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32761.log.gz 2024-04-24T23:41:14.093 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34260.log 2024-04-24T23:41:14.093 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34678.log 2024-04-24T23:41:14.093 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.32111.log: /var/log/ceph/ceph-client.admin.34260.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32111.log.gz 2024-04-24T23:41:14.093 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34260.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32189.log 2024-04-24T23:41:14.093 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-04-24T23:41:14.093 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.34678.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34678.log.gz 2024-04-24T23:41:14.093 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33021.log 2024-04-24T23:41:14.093 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34757.log 2024-04-24T23:41:14.093 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.32189.log: /var/log/ceph/ceph-client.admin.33021.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32189.log.gz 2024-04-24T23:41:14.093 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.33021.log.gz 2024-04-24T23:41:14.094 INFO:teuthology.orchestra.run.smithi057.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.33948.log 2024-04-24T23:41:14.094 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.34757.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34757.log.gz 2024-04-24T23:41:14.094 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34548.log 2024-04-24T23:41:14.094 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32786.log 2024-04-24T23:41:14.094 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.33948.log: /var/log/ceph/ceph-client.admin.34548.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33948.log.gz 2024-04-24T23:41:14.094 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34548.log.gz 2024-04-24T23:41:14.094 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.32786.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32786.log.gz 2024-04-24T23:41:14.095 INFO:teuthology.orchestra.run.smithi088.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-24T23:41:14.095 INFO:teuthology.orchestra.run.smithi057.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-24T23:41:14.106 INFO:teuthology.orchestra.run.smithi088.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-24T23:41:14.168 INFO:teuthology.orchestra.run.smithi057.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-24T23:41:14.604 INFO:teuthology.orchestra.run.smithi088.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-24T23:41:14.612 INFO:teuthology.orchestra.run.smithi057.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-24T23:41:14.654 INFO:teuthology.orchestra.run.smithi088.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-24T23:41:14.676 INFO:teuthology.orchestra.run.smithi088.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-24T23:41:14.707 INFO:teuthology.orchestra.run.smithi088.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-24T23:41:14.708 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-04-24T23:41:14.708 INFO:teuthology.orchestra.run.smithi088.stderr:real 0m0.747s 2024-04-24T23:41:14.709 INFO:teuthology.orchestra.run.smithi088.stderr:user 0m2.882s 2024-04-24T23:41:14.709 INFO:teuthology.orchestra.run.smithi088.stderr:sys 0m0.104s 2024-04-24T23:41:14.739 INFO:teuthology.orchestra.run.smithi057.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-24T23:41:14.765 INFO:teuthology.orchestra.run.smithi057.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-24T23:41:14.785 INFO:teuthology.orchestra.run.smithi057.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-24T23:41:14.787 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-04-24T23:41:14.787 INFO:teuthology.orchestra.run.smithi057.stderr:real 0m0.835s 2024-04-24T23:41:14.787 INFO:teuthology.orchestra.run.smithi057.stderr:user 0m3.271s 2024-04-24T23:41:14.787 INFO:teuthology.orchestra.run.smithi057.stderr:sys 0m0.148s 2024-04-24T23:41:14.787 INFO:tasks.ceph:Archiving logs... 2024-04-24T23:41:14.787 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672197/remote/smithi057/log 2024-04-24T23:41:14.788 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-24T23:41:15.350 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672197/remote/smithi088/log 2024-04-24T23:41:15.351 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-24T23:41:15.547 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-24T23:41:15.736 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672197/remote/smithi116/log 2024-04-24T23:41:15.736 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-24T23:41:15.754 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672197/remote/smithi174/log 2024-04-24T23:41:15.754 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-24T23:41:15.770 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-24T23:41:15.781 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-24T23:41:15.781 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-24T23:41:15.784 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-24T23:41:15.786 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-24T23:41:15.800 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-24T23:41:15.921 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-24T23:41:15.933 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-24T23:41:15.933 DEBUG:teuthology.orchestra.run.smithi057:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T23:41:15.936 DEBUG:teuthology.orchestra.run.smithi088:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T23:41:15.938 DEBUG:teuthology.orchestra.run.smithi116:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T23:41:15.940 DEBUG:teuthology.orchestra.run.smithi174:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T23:41:15.946 INFO:teuthology.orchestra.run.smithi057.stdout: remote refid st t when poll reach delay offset jitter 2024-04-24T23:41:15.946 INFO:teuthology.orchestra.run.smithi057.stdout:============================================================================== 2024-04-24T23:41:15.946 INFO:teuthology.orchestra.run.smithi057.stdout:+hv01.front.sepi 44.4.53.2 2 u 26 64 177 0.055 -0.246 1.404 2024-04-24T23:41:15.946 INFO:teuthology.orchestra.run.smithi057.stdout:+hv02.front.sepi 63.231.80.2 3 u 19 64 177 0.098 +0.882 1.691 2024-04-24T23:41:15.947 INFO:teuthology.orchestra.run.smithi057.stdout:*hv03.front.sepi 74.6.168.72 3 u 22 64 177 0.068 -0.974 1.014 2024-04-24T23:41:15.947 INFO:teuthology.orchestra.run.smithi057.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T23:41:15.949 INFO:teuthology.orchestra.run.smithi088.stdout: remote refid st t when poll reach delay offset jitter 2024-04-24T23:41:15.949 INFO:teuthology.orchestra.run.smithi088.stdout:============================================================================== 2024-04-24T23:41:15.949 INFO:teuthology.orchestra.run.smithi088.stdout:*hv01.front.sepi 44.4.53.2 2 u 27 64 177 0.146 -1.095 1.218 2024-04-24T23:41:15.949 INFO:teuthology.orchestra.run.smithi088.stdout:+hv02.front.sepi 63.231.80.2 3 u 21 64 177 0.080 -1.747 1.089 2024-04-24T23:41:15.950 INFO:teuthology.orchestra.run.smithi088.stdout:+hv03.front.sepi 74.6.168.72 3 u 25 64 177 0.084 -0.258 0.986 2024-04-24T23:41:15.950 INFO:teuthology.orchestra.run.smithi088.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T23:41:15.951 INFO:teuthology.orchestra.run.smithi116.stdout: remote refid st t when poll reach delay offset jitter 2024-04-24T23:41:15.951 INFO:teuthology.orchestra.run.smithi116.stdout:============================================================================== 2024-04-24T23:41:15.951 INFO:teuthology.orchestra.run.smithi116.stdout:+hv01.front.sepi 44.4.53.2 2 u 16 64 177 0.087 -1.587 0.415 2024-04-24T23:41:15.951 INFO:teuthology.orchestra.run.smithi116.stdout:*hv02.front.sepi 63.231.80.2 3 u 26 64 177 0.068 -1.525 0.886 2024-04-24T23:41:15.952 INFO:teuthology.orchestra.run.smithi116.stdout:+hv03.front.sepi 74.6.168.72 3 u 30 64 177 0.094 -0.906 0.576 2024-04-24T23:41:15.952 INFO:teuthology.orchestra.run.smithi116.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T23:41:15.953 INFO:teuthology.orchestra.run.smithi174.stdout: remote refid st t when poll reach delay offset jitter 2024-04-24T23:41:15.954 INFO:teuthology.orchestra.run.smithi174.stdout:============================================================================== 2024-04-24T23:41:15.954 INFO:teuthology.orchestra.run.smithi174.stdout: hv01.front.sepi 44.4.53.2 2 u 25 64 177 0.054 -1.480 0.296 2024-04-24T23:41:15.954 INFO:teuthology.orchestra.run.smithi174.stdout:*hv02.front.sepi 63.231.80.2 3 u 30 64 177 0.076 -0.871 0.378 2024-04-24T23:41:15.954 INFO:teuthology.orchestra.run.smithi174.stdout:+hv03.front.sepi 74.6.168.72 3 u 25 64 177 0.075 -0.348 0.305 2024-04-24T23:41:15.954 INFO:teuthology.orchestra.run.smithi174.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T23:41:15.955 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-24T23:41:16.023 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-24T23:41:16.024 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-24T23:41:16.065 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-24T23:41:16.098 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-24T23:41:16.132 INFO:teuthology.task.internal:Duration was 858.232106 seconds 2024-04-24T23:41:16.132 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-24T23:41:16.165 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-24T23:41:16.165 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-24T23:41:16.168 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-24T23:41:16.170 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-24T23:41:16.172 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-24T23:41:16.209 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-24T23:41:16.209 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi057.front.sepia.ceph.com 2024-04-24T23:41:16.210 DEBUG:teuthology.orchestra.run.smithi057:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-24T23:41:16.261 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi088.front.sepia.ceph.com 2024-04-24T23:41:16.261 DEBUG:teuthology.orchestra.run.smithi088:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-24T23:41:16.271 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi116.front.sepia.ceph.com 2024-04-24T23:41:16.271 DEBUG:teuthology.orchestra.run.smithi116:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-24T23:41:16.281 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi174.front.sepia.ceph.com 2024-04-24T23:41:16.282 DEBUG:teuthology.orchestra.run.smithi174:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-24T23:41:16.292 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-24T23:41:16.292 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-24T23:41:16.305 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-24T23:41:16.315 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-24T23:41:16.324 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-24T23:41:16.363 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-24T23:41:16.363 DEBUG:teuthology.orchestra.run.smithi057:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-24T23:41:16.372 DEBUG:teuthology.orchestra.run.smithi088:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-24T23:41:16.383 DEBUG:teuthology.orchestra.run.smithi116:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-24T23:41:16.392 DEBUG:teuthology.orchestra.run.smithi174:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-24T23:41:16.463 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-24T23:41:16.474 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-24T23:41:16.474 DEBUG:teuthology.orchestra.run.smithi057:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-24T23:41:16.485 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-24T23:41:16.498 DEBUG:teuthology.orchestra.run.smithi116:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-24T23:41:16.512 DEBUG:teuthology.orchestra.run.smithi174:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-24T23:41:16.525 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-24T23:41:16.536 DEBUG:teuthology.orchestra.run.smithi057:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-24T23:41:16.539 DEBUG:teuthology.orchestra.run.smithi088:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-24T23:41:16.547 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = core 2024-04-24T23:41:16.547 DEBUG:teuthology.orchestra.run.smithi116:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-24T23:41:16.556 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = core 2024-04-24T23:41:16.560 DEBUG:teuthology.orchestra.run.smithi174:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-24T23:41:16.569 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = core 2024-04-24T23:41:16.575 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = core 2024-04-24T23:41:16.666 DEBUG:teuthology.orchestra.run.smithi057:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-24T23:41:16.671 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:41:16.671 DEBUG:teuthology.orchestra.run.smithi088:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-24T23:41:16.714 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:41:16.714 DEBUG:teuthology.orchestra.run.smithi116:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-24T23:41:16.719 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:41:16.720 DEBUG:teuthology.orchestra.run.smithi174:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-24T23:41:16.724 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:41:16.725 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-24T23:41:16.736 INFO:teuthology.task.internal:Transferring archived files... 2024-04-24T23:41:16.737 DEBUG:teuthology.misc:Transferring archived files from smithi057:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672197/remote/smithi057 2024-04-24T23:41:16.737 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-24T23:41:16.760 DEBUG:teuthology.misc:Transferring archived files from smithi088:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672197/remote/smithi088 2024-04-24T23:41:16.760 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-24T23:41:16.781 DEBUG:teuthology.misc:Transferring archived files from smithi116:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672197/remote/smithi116 2024-04-24T23:41:16.782 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-24T23:41:16.803 DEBUG:teuthology.misc:Transferring archived files from smithi174:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672197/remote/smithi174 2024-04-24T23:41:16.803 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-24T23:41:16.825 INFO:teuthology.task.internal:Removing archive directory... 2024-04-24T23:41:16.825 DEBUG:teuthology.orchestra.run.smithi057:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-24T23:41:16.828 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-24T23:41:16.830 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-24T23:41:16.844 DEBUG:teuthology.orchestra.run.smithi174:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-24T23:41:16.866 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-24T23:41:16.879 INFO:teuthology.task.internal:Not uploading archives. 2024-04-24T23:41:16.879 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-24T23:41:16.910 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-24T23:41:16.910 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-24T23:41:16.913 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-24T23:41:16.915 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-24T23:41:16.916 INFO:teuthology.orchestra.run.smithi057.stdout: 658642 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 24 23:41 /home/ubuntu/cephtest 2024-04-24T23:41:16.918 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-24T23:41:16.918 INFO:teuthology.orchestra.run.smithi088.stdout: 658460 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 24 23:41 /home/ubuntu/cephtest 2024-04-24T23:41:16.922 INFO:teuthology.orchestra.run.smithi116.stdout: 655474 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 24 23:41 /home/ubuntu/cephtest 2024-04-24T23:41:16.924 INFO:teuthology.orchestra.run.smithi174.stdout: 658624 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 24 23:41 /home/ubuntu/cephtest 2024-04-24T23:41:16.925 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-24T23:41:16.941 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-24T23:41:17.010 INFO:teuthology.run:Summary data: description: fs/multiclient/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-2-client conf/{client mds mgr mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/ior-shared-file} duration: 858.2321064472198 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-24T23:41:17.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-24T23:41:17.092 INFO:teuthology.run:pass